Cross-Model Agreement

condition n_groups mean_agreement_rate mean_normalized_entropy instability_score
headlines_only 424 0.6409946840371369 0.6328563709804557 0.6328563709804557
headlines_with_manipulated_sources 424 0.6239845387840671 0.6542016926693891 0.6542016926693891
headlines_with_sources 424 0.654039383048817 0.6167524886152344 0.6167524886152344
sources_only 424 0.7438978736148548 0.4654712053731028 0.4654712053731028