Cross-Model Agreement
| condition | n_groups | mean_agreement_rate | mean_normalized_entropy | instability_score |
|---|---|---|---|---|
| headlines_only | 424 | 0.6409946840371369 | 0.6328563709804557 | 0.6328563709804557 |
| headlines_with_manipulated_sources | 424 | 0.6239845387840671 | 0.6542016926693891 | 0.6542016926693891 |
| headlines_with_sources | 424 | 0.654039383048817 | 0.6167524886152344 | 0.6167524886152344 |
| sources_only | 424 | 0.7438978736148548 | 0.4654712053731028 | 0.4654712053731028 |