Forecasting study · Data
The files
Everything the study produced, as plain files. The folder files/ keeps each hashed file under its original path, so the hashes can be checked directly.
Check the hashes
Download files/, then from inside it:
shasum -a 256 MANIFEST.sha256 # 7a76df42b41960e01e378445fb85eab4cef78487cb64510f1ddd3b0d022aed68
shasum -a 256 -c MANIFEST.sha256
Main files
- claims.csv: The claim register: every claim, its source sentence, testability, closest earlier work, relation, and the first-pass verdict where it changed
- studies.csv: The 256 pending studies found, with hypothesis, outcome, results check and flags
- excluded.csv: Excluded studies (none: see the method page)
- pilot_targets.json: The rule fixed in advance for scoring each of the ten trials
- primer_baseline.md: The baseline forecasters' primer
- primer_framework.md: The framework forecasters' primer
- baseline.txt: Baseline instructions
- framework.txt: Framework instructions
- run_audit.tsv: Audit of all 100 forecast transcripts
- MANIFEST.sha256: SHA-256 of all 144 hashed files
- novelty.md: Novelty report
- untestable.md: The 169 untestable claims and what would make each testable
All hashed files
- data/claims.csv
- data/excluded.csv
- data/harvest/exclusion_pilot.json
- data/harvest/pilot_candidates.json
- data/harvest/pilot_records/NCT04312269.json
- data/harvest/pilot_records/NCT05047120.json
- data/harvest/pilot_records/NCT05351541.json
- data/harvest/pilot_records/NCT06041152.json
- data/harvest/pilot_records/NCT06632691.json
- data/harvest/pilot_records/NCT07133529.json
- data/harvest/pilot_records/NCT07407595.json
- data/harvest/pilot_records/NCT07513337.json
- data/harvest/pilot_records/NCT07611422.json
- data/harvest/pilot_records/NCT07731568.json
- data/pilot_targets.json
- data/studies.csv
- forecasts/FORECAST_PROTOCOL.md
- forecasts/NCT04312269/baseline_1.json
- forecasts/NCT04312269/baseline_2.json
- forecasts/NCT04312269/baseline_3.json
- forecasts/NCT04312269/baseline_4.json
- forecasts/NCT04312269/baseline_5.json
- forecasts/NCT04312269/framework_1.json
- forecasts/NCT04312269/framework_2.json
- forecasts/NCT04312269/framework_3.json
- forecasts/NCT04312269/framework_4.json
- forecasts/NCT04312269/framework_5.json
- forecasts/NCT04312269/protocol.md
- forecasts/NCT05047120/baseline_1.json
- forecasts/NCT05047120/baseline_2.json
- forecasts/NCT05047120/baseline_3.json
- forecasts/NCT05047120/baseline_4.json
- forecasts/NCT05047120/baseline_5.json
- forecasts/NCT05047120/framework_1.json
- forecasts/NCT05047120/framework_2.json
- forecasts/NCT05047120/framework_3.json
- forecasts/NCT05047120/framework_4.json
- forecasts/NCT05047120/framework_5.json
- forecasts/NCT05047120/protocol.md
- forecasts/NCT05351541/baseline_1.json
- forecasts/NCT05351541/baseline_2.json
- forecasts/NCT05351541/baseline_3.json
- forecasts/NCT05351541/baseline_4.json
- forecasts/NCT05351541/baseline_5.json
- forecasts/NCT05351541/framework_1.json
- forecasts/NCT05351541/framework_2.json
- forecasts/NCT05351541/framework_3.json
- forecasts/NCT05351541/framework_4.json
- forecasts/NCT05351541/framework_5.json
- forecasts/NCT05351541/protocol.md
- forecasts/NCT06041152/baseline_1.json
- forecasts/NCT06041152/baseline_2.json
- forecasts/NCT06041152/baseline_3.json
- forecasts/NCT06041152/baseline_4.json
- forecasts/NCT06041152/baseline_5.json
- forecasts/NCT06041152/framework_1.json
- forecasts/NCT06041152/framework_2.json
- forecasts/NCT06041152/framework_3.json
- forecasts/NCT06041152/framework_4.json
- forecasts/NCT06041152/framework_5.json
- forecasts/NCT06041152/protocol.md
- forecasts/NCT06632691/baseline_1.json
- forecasts/NCT06632691/baseline_2.json
- forecasts/NCT06632691/baseline_3.json
- forecasts/NCT06632691/baseline_4.json
- forecasts/NCT06632691/baseline_5.json
- forecasts/NCT06632691/framework_1.json
- forecasts/NCT06632691/framework_2.json
- forecasts/NCT06632691/framework_3.json
- forecasts/NCT06632691/framework_4.json
- forecasts/NCT06632691/framework_5.json
- forecasts/NCT06632691/protocol.md
- forecasts/NCT07133529/baseline_1.json
- forecasts/NCT07133529/baseline_2.json
- forecasts/NCT07133529/baseline_3.json
- forecasts/NCT07133529/baseline_4.json
- forecasts/NCT07133529/baseline_5.json
- forecasts/NCT07133529/framework_1.json
- forecasts/NCT07133529/framework_2.json
- forecasts/NCT07133529/framework_3.json
- forecasts/NCT07133529/framework_4.json
- forecasts/NCT07133529/framework_5.json
- forecasts/NCT07133529/protocol.md
- forecasts/NCT07407595/baseline_1.json
- forecasts/NCT07407595/baseline_2.json
- forecasts/NCT07407595/baseline_3.json
- forecasts/NCT07407595/baseline_4.json
- forecasts/NCT07407595/baseline_5.json
- forecasts/NCT07407595/framework_1.json
- forecasts/NCT07407595/framework_2.json
- forecasts/NCT07407595/framework_3.json
- forecasts/NCT07407595/framework_4.json
- forecasts/NCT07407595/framework_5.json
- forecasts/NCT07407595/protocol.md
- forecasts/NCT07513337/baseline_1.json
- forecasts/NCT07513337/baseline_2.json
- forecasts/NCT07513337/baseline_3.json
- forecasts/NCT07513337/baseline_4.json
- forecasts/NCT07513337/baseline_5.json
- forecasts/NCT07513337/framework_1.json
- forecasts/NCT07513337/framework_2.json
- forecasts/NCT07513337/framework_3.json
- forecasts/NCT07513337/framework_4.json
- forecasts/NCT07513337/framework_5.json
- forecasts/NCT07513337/protocol.md
- forecasts/NCT07611422/baseline_1.json
- forecasts/NCT07611422/baseline_2.json
- forecasts/NCT07611422/baseline_3.json
- forecasts/NCT07611422/baseline_4.json
- forecasts/NCT07611422/baseline_5.json
- forecasts/NCT07611422/framework_1.json
- forecasts/NCT07611422/framework_2.json
- forecasts/NCT07611422/framework_3.json
- forecasts/NCT07611422/framework_4.json
- forecasts/NCT07611422/framework_5.json
- forecasts/NCT07611422/protocol.md
- forecasts/NCT07731568/baseline_1.json
- forecasts/NCT07731568/baseline_2.json
- forecasts/NCT07731568/baseline_3.json
- forecasts/NCT07731568/baseline_4.json
- forecasts/NCT07731568/baseline_5.json
- forecasts/NCT07731568/framework_1.json
- forecasts/NCT07731568/framework_2.json
- forecasts/NCT07731568/framework_3.json
- forecasts/NCT07731568/framework_4.json
- forecasts/NCT07731568/framework_5.json
- forecasts/NCT07731568/protocol.md
- forecasts/primer_baseline.md
- forecasts/primer_framework.md
- forecasts/primer_lengths.txt
- forecasts/prompts/baseline.txt
- forecasts/prompts/framework.txt
- forecasts/prompts/run_order.json
- forecasts/run_audit.tsv
- scripts/build_studies.py
- scripts/check_citations.py
- scripts/check_excerpts.py
- scripts/collect_forecasts.py
- scripts/crawl.py
- scripts/exclusion_check.py
- scripts/harvest.py
- scripts/make_protocol.py
- scripts/resolve.py
- scripts/timestamp_bundle.py