RERUN
Claim 5

Demo claim: practice run, not real research.

A claim whose data file was swapped after the market opened

A demo, not real research. The dataset at the claim's URL no longer matches the hash pinned in the spec, so the Lab refuses to run it. Both sides redeem at 0.5 and the creator's bond is forfeited.

We test one thing: does this code and data give this number? That's not the same as the science being right. The forecast price never changes the verdict.

See the proof
0.93The paper reports this as its accuracy. Counts if between 0.91 and 0.95.
RERUNCLAIM #0005

A claim whose data file was swapped after the market opened

Paper says
0.93
Counts if
0.91 to 0.95
Lab got
no number
VerdictInconclusiveThe data didn't match the fingerprint in the claim, so the test wouldn't be fair.
241c10238cc750887956Nov 04, 2026

This result is final

The data didn't match the fingerprint in the claim, so the test wouldn't be fair.

This slip is the Lab's .

✓ Verified on NEAR. See the contract's history

See the full receipt

  1. People forecast
  2. Forecasting ends
  3. The Lab retraces it
  4. Verdict posted, open to challenge
  5. Winners collect

What we didn't check

  • Whether the sample was fair or large enough.
  • Whether test data leaked into training or tuning.
  • Whether the result holds on new data.
  • Whether the study's method was the right one for its question.

Reading how the odds moved…

The evidence

See the full receipt

How much evidence is behind this?

Each step is a tougher test. Only the first one decides who wins the market.

  1. 1. !

    The Lab's retrace of the code and data named in the claim

    The test couldn't be run fairly, for example because the data changed. Every share pays back half.

  2. 2. –

    Stress test: does the number depend on luck?

    Fetching the extra runs…

  3. 3. –

    Rebuilt from the description (experimental)

    Fetching the AI's rebuild…

Coming next: a data-leakage check, for the same rows in training and test data, and a maths check on the statistics a paper reports. Neither has run on this claim.

Even all three steps can't prove the science is true. They show how well this result stands up to checking.

Verified

Your browser just re-checked these itself, so you don't have to trust this site.

Checking…

What the Lab retraces

Source
A demo, not real research
RERUN demo fixture, MIT
Code, at this exact version
https://rerun.invalid/demo/swapped-data.git
commit 563c58831162400e57dc0129eb2d2744fb3a1368
Commands
python3.11
$ pip install -r requirements.txt
$ python reproduce.py
Where the result is read
results.json using jsonpath $.accuracy
Data files
data/trials.csv
fingerprint be35dcd48bdcc0222a5c4d5ef769adb4a58e77c1914af80d8aa457ad742f9b7d
Limits
2 CPU, 2 GB, 3 minutes
241c10238cc7508879569640c22b66789c0ab85246b8aada234abb043756fbc9
Show the claim exactly as stored on the blockchain
{"artifact":{"commit":"563c58831162400e57dc0129eb2d2744fb3a1368","data":[{"path":"data/trials.csv","sha256":"be35dcd48bdcc0222a5c4d5ef769adb4a58e77c1914af80d8aa457ad742f9b7d","url":"https://rerun.invalid/demo/data/trials.csv"}],"entrypoint":"python reproduce.py","output":{"extractor":{"expr":"$.accuracy","type":"jsonpath"},"path":"results.json"},"repo_url":"https://rerun.invalid/demo/swapped-data.git","runtime":"python3.11","setup":["pip install -r requirements.txt"]},"metric":{"comparison":"within_tolerance","name":"accuracy","reported_value":"0.93","tolerance":{"type":"abs","value":"0.02"}},"private_data":null,"resources":{"cpu":2,"max_minutes":3,"mem_gb":2},"source":{"authors":"RERUN demo fixture","license":"MIT","type":"report","url":"https://rerun.invalid/demo/swapped-data"},"statement":"DEMO FIXTURE, not real research. The dataset at the claim's URL no longer matches the hash pinned in the spec, so the Lab refuses to run it. Both sides redeem at 0.5 and the creator's bond is forfeited.","title":"[DEMO] A claim whose data file was swapped after the market opened","version":1}

Community notes

Notes are people's own words, kept on the blockchain. They never change a verdict, and the Lab's AI never reads them. Posting costs a little NEAR for storage, and what isn't used comes back.