Signal Tester
Check whether your evaluation signal measures the thing you care about, or something adjacent to it.
- Sample workflow
- Exportable
- Runs in this browser
Runs in your browser. Nothing you enter is sent to a server, and nothing is stored unless you save it to this device.
Split automatically into fragments at sentence boundaries. Each fragment gets its own classification and support check.
Cited evidence, up to four sources
Leave a source blank if you have fewer than four. Nothing here is sent anywhere.
Source 1
Source 2
Source 3
Source 4
Support map
Each claim fragment, its classification, and the strongest evidence overlap found for it.
Idle
Source gaps
Problems with the evidence itself: unstated source types, or a factual claim resting on weak evidence.
Idle
Freshness risk
Recency of each source. Undated is its own risk category, not a neutral middle ground.
Idle
Confidence
A plain ratio, supported fragments over total, with the ledger of everything that moved it.
Idle
Rewritten evidence calibrated claim
The same claim, restated to assert only what the evidence supports. Every change is explained.
Idle
Rater agreement, secondary panel
Optional: where two people independently judged whether each fragment is supported, check whether they agree beyond chance.
Idle
One pair per line: rater A value, rater B value. For categorical data use the same two labels on both sides.
This is not a fact checker
This tool evaluates the evidence you supplied. It does not search the web, does not verify a fact against the world, and a fragment marked supported only means it matches what you pasted, not that it is true.Note Why does evidence narrower than the claim matter?
A source that says "in one trial" and a claim that says "in general" can both be true on their own and still not support each other. The evidence describes one case; the claim describes every case. That gap is where an AI generated summary most often quietly overreaches, because the words sound similar even though the scope changed.
The rewritten claim below narrows every fragment like that back down to what the evidence actually showed, and explains the narrowing so the change can be checked, not just trusted.
Signal Tester stopped responding.
Something in this tool threw an error. Your input was not sent anywhere, and nothing was saved. Reloading the page usually clears it.