Can AI text detectors reliably prove who wrote a text?
October 5, 2026 4 min read
No. A detector result is a tool-specific estimate about the surface statistics of a document, not evidence of who wrote it. When someone points at an "87% AI" score as proof of authorship, they are treating a statistical guess as a verdict, and the published record does not support that step. The gap matters most exactly where the stakes do: grades, hiring decisions, publication, and disputes.
What does a detector score actually measure?
What a score means is defined by the tool that produced it. Where a detector publishes documentation and validation, they state which models and conditions it was tested against, and that scope is what gives the number any standing. Check what the instrument was built around before you attach weight to the result. What every detector result shares is that the measurement is made on the text alone: the score reflects statistical properties of the writing, and nothing about the person behind it. It cannot observe identity, intent, or process, and a number computed from the text cannot contain authorship information the text does not carry.
That cuts both ways. A high "AI" score is compatible with human authorship: a careful editor, a formal technical document, or a non-native writer using standard vocabulary and structures may simply produce writing that a given tool reads as machine-like — a risk consistent with the 2023 study, which found the tested tools insufficiently accurate and reliable across a test set mixing human, translated, edited, and machine-produced documents. A low score is not proof of human origin either: the same study found that obfuscation, including editing and paraphrasing, reduced detection performance, so lightly worked machine text may clear the bar. In neither direction is the number a certificate.
What does the research show, and where does it stop?
A 2023 study in the International Journal for Educational Integrity, published by Springer Nature, put fourteen systems to work on fifty-four English documents: twelve public detectors and two commercial systems, tested against human-written, translated, AI-generated, manually edited, and machine-paraphrased text. The tested tools proved insufficiently accurate and reliable, and obfuscation — editing, paraphrasing, translation — reduced detection performance.
The scope matters as much as the finding. The study examined specific tools against a February 2023 version of ChatGPT, in English, at one point in time. It does not show that every current or future detector always fails. Raw, unedited output from a specific model version is often catchable.
How should you respond when a score lands on you?
If a detector result appears in your grade, application, or dispute, the workflow below keeps the number in its proper place. Each step produces something observable.
- Identify the instrument. Which detector, which version, when was it run, and what was it built around? Scores are not interchangeable across tools, and a system tuned to one set of models says less about text produced by others.
- Check the score against the tool's own uncertainty guidance. If the vendor publishes a confidence floor or a low-score band, a result inside that zone is explicitly low-confidence and should carry little weight.
- Examine what got flagged, not just the total. Detectors highlight the passages driving the score. Compare them against your actual writing habits — if they are your clearest, most controlled paragraphs, that pattern is more consistent with a false positive than with misconduct.
- Bring process evidence. Drafts, version history, notes, and earlier submissions show how the text developed over time. No detector outputs this material, and it is observable and checkable — usually worth more than the score.
- Cross-check with an independent tool. Disagreement between detectors is informative: divergence means inconclusive, not guilty. Agreement is stronger, but two estimates of the same surface statistics still do not constitute proof.
- Require a human decision layer. Any consequence — failing a submission, rejecting an application, accusing someone — should rest on the full picture, with a person accountable for the judgment. Automated output informs review. It does not replace it.
A practical rule of thumb: treat a detector score the way you would treat a weather forecast — useful context, wrong often enough that you would not bet your house on it. If an institution intends to act on one number alone, the right response is to ask for the draft history and a human review. The published research puts the burden of doubt squarely on the tool, not on the writer.
Sources
- SentX and Victoria — SentX
- SentX Privacy Policy — SentX
- Testing of detection tools for AI-generated text — International Journal for Educational Integrity / Springer Nature