AI Guides › Judgement & Guardrails
The Honest Case For Reading The Source, Not Just The Summary
By Nigel Guy · 2 min read
Asking an AI tool to summarise a report, a paper, a long contract, or a
thread of messages is genuinely useful — it's one of the things these tools
do well. The trouble starts when the summary quietly replaces the source
entirely, and you find yourself citing, forwarding, or acting on a document
you've never actually read a word of.
The rule: a summary is a map, not the territory — treat anything you'll
rely on, quote, or act on as requiring a pass over the actual source, not
just the summary of it.
The mechanism: the source-check pass
- Locate the specific passage the summary is drawing from. Most
summarising tools can point to it, or you can find it yourself with a
search term pulled from the summary. If you can't locate it, that's
itself worth noting.
- Read that passage directly, in its own words. Not the summary of the
passage — the passage. This is usually a minute or two, not the whole
document.
- Check what the summary emphasised against what the source actually
emphasises. Summaries compress by choosing what to leave out, and that
choice is invisible unless you look at what's missing.
- Note any qualifier, exception, or caveat the source carries that the
summary dropped. These are the first thing to disappear under
compression, and often the part that mattered.
- Only then decide whether the summary was a fair compression — and
whether you're comfortable relying on it, or need to read further.
What to skip
Skip this pass for genuinely low-stakes reading — catching up on background,
getting oriented before a meeting, deciding whether something's worth a
closer look at all. A summary is exactly the right tool for that job. And
skip reading an entire long document end to end just to check one summary
line; the point is to check the relevant passage, not to redo the reading
the summary was meant to save you.
What this replaces
Don't confuse "the summary sounded thorough" with "the summary was
accurate" — thoroughness is a property of how much detail is included, not
of whether the right details were chosen or the emphasis matches the
source. A long, detailed summary can still misrepresent what a document
actually says, and often does so more convincingly than a short one.
Guardrails
- This applies double to anything you'll quote directly, cite to someone
else, or use as the basis for a decision. Once a summary's wording leaves
your hands as if it were the source's own wording, the gap between the
two becomes your problem, not the summarising tool's.
- A summary of a summary compounds the same risk twice. If you're several
layers removed from the original document, treat that as a reason to go
further back, not a reason to trust the current layer more.
- This doesn't scale to every document you'll ever touch — it's a habit for
the documents that matter, applied consistently, not a demand to read
everything in full.
All 751 AI guides · JulieMango plans from £17/mo