Series hub: This post is one chapter in the critical thinking series. For the full map in one place, read the complete guide.
In one sentence
An AI summary is a second author that compresses — your job is to notice what got smoothed, swapped, or invented in the squeeze.
Why this matters
Students, professionals, and readers increasingly meet research, news, and long essays as chat digests. Compression is useful: you get a map. It is also risky: models prefer coherent stories, so they quietly merge claim, evidence, and interpretation, drop caveats, and sometimes invent tidy numbers or citations that were never there.
HiddenLogic already explores study tactics when answers are cheap (learning when “how” is cheap). Critical reading of summaries is the sibling skill: treat the digest as a hypothesis about the source, not a replacement for it — especially before you quote, decide, or teach from it.
Core ideas
Summaries optimise for fluency. Smooth prose feels trustworthy. Fluency is not the same as fidelity to methods, sample size, or dissenting paragraphs.
Missing hedges are a feature of length limits. “May,” “in this sample,” and “observational” disappear first. Put them back mentally until you verify.
Attribution drifts. “The study shows X” may mean the author argued X, a secondary source claimed X, or the model inferred X. Ask which.
Hallucinated precision. Exact percentages, author names, and DOIs are easy to invent. If a number matters, open the original.
Prompt framing biases the cut. “Give me the key takeaways” rewards punchy claims; “list limitations and evidence quality” rewards a different cut of the same text.
ThinkLens is built for structure (reasonable points vs issues), not for replacing your check of the source. Use both: model for a first map, you for verification.
Practices you can try
- Three-question audit. After any digest: (1) What is asserted? (2) What support did the summary actually mention? (3) What did it treat as interpretation or advice?
- Caveat hunt. Skim the original abstract or conclusion only for limits; compare to the summary’s confidence tone.
- Number lock. Circle every figure in the AI text; confirm or delete before sharing.
- ThinkLens on the source, not only the digest. Paste a key paragraph from the original into ThinkLens, then ask whether the summary preserved those tensions.
- Dual prompt. Run one “takeaways” and one “what could be wrong / missing” prompt; read them together.