AI Claim Checker

After any AI-generated explanation, require the learner to identify one place it could be wrong, one thing to check, and one source to consult. Builds epistemic vigilance — treats AI output as a claim to evaluate, not truth to absorb.

What it does

After any substantive AI-generated explanation or claim, requires the learner to complete three steps before the content is "accepted": identify one place it could be wrong, identify one thing they would check to verify it, and name one source they would consult. This builds the habit of treating AI output as a claim requiring evaluation, not as authoritative truth. Over time, it develops epistemic vigilance — the capacity to engage critically with any information source, AI-generated or otherwise.

The evidence behind it

Long & Magerko (2020) proposed a competency framework for AI literacy that includes "critical appraisal" as a core dimension: the ability to evaluate AI-generated outputs for accuracy, bias, and limitations. Their framework argues that AI literacy must go beyond understanding how AI works to developing the disposition to question what it produces. The UNESCO AI Competency Framework (Miao & Cukurova, 2024) specifically lists "evaluate AI outputs critically" as a student competency, noting that without this skill students become passive consumers of AI-generated content. Efimova & Nygren (2026) document the epistemic vigilance problem in the generative AI era: students who interact primarily with AI sources show reduced tendency to cross-verify claims and are more susceptible to AI hallucinations. Roe et al. (2024) propose a critical AI literacy framework for secondary education that includes source triangulation as a taught practice — the habit of asking "what would confirm or disconfirm this?" before accepting a claim. Wineburg et al. (2022) study lateral reading — the practice used by professional fact-checkers of leaving a source immediately to check what other sources say about it — and found that this habit can be trained in secondary students with measurable effect on information evaluation accuracy.

Sources

• Long & Magerko (2020) — What is AI literacy? Competencies and design considerations
• Efimova & Nygren (2026) — Epistemic vigilance in the age of generative AI
• UNESCO / Miao & Cukurova (2024) — AI Competency Framework for Students
• Roe et al. (2024) — Critical AI literacy framework for secondary education
• Wineburg et al. (2022) — Lateral reading: reading less and learning more

How to use it in your lesson

For the best results with EvidenceLesson, give it:

• ai_generated_content — The AI-generated explanation, claim, or answer that the learner should evaluate
• topic — The subject area or topic the content relates to
• subject_area (optional) — Academic subject — helps calibrate what verification sources are appropriate
• developmental_band (optional) — Learner age or stage

Known limitations

1. The skill requires a minimum level of subject knowledge to function well. A learner who genuinely knows nothing about a topic cannot meaningfully evaluate an AI explanation of it — they lack the framework to identify what's questionable. The warm-start protocol partially addresses this, but the skill works best when the learner has at least foundational knowledge of the topic.

1. The skill depends on the AI acknowledging its own potential for error. This works in sessions where the AI is genuinely uncertain or where errors are plausible. For topics where the AI explanation is straightforwardly correct and verifiable, the three-step check can feel mechanical. The honest framing — "in this case the explanation is solid" — matters.

1. Source recommendations require domain context. Appropriate verification sources vary enormously by subject: for law it's primary legislation; for medicine it's peer-reviewed clinical literature; for history it's primary sources and peer-reviewed scholarship. The skill's value depends on the AI correctly identifying what counts as a good source in the learner's domain.

1. The skill does not replace domain expertise. A learner who completes the three-step check on a technically complex explanation may identify a genuine-feeling objection that is actually based on a misconception. The claim check builds the habit and disposition; it is not a guarantee of accurate evaluation.

Pairs well with