Prompt Literacy Sequence Designer

Design a learning sequence teaching prompt quality — comparing vague vs. refined prompts to show why specificity and context transform AI output. Use when students use AI without understanding why output quality varies.

What it does

Generates a structured learning sequence that teaches students why prompt quality determines AI output quality — and what specific prompt moves produce more useful, accurate, and contextually appropriate responses. The sequence follows a compare-contrast structure: students run vague and refined prompts on the same question, analyse the difference in output quality, and abstract the principles. The core insight is that AI fills missing context with the most statistically common response — so a prompt with no context about audience, purpose, discipline, or constraints will receive an answer calibrated for the average case, not the student's specific situation. The Pricing Exercise (Kharbach, 2026) is included as the anchor activity: students take a context-free AI answer ("What should I charge for a service?") and iteratively add constraints (type of service, location, target market, quality level), showing in real time how specificity transforms output from generically unhelpful to genuinely useful. The sequence teaches five prompt dimensions: context (who am I, what am I doing?), task (exactly what do I want?), constraints (what limits apply?), format (how should the output be structured?), and persona (what role should the AI take?). Prompt literacy is a prerequisite for effective AI use and a direct complement to AI output evaluation skills.

The evidence behind it

Brown et al. (2020) in the GPT-3 paper demonstrated empirically that the way a prompt is formulated dramatically affects model output quality — few-shot examples in the prompt (showing the AI what a good response looks like) produce substantially better results than zero-shot prompts (no examples). This is the foundational evidence that prompt design is not arbitrary. Liu et al. (2023) conducted a systematic survey of prompting methods, documenting the research on how different prompt structures (chain-of-thought, role-play, instruction-following, few-shot) affect output quality across tasks. Their survey establishes that prompt engineering is a skill with learnable principles, not a matter of chance. Reynolds & McDonell (2021) extended this to the concept of "metaprompts" — prompts that explicitly instruct the AI about how to reason, structure its response, or adopt a persona — showing that these structural elements can substantially improve output quality. These three sources provide the AI-specific evidence base for prompt literacy instruction. However, the pedagogical evidence base for teaching prompt literacy to students is currently very limited — this is frontier territory in educational research. The remaining sources support the instructional design of this sequence: Rosenshine (2012) provides the modelling → guided practice → independent practice structure used here; Willingham (2007) provides the domain-specificity argument (what counts as a good prompt in history is different from what counts as one in mathematics) that justifies subject-specific prompt literacy instruction.

Sources

• Brown et al. (2020) — Language Models are Few-Shot Learners (GPT-3 few-shot prompting)
• Liu et al. (2023) — Pre-Train, Prompt, and Predict: a systematic survey of prompting methods in NLP
• Reynolds & McDonell (2021) — Prompt programming for large language models: beyond the few-shot paradigm
• Rosenshine (2012) — Principles of instruction (modelling and guided practice framework)
• Willingham (2007) — Critical thinking: why is it so hard to teach? (specificity in task design)

How to use it in your lesson

For the best results with EvidenceLesson, give it:

• subject_area — The discipline context for prompt examples — affects what good specificity looks like
• student_level — Age/year group and current AI usage habits
• ai_task_type — What students are using AI for — research, writing help, explanation, problem-solving, revision
• prompt_literacy_focus (optional) — Which prompt dimension to emphasise — context specificity, constraint provision, format specification, persona/role, or iterative refinement
• common_student_prompts (optional) — Examples of the vague prompts students typically use — helps generate realistic before/after comparisons
• time_available (optional) — Time available for the prompt literacy sequence

Known limitations

1. The evidence base for teaching prompt literacy to students is very limited. The research on prompt engineering (Brown et al. 2020; Liu et al. 2023; Reynolds & McDonell 2021) documents that prompt structure affects output quality — it does not study pedagogical approaches to teaching this skill. This sequence applies established instructional design principles (compare-contrast, modelling, guided practice) to a frontier domain. Teachers should treat it as principled but provisional.

1. Prompt literacy has a short shelf life as AI models improve. Current models require explicit context and constraints because they fill missing information with statistical averages. Future models may become better at inferring context, making some prompt strategies obsolete. The underlying principle (clear, specific communication produces better results than vague requests) is unlikely to become irrelevant; specific moves may change.

1. Teaching prompt literacy may increase AI dependence. Students who learn to write better prompts will get more useful AI outputs — which may reduce their motivation to develop independent skills. This skill should always be paired with ai-output-critical-audit-designer and metacognitive-monitoring-ai-contexts to ensure prompt literacy is part of a critical AI literacy framework, not a pure productivity optimisation.

1. Prompt outcomes are probabilistic, not deterministic. The same prompt can produce different outputs on different runs. Compare-contrast activities should acknowledge this — students may need to run prompts 2-3 times to see consistent patterns, and "the refined prompt is always better" is not quite accurate (it's usually better, in ways consistent with the principles, but not always).

Pairs well with