Center for Practical AI
5-guide series

How you use AI decides what it does to you.

The same tools that erode thinking in one usage mode strengthen it in another. This series maps the difference, habit by habit, from the research.

Grounded in randomized trials, observational studies, and preprints, 2011–2026. Each guide names where the evidence is strong and where it is early.

The core idea

Two ways to use the same tool.

What determines whether AI helps or harms your thinking is not how much you use it. It is whether you are asking it to hand you the finished thing, or to help you build it.

Extraction

Asking AI for finished answers.

“Write this for me.” “What’s the answer?” “Fix it.” The output arrives complete and you move on.

What the evidence shows: immediate performance goes up. Unassisted capability and persistence go down. And most people cannot feel it happening while it happens.

Scaffolding

Asking AI to work on your attempt.

“Here’s my draft — what’s weakest?” “Give me a hint, not the answer.” “Argue against this.” You still do the producing.

What the evidence shows: in the randomized studies, the harm disappears. In the best-designed tutoring systems, learning gains roughly doubled.

Where this is still a hypothesis

The strongest evidence here randomizes the system — students were assigned to a tutor that gave hints or one that gave answers. No study has yet randomized the user’s intent. The finding that hint-seekers show no deficit comes from people who chose that mode themselves, so we cannot separate the mode from the kind of person who picks it. That gap is the frontier CPAI’s own research program works on. Everything in this series is consistent with the intent hypothesis; none of it is proof of it.

The habits

Six plain practices.

Not a scale, not a score. These are the behaviors the guides keep arriving at from different directions.

Choose deliberately

Decide what you're handing off before you hand it off.

Attempt first

Commit to an answer, however rough, before you open the chat.

Verify what matters

Scale checking to the stakes, not to how confident the output sounds.

Keep people primary

For the things that need a person, go to the person first.

Notice your own reliance

Periodically do the thing unaided, just to see where you are.

Keep a no-AI zone

One domain you insist on doing yourself, chosen by you.

What you can do

Action for every level of influence.

1

For yourself

  • Try one hints-only day: for everything you're trying to learn, ask for the next step rather than the finished answer, and see what changes.
  • Commit to an answer before you ask. Even a rough one. The act of generating a position is what the AI answer then gets compared against.
  • Pick one skill you refuse to offload — and do it unaided often enough that you'd notice if it slipped.
2

For an organization

  • Make "show your attempt first" a norm in AI-assisted work. The interesting artifact is the difference between the draft and the revision, not the final output.
  • Give every verification step a named human owner. "The team checked it" is how unchecked work ships.
  • Distinguish deliverables from skills. Extraction is the right call for output nobody needs to reproduce unaided; it is the wrong call for the capabilities you're trying to build in your people.
3

For educators

  • Design tasks where AI hints are allowed but AI answers are not. This is the single change with the strongest evidence behind it.
  • Teach the distinction explicitly. Students who think the rule is "AI is cheating" and students who think the rule is "any AI use is fine" are making the same mistake — treating exposure as the variable when mode is the variable.
  • Assess the process, not only the product. A revision diff shows you what a finished document cannot.
4

For policy

  • Fund longitudinal research on usage modes. Every study we have measures immediate effects; nobody has followed users over years.
  • Require learning products to disclose whether they are designed to give hints or answers. That design choice is the difference between the two outcomes in this series.
  • Resist screen-time framings in AI guidance. Fifteen years of research on the previous panic says quantity is the wrong measure.

The other side of the same evidence

The Six Risks name the failure. This series names the habit.

CPAI’s AI Proficiency framework maps six ways AI use goes wrong. Several of them draw on exactly the studies cited here — read from the risk side rather than the practice side. If you want the diagnosis before the habit, start there.

Where this leads

The habits are one thing. Building the skills is another.

These guides teach you how to use AI without losing capability. The Applied AI Certification builds the capability itself — across all six domains, with structured practice and a cohort. They are not the same thing, and that's rather the point.

Key research

What this series is built on.

Every empirical claim across the five guides traces to one of these. Evidence tier is stated on each — a randomized trial and a preprint are not the same kind of thing, and we are not going to let the layout imply they are.

Randomized controlled trialBastani, Bastani, Sungu, Ge, Kabakcı & Mariman (2025)Generative AI Can Harm LearningPNAS. Randomized trial, ~1,000 students across ~50 Turkish high-school math classes. Unrestricted GPT-4 access raised practice performance 48% but lowered the later unassisted exam 17% versus never-AI controls. A teacher-designed, hints-only tutor version raised practice performance 127% — and eliminated the exam harm.
Randomized controlled trialKestin, Miller, Klales, Milbourne & Ponti (2025)AI Tutoring Outperforms In-Class Active LearningScientific Reports. Crossover randomized trial, ~190 Harvard intro-physics students. A GPT-4 tutor engineered to work one step at a time, never reveal full solutions, and encourage attempts first produced roughly double the learning gains of in-class active learning, in less time. Two lessons, elite sample, carefully engineered tutor — not raw ChatGPT.
Randomized trial · preprint, not yet peer-reviewedLiu, Christian, Dumbalska, Bakker & Dubey (2026)AI Assistance Reduces Persistence and Hurts Independent PerformanceThree randomized studies, N=1,222. After roughly ten minutes of AI-assisted work, people solved fewer problems unaided (89% → 76%) and skipped more without attempting them at all (1% → 8%).
Randomized trial · preprint, not yet peer-reviewedShen & Tamkin (2026)How AI Impacts Skill FormationRandomized trial, 52 mostly-junior Python engineers learning an unfamiliar async library, half with an AI sidebar. The AI group scored 17 points lower on the mastery quiz (50% vs 67%, d=0.74), with the largest gap in debugging — while their ~2-minute speed gain was not significant. Screen recordings showed delegation patterns scoring under 40% and conceptual-inquiry patterns scoring 65% or higher. Small sample, immediate assessment, preprint.
Survey / correlationalLee, Sarkar, Tankelevitch et al. (2025)The Impact of Generative AI on Critical ThinkingCHI 2025, Microsoft Research and Carnegie Mellon. N=319 knowledge workers across 936 real work tasks: higher confidence in the AI predicted less critical-thinking effort; higher confidence in one's own skill predicted more.
Observational studyBudzyń, Romańczyk et al. (2025)Endoscopist deskilling after exposure to AI-assisted colonoscopyThe Lancet Gastroenterology & Hepatology. Retrospective observational study: 19 experienced endoscopists (2,000+ colonoscopies each) at four Polish centers. Their adenoma detection rate in non-AI colonoscopies fell 6.0 percentage points (28.4% to 22.4%) after routine AI assistance was introduced. Contested: published correspondence in the same journal (December 2025) raises the observational design, temporal and case-mix confounding, and whether this reflects true skill loss or attentional complacency — read it alongside the study.Published critique (Lancet correspondence, Dec 2025)
Last reviewed: July 2026We review this page quarterly. Statistics in this category change rapidly.This series covers a fast-moving literature. The intent hypothesis is stated as a hypothesis throughout: no study yet randomizes usage intent, and the user-level evidence is self-selected. Several citations are being confirmed against our research files and are marked on the page where that applies.

Want CPAI to teach healthy AI use in your school or workplace?

We deliver this material as workshops and cohort programs for schools, libraries, employers, and community organizations.