We can't find the internet
Attempting to reconnect
Something went wrong!
Hang in there while we get back on track
Education AI is entering an evidence-and-design phase. The practical question is no longer whether a system can make a student’s work look better, but whether the student can still perform when the system is removed. A current analysis of 27,000 students in China, new U.S. federal guidance, and a wave of student-facing product launches all point to that test.
The learning test is what remains when AI is gone
The clearest current signal is a short-term/long-term split. The Economist analysis reports that students using AI saw homework scores rise 18% and spent less time on assignments, but scored 20% worse on exams than students who did not use AI. The result does not make every AI use harmful; it does show why homework performance is becoming a weak proxy for learning when the tool does the hard cognitive work.
Stanford’s SCALE brief offers a useful filter for product claims. High-impact tutoring remains defined by live, human-led instruction; AI-led tools may provide supplemental practice, but they do not inherit that evidence base simply because they give one-to-one responses. The established tutoring literature reports average effects of 0.29–0.37 standard deviations, with stronger programs meeting frequently, connecting to classroom curriculum, adjusting from evidence of student understanding, maintaining a relationship over time, and training and supporting tutors.
A randomized field experiment with nearly 1,000 high-school mathematics students makes the distinction concrete. Unrestricted GPT-4 increased practice performance by 48%; a guardrailed “GPT Tutor,” supplied with teacher-written solutions and instructed to give hints, increased it by 127%. Once AI was removed, the general-chatbot group scored 17% below the control group on an unaided test, while the guardrailed group performed about the same as control. Guardrails prevented the measured harm, but did not automatically produce a learning gain.
The evaluation problem is still visible at the model level: the best of 16 frontier models scored about 56/100 on TutorBench; almost no model-and-agent combination sustained strong tutoring across a simulated 30-day relationship; and six frontier models gave the answer in 97% of conversations with simulated eighth-graders when given generic instructions to be helpful. The last result is a diagnostic simulation, not a classroom failure rate, but it shows that “helpful” and “tutoring” are different objectives.
Federal guidance meets AI-first school politics
The U.S. Department of Education’s new Dear Colleague Letter turns that learning question into a selection standard. It says technology should have a clear instructional purpose, be backed by independent evidence, be transparent about design and data use, and have strong implementation. States and districts are told to focus on learning impact, choose tools with proven results, review effectiveness regularly, and support educator training; repeated failure should lead to removal. The department’s five questions are practical: What problem does the tool solve? When and for whom should it be used? For how long? What evidence shows that it improves learning?
The guidance favors instructional value over screen exposure, but leaves decisions to states and local communities. That creates a meaningful evidence bar without a single national implementation regime. EdSurge’s account notes that the department declined to offer new rules, while experts warned that privacy, accessibility, transparency, and responsible data use should not depend entirely on a student’s state.
The same week, federal education rhetoric gave an AI-led private-school model a prominent platform. Secretary Linda McMahon posted that responsible classroom AI can “revolutionize” learning and said she had seen it firsthand at Alpha School in Austin. Alpha is expanding from roughly a dozen to about 50 campuses; its model uses AI apps for core subjects such as math and reading for two hours, then spends the rest of the day on activities such as robotics and surfing. Co-founder Mackenzie Price says students learn twice as much in a fraction of the time, while adults focus on motivation, connection, and life skills. Those are the co-founder’s claims, not a comparison study presented in the interview.
That makes Alpha a useful test case, not a settled model. The department is asking for independent, condition-specific evidence, while SCALE classifies AI-only tutoring effectiveness as unknown and flags dosage and integration as unresolved problems.
Student-facing AI is scaling before its evidence is settled
Google is distributing a study environment directly to eligible college students: one year of Google AI Pro at no cost in the United States and one year of Google AI Plus in 140-plus countries, with the offer running through December 31, 2026. Its student hub includes study notebooks, flashcards, and practice quizzes. Google says the notebooks can use diagnostic quizzes to identify knowledge gaps, generate bite-sized lessons grounded in class materials, and track progress on a live dashboard.
The rollout also treats AI as a learning interface rather than only a text box: Gemini can generate interactive 3D simulations and dynamic tables, and Gemini Live can run a multi-step research report in the background for the student to discuss by voice later.
OpenAI is making a parallel move for younger learners. Its August 18 launch of ChatGPT for Teens targets ages 13–17 and automatically places users into the teen experience when the system estimates they are under 18. Study Mode, homework reminders, quizzes, Learning Visualizations, and Study Hours are designed to guide students through work instead of supplying a quick answer. The product also adds default age-appropriate protections, Quiet Hours and selected parental controls, safety notifications in limited high-risk situations, break reminders, and restrictions against emotional dependence.
The design direction is more disciplined than a generic answer engine, but the learning question remains open. The current tutoring analysis calls these structured products meaningful design shifts while explicitly warning that stated pedagogy is not yet evidence of durable learning.
Teachers and leaders are absorbing the implementation cost
Justin Reich’s current interview, informed by conversations with 120 K–2 teachers and students, reaches a restrained conclusion: AI might modestly help some students learn some things, but is causing “a lot of headaches” and is not transformational. One immediate classroom response is defensive. Teachers are moving writing onto paper and into class to reduce chatbot completion, which protects authenticity at the cost of instructional time. Some are paying out of pocket for revision-history tools, yet students can still retype AI-generated work. Reich’s preferred “layers of resistance” approach breaks an essay into separately completed pieces before students assemble the final work.
The leadership capacity gap is just as concrete. In a June survey discussed by Vicki Davis and National Principals Association CEO Ronn Nozoe, seven in ten respondents said their schools were already immersed in AI, but only about 18% felt very confident leading implementation. Forty percent specifically asked for time for staff training and planning. The schools making progress, the speakers say, are doing so through administrator–teacher collaboration rather than a top-down mandate or an isolated “Lone Ranger” teacher.
Higher education is moving from chat to delegated work
An EDUCAUSE Exchange discussion describes agentic AI as systems that connect multiple steps, use tools, respond to events, and act across institutional workflows. Early use is most visible in research: the speaker estimates roughly 5% of researchers are using agentic tools, from Claude Code and Codex to networks of agents that search literature and pass summaries between one another. The governance issue is ownership: institutions that choose tools and write policies should carry substantial responsibility when agents act on behalf of staff or students.
The human role is shifting toward judgment, but the discussion warns that a nominal human-in-the-loop can become “agency laundering,” with people approving an agent’s work automatically. It also frames “cognitive triage”—deciding what to delegate and what to retain—as a basic skill. Whether saved time improves advising and student support or simply becomes more cases and higher output is an institutional choice.
For lifelong learning, the pressure is structural rather than cyclical. The World Economic Forum expects 39% of workers’ core skills to change by 2030; U.S. job postings show 32% of required skills changing between 2021 and 2024, with one in four jobs experiencing 75% skill turnover. Higher education therefore needs recurring, shorter bursts of upskilling tied to different industry speeds and learner backgrounds, not only occasional returns for another full degree.
What This Means
- For K–12 leaders: Turn the Department’s five questions into a procurement record for every AI tool: the learning problem, intended users, duration, implementation owner, and evidence of impact. Separate instructional use from recreational screen exposure, and make removal a real option when results do not hold.
- For assessment leaders: Add an unaided transfer check to any workflow in which AI improves the submitted artifact. Staged drafts, explanations, and observed performance can protect learning without making continuous surveillance the default; the current classroom response shows that anti-cheating measures can consume instructional time.
- For edtech buyers and product teams: Evaluate the tutor, not just the model. A credible student-facing tutor should pursue a defined objective, elicit evidence of understanding, adapt its next move, and keep the student responsible for the thinking; test engagement, dosage, and performance after AI is removed.
- For higher-ed and L&D teams: Assign clear ownership for agents and protect the time they save for judgment, feedback, and relationships rather than automatically increasing caseloads. Design recurring learning in short, rigorous units that match the pace of work and the learner’s existing expertise.
Watch This Space
- Outcome evidence for direct-to-student AI: Google’s student hub, OpenAI’s teen experience, and Alpha’s expansion all need measures beyond usage or polished work: sustained engagement, unaided performance, learning transfer, and the dosage required to produce it.
- Federal guidance becoming local practice: Watch whether states and districts convert the new evidence language into performance-based contracts, independent evaluations, transparent data-use requirements, and actual removal of tools that fail.
- The reality of human oversight: In higher education, the key test for agentic systems will be whether “human in the loop” remains attentive judgment rather than automatic approval—and whether saved time reduces burnout instead of triggering the academic ratchet.
Direct answer: As of the Aug 18, 2026 announcement , OpenAI is introducing ChatGPT for Teens as a learning-focused experience with default safety protections and parental controls. Users are automatically placed if the system estimates they are under 18 or they state an age of 13–17, so the product's teen range is 13–17 while under-18 protections apply broadly .
- Learning features: Study Mode provides guiding questions and step-by-step support; responsible homework reminders detect shortcut attempts and redirect to Study Mode; quizzes and Learning Visualizations add practice; Study Hours let teens or parents schedule times when Study Mode is on by default .
- Limitation: no quick answers: If a teen asks for a quick answer, ChatGPT guides them toward steps and questions instead, and homework reminders redirect likely assignment-shortcutting toward collaborative problem solving . The featured teacher quote stresses the tool should not simply hand students an answer .
- Default safety protections: Protections are on by default, using age-appropriate safeguards to reduce exposure to harmful or developmentally inappropriate content while preserving learning, creation, and exploration; based on Under-18 Principles, with higher-risk areas including self-harm, violence, eating disorders, dangerous activities, and explicit sexual or graphic content .
- Parental controls: Parents with linked teen accounts can set Quiet Hours, manage selected settings, and receive safety notifications in limited high-risk situations; new eating-disorder-related notifications are being added, with sharing limited .
- Healthy-use and relationship safeguards: Break reminders and consistent AI identification are included; the updated under-18 model spec bars romantic language, emotional dependence, and implications of feelings or consciousness, beyond blocking romantic or sexualized roleplay . Additional cues include sensitive-image upload reminders, teen-specific onboarding, and limited customization such as accent colors and voice variations .
- Classroom boundary / student-use limitation: The experience is designed for learning outside the classroom; educators remain in control of classroom AI use, with institution-managed access through ChatGPT for Teachers .
- Gaps/uncertainty: The source is an announcement and does not specify availability timing, platforms, regional coverage, pricing, or detailed parental-control operation; it says under-18 evaluation results are only beginning to be shared in system cards .
Direct answer
The Department's new guidance is a Dear Colleague Letter that maintains four core requirements — clear instructional purpose, independent evidence, transparent design and data use, and strong implementation — while urging states to lead and preserve educator judgment. The release does not describe a procurement procedure as such; it sets expectations for selecting, reviewing, and removing tools.
Findings
- Form and core requirements. The Department released new guidance to help states, districts, educators, families, and ed-tech providers make informed choices, in the form of a Dear Colleague Letter that focuses on instructional value over recreational engagement and urges states to pair innovation with evidence, educator judgement, transparency for parents, and emphasis on student outcomes (). The DCL maintains four requirements: clear instructional purpose, independent evidence, transparent design and data use, and strong implementation ().
- Instructional purpose. Assistant Secretary Kirsten Baesler states instructional technologies should be judged by impact on learning, not by whether they happen on a screen, and that tools that distract recreationally can expand access to advanced courses, support students with disabilities, and close learning gaps when used wisely (). States and districts should focus on learning impact (); providers should minimize unnecessary screen time ().
- Evidence. The guidance calls for technology use backed by independent evidence and tools with proven results, with regular effectiveness review (). Every ed-tech product should be able to answer, among five questions, “What evidence demonstrates that it improves student learning?” (). When evidence shows a tool is not improving learning, schools must be willing to change course, and when repeated findings confirm persistent shortcomings, they should remove it altogether ().
- Educator judgment. The DCL urges educator judgement () and calls on states to preserve the human-centered core of teaching (). It follows Secretary McMahon’s July 2025 letter, which outlined five responsible-use AI principles including that education technologies should be educator-led ().
- State/district implementation. States and local communities should continue to lead decisions about tool use (). States and districts should focus on learning impact, choose tools with proven results, review effectiveness regularly, and support educator training (). Schools and providers should build transparency around how and when technology is used, screen time, implementation, and whether use contributes to learning outcomes (). The release also affirms that states and schools are right to take steps to remove cell-phone and algorithm-driven social-media distractions ().
- Procurement gap. The release does not specify a procurement process or vendor-selection procedure; it addresses selection and use, requires choosing proven tools, and requires removing tools that repeatedly fail, while states and local communities lead decisions about tool use ().
- Uncertainty/Gap. This release is the Department’s own summary; the full DCL is linked but the linked PDF is not in this bundle, so requirements not summarized in the release cannot be verified here ().
Direct answer: The provided SCALE brief confirms the core evidence hierarchy — relational intensity is the organizing axis, human-led high-impact tutoring rests on a robust evidence base, and AI-led models taper to unknown effectiveness — but it does not mention any guardrailed versus unrestricted GPT-4 experiment, so that portion of the objective cannot be verified from this bundle.
Findings
- Relational intensity is the hierarchy axis: The brief defines AI tutoring models by 'relational intensity,' the depth and consistency of the human connection between student and tutor, ranging from human-led models with close, sustained relationships to AI-led models with minimal or no human interaction. It states that as direct human relationships decrease, the evidence base becomes thinner, leaving unresolved questions about student safety, developmental impact, and long-term efficacy.
- Evidence map: Models are classified as Green (high-intensity human instruction with strong research support), Yellow (emerging AI-assisted models dependent on implementation quality), and Red (fully automated AI models with significant evidence gaps).
- Human-led high-impact tutoring evidence base: High-impact tutoring remains defined by live human-led instruction, with current research supporting AI tools that enhance tutor effectiveness and educator capacity rather than serving as a replacement. It is 'one of the best-evidenced interventions in K-12 education.' In-person or remote tutoring with a live tutor is described as having a robust evidence base and being highly effective, with stronger evidence for in-person tutoring while virtual tutoring also shows meaningful positive effects in high-quality studies. Consistent tutoring with the same tutor is linked to improved engagement, attendance, motivation, and learning outcomes. School-day tutoring at the appropriate dosage (three or more sessions weekly, 90 minutes total, for at least 10 weeks) produces effects roughly twice as large as out-of-school programs.
- Human-led with AI support: This model has an emergent research base and is 'potentially as effective as, or more effective than, in-person and remote tutoring.'
- AI-led models: AI-led tutoring software, even learning-sciences-based, offers potential for supplemental practice but does not yet meet the established evidence base or definition of high-impact tutoring. AI tutoring with human support is rated 'Emergent evidence; early research indicates implementation determines effectiveness on student outcomes'; AI-only tutoring is rated 'Emergent evidence; unknown effectiveness.' In two-district RCTs, 40% to 47% of students never used the AI platform, and those who logged on used it only four to five weeks total, averaging two to five minutes per week. Adding human check-ins improved engagement but usage still fell short of the dosage associated with learning gains, and reading achievement did not improve. Human oversight improves engagement and keeps instruction aligned, but does not by itself get students to the dosage that produces gains.
- Guardrailed versus unrestricted GPT-4 experiment — not found: No GPT-4 experiment, guardrailed or unrestricted, appears anywhere in the bundled text (full bundle ). Guardrails are mentioned only generally: safe implementation requires evaluating 'data privacy safeguards, student safety guardrails, and the depth of unmonitored interaction,' and general-purpose tools can be adapted for education through 'prompt engineering and custom guardrails.' This component of the objective remains a gap.
- Khan says Khan Academy is launching a more proactive version of Khanmigo after the first version, used in schools, waited for prompts many students could not write; the new version aims to motivate students and increase practice while keeping teachers in the loop .
- Khan's new institute — flagged in the interview as a collaboration with TED and ETS — was announced at TED and is seeking educational accreditation for largely online bachelor's and master's programs open to students of any age; it had 3,000 signups in 2–3 weeks, most with a prior degree, and will charge at most $10,000 for the whole degree (likely much less) . The program is built on competencies and centers on group simulations/projects with peer evaluation using a durable-skills framework (communication, teamwork, creativity, critical thinking), launching with six corporate partners (McKinzie, Bin, Google, Microsoft, Replit, Accenture) .
- Khan Academy is developing an AI-based psychometric assessment system in which students explain their reasoning and teachers get a fuller picture than multiple-choice tests; Khan says this requires testing on millions of students and years of school adoption, so he doubts the market will build it .
- From a Davos conversation with Ryan Roslansky, former LinkedIn director, Khan cites labor-market data: 75M LinkedIn profiles mention 'creator' (4M as primary job), entry-level hiring is down 12% (attributed to expensive capital, not AI), AI has created 1.3M new professions, and U.S. postings requiring AI skills pay about $18,000/year more .
- Khan calls teaching one of the safest professions as AI absorbs information delivery; the teacher role shifts to coaching, planning, and motivation, and human-connection skills (communication, persuasion, teamwork, listening) become more valuable, while fully computer-based work without human interaction is most exposed .
- Khan Academy's own AI adoption: roughly $1.2M/year on Anthropic and one of Anthropic's most active users of code-review agents; one engineer spent $3,000 in a day and completed 3–4 months of work in hours . Leadership tells staff to use AI more, promises employees who automate their own work a better, higher-paid role, says only funding shortfalls would cause layoffs, and added mastery of new tools to its career matrix .
- OpenAI gave Khan Academy pre-release access to a next-generation model before ChatGPT publicly launched. After it answered and explained an AP Biology question, Sal Khan decided within a week that AI would "change everything" and committed Khan Academy to building AI responsibly, saying otherwise others would deploy it without guardrails .
- Khan Academy moved from rapid prototyping in November 2022 to launching Khanmigo around GPT-4's March 2023 release, built by a seven-to-eight-person tiger team. Khanmigo was designed as a Socratic tutor that does not give answers, with guardrails against hallucinations, cheating, and safety issues for under-18 students .
- Early classroom signal: Khanmigo was "kind of a non-event" for many students — only 10-15% of kids (and employees) are willing to try it out and find it a game-changer, and many students do not know how to construct the help they need. Khan Academy's response is deeper, more proactive integration; for the coming school year students will have to explain their reasoning to Khanmigo to get credit on multiple-choice questions, explicitly countering cognitive offloading .
- Khan Academy's early testing fed back into model development: it helped OpenAI discover mistakes in initial training data that fixed some math errors, and a Google researcher credited Khan Academy with demonstrating "the power of prompting" to researchers .
- Sal Khan frames AI-era learning as three distinct skills — learning about AI, learning subjects with AI, and learning to use AI generally (e.g., vibe coding, Claude Cowork) — with the last evolving fastest. He links AI tutoring to Bloom's two-sigma finding, arguing AI can play the role of a tutor, teacher, or peer when none is around, potentially moving a 50th-percentile student to roughly the 96th .
On the Future of Education Podcast, Mackenzie Price's Alpha School model is framed as 'disrupting education through AI' . Price describes Alpha as one-to-one, mastery-based learning, contrasted with the traditional 'time-based system' of 'a teacher in front of a classroom' .
Christy Ray, Florida's 2020 Principal of the Year, now serves as an Alpha guide after 20-plus years in Florida schools, saying she 'came to Alpha because I realized the system was broken' .
On Alpha's staff culture, Ray called hard-feedback coaching 'amazing about Alpha and also really difficult' for a high achiever, contrasting it with traditional schools where strong teachers may get only one observation a year .
Asked why "Everybody uses AI. Everybody hates AI," Sam Altman says the AI field has not explained its benefits or how downsides will be mitigated, and contrasts this with Intel's founders, who after inventing the microprocessor "putting on more classes than the local community college had in their entire course catalog" to educate customers and investors. He agrees AI should be doing more: "No excuses. We should be doing more. I think we've like tried versions of this. We haven't gotten it quite right."
The interviewer describes a custom AI tool he built trained on every note and highlight from books read since 2018 plus his podcast transcripts, which he uses daily to retrieve exact past material (e.g., what Bob Noyce or Rockefeller said) when producing episodes; Altman calls it "awesome" and says he wants AI agents that read more context than any person can (internal Slack, customer stories, research papers) to advise him, arguing the product side hasn't yet figured out "what it means to give a model more context than any person could have."
Altman predicts AI will drive "the greatest boom in people starting smaller businesses that we have ever seen," saying AI is empowering that even though the field hasn't talked about it enough and hasn't "built enough products to accelerate that."
On adoption timing, Altman says changing ingrained habits and workflows is difficult and things "have to happen gradually"; he calls the current transitional phase "mostly a product failure," comparing it to smartphones before the iPhone — all the technological pieces exist but there has been no "iPhone moment" for how people interface with technology.
- In interviews with 120 K-12 teachers and students, MIT's Justin Reich concludes generative AI "might modestly help some students learn some things" but is causing "a lot of headaches" and is not transformational; there's no good evidence daily teaching/learning practices have changed much.
- A century of ed-tech evidence shows: teachers first extend existing practices; benefits disproportionately reach affluent students; tech only works when communities have time to redesign curricula; gains are incremental (~1% per year).
- Past transformation predictions failed: Edison (1913) predicted textbooks replaced by film in 10 years; Clayton Christensen predicted by 2019 half of secondary courses online at 1/3 cost with better outcomes; MOOC boosters predicted only 50 universities left. None happened.
- AI is already reshaping homework: schools shift to in-class paper assignments to stop chatbot cheating (cutting instruction time); teachers say they must watch students write to see authentic work, and "millions of fewer minutes of homework" may reduce valuable practice.
- Teachers are paying out of pocket for Google Docs revision-history extensions to detect AI-written essays; students evade by retyping ChatGPT output, and scaling up writing surveillance is "really not good for a democratic society."
- One effective anti-cheat strategy is "layers of resistance": break essays into separate graded pieces, making shortcuts harder and forcing students to think longer before combining them.
- Reich sees promise in AI writing feedback but finds students still want human feedback because relationships drive motivation; historically, adaptive "help me" buttons go unused by the students who need them most.
- Core open question: whether schools should scaffold students into AI partnership or focus on domain knowledge so students can judge uneven AI output; science cannot yet choose between these stories.
- State/district AI-literacy requirements repeat a "tech literacy" strategy that has not worked; upgrading 3.5M teachers is huge, and even Google DeepMind engineers don't know how to train junior engineers to code with AI copilots (Claude Code, GitHub Copilot, Cursor, Codex), risking a generation who can't fix or understand code.
- AI could transform special education (e.g., personalized supports for severe language disabilities, universal design for learning), but decades of similar tech only helped affluent communities with system-level support; benefits will take community redesign, not tool adoption alone.
- If gains come at all, Reich expects 10–20 years of incremental development rather than a quick "stumbling across something" super-effective in a year or two.
Practitioners argue edtech is saturated with 'yet another dashboard or AI wrapper,' and one developer says he has yet to find a wrapper he couldn't replace with a prompt copy-pasted from a Google Doc .
One commenter says the problem isn't saturation but toolmakers' refusal to pay experienced teachers to consult (indie developers and Pearson/HMH alike); the best tools came from teachers or serious teacher collaboration — DeltaMath was initially made by a high school teacher for his own classes, and Desmos Activity Builder was developed with a team including math educator Dan Meyer . A Kami employee notes about a third of Kami's workforce are former educators .
A parent and engineer managing 300+ engineers in a regulated market warns against teachers 'vibe-coding' their own AI classroom tools: homegrown apps bypass school/district checks and balances, and he says he has seen 'terrifying examples' of student data flowing to multiple organizations without teachers knowing what data was shared, who held it, or for how long . A teacher of Thai students calls the fear of a student name leaking 'oversaturated' ; in response, the engineer details that a vibe-coded AI tutor using third-party hosting, AI-call routing, logging providers, and a homework camera could share a student's photo with multiple organizations, including bad actors — the reason GDPR or PDPA exist .
One commenter predicts feature-heavy edtech software will deflate as AI drives the cost of features to zero , and another argues edtech SaaS should be 'dismantled' so high-quality software becomes a public good, saying the industry invests in software rather than human capacity to integrate AI and edtech in meaningful, evidence-based ways . An educator adds that 'state of the art' LMS tools like Canvas and Moodle still lag consumer/enterprise tech by years .
Ethan Mollick highlights MIT/Stanford research finding that most people would be financially better off following financial advice from LLMs (GPT-5.2 & Gemini 3 Flash), though advice quality varies with how questions are asked . He connects this to his prior work teaching financial literacy, calling access to a research-backed financial advice tool 'a big deal' . He argues consumer AI is underrated for navigating hard-to-handle life tasks including personal finance and school forms , and worries that groups most trying to help people with such problems are reflexively rejecting AI despite its capabilities .
- Ethan Mollick used GPT-5.6 Sol in Codex to take over his Chrome browser, export all 5,302 of his X bookmarks (back to 2014), and asked it to find "gems" — a concrete demonstration of an AI agent automating personal knowledge-management and curation work . He first tried Grokbot, which lacked API access to his bookmarks .
- AI-curated finding: after AI surpassed humans at Go, professional players improved by learning machine-discovered strategies — an example of superhuman AI expanding, not replacing, human capability .
- AI-curated resource: a working nanoGPT (~85,000 parameters) recreated inside a spreadsheet makes a transformer model inspectable cell by cell, turning an otherwise opaque architecture into a hands-on learning artifact .
- AI-curated resource: the University of Chicago's four-year Great Books discussion course is open to anyone, offering a structured route through foundational works without degree enrollment .
- AI-curated research: across four studies, people trusted more aesthetically pleasing graphs more, even when beauty shouldn't have affected credibility — a warning for anyone creating or consuming research .
- AI-curated lesson: one man spent five years recreating all 107 recipes in the Alinea cookbook, framed as a lesson in mastery, deliberate practice, and the consumer-to-creator transition .
- AI-curated analysis: Wikipedia succeeded while seven similar online encyclopedia projects launched around the same time failed; a paper examines the institutional and organizational reasons why .
- AI-curated graphic: a "mostly complete" visual map of neural-network architectures organizes the field's many varieties into a single taxonomy .
- Alpha School, a private school teaching core subjects like math and reading with AI apps, is expanding from roughly a dozen to about 50 campuses this school year; students spend two hours on AI learning per day, then the rest of the day on real-world skills such as coding a robot and surfing.
- Co-founder Mackenzie Price says AI gives each student a personalized learning experience like a one-to-one tutor and lets adults focus on motivating and connecting with students ; she claims students learn twice as much in a fraction of the time of traditional classrooms , with the system meeting students at the right level and pace so advanced students can accelerate and those with gaps or learning differences get support .
- Students are grouped by age for connection but can work at different academic levels side by side (e.g., a 7-year-old on algebra next to one on addition/subtraction) ; Price argues students get more one-to-one connection time with adults than in traditional schools, where teachers manage many students in a time-based system .
Sal Khan credits MIT OpenCourseWare as the direct inspiration for Khan Academy: seeing MIT release lectures and problem sets for free on principle led him to adopt the same stance, and he once offered to donate Khan Academy to OpenCourseWare (rejected because he wasn't an MIT professor) . He contrasts this with the pre-2000s norm of universities partnering with for-profits to sell online degrees for tens of thousands of dollars . Khan Academy is philanthropy-funded with a budget approaching $100 million — comparable to a large U.S. high school — and the charter of "educating humanity" . He argues open education scales to hundreds of millions or billions, reaching orphans in Mongolia, prisoners in the U.S., and rural Alaska students — enough to keep some engaged toward middle-class lives and to unlock potential like "50 Albert Einsteins" who otherwise go uninvested .
- In her debut book School's Out: Why Families Are Choosing Unconventional Education, Connections Academy co-founder Mickey Revenaugh argues AI now gives educators the tools to evaluate student portfolios against rubrics, finally making authentic, output-based assessment viable — and more necessary as standardized tests, Carnegie units, and seat time lose relevance; she expects public funding through ESAs and a forthcoming tax-credit scholarship program to force this reckoning with how learning is measured .
- Revenaugh says pandemic-era "Zoom school"/emergency remote instruction was the "lowest common denominator virtual education" and still shapes what people see as online learning, where she attributes many poor results; virtual-education technology is "still a work in progress," and many students attended virtual schools mainly because no other unconventional option existed .
- Families increasingly "switch and mix" schooling arrangements year to year — homeschooling, Montessori, charter, district, microschools, and online courses — making portable evidence of mastery (e.g., portfolios) more relevant than standardized test scores, and pressuring traditional districts to adopt new models as enrollment falls .
- Revenaugh contends passion-driven models (project-based learning, unschooling) build a love of learning, self-motivation, and resilience that will serve kids better than traditional schooling, and credits Gen Alpha's curiosity partly to growing up with powerful tools for learning about anything in the world, including online .
Khan Academy released a new free AP Physics C: Mechanics course, ready for teachers to assign, featuring seven units, videos, PhET simulations, exam-style practice, quizzes, unit tests, and step-by-step explanations . More details are available in a linked blog post .
Khan Academy launched a free SAT Reading and Writing Challenge unit designed so the hardest SAT Reading and Writing questions are not a test-day surprise, giving students who completed Advanced practice six mastery-enabled exercises to stretch their skills . Details are in a linked blog post (https://blog.khanacademy.org/sat-reading-writing-challenge-unit/) .
Ethan Mollick: AI research using older models (e.g., GPT-4) remains valid when showing AI can do something — once an ability is gained, it generally does not regress in later generations . Negative capability claims need more caution: a GPT-4 failure does not prove AI is bad at a task . Valid alternatives include: explicitly framing results as "GPT-4 could not do X" with reproducible details as a progress benchmark ; measuring trends across model generations, ideally including at least one reasoning model ; making a grounded argument for a natural limitation ; studying moderators/mediators such as prompting, social context, or connections ; and focusing on human reactions, failures, and impacts . Negative capability claims have generally been much less durable than positive ones . This is directly relevant to interpreting AI-in-education research, which often evaluates older LLMs on teaching, tutoring, and assessment tasks.
Ethan Mollick pushed back on "ELI5" as the default way to make AI explanations easy, arguing LLMs work best as "universal translators across topics" and that personalized prompts — "explain to me drawing on what I know" — beat generic dumbed-down explanations . In a reply, he cites research that drawing connections to prior knowledge improves memory and context-building, and says adults "don't need things dumbed down, you need things explained differently" — a capability he calls one of LLMs' most exciting features . The exchange responds to a widely viewed post describing a skill Anthropic employees use: "/eli5 <what you want explained>", which generates an HTML artifact with big pictures and few words .
Stanford SCALE's new brief "AI Tutoring Is Not a Monolith" sorts tutoring models by relational intensity and concludes evidence remains strongest for live, human-led high-impact tutoring; AI-led tutors may offer supplemental practice but do not yet inherit the definition or evidence base of high-impact tutoring . Meta-analyses estimate tutoring raises achievement by 0.29–0.37 SD; strong programs share frequent 1:1/small-group sessions, curriculum alignment, evidence-based adjustment, a consistent tutor over time, and tutor training/support — features AI tutor designers should replicate, including pedagogical preparation beyond the foundation model . In two randomized trials with 355 elementary students, independent use of an AI literacy platform led nearly half to never use it (users averaged 2–5 minutes/week); adding an in-person engagement-focused tutor raised engagement 71–80% but use stayed low and reading achievement did not improve — access alone is not enough . A randomized field experiment with ~1,000 high-school math students found access to general GPT-4 raised practice performance by 48% vs 127% for a guardrailed GPT Tutor (teacher-written solutions, hints); after AI removal, the general-chatbot group scored 17% below control while the guardrailed group matched control — unrestricted help creates "cognitive debt" . A working definition: "A student-facing AI tutor pursues a defined learning objective, elicits evidence of the student's understanding, adapts its next move, and keeps the student responsible for the thinking" . Benchmarks show models still fall short as tutors: the best of 16 frontier models scored ~56/100 on TutorBench (adapting explanations, actionable feedback, hints); in a Comprendo simulation, six frontier models given generic helpful instructions revealed answers in 97% of conversations with simulated 8th-graders, and a tutoring prompt improved but no model consistently identified misconceptions while withholding reasoning; EduClaw-Bench found almost no model sustained strong tutoring over a simulated 30-day relationship . Product and lab shifts toward structured, curriculum-aligned tutoring: Rori, a WhatsApp math tutor, produced an estimated 0.36-SD gain across 11 Ghanaian schools (uncertain due to small sample/attrition); Eedi and Google tested LearnLM in a constrained UK math platform with human tutors supervising AI-drafted messages; OpenAI's ChatGPT Study Mode, Anthropic's Claude Learning Mode, and Google's Gemini Guided Learning each aim to scaffold and delay answers . Shared infrastructure is emerging: Digital Promise's $26M K-12 AI Infrastructure Program first grantees include a science-misconception benchmark, simulated student models, a National Tutoring Observatory speech-recognition project, and KB-TutorBench; Learning Commons is building open knowledge graphs and evaluators linking AI outputs to curriculum and standards . The U.S. Department of Education released guidance on responsible use of edtech, urging schools and providers to evaluate the learning problem, evidence, educator judgment, transparency, and student outcomes, and to remove technologies that repeatedly fail . A new Economist analysis of 27,000 students ages 12–18 in China found AI-assisted students' homework scores rose 18% with less time spent, but they scored 20% worse on exams than non-AI students — a short-term performance vs deeper-learning tradeoff . OpenAI launched ChatGPT for Teens (ages 13–17) with Study Mode, homework reminders, quizzes, learning visualizations, Study Hours, parent controls, and a CodeAI partnership for AI literacy . Reach Capital raised a $265M Fund V to invest in ~50 early-stage companies across learning, health, and work, focused on AI that "expands human potential" .
A new study on student AI use in China (highlighted by @nxthompson via The Economist) finds homework grades may now mean the opposite of what they once did — good homework used to predict good test grades, but possibly not anymore . Ethan Mollick calls the paper good and argues AI has made the cheating problem worse, while cautioning that pre-AI cheating was already substantial: doing homework improved final test grades for 86% of college students in 2008 versus only 45% in 2017, when they were copying from the internet .
AI Tutoring is Not a Monolith: What We Actually Know
This Brief at a Glance
- High-impact tutoring remains defined by live human-led instruction. Current research supports leveraging AI tools to enhance tutor effectiveness and educator capacity, rather than serving as a replacement for high-impact tutoring.
- AI-led tutoring software, even software based on learning sciences, offers potential for supplemental practice but does not yet meet the established evidence base or definition of high-impact tutoring.
- The effectiveness of AI-led tutoring depends as much on integration, such as by teachers in classrooms or parents at home, as on the quality of the software itself.
- Safe implementation of direct-to-student AI tools requires careful evaluation of data privacy safeguards, student safety guardrails, and the depth of unmonitored interaction.
High-impact tutoring is a highly effective, well-researched approach (opens in new tab) for accelerating student learning. Students who receive it show learning gains of three to more than 15 months (opens in new tab) across grade levels and content areas, along with improved well-being and engagement in school. Many practitioners identify strong relationships as a key driver of effective tutoring, and research suggests that relationship-building strategies, particularly consistent tutoring with the same tutor, improve student engagement, attendance, motivation, and learning outcomes (opens in new tab).
Practitioners are increasingly considering Artificial Intelligence (AI) as a way to expand access, lower costs, and improve personalization of tutoring. Although the published AI tutoring research base currently lags behind field implementation, an emergent body of research, supplemented by applicable research in educational technology, can guide current practice.
This brief draws on research on high-impact tutoring, emerging evidence on AI-enabled tutoring models, and interviews with AI tutoring providers, platform developers, and researchers. It defines the core elements of high-impact tutoring, then identifies and maps a spectrum of AI tutoring models by how much human interaction each one preserves.
The Elements of High-Impact Tutoring
High-impact tutoring is one of the best-evidenced interventions in K-12 education. A growing body of research continues to sharpen what we know about which design features drive results. Features defining high-impact tutoring include:
The Tutoring Quality Standards, developed by (opens in new tab) an Advisory Group (opens in new tab) of practitioners and researchers, further outline research-based effective practices. (opens in new tab)
These elements matter for AI tutoring because they explain why tutoring works, not just that it does work. Effective tutoring depends on frequency and consistency, instructional quality, responsiveness to individual student data, and a relationship that keeps students showing up and engaged. These features give practitioners and product developers a concrete place to start with any AI tutoring model: which of these conditions does it reproduce, which does it change, and which does it drop? Asking that question yields more useful information on effectiveness than simply asking whether AI tutoring “works.”
Evaluating AI tutoring doesn’t have to start from scratch.
Artificial Intelligence Tools in Education
AI tools in education range from general-purpose platforms to tools built specifically for teaching and learning. They also differ in who they’re designed for: some engage students directly, while others work behind the scenes to support the adults delivering instruction. Both distinctions shape how a tool integrates into high-impact tutoring:
- General-purpose AI tools answer questions, generate content, and save time. These tools depend on the user, e.g. students or educators, to initiate each interaction, and often function as homework helpers or answer engines.
- Student-focused AI tools are built around learning goals, high-quality instructional materials, and pedagogical support. They encourage productive struggle, provide step-by-step guidance, and keep students aligned with a standard curriculum.
- Educator-focused AI tools support the teacher or tutor rather than the student. These tools can provide in-the-moment pedagogical suggestions during a session, differentiate materials for individual students, match students with similar needs into small groups, flag struggling students or tutors so a coach can step in, and support professional development.
This brief primarily focuses on student-focused and educator-focused AI tools, those built with explicit instructional intent. General-purpose tools can also be adapted for education settings, through prompt engineering and custom guardrails.
Tutoring Models Across the AI-Human Spectrum
AI tutoring models vary by their level of human involvement, what we call relational intensity. Relational intensity is the depth and consistency of the human connection between a student and a tutor within a given tutoring model, ranging from human-led models with close, sustained relationships to AI-led models with minimal or no human interaction. As direct human relationships decrease, the evidence base becomes thinner, leaving unresolved questions about student safety, developmental impact, and long-term efficacy.
The tables below use a visual framework to map tutoring models that incorporate AI by relational intensity and the strength of the evidence base:
Green – high-intensity human instruction with strong research support Yellow – emerging AI-assisted models dependent on implementation quality Red – fully automated AI models with significant evidence gaps
Human-Led Tutoring Models With High Relational Intensity
Human-led tutoring models build upon a research-based program design in which a human tutor holds the relationship with the student. The tutor delivers the session, responds to the student in real time, and is the person the student shows up for. AI, where present, works behind the scenes, supporting preparation, data analysis, and tutor efficiency.
| Tutoring Model | Description | Evidence Base and Effectiveness |
|---|---|---|
| In-Person Tutoring or Remote Tutoring | A live tutor is directly responsible for all instruction and student interaction (in-person or via online platform). No AI is used during student-tutor sessions, though providers may use standard software or dashboards for operations. | Robust evidence base (opens in new tab); highly effective. Note: The evidence for in-person tutoring is stronger, but virtual tutoring has also demonstrated meaningful positive effects in high-quality studies. |
| Human Tutoring With AI Support | A live human tutor is responsible for interaction with the student. AI assists the tutor behind-the-scenes through synchronous or asynchronous support. | Emergent research base (opens in new tab); potentially as effective as, or more effective than, in-person and remote tutoring. |
AI-Led Tutoring With Decreasing Relational Intensity
Adopting AI-led solutions without clear integration plans risks undermining several elements of effective high-impact tutoring. Given strong evidence that dosage (opens in new tab) is a key driver of student outcomes in human-led tutoring, similar requirements, such as a 90-minute weekly dosage threshold, apply to AI-led tutoring. Meeting dosage requirements presents a documented challenge for learning software. For example, in a study (opens in new tab) of 181,000 students using a supplemental math platform, only 5% reached the recommended 30 minutes per week, and 41% never logged on. Teacher, school, and district factors explained 57% of the variance in usage, indicating classroom integration determines whether students reach recommended dosage.
AI tutoring with human support places AI in the lead, while a human oversees the process and intervenes as needed. Two recent studies suggest this model is workable in design but unproven in effect. A pair of randomized controlled trials (opens in new tab) (RCTs) across two school districts found that adding human check-ins and motivation raised elementary students’ engagement with an AI platform, but usage still fell short of the dosage associated with learning gains, and reading achievement did not improve. An exploratory randomized controlled trial in United Kingdom classrooms points to a different strength of the model: with a human supervising, AI-led sessions preserved structured learning goals and curriculum alignment.
Together, these findings point to what human oversight can and cannot do in AI-led tutoring models: it improves engagement and keeps instruction aligned, but it does not by itself get students to the dosage that produces gains. Whether AI-led tutoring can benefit students is not yet clear, given unresolved barriers to engagement and dosage.
| Tutoring Model | Description | Evidence Base and Effectiveness |
|---|---|---|
| AI Tutoring with Human Support | The student engages directly with AI, while a human tutor oversees, guides, and intervenes when prompted. | Emergent evidence; early research indicates implementation determines effectiveness on student outcomes |
At the low end of relational intensity sits AI-only tutoring. This model represents standalone AI tools operating without direct human oversight. Results from the two-district randomized controlled trials (opens in new tab) demonstrated that when left to work independently, 40% to 47% of students never used the AI platform at all. Even students who logged on used it only for four to five weeks total across a multi-month intervention, averaging two to five minutes per week, far below the dosage associated with reading gains.
| Tutoring Model | Description | Evidence Base and Effectiveness |
|---|---|---|
| AI-Only Tutoring | The student works directly with AI for all aspects of the tutoring experience without direct human oversight. | Emergent evidence; unknown effectiveness. |
Open questions remain about how AI affects student emotional needs and long-term cognitive development, beyond questions of dosage. Recent survey data shows a rapid rise in youth using AI tools to build emotional bonds (opens in new tab). This use raises questions about how AI companions affect developing minds and how to protect prosocial development both inside and outside of school.
Cognitive risks also exist. AI can ease a student’s immediate learning burden, but long-term educational effects are mixed once the tool is removed. Interviews with AI tutoring developers revealed efforts to build education-focused AI tools that prioritize student agency and access while supporting human connection.
Intentional AI Integration in High-impact Tutoring
The following section explores how each element of the high-impact tutoring design principles (opens in new tab) translates into AI implementation decisions. Under each element of high-impact tutoring, AI tutoring use cases are curated from interviews and experimental research with the primary goal of enhancing human-led instruction and augmenting educators’ capacity.
Regular Tutoring Sessions with School-Day Implementation
If teachers are not bought into using [AI] in their classroom practice or setting homework, then there is no impact of [AI], because dosage is absolutely key.
-Tutoring provider using AI to support human tutors
Tutoring embedded in the school day, with appropriate dosage (three or more sessions weekly, 90 minutes total, for at least 10 weeks), produces effects roughly twice as large (opens in new tab) as out-of-school programs, particularly within a Multi-Tiered System of Support (MTSS) model (opens in new tab). This difference likely reflects the removal of barriers such as transportation, scheduling conflicts, and opt-in requirements.
AI-led tutoring inherits the dosage evidence base only when it is scheduled, supervised, and protected within the school day on the same terms as human-led tutoring. AI removes the staffing constraint that caps how many students a school can tutor by serving any number of students at once, but it reintroduces an opt-in requirement that a live, school-day tutoring model eliminates. Even with dedicated classroom time set aside for tutoring, an AI tutor on a device relies on the student to decide to engage and self-monitor. Interviews highlight AI tools designed to streamline master scheduling and attendance tracking, helping schools protect time for human-led tutoring.
Leveraging AI to Support Dosage and Scheduling Efficacy
- AI can streamline master scheduling and effective allocation of students and educators (opens in new tab), significantly reducing schedule-building time while preserving core instructional time and intervention blocks.
- AI can analyze attendance data to identify students below dosage standards and pinpoint root causes.
- AI can identify integration points for tutoring within the district’s existing Multi-Tiered System of Support (opens in new tab) (MTSS) or Response to Intervention (RTI) Systems.
Small-Group Formats
[Tutors] are the critical lever… AI will enhance scalability and efficiency, but humans are still at the heart of it.
-NSSA Badged Tutoring Provider
High-impact tutoring operates with tutor-student ratios at or below 1:4 to support individualized instruction, foster stronger relationships, and maximize student achievement (opens in new tab). Experimental evidence (opens in new tab) on online tutoring demonstrates 1:1 instruction yields the strongest gains in student cognitive outcomes and academic achievement. An AI model delivering 1:1 instruction inherits the ratio evidence only if it also delivers what the ratio produces: consistent engagement, personalized instruction, ability to diagnose misconception, and responsiveness to student cues.
This ratio evidence cuts both ways. In human-led tutoring models, small-group formats remain viable and cost-effective alternatives to 1:1 (opens in new tab), particularly in secondary mathematics, where peer collaboration adds value and effects on student performance stay strong. AI’s ability to give every student an individual session is not automatically an upgrade if it removes the peer interaction those positive impacts are attributed to.
Supporting Small Group Formats with AI
- AI can facilitate station rotations within small-group tutoring, allowing human tutors to deliver targeted one-on-one instruction while the remaining students engage in high-quality individual practice.
- AI can expand opportunities for student practice, reinforcement, and progress tracking outside of regularly scheduled tutoring sessions.
- AI can automate administrative tasks, including session notes, usage metrics, and engagement tracking, so tutors maximize direct instructional time.
- AI can evaluate performance data to regroup students by current skill needs while keeping each student with the same tutor.
Consistent, Well-Trained Tutors
Consistent pairings in 1:1 and small-group formats deepen student-tutor relationships, which is often a precursor to learning. High-impact tutoring increased student attendance in D.C. schools (opens in new tab), with students 7% less likely to be absent on days when they had a scheduled tutoring session. Tutoring programs that prioritize consistent tutor-student pairings with the intent of developing a positive relationship-based experience may produce improved attendance, motivation, and learning outcomes. AI can be used as a tutor support tool by providing well-timed and responsive recommendations to tutors during virtual tutoring sessions. Research shows that students whose instructors used the system were four percentage points more likely to master lesson topics, a benefit that increased to nine percentage points for the students of lower-rated tutors (opens in new tab).
Supporting Tutor Efficacy With AI
- AI can provide real-time feedback and suggestions on key interaction metrics, including tutor talk time, instructional moves, participation equity, and behavior management.
- AI can scaffold student practice through adaptive hints, guiding questions, and step-by-step reasoning support under the direct oversight of a human tutor.
- AI can support novice tutors by generating real-time session scripts and instructional scaffolds to boost pedagogical confidence and consistency.
- AI can enhance tutor training and professional development through realistic practice simulations that allow tutors to hone their instructional techniques before leading live sessions.
Data-Driven Instruction
Our hope is actually to free up the human beings in the loop to spend more time on the human connection side of things.
-AI-led instructional tool developer
The use of data to improve organizational outcomes, guide instruction, and measure student progress is well-researched (opens in new tab) in education. Effective tutoring programs use data to increase their program effectiveness and adjust the program to be responsive to student needs and outcomes (opens in new tab). Analyzing student-level progress data and system-level organizational metrics can drive continuous improvement in programs. AI has the opportunity to alleviate human constraints around data capture and synthesis, provided educators and program leaders act on the resulting insights and data privacy is protected (opens in new tab).
Informing Instruction and Systems with AI Insights
- AI can scale real-time analysis across operational data and logistics, such as attendance, scheduling, and dosage, as well as student performance metrics.
- AI can analyze multi-source data to rapidly identify students in need of additional academic support.
- AI can synthesize performance data to generate real-time insights on skill mastery, progress monitoring, and specific student misconceptions.
- AI can summarize performance trends and generate actionable, data-informed recommendations for subsequent sessions.
Instructional Materials
Effective tutoring sessions use high-quality instructional materials that align with grade-level (opens in new tab) classroom instruction and focus on skills and concepts most critical to accessing the upcoming content (opens in new tab). Effective tutoring programs prioritize consistency between tutoring content coverage and assessment (opens in new tab), integrate with existing data systems, and align with district and state standards and curricula. Interviews surfaced a need for AI-generated materials to be structured within existing curricula and vetted by humans before they are used with students.
Supporting High-Quality Instructional Materials with AI
- AI can support curriculum alignment by confirming tutoring lessons strictly correspond with district and state standards, pacing guides, and High-Quality Instructional Materials (HQIM).
- AI can personalize learning by generating targeted student practice materials, while maintaining quality control through required human review before implementation.
- AI can audit structured curricula to identify opportunities for culturally relevant examples, inclusive content, and language accessibility features for diverse and multilingual learners.
Strong Student-Tutor Relationships
You’re not necessarily replicating that experience [of tutoring with humans]. I think it’s a mistake to try and—you know, an AI is not human. You should focus on the strengths of it [AI].
-Human-led tutoring provider developing AI-led delivery
Research on youth mentoring (opens in new tab), student-educator matching (opens in new tab), and attendance (opens in new tab) suggests a strong student-tutor relationship as an essential contributor to engagement and improved outcomes in high-impact tutoring. To date, AI does not replicate human relationships. Most AI tutoring developers interviewed describe the goal as applying specific AI strengths rather than replacing human relationships.
Enabling Strong Student-Tutor Relationships With AI Assistance
- AI can support student motivation and social connection by delivering personalized, adaptive learning paths while human tutors provide essential social-emotional support, troubleshooting, and redirection.
- AI can facilitate real-time, multilingual communication and translation between educators and families.
- AI can track student interests, hobbies, and personal goals across sessions to support meaningful, personalized interactions.
- AI can analyze session transcripts to provide targeted feedback to tutors and teachers on safety, cultural responsiveness, and growth-mindset messaging.
- AI implementation can incorporate staged human-review and decision points before, during, and after sessions, supporting safety, relational quality, and instructional alignment. Essential Guardrail: Student Data Privacy Effective AI implementation relies on strict student data privacy safeguards. Secure deployment requires enterprise-grade AI platforms with formal data protection agreements alongside comprehensive tutor training on personally identifiable information (PII) protection. Existing NSSA data privacy guidance (opens in new tab) outlines the platform requirements and training components district and state leaders verify before deployment.
Conclusion
AI offers a pathway to extend the reach of high-impact tutoring by expanding access, lowering costs, and improving personalization. Technology alone cannot replace the foundational student-tutor relationship driving learning gains. When integrated with specific pedagogical structures, AI can expand the capacity of human-based tutoringby improving tutor effectiveness and minimizing the operational complexity of high-impact tutoring. AI also supports personalized instruction, increasing opportunities for student practice, streamlining operations, and reducing cost. The research at this time supports using AI tools to enhance tutor effectiveness and educator capacity within high-impact tutoring.
I don’t think it’s a thing to be rushed. AI is exploding everywhere, but I think this is one where being thoughtful and taking our time to do it the right way is going to be the right answer.
-Badged Tutoring Provider
Acknowledgements
This brief reflects the contributions of researchers, educators, and tutoring providers who shared their time and expertise on how AI-enabled models intersect with high-impact tutoring principles. NSSA extends its gratitude to each of them.
Primary writers and editors
- Chayne Turano, SCALE Initiative at Stanford University
- Valeria Pihl, SCALE Initiative at Stanford University
- Chris Agnew, SCALE Initiative at Stanford University
- Lauren Ziegler, SCALE Initiative at Stanford University
- Susanna Loeb, SCALE Initiative at Stanford University
With thanks to the following individuals and organizations
We thank the individuals and organizations below, who contributed through interviews, peer review, or shared resources.
- Sawyer Altman, Goblins
- Josh Atir, Paper
- Kathy Bendheim, SCALE Initiative at Stanford University
- John Calvello, Tutor.com
- Audrey Fan, SCALE Initiative at Stanford University
- Bibi Groot, Eedi
- Tom Hooper, ThirdSpace Learning
- Jon Laven, Snorkl
- Arathi Padmanabhan, EduRaptor
- Carly Robinson, SCALE Initiative at Stanford University
- Amy Stuber, Paper
- Martina Tam, Paper
- Maurice Telesford, NSSA Educator Tutoring Advisory Group Member
Participation in an interview or review does not imply endorsement of this brief’s findings, nor does inclusion here imply NSSA endorsement of any product or organization.
Badged Tutoring Providers refers to Tutoring Providers that have earned the Tutoring Program Design Badge (opens in new tab) by submitting evidence that their program design adheres to high-impact tutoring standards.
Direct answer: The provided SCALE brief confirms the core evidence hierarchy — relational intensity is the organizing axis, human-led high-impact tutoring rests on a robust evidence base, and AI-led models taper to unknown effectiveness — but it does not mention any guardrailed versus unrestricted GPT-4 experiment, so that portion of the objective cannot be verified from this bundle.
Findings
- Relational intensity is the hierarchy axis: The brief defines AI tutoring models by 'relational intensity,' the depth and consistency of the human connection between student and tutor, ranging from human-led models with close, sustained relationships to AI-led models with minimal or no human interaction. It states that as direct human relationships decrease, the evidence base becomes thinner, leaving unresolved questions about student safety, developmental impact, and long-term efficacy.
- Evidence map: Models are classified as Green (high-intensity human instruction with strong research support), Yellow (emerging AI-assisted models dependent on implementation quality), and Red (fully automated AI models with significant evidence gaps).
- Human-led high-impact tutoring evidence base: High-impact tutoring remains defined by live human-led instruction, with current research supporting AI tools that enhance tutor effectiveness and educator capacity rather than serving as a replacement. It is 'one of the best-evidenced interventions in K-12 education.' In-person or remote tutoring with a live tutor is described as having a robust evidence base and being highly effective, with stronger evidence for in-person tutoring while virtual tutoring also shows meaningful positive effects in high-quality studies. Consistent tutoring with the same tutor is linked to improved engagement, attendance, motivation, and learning outcomes. School-day tutoring at the appropriate dosage (three or more sessions weekly, 90 minutes total, for at least 10 weeks) produces effects roughly twice as large as out-of-school programs.
- Human-led with AI support: This model has an emergent research base and is 'potentially as effective as, or more effective than, in-person and remote tutoring.'
- AI-led models: AI-led tutoring software, even learning-sciences-based, offers potential for supplemental practice but does not yet meet the established evidence base or definition of high-impact tutoring. AI tutoring with human support is rated 'Emergent evidence; early research indicates implementation determines effectiveness on student outcomes'; AI-only tutoring is rated 'Emergent evidence; unknown effectiveness.' In two-district RCTs, 40% to 47% of students never used the AI platform, and those who logged on used it only four to five weeks total, averaging two to five minutes per week. Adding human check-ins improved engagement but usage still fell short of the dosage associated with learning gains, and reading achievement did not improve. Human oversight improves engagement and keeps instruction aligned, but does not by itself get students to the dosage that produces gains.
- Guardrailed versus unrestricted GPT-4 experiment — not found: No GPT-4 experiment, guardrailed or unrestricted, appears anywhere in the bundled text (full bundle ). Guardrails are mentioned only generally: safe implementation requires evaluating 'data privacy safeguards, student safety guardrails, and the depth of unmonitored interaction,' and general-purpose tools can be adapted for education through 'prompt engineering and custom guardrails.' This component of the objective remains a gap.

