AI tutoring works when it is designed right
A randomized controlled trial ran a carefully designed AI physics tutor against active in-class instruction. The students using the guardrailed tutor learned more, and they did it in less time. The gains were large by the standards of education research, in the range of 0.73 to 1.3 standard deviations.
What we built because of it: The whole system is guardrailed on purpose. Claude quizzes you and coaches your thinking. It does not hand you the answer.
Kestin et al. 2025, Scientific Reports (Harvard).
