TutorMoments: Do AI tutors know when to help and when to hold back?

The TutorMoments project, supported by the Gates Foundation and Learning Commons, investigates whether AI tutors can discern when to offer help and when to refrain. Research indicates that human tutors, while a naturalistic reference, are not a ceiling for AI performance; their scores for appropriate scaffolding (0.458), rigor (0.182), and avoiding over-scaffolding (0.496) are often below AI models' evaluation-aware scores. The dataset focuses on missed opportunities in human tutoring rather than ideal practices.