← Research
Submitted · Teaching in Higher Education

Measuring Teaching Efficacy Through Comprehension Delta: Large Language Models as Standardized Learner Proxies

· Rohith Namboothiri · Teaching in Higher Education
Read full paper

Abstract

We propose using language models as standardized learner proxies to measure teaching efficacy along a 'comprehension delta', the change in a calibrated proxy's understanding before and after a lesson.

Venue
Teaching in Higher Education
DOI
10.36227/techrxiv.177280963.36808775/v1

Measuring teaching is hard because learners are not standardized. We propose using calibrated LLM proxies, themselves benchmarked against human cohorts, as a stable instrument for measuring the comprehension delta induced by a lesson.

Drawn from a decade of running an educator-centric platform, the paper proposes a methodology for evaluating teaching efficacy through before-and-after comprehension shifts in standardized learner proxies.

Submitted to Teaching in Higher Education and currently under peer review.

Keywords

EdTechEvaluationLLM proxyTeachingMeasurement