A recent mini-study looked at what happened after a subset of schools in Newark, New Jersey adopted Khan Academy as a supplemental math tool. Not only did they see strong usage numbers, but students who used it more frequently saw larger gains, and the gains were particularly large for previously low-performing students.
Across three school years, 13 schools in one part of the district offered Khan Academy as a math supplement to roughly 6,700 students. Of those students, 87% of the students qualified for free- or reduced-price lunch, a proxy measure for income. In the last year of the three-year period, 70% of students met the recommended usage of at least 30 hours per week.
That alone is kind of a big deal. There’s plenty of research suggesting that high-quality apps like Khan Academy are helpful, but only for the kids who actually use them regularly. Laurence Holt dubbed this the “5 percent problem” because so few kids actually engage with the tools enough to see results. So the fact that Newark was able to get 70 percent engagement is quite good.
On average, the Khan Academy supplement helped produce small but noticeably positive gains. The returns were also linear, in the sense that kids who spent more time on the app and completed more lessons learned more. This may sound obvious, but it’s a good reminder that engagement really is the holy grail of learning.
But now look at the right side of the chart above. When the authors sorted the effects of Khan Academy implementation across performance levels the largest effects, by far, were for the lowest-performing students (NJSLA level 1).
This is a hugely important finding given that achievement scores across the country have fallen so dramatically for the lowest-performing students. In other words, schools and districts have tools available to address their biggest challenges. All they need to do is get students to use them.
Chad Aldeman is a nationally recognized expert on education policy, including school finance; teacher preparation, evaluation, and compensation; and state standards, assessment, and accountability.
Khan Academy drives math gains in Newark, NJ
A recent mini-study looked at what happened after a subset of schools in Newark, New Jersey adopted Khan Academy as a supplemental math tool. Not only did they see strong usage numbers, but students who used it more frequently saw larger gains, and the gains were particularly large for previously low-performing students.
Across three school years, 13 schools in one part of the district offered Khan Academy as a math supplement to roughly 6,700 students. Of those students, 87% of the students qualified for free- or reduced-price lunch, a proxy measure for income. In the last year of the three-year period, 70% of students met the recommended usage of at least 30 hours per week.
That alone is kind of a big deal. There’s plenty of research suggesting that high-quality apps like Khan Academy are helpful, but only for the kids who actually use them regularly. Laurence Holt dubbed this the “5 percent problem” because so few kids actually engage with the tools enough to see results. So the fact that Newark was able to get 70 percent engagement is quite good.
On average, the Khan Academy supplement helped produce small but noticeably positive gains. The returns were also linear, in the sense that kids who spent more time on the app and completed more lessons learned more. This may sound obvious, but it’s a good reminder that engagement really is the holy grail of learning.
But now look at the right side of the chart above. When the authors sorted the effects of Khan Academy implementation across performance levels the largest effects, by far, were for the lowest-performing students (NJSLA level 1).
This is a hugely important finding given that achievement scores across the country have fallen so dramatically for the lowest-performing students. In other words, schools and districts have tools available to address their biggest challenges. All they need to do is get students to use them.
Chad Aldeman
Recent posts
A Low-Cost, Highly Effective Math Program
Let the March Mathness Begin
Automatic Enrollment Policies Check All the Boxes
Virginia Pushes to Accelerate Students in Math