How lessons learned from NAEP 2022 during the COVID-19 pandemic can improve remote online learning

Abstract

Background

This study’s background is situated within the overlap between the 2022 administration of the National Assessment of Educational Progress (NAEP) and the COVID-19 pandemic. This made NAEP 2022 useful as a nationally representative, large-scale dataset of students who coincidentally underwent mass-remote online learning.

Purpose

The purpose of the present study was to utilize a temporally distinct dataset to investigate contextual factors related to remote learning that may inform remote learning more broadly in a post-pandemic world.

Methods

The study’s methods used a conceptual framework of physical and psychological resources and stressors to help select NAEP variables and present findings. A sample of 36,200 students who experienced remote learning was analyzed using hierarchical linear modeling. These procedures were chosen due to the nested structure of NAEP data.

Main finding

One main finding was that computing hardware and physical school supplies were key physical resources (when available) or stressors (when lacking) on student achievement. Another finding was that self-confidence and self-awareness in mathematics knowledge and skills were major psychological resources. Additionally, the study provided evidence about the potential drawback of unfettered, unsupervised internet access while in remote learning environments.

Conclusion

The study concluded on the educational importance of provisioning students with internet access and digital devices for remote learning, as well as, building confidence in remote learning technology.

Implications

Implications were actionable factors to support remote learning, increase remote learning equity, and reduce score gaps of students from economically disadvantaged backgrounds.