How video production affects student engagement: an empirical study of MOOC videos
Published | March 2014 |
Conference | L@S '14: Proceedings of the first ACM conference on Learning @ scale conference Pages 41-50 |
Country | United States, North America |
ABSTRACT
Videos are a widely-used kind of resource for online learning. This paper presents an empirical study of how video production decisions affect student engagement in online educational videos. To our knowledge, ours is the largest-scale study of video engagement to date, using data from 6.9 million video watching sessions across four courses on the edX MOOC platform. We measure engagement by how long students are watching each video, and whether they attempt to answer post-video assessment problems.Our main findings are that shorter videos are much more engaging, that informal talking-head videos are more engaging, that Khan-style tablet drawings are more engaging, that even high-quality pre-recorded classroom lectures might not make for engaging online videos, and that students engage differently with lecture and tutorial videos.
Based upon these quantitative findings and qualitative insights from interviews with edX staff, we developed a set of recommendations to help instructors and video producers take better advantage of the online video format. Finally, to enable researchers to reproduce and build upon our findings, we have made our anonymized video watching data set and analysis scripts public. To our knowledge, ours is one of the first public data sets on MOOC resource usage.
Keywords | information systems · information systems applications · multimedia information systems |
Language | English |
Refereed | Yes |
DOI | 10.1145/2556325.2566239 |
Export options | BibTex · EndNote · Tagged XML · Google Scholar |
Viewed by 297 distinct readers
CLOUD COMMUNITY REVIEWS
The evaluations below represent the judgements of our readers and do not necessarily reflect the opinions of the Cloud editors.










Click a star to be the first to rate this document
▶ POST A COMMENT
SIMILAR RECORDS
Great news! OER courses can boost engagement
Ascione, Laura
A two-year study reveals that instructors found OER materials helped them make positive changes to their teaching
Match: engagement; united states; north america
Analysis of the impact of social feedback on written production and student engagement in language Moocs
Ventura, Patricia; Bárcena, Elena; Martín-Monje, Elena
This paper explores the challenges of receiving feedback in a language MOOC and proposes a model for social feedback that aims to develop students’ foreign language written skills. The experience of the first edition ...
Match: production; engagement
The Impact of Adopting OER Videos as Supplementary Resources on Student Scores and Engagement
Albalawi, Awad
Open educational resources (OER) have gained immense popularity in recent years, due to their ability to offer students and educators access to high-quality, free-to-use educational materials. The widespread use of OER ...
Match: engagement; united states; north america
Student engagement in massive open online courses
Sinclair, Jane; Kalvala, Sara
Completion rates in massive open online courses (MOOCs) are disturbingly low. Existing analysis has focused on patterns of resource access and prediction of drop-out using learning analytics. In contrast, the ...
Match: engagement; united states; north america
MOOC teaching assistants’ global-engaged learning in the US and China
Li, Yue; Armstrong, Anne; Krasny, Marianne
How can we create a “global-at-home” learning experience for university students to engage them in serving global professional communities online? This study applied global engagement surveys alongside interviews ...
Match: united states; north america
Deconstructing disengagement: analyzing learner subpopulations in massive open online courses
Kizilcec, René F.; Piech, Chris; Schneider, Emily
As MOOCs grow in popularity, the relatively low completion rates of learners has been a central criticism. This focus on completion rates, however, reflects a monolithic view of disengagement that does not allow MOOC ...
Match: engagement; united states; north america
Gamification of MOOCs for increasing user engagement
Vaibhav, Anant; Gupta, Pooja
As the educational organizations worldwide are moving towards bringing education experience on Internet, via Massive Open Online Courses (MOOCs) on Massive Open Online Education Platforms (MOOEPs), the retention of the ...
Match: engagement
Understanding Chinese-speaking open courseware users: A case study on user engagement in an open courseware portal in Taiwan (Opensource Opencourse Prototype System)
Huang, Wen-Hao David; Lin, Meng-Fen Grace; Shen, Wendi
The open educational resource (OER) movement has reached a critical mass due to recent technology advancements. In Taiwan, to overcome the language barrier, the Opensource Opencourse Prototype System (OOPS) plays a ...
Match: engagement
Analysis of existing technological platforms for the collaborative production of Open Textbooks
Ochoa, Xavier; Carrillo, Gladys; Casali, Ana; Deco, Claudia; et al.
The production of high-quality open textbooks requires the collaboration of different contributors. This work conducts a comparative analysis of the six different collaborative platforms for the production of books. To ...
Match: production
Recommendations on Formative Assessment and Feedback Practices for stronger engagement in MOOCs
Floratos, Nikolaos; Guasch, Teresa; Espasa, Anna; Gil-Jaurena, Inés
Many publications and surveys refer to the high drop out rate in Massive Open Online Courses (MOOCs) which is around 90%, especially if we compare the number of students who register against those who finish. Working ...
Match: engagement