Meaningful learner information for MOOC instructors examined through a contextualized evaluation framework
Published | February 2019 |
Journal | The International Review of Research in Open and Distributed Learning Volume 20, Issue 1, Pages 204-220 |
Country | United States, North America |
ABSTRACT
Improving STEM MOOC evaluation requires an understanding of the current state of STEM MOOC evaluation, as perceived by all stakeholders. To this end, we investigated what kinds of information STEM MOOC instructors currently use to evaluate their courses and what kinds of information they feel would be valuable for that purpose. We conducted semi-structured interviews with 14 faculty members from a variety of fields and research institutions who had taught STEM MOOCs on edX, Coursera, or Udacity. Four major themes emerged related to instructors' desires: (1) to informally assess learners as an instructor might in a traditional classroom, (2) to assess learners’ attainment of personal learning goals, (3) to obtain in-depth qualitative feedback from learners, and (4) to access more detailed learner analytics regarding the use of course materials. These four themes contribute to a broader sentiment expressed by the instructors that they have access to a wide variety of quantitative data for use in evaluation, but are largely missing the qualitative information that plays a significant role in traditional evaluation. Finally, we provide our recommendations for MOOC evaluation criteria, based on these findings.Keywords | evaluation · MOOC instructor · MOOCs · STEM |
ISSN | 1492-3831 |
Refereed | Yes |
Rights | Attribution 4.0 International (CC BY 4.0) |
DOI | 10.19173/irrodl.v20i1.3717 |
URL | http://www.irrodl.org/index.php/irrodl/article/view/3717 |
Export options | BibTex · EndNote · Tagged XML · Google Scholar |
AVAILABLE FILES
Viewed by 83 distinct readers
CLOUD COMMUNITY REVIEWS
The evaluations below represent the judgements of our readers and do not necessarily reflect the opinions of the Cloud editors.
Click a star to be the first to rate this document
▶ POST A COMMENT
SIMILAR RECORDS
The infrastructure of openness: Results from a multi-institutional survey on OER platforms
Nyland, Rob
The purpose of this study is to understand how higher education institutions are selecting and using technology platforms for the creation and delivery of Open Educational Resources (OER). A survey about OER technology ...
Match: evaluation; United States; North America
The course as container: Distributed learning and the MOOC
Morris, Sean Michael; Stommel, Jesse; Layne, Prudence C.; Lake, Peter
Critics of MOOCs and connected learning environments in general assert that they are too susceptible to neoliberal motivations, that MOOCs propose to replace 1000 local instructors with one famous one, and that the ...
Match: MOOCs; United States; North America
United States: State department expands access to open educational resources in the Middle East and North Africa
Mena Report
The U.S. Department of State is sponsoring a special exchange program on Open Educational Resources (OER) for education leaders in the Middle East and North Africa. Open Educational Resources are ...
Match: United States; North America
Motivating students in massive open online courses (MOOCs) using the attention, relevance, confidence, satisfaction (ARCS) model
Li, Kun; Moore, David Richard
Massive Open Online Courses (MOOCs) often have low persistence rates, which may be attributed to a learners' lack of motivation. In this design-based research study, Keller's Attention, Relevance, Confidence, ...
Match: MOOCs; United States; North America
Free textbooks gain support among campus tech leaders
Wexler, Ellen
COLLEGE TECHNOLOGY officials appear more optimistic these days about open-source textbooks and open educational resources –teaching and learning materials that can be used at no cost. According to the latest ...
Match: United States; North America
A case study of work-based learning through the design of edX MOOCs for Latin America and the Caribbean
Freire, Fabian
This exploratory case study analyzed the reported learning experiences among the multidisciplinary practitioners employed in the development of edX courses for a pioneering MOOC program targeted at Latin America and ...
Match: MOOCs; United States; North America
Teaching Massive, Open, Online, Courses (MOOCs): Tales from the front line
Lowenthal, Patrick; Snelson, Chareen; Perkins, Ross
Very little research has been conducted about what it is like to teach a MOOC. Given this, a mixed methods study, involving a survey of 186 MOOC instructors and 15 follow-up interviews, was conducted to explore the ...
Match: MOOCs; United States; North America
Massive Open Online Course instructor motivations, innovations, and designs: Surveys, interviews, and course reviews
Zhu, Meina; Bonk, Curtis; Sari, Annisa
This mixed methods study explores instructor motivations for offering massive open online courses (MOOCs) as well as the instructional innovations used to enhance the MOOC design. The researchers surveyed 143 MOOC ...
Match: MOOCs; United States; North America
Student engagement in massive open online courses
Sinclair, Jane; Kalvala, Sara
Completion rates in massive open online courses (MOOCs) are disturbingly low. Existing analysis has focused on patterns of resource access and prediction of drop-out using learning analytics. In contrast, the ...
Match: MOOCs; United States; North America
Awareness and usage of MOOCs: The underrepresented experience
Houston, Tyreek
MOOC's (Massive Open Online Courses) allow individuals to expand boundaries, enrolling massive numbers of students with potential quality learning materials and resources that may not otherwise exist in underserved ...
Match: MOOCs; United States; North America