Measuring the success of scaleable open online courses
| Published | November 2014 |
| Journal | Performance Measurement and Metrics Volume 15, Issue 3, Pages 145 - 162 |
| Publisher | Emerald Group Publishing Limited |
ABSTRACT
Purpose– The purpose of this paper is to propose measures of online open course success for non-commercial institutional providers of massive open online courses (MOOCs) and other scaleable open online courses (SOOCs).
Design/methodology/approach
– The measures are derived from the characteristics of open online courses, existing knowledge about open online course providers and users and their motivations, and current practice in MOOC evaluation and data analytics.
Findings
– Current practices for evaluation of open online courses are dominated by MOOC analytics which provide insights into user demographics and behaviour with some implications for evaluation of reach and course design but leaving many unknowns. Measures for evaluation of success at the institutional level can be derived from institutional goals for open online courses. Success from the point of view of teachers and technical teams involved in design, development and delivery of open online courses can be derived from team members’ expectations, resources and satisfaction as well as measures of cost and effort compared to budget and benchmarks. Users are classified as registrants (information seekers, window shoppers, samplers), downloaders and participants (starters, partial participants and full participants who are further divided into auditing, active and certificate takers); different measures are appropriate for each group.
Practical implications
– Practitioners and researchers must consider a variety of levels and indicators of success to adequately evaluate open online courses. Tables in the text propose measures, methods, timing and roles.
Originality/value
– This is the first published paper to take a holistic view of open online course evaluation and propose detailed measures.
| Keywords | e-learning · evaluation · MOOC · open online courses · SOOCs · success measures |
| ISSN | 1467-8047 |
| Refereed | Yes |
| DOI | 10.1108/PMM-10-2014-0036 |
| Other information | Performance Measurement Metric |
| Export options | BibTex · EndNote · Tagged XML · Google Scholar |
AVAILABLE FILES
Viewed by 52 distinct readers
CLOUD COMMUNITY REVIEWS
The evaluations below represent the judgements of our readers and do not necessarily reflect the opinions of the Cloud editors.
Click a star to be the first to rate this document
▶ POST A COMMENT
SIMILAR RECORDS
Ascertaining the relevance of Open Educational Resources by integrating various quality indicators
Sanz, Javier; Dodero, Juan Manuel; Sánchez, Salvador
The aim of the open educational resource (OER) development movement is to provide free access to high quality educational materials in repositories. However, having access to a large amount of educational materials does ...
Match: e-learning; evaluation
Connectivism and connective knowledge: Essays on meaning and learning networks
Downes, Stephen
Connectivism is the thesis that knowledge is distributed across a network of connections, and therefore that learning consists of the ability to construct and traverse those networks. The bulk of this work is devoted to ...
Match: e-learning; MOOC
Students’ and instructors’ use of massive open online courses (MOOCs): Motivations and challenges
Hew, Khe Foon; Cheung, Wing Sum
Massive open online courses (MOOCs) are among the latest e-learning initiative to attain widespread popularity among many universities. In this paper, a review of the current published literature focusing on the use of ...
Match: e-learning; MOOC
Effectiveness of integrating MOOCs in traditional classrooms for undergraduate students
Israel, Maria Joseph; Conrad, Dianne; McGreal, Rory
The idea of a Massive Open Online Course (MOOC) has attracted a lot of media attention in the last couple of years. MOOCs have been used mostly as stand-alone online courses without credits. However, some researchers, ...
Match: e-learning; MOOC
Motivating MOOC participants
Mokwa-Tarnowska, Iwona; Gdańska, Politechnika
Over the last four years, massive online open courses (MOOCs) have attracted millions of learners from around the
world. Many factors seem to play an important role in them gaining in popularity. One of them is ...
Match: e-learning; MOOC
Gli Open Educational Path: per una accezione epistemologica di “apertura”
Calvani, Antonio; Menichetti, Laura
L’e-learning universitario ha visto affermarsi nuovi orientamenti all’insegna di una filosofia di “apertura” (openness) intesa come libero accesso e/o gratuità: i MOOC ne sono l’esempio più noto. È questa ...
Match: e-learning; MOOC
The MOOCs: Origin, characterization, principal problems and challenges in Higher Education
Atiaja, Lourdes Atiaja; Proenza, Rey Segundo
MOOCs (Massive Open Online Courses) are an innovation that have attracted public academic attention in recent times, and which have resulted in the evolution of e-learning (electronic learning) and so far have not ...
Match: e-learning; MOOC
Massive open online courses for Africa by Africa
Oyo, Benedict; Kalema, Billy Mathias; Conrad, Dianne; McGreal, Rory
Africa is known for inadequate access to all sorts of human needs including health, education, food, shelter, transport, security, and energy. Before the emergence of massive open online courses (MOOCs), open access to ...
Match: e-learning; MOOC
Gamification: A key determinant of massive open online course (MOOC) success
Aparicio, Manuela; Oliveira, Tiago; Bacao, Fernando; Painho, Marco
Massive open online courses (MOOCs), contribute significantly to individual empowerment because they can help people learn about a wide range of topics. To realize the full potential of MOOCs, we need to understand ...
Match: e-learning; MOOC
Presentation to UNCTAD's advisory group on "Developing skills, knowledge and capacities through innovation: E-Learning, M-Learning, cloud-Learning"
Downes, Stephen
Match: e-learning; MOOC
