Measuring the success of scaleable open online courses
| Published | November 2014 |
| Journal | Performance Measurement and Metrics Volume 15, Issue 3, Pages 145 - 162 |
| Publisher | Emerald Group Publishing Limited |
ABSTRACT
Purpose– The purpose of this paper is to propose measures of online open course success for non-commercial institutional providers of massive open online courses (MOOCs) and other scaleable open online courses (SOOCs).
Design/methodology/approach
– The measures are derived from the characteristics of open online courses, existing knowledge about open online course providers and users and their motivations, and current practice in MOOC evaluation and data analytics.
Findings
– Current practices for evaluation of open online courses are dominated by MOOC analytics which provide insights into user demographics and behaviour with some implications for evaluation of reach and course design but leaving many unknowns. Measures for evaluation of success at the institutional level can be derived from institutional goals for open online courses. Success from the point of view of teachers and technical teams involved in design, development and delivery of open online courses can be derived from team members’ expectations, resources and satisfaction as well as measures of cost and effort compared to budget and benchmarks. Users are classified as registrants (information seekers, window shoppers, samplers), downloaders and participants (starters, partial participants and full participants who are further divided into auditing, active and certificate takers); different measures are appropriate for each group.
Practical implications
– Practitioners and researchers must consider a variety of levels and indicators of success to adequately evaluate open online courses. Tables in the text propose measures, methods, timing and roles.
Originality/value
– This is the first published paper to take a holistic view of open online course evaluation and propose detailed measures.
| Keywords | e-learning · evaluation · MOOC · open online courses · SOOCs · success measures |
| ISSN | 1467-8047 |
| Refereed | Yes |
| DOI | 10.1108/PMM-10-2014-0036 |
| Other information | Performance Measurement Metric |
| Export options | BibTex · EndNote · Tagged XML · Google Scholar |
AVAILABLE FILES
Viewed by 234 distinct readers
CLOUD COMMUNITY REVIEWS
The evaluations below represent the judgements of our readers and do not necessarily reflect the opinions of the Cloud editors.
Click a star to be the first to rate this document
▶ POST A COMMENT
SIMILAR RECORDS
The Open Learning Initiative: Measuring the effectiveness of the OLI statistics course in accelerating student learning
Lovett, Marsha; Meyer, Oded; Thille, Candace
The Open Learning Initiative (OLI) is an open educational resources project at Carnegie Mellon University that began in 2002 with a grant from The William and Flora Hewlett Foundation. OLI creates web-based courses that ...
Match: measuring; evaluation
Measuring the degree of innovation in education through the implementation of an indicator based on analyzing MOOC-related activities
Alvarez-Rodríguez, Jose María; de Amescua, Antonio; García-Guzman, Javier; Sánchez-Segura, Maribel; et al.
Nowadays, the digital transformation is affecting any task, activity, process that is done in any organization or even in our daily life activities. The education sector, considered as one of the leading sectors in ...
Match: measuring; mooc
Cloud learning activities orchestration for MOOC environments
Hernández, Rocael; Gütl, Christian; Amado-Salvatierra, Hector R.; Uden, Lorna; et al.
In this paper we focus on an approach to using cloud-based (Web 2.0) tools for MOOCs applying a new version of an innovative architecture for `cloud learning activities orchestration' (CLAO). This works presents the ...
Match: e-learning; mooc
MOOC, OER e l’approccio “flipped classroom”: due case study di transizione in ambito scolastico e aziendale
Sancassani, Susanna; Casiraghi, Daniela; Corti, Paola; Trentinaglia, Nicoletta
La portata innovativa dei MOOC non esaurisce la sua rilevanza nell’ambito dei processi di apprendimento che si svolgono in rete. Uno dei principali obiettivi che ha mosso grandi università quali Stanford o MIT ad ...
Match: e-learning; mooc
MOOCs: A viable business model?
Epelboin, Yves; Jemni, Mohamed; Kinshuk; Khribi, Mohamed Koutheair
MOOCs are complex and expensive objects, which, contrary to ordinary courses, require a full team, to be created. There is a large gap between building and delivering a few MOOCs and systematically transforming a ...
Match: e-learning; mooc
MOOC for capacity building in Indian agriculture
Balaji, Venkataraman; Sodhi, Balwinder; Prabhakar, T V
Presentation slides of the National Academy of Agricultural Sciences Brainstorming Session in partnership with COL, New Delhi, India, 5 March 2014. By Venkataraman Balaji, Commonwealth of Learning, co-written with ...
Match: evaluation; mooc
Co-regulation in technology enhanced learning environments
Kaplan, Jonathan; Uden, Lorna; Sinclair, Jane; Tao, Yu-Hui; Liberona, Dario
This paper discusses the importance of strategy use in regulating cognitive processes, with a particular interest in co-regulation of the learning by peers in technology enhanced learning environments. Research on ...
Match: e-learning; mooc
Gli Open Educational Path: per una accezione epistemologica di “apertura”
Calvani, Antonio; Menichetti, Laura
L’e-learning universitario ha visto affermarsi nuovi orientamenti all’insegna di una filosofia di “apertura” (openness) intesa come libero accesso e/o gratuità: i MOOC ne sono l’esempio più noto. È questa ...
Match: e-learning; mooc
Presentation to UNCTAD's advisory group on "Developing skills, knowledge and capacities through innovation: E-Learning, M-Learning, cloud-Learning"
Downes, Stephen
Match: e-learning; mooc
E-learning, online education and open education: A contribution to a theoretical approach
Aires, Luisa
PORTUGUESE LANGUAGE ATTACHMENT ONLY
Resumo
O presente artigo resulta das reflexões desenvolvidas no âmbito do Observatório da Qualidade do Ensino a Distância e e-Learning sediado na Universidade Aberta e, ainda, da ...
Match: e-learning; mooc
