The OER Knowledge Cloud makes use of cookies. By continuing, you consent to this use. More information.
Measuring the success of scaleable open online courses
Klobas, Jane E.

PublishedNovember 2014
JournalPerformance Measurement and Metrics
Volume 15, Issue 3, Pages 145 - 162
PublisherEmerald Group Publishing Limited

ABSTRACT
Purpose
– The purpose of this paper is to propose measures of online open course success for non-commercial institutional providers of massive open online courses (MOOCs) and other scaleable open online courses (SOOCs).

Design/methodology/approach
– The measures are derived from the characteristics of open online courses, existing knowledge about open online course providers and users and their motivations, and current practice in MOOC evaluation and data analytics.

Findings
– Current practices for evaluation of open online courses are dominated by MOOC analytics which provide insights into user demographics and behaviour with some implications for evaluation of reach and course design but leaving many unknowns. Measures for evaluation of success at the institutional level can be derived from institutional goals for open online courses. Success from the point of view of teachers and technical teams involved in design, development and delivery of open online courses can be derived from team members’ expectations, resources and satisfaction as well as measures of cost and effort compared to budget and benchmarks. Users are classified as registrants (information seekers, window shoppers, samplers), downloaders and participants (starters, partial participants and full participants who are further divided into auditing, active and certificate takers); different measures are appropriate for each group.

Practical implications
– Practitioners and researchers must consider a variety of levels and indicators of success to adequately evaluate open online courses. Tables in the text propose measures, methods, timing and roles.

Originality/value
– This is the first published paper to take a holistic view of open online course evaluation and propose detailed measures.

Keywords e-learning · evaluation · MOOC · open online courses · SOOCs · success measures

ISSN1467-8047
RefereedYes
DOI10.1108/PMM-10-2014-0036
Other informationPerformance Measurement Metric
Export optionsBibTex · EndNote · Tagged XML · Google Scholar



AVAILABLE FILES
PMM-10-2014-0036.pdf · 262.6KB43 downloads



Viewed by 13 distinct readers




CLOUD COMMUNITY REVIEWS

The evaluations below represent the judgements of our readers and do not necessarily reflect the opinions of the Cloud editors.

Click a star to be the first to rate this document


POST A COMMENT
SIMILAR RECORDS

Connectivism and connective knowledge: Essays on meaning and learning networks
Downes, Stephen
Connectivism is the thesis that knowledge is distributed across a network of connections, and therefore that learning consists of the ability to construct and traverse those networks. The bulk of this work is devoted to ...
Match: e-learning; MOOC

Co-regulation in technology enhanced learning environments
Kaplan, Jonathan; Uden, Lorna; Sinclair, Jane; Tao, Yu-Hui; Liberona, Dario
This paper discusses the importance of strategy use in regulating cognitive processes, with a particular interest in co-regulation of the learning by peers in technology enhanced learning environments. Research on ...
Match: e-learning; MOOC

Cloud learning activities orchestration for MOOC environments
Hernández, Rocael; Gütl, Christian; Amado-Salvatierra, Hector R.; Uden, Lorna; et al.
In this paper we focus on an approach to using cloud-based (Web 2.0) tools for MOOCs applying a new version of an innovative architecture for `cloud learning activities orchestration' (CLAO). This works presents the ...
Match: e-learning; MOOC

Ascertaining the relevance of Open Educational Resources by integrating various quality indicators
Sanz, Javier; Dodero, Juan Manuel; Sánchez, Salvador
The aim of the open educational resource (OER) development movement is to provide free access to high quality educational materials in repositories. However, having access to a large amount of educational materials does ...
Match: e-learning; evaluation

Effectiveness of integrating MOOCs in traditional classrooms for undergraduate students
Israel, Maria Joseph; Conrad, Dianne; McGreal, Rory
The idea of a Massive Open Online Course (MOOC) has attracted a lot of media attention in the last couple of years. MOOCs have been used mostly as stand-alone online courses without credits. However, some researchers, ...
Match: e-learning; MOOC

Massive open online courses for Africa by Africa
Oyo, Benedict; Kalema, Billy Mathias; Conrad, Dianne; McGreal, Rory
Africa is known for inadequate access to all sorts of human needs including health, education, food, shelter, transport, security, and energy. Before the emergence of massive open online courses (MOOCs), open access to ...
Match: e-learning; MOOC

E-learning, online education and open education: A contribution to a theoretical approach
Aires, Luisa
PORTUGUESE LANGUAGE ATTACHMENT ONLY Resumo O presente artigo resulta das reflexões desenvolvidas no âmbito do Observatório da Qualidade do Ensino a Distância e e-Learning sediado na Universidade Aberta e, ainda, da ...
Match: e-learning; MOOC

MOOC, OER e l’approccio “flipped classroom”: due case study di transizione in ambito scolastico e aziendale
Sancassani, Susanna; Casiraghi, Daniela; Corti, Paola; Trentinaglia, Nicoletta
La portata innovativa dei MOOC non esaurisce la sua rilevanza nell’ambito dei processi di apprendimento che si svolgono in rete. Uno dei principali obiettivi che ha mosso grandi università quali Stanford o MIT ad ...
Match: e-learning; MOOC

MOOCs: A learning journey
Smith, Becky; Eng, Min; Cheung, Simon K. S.; Fong, Joseph; et al.
MOOCs (Massive Open Online Courses) have been radically changing the direction of online education in the last few years. Although sharing many common features, there has been an emergence of two distinct varieties of ...
Match: e-learning; MOOC

Starting MOOCs in African university: The experience of Cadi Ayyad University, process, review, recommendations, and prospects
Jouicha, Abdellah Idrissi; Berrada, Khalid; Bendaoud, Rachid; Machwate, Said; et al.
The increasing number of enlistees claiming their right to enroll in the programs of African Universities and the limited number of Higher Education Institutions (HEIs) were the prime reasons of students overcrowding in ...
Match: e-learning; MOOC