The OER Knowledge Cloud makes use of cookies. By continuing, you consent to this use. More information.
Evaluating the validity and applicability of automated essay scoring in two massive open online courses
Reilly, Erin · Stafford, Rose · Williams, Kyle · Corliss, Stephanie

PublishedNovember 2014
Type of workSpecial Issue: Research into Massive Open Online Courses
JournalThe International Review of Research in Open and Distributed Learning
Volume 15, Issue 5, Pages 83-98
Original PublicationThe International Review of Research in Open and Distance Learning
EditorsMcGreal, Rory and Conrad, Dianne

ABSTRACT
The use of massive open online courses (MOOCs) to expand students’ access to higher education has raised questions regarding the extent to which this course model can provide and assess authentic, higher level student learning. In response to this need, MOOC platforms have begun utilizing automated essay scoring (AES) systems that allow students to engage in critical writing and free-response activities. However, there is a lack of research investigating the validity of such systems in MOOCs. This research examined the effectiveness of an AES tool to score writing assignments in two MOOCs. Results indicated that some significant differences existed between Instructor grading, AES-Holistic scores, and AES-Rubric Total scores within two MOOC courses. However, use of the AES system may still be useful given instructors’ assessment needs and intent. Findings from this research have implications for instructional technology administrators, educational designers, and instructors implementing AES learning activities in MOOC courses.

Keywords assessment · automated essay scoring systems · MOOC

ISSN1492-3831
Other number5
RefereedYes
Rightsby/4.0
URLhttp://www.irrodl.org/index.php/irrodl/article/view/1857
Other informationIRRODL
Export optionsBibTex · EndNote · Tagged XML · Google Scholar



AVAILABLE FILES
1857-15542-1-PB.pdf · 230.6KB7 downloads



Viewed by 22 distinct readers




CLOUD COMMUNITY REVIEWS

The evaluations below represent the judgements of our readers and do not necessarily reflect the opinions of the Cloud editors.

Click a star to be the first to rate this document


POST A COMMENT
SIMILAR RECORDS

Global times call for global measures: Investigating automated essay scoring in linguistically-diverse MOOCs
Reilly, Erin; Wiliams, Kyle; Stafford, Rose; Corliss, Stephanie; et al.
This paper utilizes a case-study design to discuss global aspects of massive open online course (MOOC) assessment. Drawing from the literature on open-course models and linguistic gatekeeping in education, we position ...
Match: Reilly, Erin; Stafford, Rose; Corliss, Stephanie; assessment

Brief report on Open Praxis figures and data (2017)
Inés Gil-Jaurena
In the first Open Praxis issue in 2018 we briefly report on some statistics and information about Open Praxis development. The report covers the period January 2013 - December 2017, with a special focus in volume 9, ...
Match: assessment; MOOC

Architecture of a MOOC: Assessment
Prabhakar, T V
Week 2: Architecture of a MOOC, module 4 of the MOOC on MOOC course offered by the Indian Institute of Technology Kanpur (IITK) & Commonwealth of Learning (COL) in September 2014. This resource contains a video link, ...
Match: assessment; MOOC

Presentation to UNCTAD's advisory group on "Developing skills, knowledge and capacities through innovation: E-Learning, M-Learning, cloud-Learning"
Downes, Stephen
Match: assessment; MOOC

Assessment in Massive Open Online Courses
Admiraal, Wilfried; Pilli, Olga; Huisman, Bart
Open online distance learning in higher education has quickly gained popularity, expanded, and evolved, with Massive Open Online Courses (MOOCs) as the most recent development. New web technologies allow for scalable ...
Match: assessment; MOOC

Development of OERs through international collaboration E-QUAL case study
Gupta, Parul
Development of Open Education Resources (OER) is similar to product development and it requires due attention to get the final product. Generally, the focus is laid on the final product and not on the process. However, ...
Match: assessment; MOOC

Developing a strategic approach to MOOCs
Ferguson, Rebecca; Scanlon, Eileen; Harris, Lisa
During the last eight years, interest in massive open online courses (MOOCs) has grown fast and continuously worldwide. Universities that had never engaged with open or online learning have begun to run courses in these ...
Match: assessment; MOOC

MOOCs in Europe: Overview of papers representing a collective European response on MOOCs as presented during the HOME conference in Rome November 2015
Bang, Joergen; Dalsgaard, Christian; Kjaer, Arne; O’Donovan, Maria; et al.
Table of contents Foreword Part 1: Regional MOOC initiatives Building OOC layers on top of existing courses (M)OOCs in Iceland: Language and learning communities EduOpen network in Italy Part 2: Role media ...
Match: assessment; MOOC

MOOCs - A review of the state-of-the-art
Yousef, Ahmed Mohamed Fahmy; Chatti, Mohamed Amine; Schroeder, Ulrik; Wosnitza, Marold; Jakobs, Harald
Massive open online courses (MOOCs) have drastically changed the way we learn as well as how we teach. The main aim of MOOCs is to provide new opportunities to a massive number of learners to attend free online courses ...
Match: assessment; MOOC

Is peer review an appropriate form of assessment in a MOOC? Student participation and performance in formative peer review
Meek, Sarah E.M.; Blakemore, Louise; Marks, Leah
Many aspects of higher education must be reconceptualised for massive open online courses (MOOCs). Formative and summative assessment of qualitative work in particular requires novel approaches to cope with the numbers ...
Match: assessment