Peer grading in a MOOC: Reliability, validity, and perceived effects
Published | July 2014 |
Journal | Online Learning Volume 18, Issue 2, Pages 1-14 |
ABSTRACT
Peer grading affords a scalable and sustainable way of providing assessment and feedback to a massive student population, and has been used in massive open online courses (MOOCs) on the Coursera platform. However, currently there is little empirical evidence to support the credentials of peer grading as a learning assessment method in the MOOC context. To address this research need, this study examined 1825 peer grading assignments collected from a Coursera MOOC with the purpose of investigating the reliability and validity of peer grading as well as its perceived effects on students’ MOOC learning experience. The empirical findings proved that the aggregate ratings of student graders can provide peer grading scores that were fairly consistent and highly similar to the instructor grading scores. Student responses to a survey also show that the peer grading activity was well received as the majority of MOOC students believed it was fair, useful, beneficial, and would recommend it to be included in future MOOC offerings. Based on the empirical results, this study concludes with a set of principles for designing and implementing peer grading activities in the MOOC context.Keywords | MOOC research · MOOCs · peer grading · reliability · validity |
ISSN | 2472-5730 |
Other number | 2 |
Refereed | Yes |
Rights | Open Access Policy This journal provides immediate open access to its content on the principle that making research freely available to the public supports a greater global exchange of knowledge. |
DOI | 10.24059/olj.v18i2.429 |
URL | https://olj.onlinelearningconsortium.org/index.php/olj/article/view/429 |
Export options | BibTex · EndNote · Tagged XML · Google Scholar |
AVAILABLE FILES
Viewed by 39 distinct readers
CLOUD COMMUNITY REVIEWS
The evaluations below represent the judgements of our readers and do not necessarily reflect the opinions of the Cloud editors.
Click a star to be the first to rate this document
▶ POST A COMMENT
SIMILAR RECORDS
How MOOC instructors view the pedagogy and purposes of massive open online courses
Evans, Suzannah; Myrick, Jessica Gall
Massive open online courses (MOOCs) have proliferated in recent years despite disagreement about the role of MOOCs in higher education and whether student outcomes are satisfactory. Taking a mixed-methods approach, the ...
Match: MOOC research; MOOCs
Enhancing the student experience: integrating MOOCs into campus based modules
Fair, Nicholas; Harris, Lisa; León-Urrutia, Manuel
Massive Open Online Courses (MOOCs) are continuing to expand in Higher Education Institutions (HEIs). According to Class Central, over 1500 courses started in May 2017 alone. In some cases, these courses are becoming ...
Match: MOOC research; MOOCs
Comparing institutional MOOC strategies 2015 country report - Israel: Status report based on a mapping survey conducted in October - December 2015
Kalman, Yoram M.; Jansen, Darco; Goes-Daniels, Miriam; European Association for Distance Teaching Universities; HOME Project
Executive Summary
This report details the responses of seven Israeli higher education institutions (HEIs) to survey questions about their MOOC offerings, and compares them to other European HEIs. The surveys show that ...
Match: MOOC research
Open Educational Resources: Access to high-quality education for all
Evertse, Judith
This article deals with what Open Educational Resources (OER actually are, what the benefits are, and what points need to be considered.
Open Educational Resources (OER) are learning materials that are freely available ...
Match: reliability
The perceptions of MOOC among learners based on Activity Theory
Goh, Wei Wei; Kaur, Sukhminder; Chion, Zheng Hao Addy; Tang, Siew Fun; Logonnathan, Loshinikarasi
Since Massive Online Open Courses (MOOCs) have started to bloom in education industry, there are many discussions about their design, structure, effectiveness and openness to the community. It is undeniable that MOOCs ...
Match: MOOC research
Output 9 SCORE2020: Evidence based practice for teachers and institutions using MOOCs
SCORE2020
The SCORE2020 project focused on (regional) support structures in the development and delivery of Open Education and especially of MOOCs. In total, thirteen intellectual outputs are ...
Match: MOOC research
Is peer review an appropriate form of assessment in a MOOC? Student participation and performance in formative peer review
Meek, Sarah E.M.; Blakemore, Louise; Marks, Leah
Many aspects of higher education must be reconceptualised for massive open online courses (MOOCs). Formative and summative assessment of qualitative work in particular requires novel approaches to cope with the numbers ...
Match: MOOC research
Output 3. SCORE2020: Evaluation report based on regional events organised by each partner
SCORE2020
The SCORE2020 project focused on (regional) support structures in the development and delivery of Open Education and especially of MOOCs. In total, thirteen intellectual outputs are ...
Match: MOOC research
Output 11 SCORE2020: Scenario’s for support of different target groups
SCORE2020
The SCORE2020 project focused on (regional) support structures in the development and delivery of Open Education and especially of MOOCs. In total, thirteen intellectual outputs are ...
Match: MOOC research
Output 6 SCORE2020 : Train-the-trainer mOOC (micro open online course)
SCORE2020
The SCORE2020 project focused on (regional) support structures in the development and delivery of Open Education and especially of MOOCs. In total, thirteen intellectual outputs are ...
Match: MOOC research