The OER Knowledge Cloud makes use of cookies. By continuing, you consent to this use. More information.
Peer grading in a MOOC: Reliability, validity, and perceived effects
Luo, Heng · Robinson, Anthony · Park, Jae-Young

PublishedJuly 2014
JournalOnline Learning
Volume 18, Issue 2, Pages 1-14

ABSTRACT
Peer grading affords a scalable and sustainable way of providing assessment and feedback to a massive student population, and has been used in massive open online courses (MOOCs) on the Coursera platform. However, currently there is little empirical evidence to support the credentials of peer grading as a learning assessment method in the MOOC context. To address this research need, this study examined 1825 peer grading assignments collected from a Coursera MOOC with the purpose of investigating the reliability and validity of peer grading as well as its perceived effects on students’ MOOC learning experience. The empirical findings proved that the aggregate ratings of student graders can provide peer grading scores that were fairly consistent and highly similar to the instructor grading scores. Student responses to a survey also show that the peer grading activity was well received as the majority of MOOC students believed it was fair, useful, beneficial, and would recommend it to be included in future MOOC offerings. Based on the empirical results, this study concludes with a set of principles for designing and implementing peer grading activities in the MOOC context.

Keywords MOOC research · MOOCs · peer grading · reliability · validity

ISSN2472-5730
Other number2
RefereedYes
RightsOpen Access Policy This journal provides immediate open access to its content on the principle that making research freely available to the public supports a greater global exchange of knowledge.
DOI10.24059/olj.v18i2.429
URLhttps://olj.onlinelearningconsortium.org/index.php/olj/article/view/429
Export optionsBibTex · EndNote · Tagged XML · Google Scholar



AVAILABLE FILES
429-2333-1-PB.pdf · 316.4KB9 downloads



Viewed by 39 distinct readers




CLOUD COMMUNITY REVIEWS

The evaluations below represent the judgements of our readers and do not necessarily reflect the opinions of the Cloud editors.

Click a star to be the first to rate this document


POST A COMMENT
SIMILAR RECORDS

How MOOC instructors view the pedagogy and purposes of massive open online courses
Evans, Suzannah; Myrick, Jessica Gall
Massive open online courses (MOOCs) have proliferated in recent years despite disagreement about the role of MOOCs in higher education and whether student outcomes are satisfactory. Taking a mixed-methods approach, the ...
Match: MOOC research; MOOCs

Enhancing the student experience: integrating MOOCs into campus based modules
Fair, Nicholas; Harris, Lisa; León-Urrutia, Manuel
Massive Open Online Courses (MOOCs) are continuing to expand in Higher Education Institutions (HEIs). According to Class Central, over 1500 courses started in May 2017 alone. In some cases, these courses are becoming ...
Match: MOOC research; MOOCs

Comparing institutional MOOC strategies 2015 country report - Israel: Status report based on a mapping survey conducted in October - December 2015
Kalman, Yoram M.; Jansen, Darco; Goes-Daniels, Miriam; European Association for Distance Teaching Universities; HOME Project
Executive Summary This report details the responses of seven Israeli higher education institutions (HEIs) to survey questions about their MOOC offerings, and compares them to other European HEIs. The surveys show that ...
Match: MOOC research

Open Educational Resources: Access to high-quality education for all
Evertse, Judith
This article deals with what Open Educational Resources (OER actually are, what the benefits are, and what points need to be considered. Open Educational Resources (OER) are learning materials that are freely available ...
Match: reliability

The perceptions of MOOC among learners based on Activity Theory
Goh, Wei Wei; Kaur, Sukhminder; Chion, Zheng Hao Addy; Tang, Siew Fun; Logonnathan, Loshinikarasi
Since Massive Online Open Courses (MOOCs) have started to bloom in education industry, there are many discussions about their design, structure, effectiveness and openness to the community. It is undeniable that MOOCs ...
Match: MOOC research

Output 9 SCORE2020: Evidence based practice for teachers and institutions using MOOCs
SCORE2020
The SCORE2020 project focused on (regional) support structures in the development and delivery of Open Education and especially of MOOCs. In total, thirteen intellectual outputs are ...
Match: MOOC research

Is peer review an appropriate form of assessment in a MOOC? Student participation and performance in formative peer review
Meek, Sarah E.M.; Blakemore, Louise; Marks, Leah
Many aspects of higher education must be reconceptualised for massive open online courses (MOOCs). Formative and summative assessment of qualitative work in particular requires novel approaches to cope with the numbers ...
Match: MOOC research

Output 3. SCORE2020: Evaluation report based on regional events organised by each partner
SCORE2020
The SCORE2020 project focused on (regional) support structures in the development and delivery of Open Education and especially of MOOCs. In total, thirteen intellectual outputs are ...
Match: MOOC research

Output 11 SCORE2020: Scenario’s for support of different target groups
SCORE2020
The SCORE2020 project focused on (regional) support structures in the development and delivery of Open Education and especially of MOOCs. In total, thirteen intellectual outputs are ...
Match: MOOC research

Output 6 SCORE2020 : Train-the-trainer mOOC (micro open online course)
SCORE2020
The SCORE2020 project focused on (regional) support structures in the development and delivery of Open Education and especially of MOOCs. In total, thirteen intellectual outputs are ...
Match: MOOC research