The OER Knowledge Cloud makes use of cookies. By continuing, you consent to this use. More information.
An Application of the I-AER Framework to Understand OER Effectiveness at Community Colleges
Pilipshen, Adam G.

Published16 April 2026
Type of workDissertation
PeriodicalPages 289
InstitutionUniversity at Buffalo, SUNY
CountryUnited States, North America

ABSTRACT
Higher education institutions face a fundamental disconnect between extensive data collection and actionable understanding of student learning, a practitioner's dilemma perpetuated by fragmented institutional assessment, evaluation, and research functions. This dissertation proposes the Integrated Institutional Assessment, Evaluation, and Research (I-AER) Framework, which reconceptualizes these three functions as complementary modes of inquiry (descriptive, comparative, and explanatory) capable of generating integrated institutional intelligence when aligned around common questions, shared data, and coordinated analysis. To demonstrate the framework's practical value, it was applied to the evaluation of Open Educational Resources (OER) effectiveness within the State University of New York (SUNY) community college system. Using 12,537 course sections across seven high-enrollment general education courses at 25 community colleges from Fall 2018 through Spring 2020, propensity score matching and inverse probability weighting addressed selection bias, with treatment effects estimated through fixed-effects regression with cluster-robust standard errors. Heterogeneous treatment effects analyses examined whether OER impacts varied across instructor, course, and institutional characteristics. OER adoption was associated with statistically significant reductions in average grades (-0.19 grade points) and course completion rates (approximately -4 percentage points), with effects concentrated in face-to-face instruction. No measured moderator explained this variation. Exploratory analyses raised equity concerns, with institutions serving higher proportions of underrepresented minority students showing larger negative effects. Together, the three modes validated I-AER as a model for transforming institutional effectiveness from compliance-driven activity into evidence-driven discovery, generating both system-level insight and the localized intelligence practitioners need to act.

Keywords I-AER framework · assessment · evaluation · research · institutional intelligence · OER

Published atBuffalo
LanguageEnglish
RefereedYes
URLhttps://www.proquest.com/openview/243a55c20d9752c507dfc074709a16ff/1
Export optionsBibTex · EndNote · Tagged XML · Google Scholar


Viewed by 7 distinct readers




CLOUD COMMUNITY REVIEWS

The evaluations below represent the judgements of our readers and do not necessarily reflect the opinions of the Cloud editors.

Click a star to be the first to rate this document


POST A COMMENT
SIMILAR RECORDS

The Open Learning Initiative: Measuring the effectiveness of the OLI statistics course in accelerating student learning
Lovett, Marsha; Meyer, Oded; Thille, Candace
The Open Learning Initiative (OLI) is an open educational resources project at Carnegie Mellon University that began in 2002 with a grant from The William and Flora Hewlett Foundation. OLI creates web-based courses that ...
Match: effectiveness; evaluation; research

What impacts do OER have on students? Students share their experiences with a health psychology OER at New York City College of Technology
Cooney, Cailean
This article reports findings from a study conducted with students in three sections of a Health Psychology course that replaced a traditional textbook with open educational resources (OER) as the primary course ...
Match: assessment; evaluation; OER

Effectiveness of OER use in first-year higher education students’ mathematical course performance
Venegas Muggli, Juan Ignacio; Westermann, Werner
This article examines the effect of two Open Educational Resources (OER) - Khan Academy Collection and a teacher-authored open textbook - on mathematical course performance and attendance amongst first-year higher ...
Match: effectiveness; OER

The effectiveness of MOOC among learners based on Kirkpatrick's Model
Goh, Wei Wei; Wong, Seng Yue; Ayub, Enna; Tang, Siew Fun; Cheah, Swi Ee
Massive open online course (MOOCs) are transforming the era of distance learning education in a groundbreaking way that it has attracted a huge amount of attention from the media, education institutions, and education ...
Match: effectiveness

Effectiveness of OER use in first-year higher education students' mathematical course performance: A case study
Westermann Juárez, Werner; Venegas Muggli, Juan Ignacio; Hodgkinson-Williams, Cheryl; Arinto, Patricia B.
This chapter aims to understand the impact of Open Educational Resources (OER) on first-year mathematics students at the Instituto Profesional Providencia (IPP) in Santiago, Chile, where more than half (52%) of ...
Match: effectiveness; OER

Connectivism: Its place in theory-informed research and innovation in technology-enabled learning
Bell, Frances; McGreal, Rory; Conrad, Dianne
The sociotechnical context for learning and education is dynamic and makes great demands on those trying to seize the opportunities presented by emerging technologies. The goal of this paper is to explore certain ...
Match: evaluation; research

Report on the assessment and accreditation of learners using OER
Conrad, Dianne; Mackintosh, Wayne; McGreal, Rory; Murphy, Angela; Witthaus, Gabi
This report shares the findings and lessons learned from an investigation into the economics of disaggregated models for assessing and accrediting informal learners, with particular attention to the OER University ...
Match: assessment; OER

Brief report on Open Praxis figures and data (2017)
Inés Gil-Jaurena
In the first Open Praxis issue in 2018 we briefly report on some statistics and information about Open Praxis development. The report covers the period January 2013 - December 2017, with a special focus in volume 9, ...
Match: assessment; OER

Contribution to the authoring, distribution, evaluation and integration of learning objects
Gordillo Méndez, Aldo; Quemada Vives, Juan; Barra Arias, Enrique
Learning Objects have emerged in recent years in the field of educational technology as a key strategy for creating and delivering digital educational resources. The fundamental idea behind them is that educational ...
Match: research; OER

Lista de comprobación de calidad de un Recurso Educativo Abierto
Alberdi, Lola
Los docentes siempre han compartido sus recursos e ideas con los colegas de profesión, bien en forma de sencillos consejos y comentarios en la sala de profesores, compartiendo materiales educativos de referencia o ...
Match: evaluation; OER