Towards a comprehensive online peer assessment system: Design outline

Dmytro Babik, Lakshmi S. Iyer, Eric W. Ford

Research output: Chapter in Book/Report/Conference proceedingConference contribution

5 Scopus citations

Abstract

The business of business education is rapidly evolving because of changing economic and social conditions. At many institutions, class sizes are growing, more curricula is being offered online and traditionally successful pedagogical standards are being threatened unless they are adapted to the emerging economic realities of the 21st century. In response to the economic threats and consumers' preferences, numerous IT artifacts are being created to facilitate online teaching in the hope that both quality and cost concerns will be ameliorated (albeit not always using the precepts of design science). The purpose of this 'work-in-progress' paper is to apply design science principles to outline an algorithm for a computer-aided peer assessment system, named Double-loop Mutual Assessment (DLMA). The project's goal is to emulate the case method online, improve students' learning experience and increase grading efficacy. The DLMA yields two IT artifacts: a method and an instantiation. The DLMA method artifact involves two loops of assessment: 1) a summative and formative mutual peer assessment algorithm for essays; and 2) a summative peer assessment of the feedback's quality. An instantiation of DLMA system - a prototype and a beta-version has been implemented and described. Future directions of researching behavioral and operational aspects of the system are outlined. Potential applications of the artifact's capabilities beyond the business necessity are discussed.

Original languageEnglish (US)
Title of host publicationDesign Science Research in Information Systems
Subtitle of host publicationAdvances in Theory and Practice - 7th International Conference, DESRIST 2012, Proceedings
Pages1-8
Number of pages8
DOIs
StatePublished - 2012
Externally publishedYes
Event7th International Conference on Design Science Research in Information Systems: Advances in Theory and Practice, DESRIST 2012 - Las Vegas, NV, United States
Duration: May 14 2012May 15 2012

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume7286 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Other

Other7th International Conference on Design Science Research in Information Systems: Advances in Theory and Practice, DESRIST 2012
Country/TerritoryUnited States
CityLas Vegas, NV
Period5/14/125/15/12

Keywords

  • design artifact
  • design process
  • design science
  • double-loop mutual assessment
  • online
  • peer assessment
  • prototype

ASJC Scopus subject areas

  • Theoretical Computer Science
  • General Computer Science

Fingerprint

Dive into the research topics of 'Towards a comprehensive online peer assessment system: Design outline'. Together they form a unique fingerprint.

Cite this