Overview

The major goal of this activity is to familiarize students with the peer review process and also how to accept criticism from their peers.

In Class 1, a peer calibration exercise is performed whereby the instructor gives the students a paper to edit. The students mark the paper using a predefined grading rubric. The students are then asked to compare their evaluation with that of their neighbours and through a polling exercise, students are shown that, typically, the difference between their final grade that of their neighbour will range from one to two marks.

Then the instructor shows the students how ...

Read More +

The major goal of this activity is to familiarize students with the peer review process and also how to accept criticism from their peers.

In Class 1, a peer calibration exercise is performed whereby the instructor gives the students a paper to edit. The students mark the paper using a predefined grading rubric. The students are then asked to compare their evaluation with that of their neighbours and through a polling exercise, students are shown that, typically, the difference between their final grade that of their neighbour will range from one to two marks.

Then the instructor shows the students how he marked the paper and again through a polling exercise, she/he demonstrates that, typically, the difference between the final mark given by the instructor and those of the student reviewers will fall within one to two marks of each other.

Outside class, students are then asked to write a response to an ethical dilemma.

In Class 2, students bring their response to class and switch their paper with a neighbour. The students then edit each other's papers using a predefined grading rubric and hand them back to each other.

Outside of class, the students will then edit their papers and either accept or reject the reviewer's comments. The final draft is then submitted to Peerceptiv (a peer reviewing software).

Through the Peerceptiv software, the students are assigned five of their peers' papers to evaluate (here students play the role of reviewer). The authors of each paper must also evaluate their five reviewers.

A final grade is given based on timely task completion, a weighted average of the five year reviews (based on their proximity to each other, outliers are weighted less), and on how well they did as a reviewer (which is based on how high their evaluation was weighted on Peerceptiv and also on author evaluation).

This activity was performed in a class of 200 students.

Read Less -

Objectives

To develop critical thinking, analysis, and assessment skills (in the roles of author and reviewer). To learn how to accept and what to do with feedback and criticism from others (largely based on your role as an author).

Context and requirements

Level U1-U3
Discipline Engineering
Activity Content Peer assessment, engineering ethics
Technological Requirements Peerceptiv peer assessment software
Best Use Peer assessment

Author’s Notes

Benefits

Students realize the complexity in making an ethical decision (from writing the paper). Students learn to judge a paper based on its merits, not only on whether or not they agree with it. Students learn what to do with feedback from peers. Students learn how to accept criticism from their peers. Students familiarize themselves with the peer review process.

Challenges

Students are sometimes nervous or reluctant to have other students grade their work; the biggest challenge is having students believe in peer review and getting them comfortable with the process. In this activity, they have to get outside of their comfort zone which is often challenging for students.

Tips

By comparing the instructors scores to the student scores and demonstrate that they are about the same, they can be reassured_â__about the accuracy of the peer review process.

Activity Pedagogical Components

Peer Instruction

INDIVIDUALLY, students edited a paper of one of their peers. In a GROUP of two, students discuss their edits. As a CLASS, peer assessment is discussed. This is done IN CLASS.

Peer Assessment

INDIVIDUALLY, students write a paper and edit 5 papers of their peers. INDIVIDUALLY, students edit their paper based on the 5 sets of peer reviews. INDIVIDUALLY, students evaluate their 5 reviewers (how they though their peers performed as reviewers). This is done OUT OF CLASS.

Download Flowchart Download Complete Material