This is one of many help and support pages that are available about the University of Nottingham's Moodle online learning environment. If you have any questions or queries concerning Moodle then contact information is at the bottom of this one-page sheet. Please browse or use the SEARCH box below.
Peer Evaluation using PeerMark in Turnitin
View student feedback results:
I wanted to improve my student's approach to clinical research writing e.g. abstracts and paper evaluations. I thought a good way to do this would be through peer assessment of student submissions i.e. getting them to review other's work and provide feedback.
What we did
I contacted email@example.com for advise about using the PeerMark tool in Moodle as I had come across it when creating an assignment dropbox. They created some basic guidance for lecturers on how to setup a peer assessment in Turnitin and one for students about using it to peer assess.
Based on the guidance documents I setup a Turnitin assignment dropbox and went through each of the settings to see what was available.
Throughout the peer evaluation process I contacted the Faculty and School Support team for guidance at poignant times to ensure I was approaching it in a way that would meet my needs.
I decided to opt for anonymous marking and rather than an overall grade I used a basic rubric to ensure students fed back consistently across all the areas required.
How it worked
I setup the dropbox due date to be the same as the date at which students could start peer evaluating other's submissions and the post date for both the dropbox and the peer assessment to be the same so students received both sets of feedback and their overall grade at the same time so they could compare.
I gave instructions about the titling of the submission to ensure students remained anonymous to their peers
PeerMark Tool Features
- The default is anonymous e.g. neither the reviewer or the reviewee will see any names, but it is possible to change this to ‘Allow students to view author and reviewer names’. The lecturer will always be able to see student names in PeerMark, this cannot be made anonymous.
- Both text and scale questions can be created like a basic rubric for students to complete.
- Editing teachers can also complete a peer review so students can compare an experienced evaluator's assessment to their peer's assessment using the same criteria.
- A grade out of 10 can be given to the reviewer based on the quality of their review(s). This does not contribute to the overall score for the assignment and therefore does not feed into Grades in Moodle. It is purely formative.
- Submission distribution to be random or manually matched to particular students to control who reviews what.
- Students can be manually excluded from the peer evaluation exercise.
Tips and recommendations
There were a few glitches (mainly due to me hitting buttons without having much clue of what I was doing). I learned from them so next year everything should run smoothly. I will ask for student feedback early next year. If there are any particular issues you would like feedback from students let me know and I’ll ask them. We will definitively use it next year and I will give a short demo to the Neurosciences Teaching Committee (about peer marking and regular marking using moodle) to try to increase the number of “users”. I tried to modify the distribution but it does not let me do any change once the exercise started.
- Students giving grades: when we looked at it in my office we logged in as an Editing Teacher. The grade was for marking the reviewer on their review skills (if you’ve selected to give ‘points’ as part of the exercise). It appears that the ability for a student to give a grade to another student is not possible unless you create a specific question for students to answer; I think this is because the peer assessment tool is often described as a peer evaluation tool rather than peer marking. Unfortunately you can’t change the answers once students have started to submit, but you could make this change on the future assignment dropboxes you’ve set up. Sorry, this probably isn’t the answer you’d like to hear.
- Peer marking after late submission: I believe this can be done by choosing the ‘Allow students without a paper to review’ option in the Additional settings. I need to test this further though so I’ll confirm this with you tomorrow.