The QPS software requires that courses/instances (kurs/kurstillfälle) are correctly set-up and that appropriate privileges are assigned to you. Please contact the person responsible for your course if the course/instance or menus referenced below are not visible or if error messages appear.



Time estimate to perform tasks in this tutorial

10-15 minutes

Scope

  1. Individual scored exam – preliminary (via mail)
  2. Analytics: 
    • remove candidate
    • remove question
    • Cohen calculations
  3. Pass mark
  4. Publish exam
  5. Individual scored exam - final (mail/publish) 
  6. Individual report with exam part (final) 

Definitions

Angoff: relies on subject-matter experts (SMEs) who examine the content of each test question (item) and then predict how many minimally-qualified candidates would answer the item correctly. The average of the judges' predictions for a test question becomes its predicted difficulty.

Cohen: Cohen is a method of establishing a cut-off score by taking 60% of the score achieved by the 95th percentile candidate.

Passmark: is how many marks do you need to pass the exam

Software dependency


Who can see content created in this tutorial

Examiners can see the analysis menus. The reports can be seen by students (students can only see their own data), teachers and course administrator.

GoalLearn the routines after an examination. How to remove a candidate with no data or very little data to avoid strange statistics. How to remove a question from an exam and do correct passmark calculations. Work which leads to a fair exam.


The exam needs to be closed before this tutorial can be used
TABLE OF CONTENTS

Select exam

Select exam in post processing mode

  1. Select Course
  2. Select Course instance

  • Click on Edit Exam to select the exam to analyze


Individual scored exam – preliminary (via e-mail)

Under the Reports tab a number of reports are available. The first report to send is the Individual scored exam – preliminary. The purpose of sending this report is that the students  get a few days to look at their given answers and the correct answers, side by side.

  1. At the row Individual scored exam (preliminary), click on the letter icon. All students in the exam will receive the report, as an attachment in an e-mail.

 

A screenshot of a cell phone Description automatically generated

Analytics tab

This tab contains a variety of different analysis tools, which will be handled in a separate Analysis tutorial.


Remove a candidate

Sometimes you need to remove a candidate from the exam, for various reason, before the final analysis and calculation of passmarks.

  • Select Overview tab



  • Click on Exclude Candidate in the Excluded candidate section

 A popup window appears.

  1. Select the candidate that you want to remove from exam from the dropdown menu.
  2. Click on Exclude candidate

A screenshot of a cell phone Description automatically generated 

Excluded candidates section has been updated with the removed candidate name.


Remove a question

Remove a question is an important function. For example you may have added a question from another content, or maybe a question has the wrong answer.

  • Select Item performance tab



A list with exam questions appears.

  • To remove a question from the exam click the X in the last column of the row that contains the question you want to remove.

A popup window appears, Exclude question

  • Write a comment for the removal (not mandatory)
  • Click on Exclude question


Confirmation of the removal  is found in the Overview tab

If you accidentally removed the wrong question, click on the +-icon.


Cohen (not mandatory)

If you would like to use Cohen to calculate passmark

  • Select Overview tab

  • Click on Cohen, in the Pass marks section

A popup window appears, Cohen´s pass mark calculator

  • Click on Calculate pass mark

 

The result is displayed in the popup window.

 


If you would like to use the calculated pass mark, update the Info tab with the displayed information.

  1. Set passmark in %
  2. Click Save

A screenshot of a social media post Description automatically generated

 

Pass mark

Select Info tab

  1. Set passmark in % (how many % of maximum score to pass exam)
  2. Click on Save

A screenshot of a social media post Description automatically generated

 

Publish grades

To finalize the changes with the post processing of the exam, we need to "Publish grades". 


Once the grades are published it is no longer possible to change the exam.


  •  Click on Publish Grades, found under Info tab

 

Individual scored exam - final

Under the report tab a number of reports are available. When the grades are published choose Individual scored exam – final. The purpose of this report is to send the students their final results.

  1. At the row Individual scored exam  (final), click on the letter icon. All students in the exam will receive the report, as an attachment in an e-mail.

A screenshot of a cell phone Description automatically generated

 

Individual report with exam parts (final)

Under the report tab a number of report are available. If the exam consists of several parts you can use the report Individual report with exam parts – final. The purpose of  this report is for the students to see how they performed on each part of the exam.

  1. At the row Individual scored exam parts (final), click on the letter icon. All students in the exam will receive the report, as an attachment in an e-mail.

A screenshot of a cell phone Description automatically generated


Complete exam

To finalize the post processing changes of the exam, you need to Publish grades. By doing this, no more changes can be made.

  • Click on Publish Grades, found under Info tab


Did you know the system can help you to calculate a good pass mark