As soon as reviewers start rating candidates' answers to Sift Questions, you'll notice that the Reviews column on the Role Manager tab (click here to learn more) will automatically update with these scores in a structure similar to the one below.
Note: If you can't see scores with a structure similar to the one you see below, this might be because reviews haven't been completed (click here to learn how to track review progress).
These are the main elements of an overall review score given to each candidate:
a. Overall average. This is the average of all the scores that you see in the coloured grid.
b. Number of Sift Questions asked to candidates. Each column represents one question / answer given by a candidate. In the case of the image above, each candidate submitted 3 answers.
c. Number of reviewers who scored each answer. Each cell within the same column represents the scores given by the various reviews for the candidate's answer. In the case of the image above, the review panel had 3 members.
d. Score given by a reviewer to a specific answer. Scores can range from 1 to 5. For your visual ease, the greener the cell, the higher the score; the redder the cell, the lower the score (a grey cell means that the score is pending).
This colour coding will make it easy to skim both:
- the general and relative performance of a single answer and,
- the level of disagreement between reviewers with regards to the quality of the same answer.