Avoiding contradictory ratings
Avoiding Contradictory Ratings
A scorecard that says one thing in the numbers and another in the notes cannot be trusted. Learn how to keep your scores, evidence, and recommendation aligned — so every rating tells a single, consistent, defensible story.
Introduction
Imagine a scorecard that gives a candidate a "5" for communication, but the notes say "hard to follow, rambled a lot." Or an overall "Strong Hire" verdict sitting above three low scores. These are contradictory ratings — where the parts of the assessment disagree with each other.
Contradictions quietly destroy the value of an evaluation. If your scores, your evidence notes, and your final recommendation do not tell the same story, no one can trust any of them. This lesson shows how to catch and prevent contradictions, so your assessment holds together as one coherent, defensible whole.
Learning Objectives
- Define contradictory ratings.
- Recognize the common types of contradictions.
- Understand why they undermine fairness and trust.
- Run consistency checks before finalizing.
- Keep scores, evidence, and verdict aligned.
Why This Matters
Contradictory ratings are more than untidy paperwork. They often reveal that bias crept in — a "5" driven by a good feeling despite weak evidence, or a harsh verdict that ignores strong scores. And if a decision is ever questioned, a contradictory scorecard is impossible to defend.
Keeping ratings consistent forces your judgment to stay honest. When your score must match your evidence and your verdict must match your scores, there is far less room for gut feeling to distort the outcome.
What Are Contradictory Ratings?
Contradictory ratings occur when the different parts of an assessment — the evidence notes, the competency scores, and the overall recommendation — do not agree with one another.
Think of a Story That Doesn't Add Up
If a witness says "it was dark" but also "I clearly saw the colour of his eyes," you stop trusting the account. A scorecard works the same way: the moment the parts contradict, the whole story becomes unreliable.
Common Types of Contradictions
Score vs Evidence
The number disagrees with the notes.
A high score with negative notes, or a low score with glowing notes. Example: "5" for a competency the notes describe as weak.
Scores vs Recommendation
The verdict disagrees with the scores.
A "Strong Hire" sitting above mostly low scores, or a "No Hire" above strong scores with no critical gap to justify it.
Internal Inconsistency
The notes disagree with themselves.
Praising and criticizing the same behaviour, or saying "great communicator" and "couldn't explain clearly" in the same assessment.
Why Contradictions Happen
Common Causes
- Scoring on gut feeling, not evidence.
- Halo effect inflating a weak area.
- Rushing the scorecard at the end.
- Letting a likeable candidate get soft scores.
- Not re-reading before submitting.
What Prevents Them
- Tie every score to specific evidence.
- Score each competency independently.
- Take notes during the interview.
- Judge behaviour, not likeability.
- Run a consistency check before submitting.
Contradiction Examples and Fixes
| Contradiction | The Fix |
|---|---|
| Score 5, notes say "rambled, unclear". | Lower the score to match the evidence. |
| "Strong Hire" over mostly 2s and 3s. | Align the verdict with the actual scores. |
| "No Hire" over strong scores, no critical gap. | Re-check for hidden bias; justify or revise. |
| Notes both praise and criticize the same thing. | Clarify what was actually observed. |
The Consistency Check
Before submitting any scorecard, run a quick three-way consistency check. It takes seconds and catches most contradictions.
Do the Notes Match Each Score?
Read each score and its evidence — do they tell the same story?
Does the Verdict Match the Scores?
Check that the overall recommendation follows logically from the scores.
Is Anything Self-Contradictory?
Scan the notes for statements that cancel each other out.
Worked Example: Catching a Contradiction
The Problem
The "5" contradicts the note, and the "Strong Hire" is not supported by weak fundamentals. Two contradictions in one card — it cannot be trusted.
The Fix
Lower Fundamentals to match the note, re-examine the overall verdict against the corrected scores, and revise it to an honest recommendation supported by the evidence.
Best Practices for Consistent Ratings
- Tie every score to specific, observable evidence.
- Make sure each note and its score tell the same story.
- Check that the verdict follows logically from the scores.
- Justify any verdict that seems to defy the scores (e.g. a critical gap).
- Re-read the whole scorecard before submitting.
- Ask if a stranger would reach the same conclusion.
Common Mistakes
Avoid These
- Scores that don't match the notes.
- A verdict that ignores the scores.
- Notes that contradict themselves.
- Submitting without re-reading.
- Letting a good feeling inflate a score.
Do These Instead
- Align every score with its evidence.
- Match the verdict to the scores.
- Keep notes internally consistent.
- Run a consistency check first.
- Score on evidence, not feeling.
Real-World Use Cases
Pre-Submission Review
Before submitting, an interviewer spots a "4" beside a negative note and corrects it, keeping the scorecard honest.
Panel Debrief
The panel notices one card's verdict contradicts its scores and asks the interviewer to clarify, leading to a fairer consensus.
Defending a Decision
Because every score, note, and verdict align, the decision holds up cleanly if it is ever reviewed or questioned.
Frequently Asked Questions
What exactly is a contradictory rating?
It is any mismatch between the evidence, the scores, and the overall recommendation — where one part of the assessment says the opposite of another.
Can the verdict ever differ from the average score?
Yes — but only for a clear, stated reason, such as a critical gap. That is not a contradiction if it is justified; it becomes one only when the mismatch is unexplained.
Why do contradictions usually happen?
Most often from scoring on gut feeling, the halo effect, or rushing the scorecard without re-reading it. Tying scores to evidence prevents most of them.
How do I fix a contradiction I find?
Decide which part reflects the true evidence — usually the notes — and align the others to it. Adjust the score or verdict so the whole card tells one story.
What's the quickest way to catch contradictions?
Re-read the whole scorecard and ask whether a stranger could reach the same verdict from your scores and notes. If not, something contradicts.
Conclusion
A trustworthy assessment tells a single, consistent story. Contradictory ratings — a score that defies its notes, a verdict that ignores its scores, or notes that argue with themselves — break that story and often reveal hidden bias. They make an evaluation impossible to trust or defend.
Tie every score to evidence, make sure the verdict follows from the scores, and run a quick three-way consistency check before submitting. Ask whether a stranger could reach your same conclusion. When your evidence, scores, and recommendation all agree, your assessment becomes coherent, honest, and fully defensible.
Key Takeaways
Contradictory ratings occur when evidence, scores, and the verdict disagree. They break trust and often hide bias. Tie every score to evidence, match the verdict to the scores, justify any exception, and run a consistency check before submitting.