Forum Discussion
Assessment Demonstration with Confidence Rating and Dynamic Results
So here is a (much simpler) demonstration of an assessment technique I've been working on for a while.
The key feature of this assessment is that it scores not just whether a submitted answer is c...
You're absolutely right, Diane, and I should have been clearer.
Questions which are answered as "Don't Know" are not calculated within the overall calculation of the score of correctness/confidence.
The scoring algorithm keeps score of how many responses are recorded as "Don't Know" and ensures that their score does not impact the overall calculation.
As you suggest the actual confidence rating recorded (for calculation purposes) of a "Don't Know" response is zero in regards to the scoring calculation.
In this respect respondents are not penalised (i.e. as showing up as confidently wrong) for "Don't Know". They will simply show as in need of training.
Probably too much information but...in some roles you might actually prefer people to take a calculated guess rather than "Don't Know".
If they're a train driver and unsure what the signal means I definitely don't want them to guess.
If they're a futures trader for a bank and need to make an investment decision in a fast moving and uncertain situation where all the facts cannot be known - well then refusing to act unless 100% certain in that role could actually be a drawback.
