Confidence-based assessment in Quizmaker

I'm not sure how to implement certainty-based marking assessments in Quizmaker, but it may indeed be possible.

In the past, we have developed these assessments in SCORM-compliant elearning using custom programming in Flash. And because there was no place to record the additional certainty-based data in the LMS, we created a companion reporting website for admins to use, which showed details such as: how learners did as a group on each lesson's assessment and how a learner did on each quiz question.

I wish I could be more helpful with implementing it in Quizmaker. If you're interested, we did put together an article on our experiences with certainty-based marking that you might find interesting.  ( go to http://www.docntrain.com/resource_view.php?id=43 )

Hi Ger,

I'm working on a project for LINGOS where we're doing something similar. It's more around a "readiness plan" where the user certifies their level of preparedness. The activity was inspired by this Thanksgiving Readiness survey.

Now, we're building this in Storyline, but, you could use Jeanette's technique for creating multiple-response questions in Quizmaker. Or, another great option is Jeanette's assess & categorize learners demo in Quizmaker.

Please let us know if you think those ideas could work... We'd be happy to help you work it out.

Try playing different quiz games. that will give u some ideas.

Thanks to all of you for your replies I was away from the computer for a few days.I've had a quick look at Jeanette's multiple-response questions in Quizmaker, I think i may be able to implement using this.

Thanks again for all your help Ger

Hi all,

Was the confidence based assessment functionality built into Storyline? If so, can you point me to some instructional material for it? We are hoping to assess confidence in diagnosis of different medical conditions and hopefully bring up a summary at the end along the lines of "Out 19 questions of which you answered confidently (90%+) , 17 were correct, etc.

Has Quizmaker or Story line added any more confidence-based capabilities? I really like the multiple response tutorial, but I don't think it will work when it comes to confidence, because the user confidence level is not a right/wrong question.

Hi Julee, 

This thread is a bit older, so I'm not sure if anyone else is still subscribed but there hasn't been a change to any of the question types recently. Although I'm not sure what you mean by confidence based questions? Could you share a bit more information and then perhaps folks in the community will be able to weigh in on ideas for how to accomplish this in Storyline or Quizmaker's current question format.

We've got clients who already do confidence based assessments.

In their existing quiz, they'll ask a question--and after the answer is selected AND while on the same slide--the confidence assessment comes up to ask the learners level of confidence in the answer they chose.

One particular client uses this to flag individual users who got the question wrong with a high confidence. 

We're trying to replicate this with Quizmaker, but so far I can only put the quiz question on one slide followed by a Likert question on the next. Separating the question and the confidence assessment is unacceptable to the client. We need to make this work using Quizmaker. Do you have any ideas on how we can make this work?

We are also considering Storyline 2 to implement these quizzes. Is there a good way to ask a question and ask for the confidence in the answer on the same slide? Thanks!

Hi Julee,

I reached out to a few of our team who know a bit more about instructional design and they weren't entirely clear on what you meant by confidence based questions either. Storyline and Quizmaker only allow for one question per slide, so the set up you described wouldn't be possible with the built in functionality of the questions.