Need to Track/Report Quiz Results at the Question Level

Hi Brennan,
We still publish to SCORM 1.2.
We ended up putting our quizmaker exams into Storyline.

This is giving us a report that shows how users did on each question.
However, if you want to analyze many users together to get a good snapshot of how people are answering questions, you have to stick with question types that only have a single answer (ie: multiple choice, true/false, pick one).

Any question types that have multiple parts (multiple select, pick many, drag and drop, etc...) generate an inconsistent number of rows in the report from person to person depending on how they answered. Thus, using an excel macro will not work because each person's report might contain a different number of rows.

We don't want to sacrifice the interactive types of questions as this opens up a better test experience and can help you create questions that check against learning objectives better in many cases. Thus, we only check how users are responding on each exam once per year (maybe twice in some cases) because it is an entirely manual and lengthy process to go user by user to see how they answered against the correct answer and then check multiple users answers against each other.

We like to see which questions are missed most often and greater than 50% of the time (if I can toss a coin and have better probability of getting it correct, the question and/or content needs work...usually the question). We go user by user on the ones who answered incorrectly  to see how they are answering and if most people who get it incorrect are answering the same way we definitely know there is an issue with the question wording or structure.

Hope this helps.