Forum Discussion

JeanMarrapodi-c's avatar
JeanMarrapodi-c
Community Member
17 days ago

Inconsistent Scoring of Quiz Questions

 

I've rolled out a series of quizzes, and have had three users send me screen shots that they had the correct answer, and the system scored it as wrong. One user just told me that she retried the quiz with the same info and it scored correctly.

Here's one of the quiz questions

Here are the examples. This is the print questions from the results screen output. You can see she has the correct answer for all three of these questions.

From Quiz 4, two more fill in the blanks.

Here's another learner with the same thing on Quiz 3. This is from the Excel output from the LMS.

But look! Others with the same thing are marked correctly. 

This is a pivot table from the report, and it only shows 1, but the first student hadn't taken the quiz when this report was done. I don't have the full reporting yet.

So I have three fill in the blank questions scoring incorrectly that impacted two different learners. The other problem question is a hot spot question in a Quiz 5. Here is the question:

And my learner said:

 Question 18 asks where to click to get the list view. I clicked the grid next to the bullet list towards top-center, but it was counted wrong. However, clicking that grid does bring up that view. Clicking next to the bullet list said it was wrong.

------------------

When I heard from the first student, I reached out to support (Case #01176443) and they thought it could be an LMS issue and sent me a link for the LMS debugger, which I'm going to run. But I have three different people, three different quizzes (ok, I do file save as so they are related) and four different questions being wonky. 

Our LMS is Workday.

Has anyone ever dealt with something like this? 

I've attached the Storyline file for the quiz the two people had issues on the same question if it helps. It's question 3.2 in the question bank for quiz 3.

13 Replies

  • Hi JeanMarrapodi-c,

    This is definitely an interesting occurrence. I see that my teammate, John, wasn't able to reproduce the issue while testing in SCORM Cloud. I'd like to hear from other community members who use Workday on their experience with this!

    • JeanMarrapodi-c's avatar
      JeanMarrapodi-c
      Community Member

      This is worse than I thought. Here's the analysis of this question after the weekend. 

      We've investgated other courses and it appears to occur randomly throughout. ACK! Going to see if we can get Workday involved. 

      • LucianaPiazza's avatar
        LucianaPiazza
        Staff

        Hi JeanMarrapodi-c

        I see you've opened a support case and you've been working with my colleague Cleober. Great call! I understand you're reaching out to Workday this week. We'll continue the conversation in your case if you have any follow-up questions about the Storyline end of things! 

  • Wild guess: Is there a space at the end of the incorrect answers? That character would be viewed as wrong. 

    • JeanMarrapodi-c's avatar
      JeanMarrapodi-c
      Community Member

      Good hypothesis! Any ideas how I might identify that in the Excel output?

      • JudyNollet's avatar
        JudyNollet
        Super Hero

        Click into the cell. Based on the cursor, you should be able to tell whether there's a space after the last alphanumeric character.