Grade Reporting Incorrectly
Jun 14, 2016
Hello everyone,
Recently I made a Quiz Template. It is fairly standard with the built-in results screen. I am publishing to Scorm 1.2
Long story short --> The quiz has 26 questions in a quiz bank format, set to NOT be randomized. Each question is worth 1 point.
- The first question, has a next button but no previous button.
- The questions between the first and last have the previous and next button but NO submit button
- There are a variety of question types, choose all, true false, multi choice, hot spot, text entry
- The last question (26) counts for 0 points and has the user type in "Grade My Test" then press SUBMIT
- The results screen then shows them their score (say I scored a 76) 6/25 wrong.
- The pass rate is set to 80%, so a 76 SHOULD be FAILED.
Issue here is for a small % of users, no matter WHAT the module says they scored, 76, 80, 84, 90, etc.... the LMS reports back in the Grade Book 100% Complete with a 100% Grade (Passing)
10 Replies
It may be important to note that I created the template, and copy pasted it 5 times, giving it a new file name, course name, course id each time. For a total of 5 skill checks inside of the LMS each 25 questions.
Hi Justin!
Is this something that you are able to reproduce in SCORM Cloud or is this issue limited to your LMS?
If you can reproduce the issue, we would want to take a look at your .story file.
Update on this issue --- so it turns out that putting the option "ALWAYS RESUME" was the culprit here. When a user would close out of the test, either by accident or on purpose it would automatically report a 100% to the LMS.
As soon as I set it to "prompt to resume" the issue stopped completely on all platforms.
Very odd.
I believe this stems from an issue where because the questions were not being "submitted" but rather answers were being locked in until the end when everything was being submitting, closing out of the test somehow screwed up the recorded answers / grades and set it to the default of 100% Complete.
Thanks for the update Justin. So, the resume and the actual grade was then not updating your LMS.
Perhaps this information can assist:
Most learning management systems (LMSs) consider a course to be in review mode when attempting it again after the completion requirement has been met. This prevents learners from accidentally changing their course status from complete back to incomplete. If you'd like to change this default behavior, see this article for details.
Well, I am not sure that was the case entirely. My module was set up a little different than most standard quizzes / tests. I think the user closing out the module somehow sent a "all answers" correct response to the LMS.
When I ran the Question by Question reports I could still see that the user got say 6/25 wrong, even though the LMS said 100%. Upon investigating, I closed out the test myself, saw it report a 100% in the "Completed" tab of the LMS then I was still able to open it up, complete the test and hit "Complete Test" this did not change my grade of course inside the LMS, as it was locked at 100%, even though my screen showed 76%.
The interactions report (q by q) really came in handy here in finding falsified records of perfect scores.
Did you ever do the SCORM Cloud comparison to see if it's your course or the LMS?
I hadn't tested it in the SCORM Cloud, as I don't have an account / anything set up there atm.
If I have any further issues with the course and user testing I will definitely investigate that.
Sounds great Justin. Sounds like you're getting down to the bottom of it pretty efficiently :)
It was definitely odd, never had anything like this happen before. I think in the long run it may also have something to do with the next and back buttons being enables and the Submit button being turned off.
This discussion is closed. You can start a new discussion or contact Articulate Support.