Forum Discussion
Storyline scales score by half when reporting to the LMS
Hi everyone,
Editing my question because I solved one reporting problem (the issue was in the LMS) but ran into another. While [QuizName].ScorePoints tracks the score correctly throughout the quiz, the LMS gets half that value. I checked and seems like the problem is in the .story file (see the attached image - "scaled:50" means the score was sent to the LMS scaled down).
I'm not sure what causes the issue in the .story file. Would appreciate any help!
Thanks,
Nilli
*Old post:
I created a 10 question trivia game. Each question is worth 10 points, but sometimes users can choose if they want to "bet" on a question to increase their score. This means there are a few branching slides.
I tested the quiz on the client's LMS and it fails to track the score. This is my first time working on a project with a results slide so I'm not sure what causes the issue. I'd really appreciate if someone can take a look!
Hello Nilli,
Thanks for reaching out!
I took a look at your course and saw that Storyline 360 is not scaling the score down, but rather reporting the final score as a percentage to your LMS. Here's an example, with 170 being the perfect score for the quiz:
The missing 15% in the score is because some of the question slides in your course were being left unanswered due to its branching nature, resulting in an incorrect mark with a score of 0 being issued to the slides.
To get a more accurate representation of the user's score, make sure that this option is checked in your course's Result Slide:
With this option enabled, this is the score that your LMS will receive when a learner gets a perfect score in the quiz:
Here's a link so you can test how making the adjustment above affects the scoring of your quiz.
Let me know if you hav any questions!
Hi Joe,
Thank you for answering! I enabled "only score viewed questions" and that seems to solve the problem while testing in SCORM cloud.
However, there are 2 issues I'm still struggling with:
1. Since Storyline is reporting the score as percentage, all users that answered 10 questions correctly get 100%. However, this doesn't reflect the difference between user who didn't bet at all (max. score 100 points) and user who increased their score with bets (max. score 170 points). Is there a way to send the total score to the LMS?
2. Something is off with the score while testing in the LMS. When a user doesn't bet at all (i.e. every question gives 10 points for a correct answer and 0 points for incorrect), the score shows fine in the LMS. For example, this user answered 7 questions correctly, each worth 10 points. They are graded 70 as expected:
However, betting questions messes up the score. This user answered 7 questions correctly, but placed bets to increase their score. Successful bets let to them earning 100 points over 7 questions:
However in the LMS it's marked as 77:
This is weird to me, since I'd expect them to get either 100 (the number of points) or 70 (the success percentage). I can't figure out where the 77 came from.
Thanks again,
Nilli
Hi Nilli,
I'm happy to share some insights into this as well! I'd like to understand the issue better to make more accurate recommendations.
- If the learner made some bets, the total score would also change because of the larger weight of the question slides with bets. So if the learner got a perfect score without any bet, the computation should be 100/100, which is 100%. If they got a perfect score while using all the bets, their score would be 170/170, which is also 100%. So what you're seeing is accurate and is the correct calculation. I'd like to know what you expect to see in the LMS to reflect the difference between using the bets or not.
- I ran some tests on Joe's link above (with the "only score viewed questions" option enabled). I used up all the bets except the last one, worth 50 points. So the total score is 130. I deliberately chose the wrong answer on one of the slides worth 10 points, so my total score is 120. So 120/130 is 92.30%. Here's a screenshot of the results in SCORM Cloud. Following this pattern, do you also get 92.30% in your LMS? Also, can you share how you earned 100 points over seven questions? What slides did you answer, and what slides did you bet on? I'll replicate them on my end and see if I get the same results. Here's a screenshot of my test:
I'm looking forward to your response; thanks!
Hi Eric,
Thank you! I think I have a better understanding of how score is calculated now - I wasn't sure about the math behind it.
1. What I'd like to see in the LMS is the score in numbers rather than the percentage. I replicated your test and here's a screenshot of how results show in our LMS:
The number on the right is the max possible score, which I need to define manually. This is for the benefit of the users, so they know how many points they can earn. Here I set it to 170, since it's the perfect score while using all the bets.
The number on the left is the score as it's sent from the SCORM. It shows the score percentage. Here it shows 92 as 120/130 = ~92%, but I would like it to show 120.
Following the same logic, if user A got 100/100 and user B got 170/170, both would get 100 in the LMS, but I would like user B to get 170 since they took risks and succeeded in their bets. I am wondering if it's at all possible...
2. To replicate my 77% test, I used all bets except the last one and got 3 wrong answers that cost me 30 points, so the score is 100/130.
Hopefully I managed to explain myself better.
Thanks again for your detailed reply!
Nilli
Hi Nilli,
Thanks for the additional information.
Unfortunately, there isn't a way to change how Storyline 360 reports scores to an LMS. You'll need to reach out to your LMS administrator to make any customizations to your LMS, including how scoring is graded. Here's a reference article which explains all of the data that is sent to an LMS by default:
As for the 77%, correct me if I'm wrong but wouldn't this be correct since the learner scored a score of 100/130 which calculates to 76.9%? Seeing a score of 77 in your LMS would be the expected value in this case.
Hi Joe,
Thank you!
The 77% is indeed correct. I understand the calculation now.
I will try to solve it from the LMS side. This is my first time trying graded quizzes so it's a good lesson to keep in mind for next time.
Thanks for the update, Nilli. I appreciate your patience as we try to come up with a resolution.
Please don't hesitate to contact us again if you encounter other issues. We're happy to help!
