We are using the "End Quiz After" functionally in our initial exams. We give folks an hour to complete the exam. An instructor pointed out an issue to which I later confirmed, and found alarming.
If the learner doesn't view all the questions before time expires, the un-viewed questions aren't accounted for. Nor are they counted as incorrect. If I had a 10 minute quiz with 20 questions and got the 1st question correct, I could sit there, not visit any other questions, and Storyline would give me a score of 100.
Is there a way to use "End Quiz After" in Storyline and have a exam grade all of the answered and un-answered questions?
But that's what I'm doing. I'm having it go to the results slide. Even if I submit and exit the exam, Storyline is only going to count the questions that were answered or viewed. If I have a 50 question test and the learner only answers or views 40 questions, Storyline will grade it as a 40 question test. Not 50.
Are you comfortable with sharing your .story file with us, so we can take a thorough look at your set-up to test and offer more tailored support? You can share the project publicly here or privately by this link!
In the meantime, would it work for your design to have all the questions submitted at the same time at the end of the quiz? Here's how to set that up!
I've changed the total questions to 5 and set the "End Quiz After" to 1 minute Answer the 1st question correctly, click next, and let the time expire while remaining on the 2nd question. Storyline will see that you've only visited 2 questions and will score a 50%.
The issue pops up when we have a learner not finish the exam and they are only graded on the questions viewed or answered, not the exam as a whole.
Thank you for including your file and providing a clear explanation of where the issue occurs!
I noticed the exact same error where the score is 50% when the user only answers one question. We've found this is a software bug within question banks. The score is based on the slide that was answered and the slide where the time runs out.
I've attached the file and your comments in the bug report with our team! I'm sorry this has been troublesome.
I wanted to update this discussion to share that we aren't seeing this bug, unattempted questions in question banks are not included in the computation for cumulative score when timer expires in a timed quiz, in our latest version of Storyline 360 (Build 3.61.27106.0).
If others are running into this bug, please make sure you're using the latest version of Storyline 360. You can reach our team in this discussion or privately in a support case.
7 Replies
Hello Aaron!
This would be a good scenario to use the trigger, "Submit Results when Timeline reaches".
You could also add a trigger to exit the course when the timeline reaches.
Let me know what you decide on!
But that's what I'm doing. I'm having it go to the results slide. Even if I submit and exit the exam, Storyline is only going to count the questions that were answered or viewed. If I have a 50 question test and the learner only answers or views 40 questions, Storyline will grade it as a 40 question test. Not 50.
Hi there, Aaron. Happy to lend a hand!
Are you comfortable with sharing your .story file with us, so we can take a thorough look at your set-up to test and offer more tailored support? You can share the project publicly here or privately by this link!
In the meantime, would it work for your design to have all the questions submitted at the same time at the end of the quiz? Here's how to set that up!
Thank you, Katie!
I've changed the total questions to 5 and set the "End Quiz After" to 1 minute Answer the 1st question correctly, click next, and let the time expire while remaining on the 2nd question. Storyline will see that you've only visited 2 questions and will score a 50%.
The issue pops up when we have a learner not finish the exam and they are only graded on the questions viewed or answered, not the exam as a whole.
Thanks for taking a look.
Hi Aaron!
Thank you for including your file and providing a clear explanation of where the issue occurs!
I noticed the exact same error where the score is 50% when the user only answers one question. We've found this is a software bug within question banks. The score is based on the slide that was answered and the slide where the time runs out.
I've attached the file and your comments in the bug report with our team! I'm sorry this has been troublesome.
Hi Aaron!
I wanted to update this discussion to share that we aren't seeing this bug, unattempted questions in question banks are not included in the computation for cumulative score when timer expires in a timed quiz, in our latest version of Storyline 360 (Build 3.61.27106.0).
If others are running into this bug, please make sure you're using the latest version of Storyline 360. You can reach our team in this discussion or privately in a support case.
Yea - thank you!