Very similar to 2-4 year old questions I am getting only the incorrect banner on Review Quiz slides in Storyline 360. I need to fix this for a client. Got any advice?
Sorry this is affecting your course! We found that it's the rapid clicking that affects incorrect scoring.
We haven't released a fix yet, but we are continuing to track and test files. Are you comfortable sharing your file with us? If so, please use this private upload link. We'll test your file and share our findings!
Sorry to hear this is affecting your courses too! I don't have an update to share for this bug fix. When we have an update, we'll report back to this discussion.
I'm experiencing a related issue. I have a quiz in where all of the questions are set to shuffle the answers, except for a Multiple Choice type question where All of the Above is the last answer.
If the user selects a wrong answer, the Print Results shows one of the other answers as Correct (usually the answer the learner selected, which is really confusing them). I have yet to see it show as the All of the Above choice. Again, this question slide is the ONLY one set to Shuffle = None.
This is not a problem with my LMS, as it's doing this in both my LMS and Scorm Cloud.
After trying to solve the problem by removing shuffle, random questions, and question banks, we solved the problem by going to Ispring quiz maker. We did a lot of testing first and have been using it for a couple of weeks with no problems. It also adds some nice features for analyzing the answer selections for each student.
We are running into a similar issue with one of our courses. When a user "Reviews Quiz," they're being marked incorrect for questions that don't even have a response (which i assume has something to do with how quickly they're answering the questions).
Thanks for sharing what you are experiencing as well as that screenshot.
We are currently investigating an issue specific to quizzes that have a pre-submission Review option when submitting all at once and then clicking the next button rapidly prior to submission. Does that sound like what you are experiencing as well? I know you specifically mentioned how quickly they were moving through the content.
I'm was having the same problem - one of the questions in my quiz showed as correct with the right options chosen IF I viewed it as a single-page preview; but, as soon as I previewed it as part of the full course or tried it as part of a published course, it showed as incorrect even though the right options were chosen. This happened on the first run through the questions, not as part of a review. I also was not clicking through the answers quickly at all.
I tried changing it from randomized options to not randomize; I tried reselecting the correct answers in the Form view; I even tried deleting that question and reprogramming it. Nothing worked. In the end, I just pulled the question out of the quiz; which was a shame, because it was a good question.
I'm so sorry you experienced this bug, but it's much appreciated that you shared what helped! We'll report back to this discussion with any changes.
You mentioned you didn't click the Next button quickly, so we're happy to troubleshoot the file and see what's happening on that specific question. If you have the affected .story file handy, please use this private upload link.
I have tried twice to submit a ticket through your page. Both times, I clicked on the Submit button and nothing happened.
Margaret Werdermann
Organizational Development Consultant
………………………………………………………………………………….................................
Manitoba Public Insurance | Organizational Development
C: 204-955-2045
950-234 Donald Street, Winnipeg, MB R3C 4A4
Thank you for getting back to me.
When I submitted the question to now ... we just had to publish the file and move forward.
I went into Storyline 360 and made a test file and it didn’t show the same results as I had in the past.
If this happens again, I will let you know.
I'm experiencing the same error as Joanna outlined above. I've opened a ticket (case number 02547069) but I'm wondering if anybody has found a workaround?
Is it confirmed that refraining from "rapid or very fast clicking" when reviewing answers prior to submitting will mitigate this error?
Every side is set to "Automatically Decide" and I don't use the built-in feedback so Tanmay's fix won't work for me.
I have exactly the same issue where the feedback is coming incorrect upon selecting correct answer after publishing it on review link. Another instances is that it is doing well for some but not for some at the same time.
I tried every option discuss in this group but no success.
I'm sorry to hear you've also run into this issue—great call opening a case for us to investigate!
I see my teammate, Lianne, followed up with a next step. Let us know if you received that email, and if so, let Lianne know if those suggestions helped or not!
Hi Becca, is it possible to add the suggestions from Lianne to this thread? I'm running into similar issues as described by other users in this thread. My slides are set to "Automatically decide" when revisiting. We are receiving reports from our users (including screenshots) where the same provided answer is marked as correct/incorrect in different tries.
Because of these reports, we completely rebuilt our exams, but we are still getting similar feedback from our users. Rebuilding/testing is taking a lot of our time, and we are not getting better results.
I don't mind creating a ticket (so let me know if that's the only option to get this information), but I think it would be helpful to have the suggestions from the Articulate Team added to this thread, so other Articulate users can use these suggestions to troubleshoot.
Absolutely, I'm happy to share Lianne's suggestions.
If this issue only occurs in Review 360, we recommend previewing the course with the drag and drop slide in Storyline.
If the incorrect feedback layer appears after answering the question correctly, then we recommend recreating the slide to see if it resolves the issue.
If the issue doesn't happen in Preview, then there might be something wrong with the learner's browser. They'll need to follow the steps in this article to clear their browser cache.
Learners will also want to make sure they're using the most up-to-date version of their browser.
If you're still running into this issue, Mischka, I'd recommend working with our Support Engineers in a support case.
I had this issue several months ago and it nearly derailed electronic assessments in a program. I opened a ticket and after several weeks they were able to recreate the issue but no resolution came from it.
Similar to what Ren mentioned above, we believed that "rapid tapping" or "clicking" when reviewing, prior to submitting, was the culprit.
To solve this issue, we delayed navigation by 1 second to keep the user from rapidly tapping/clicking. This has worked really well for us and we've have over 50,000(!!!) assessment completions with ZERO glitches.
Here are the basics:
- Our Learners are mobile-first so we develop for an iPhone 7 Plus screen. We use the built-in quiz feature but to optimize screen space we have never used the built-in player and opted to use our own with custom navigation, custom feedback, etc.
- We placed the PREV and NEXT buttons on their own slide layer and added a delay of 1 second. This has been enough to slow down the user's navigation when reviewing so the answer can be recorded.
I've attached a copy of our quiz template to this post.
I have a slightly different issue... though related to the above... my review banners are correct - however the usual green check marks to indicate which were supposed to be the correct answers are missing....anyone know what is going on here??
Thanks for reaching out and sharing what you are experiencing. It sounds like you have the Review button enabled on your Result Slide, so now we just need to be sure you can see those correct answers.
To give learners visual feedback on their performance, double-click the Review results trigger in the Triggers panel and mark the box to Show correct/incorrect responses when reviewing:
63 Replies
Hi Bill!
Sorry this is affecting your course! We found that it's the rapid clicking that affects incorrect scoring.
We haven't released a fix yet, but we are continuing to track and test files. Are you comfortable sharing your file with us? If so, please use this private upload link. We'll test your file and share our findings!
Hi there, has there been any fix for this? On one of my quiz questions all of the answers are showing as correct, even the incorrect ones.
Hi domenica!
Sorry to hear this is affecting your courses too! I don't have an update to share for this bug fix. When we have an update, we'll report back to this discussion.
I'm experiencing a related issue. I have a quiz in where all of the questions are set to shuffle the answers, except for a Multiple Choice type question where All of the Above is the last answer.
If the user selects a wrong answer, the Print Results shows one of the other answers as Correct (usually the answer the learner selected, which is really confusing them). I have yet to see it show as the All of the Above choice. Again, this question slide is the ONLY one set to Shuffle = None.
This is not a problem with my LMS, as it's doing this in both my LMS and Scorm Cloud.
After trying to solve the problem by removing shuffle, random questions, and question banks, we solved the problem by going to Ispring quiz maker. We did a lot of testing first and have been using it for a couple of weeks with no problems. It also adds some nice features for analyzing the answer selections for each student.
We are running into a similar issue with one of our courses. When a user "Reviews Quiz," they're being marked incorrect for questions that don't even have a response (which i assume has something to do with how quickly they're answering the questions).
Hi Sara,
Thanks for sharing what you are experiencing as well as that screenshot.
We are currently investigating an issue specific to quizzes that have a pre-submission Review option when submitting all at once and then clicking the next button rapidly prior to submission. Does that sound like what you are experiencing as well? I know you specifically mentioned how quickly they were moving through the content.
I'm was having the same problem - one of the questions in my quiz showed as correct with the right options chosen IF I viewed it as a single-page preview; but, as soon as I previewed it as part of the full course or tried it as part of a published course, it showed as incorrect even though the right options were chosen. This happened on the first run through the questions, not as part of a review. I also was not clicking through the answers quickly at all.
I tried changing it from randomized options to not randomize; I tried reselecting the correct answers in the Form view; I even tried deleting that question and reprogramming it. Nothing worked. In the end, I just pulled the question out of the quiz; which was a shame, because it was a good question.
Please let me know when this bug is fixed.
Hi Margaret,
I'm so sorry you experienced this bug, but it's much appreciated that you shared what helped! We'll report back to this discussion with any changes.
You mentioned you didn't click the Next button quickly, so we're happy to troubleshoot the file and see what's happening on that specific question. If you have the affected .story file handy, please use this private upload link.
We'd be remiss not to explore further!
I have tried twice to submit a ticket through your page. Both times, I clicked on the Submit button and nothing happened.
Margaret Werdermann
Organizational Development Consultant
………………………………………………………………………………….................................
Manitoba Public Insurance | Organizational Development
C: 204-955-2045
950-234 Donald Street, Winnipeg, MB R3C 4A4
Hi Margaret,
Thanks so much for keeping at it, and I'm sorry you had to submit multiple times for your case to come through!
It looks like my teammate, Renato, has reviewed your file and provided you with some suggestions and next steps.
Let us know if you received it, and if you have, please let Renato know if the changes will work for you!
Hi everyone!
I'm also interested to know if there's been any progress on fixing this bug? It might cause some confusion with the learners/stakeholders.
Thanks!
Hi Nevena and welcome to E-Learning Heroes 😊
There have been a couple of items discussed here, so I'd like to understand what you may be seeing.
Thank you for getting back to me.
When I submitted the question to now ... we just had to publish the file and move forward.
I went into Storyline 360 and made a test file and it didn’t show the same results as I had in the past.
If this happens again, I will let you know.
Bryan
Hi,
If you are using Review Quiz feature in Storyline, couple of things we should follow:
1. set questions to When revisiting: "Automatically decide".
2. In Form view, set Feedback = none.
That should fix any issue regarding Review Quiz.
I'm experiencing the same error as Joanna outlined above. I've opened a ticket (case number 02547069) but I'm wondering if anybody has found a workaround?
Is it confirmed that refraining from "rapid or very fast clicking" when reviewing answers prior to submitting will mitigate this error?
Every side is set to "Automatically Decide" and I don't use the built-in feedback so Tanmay's fix won't work for me.
Anything else work for anybody?
This post was removed by the author
Hi,
I have exactly the same issue where the feedback is coming incorrect upon selecting correct answer after publishing it on review link. Another instances is that it is doing well for some but not for some at the same time.
I tried every option discuss in this group but no success.
Can you let me know when this bug is fixed!
Thanks!
Garima
Hello Garima,
I'm sorry to hear you've also run into this issue—great call opening a case for us to investigate!
I see my teammate, Lianne, followed up with a next step. Let us know if you received that email, and if so, let Lianne know if those suggestions helped or not!
Hi Becca, is it possible to add the suggestions from Lianne to this thread? I'm running into similar issues as described by other users in this thread. My slides are set to "Automatically decide" when revisiting. We are receiving reports from our users (including screenshots) where the same provided answer is marked as correct/incorrect in different tries.
Because of these reports, we completely rebuilt our exams, but we are still getting similar feedback from our users. Rebuilding/testing is taking a lot of our time, and we are not getting better results.
I don't mind creating a ticket (so let me know if that's the only option to get this information), but I think it would be helpful to have the suggestions from the Articulate Team added to this thread, so other Articulate users can use these suggestions to troubleshoot.
Hello Mischka!
Absolutely, I'm happy to share Lianne's suggestions.
If you're still running into this issue, Mischka, I'd recommend working with our Support Engineers in a support case.
I had this issue several months ago and it nearly derailed electronic assessments in a program. I opened a ticket and after several weeks they were able to recreate the issue but no resolution came from it.
Similar to what Ren mentioned above, we believed that "rapid tapping" or "clicking" when reviewing, prior to submitting, was the culprit.
To solve this issue, we delayed navigation by 1 second to keep the user from rapidly tapping/clicking. This has worked really well for us and we've have over 50,000(!!!) assessment completions with ZERO glitches.
Here are the basics:
- Our Learners are mobile-first so we develop for an iPhone 7 Plus screen. We use the built-in quiz feature but to optimize screen space we have never used the built-in player and opted to use our own with custom navigation, custom feedback, etc.
- We placed the PREV and NEXT buttons on their own slide layer and added a delay of 1 second. This has been enough to slow down the user's navigation when reviewing so the answer can be recorded.
I've attached a copy of our quiz template to this post.
This post was removed by the author
I have a slightly different issue... though related to the above... my review banners are correct - however the usual green check marks to indicate which were supposed to be the correct answers are missing....anyone know what is going on here??
Hello Patricia,
Thanks for reaching out and sharing what you are experiencing. It sounds like you have the Review button enabled on your Result Slide, so now we just need to be sure you can see those correct answers.
To give learners visual feedback on their performance, double-click the Review results trigger in the Triggers panel and mark the box to Show correct/incorrect responses when reviewing: