Test - 3 tries, allowing exit and remediation

I am using Storyline to develop a certification test that will run in an LMS (SABA). This is how the client would like the testing to function. I am not sure how to make this happen, especially how to record only a passing score in the LMS on the 1st 2 attempts. I have attached a skeleton story file if someone is able to help.

  1. User takes quiz
  2. User has three chances
  3. If user fails the 1st try, they have option to "retry quiz now" or "exit and remediate."
  4. No score should be reported to LMS unless user passes. Not sure how to keep failing score from being recorded in SABA if user exits and remediates.
  5. When user re-enters to take test again, course should be bookmarked and know this is 2nd attempt. If user FAILS again, screen appears with the wording: You have completed your 2nd attempt and were not successful. Do you want to "retry quiz again now" or "exit and remediate."
  6. No score should be reported to LMS unless user passes. Not sure how to keep failing score from being recorded in SABA if user exits and remediates.
  7. When user re-enters for the 3rd time, course should be bookmarked and know this is 3rd attempt. If user FAILS, the message should be something like: “You were not successful. An incomplete score has been recorded on your record. Please contact your manager for further instructions."
  8. A score of FAIL is recorded in the LMS.
9 Replies
Kelly Kung

Interesting business requirements.   Not too sure how this can be done using Storyline, but the "other" authoring tool that starts with an "L" can do this easily because you can access system variables like the course's status, score, username, ect.

Hopefully someone can chime in with a way to do it in Storyline.

-kelly

Kelly Kung

Kelly Kung said:

Interesting business requirements.   Not too sure how this can be done using Storyline, but the "other" authoring tool that starts with an "L" can do this easily because you can access system variables like the course's status, score, username, ect.

Hopefully someone can chime in with a way to do it in Storyline.

-kelly


Before I get flamed on mentioning the "other company", I just wanted to say each product has its Pros and Cons.  Hopefully this didn't offend anyone.  The company that I'm at uses both Articulate products and also the "other company" and each product is great for doing certain tasks.

-kelly

Gerry Wasiluk

The 3 quiz attempts can easily be done using variables to track quiz attempts and then "hide the quiz" once three attempts are made.  However, if I remember right, you can only either send no score consistently or a score consistently.  Pick one but don't mix them.

A hybrid might be possible if the user has to get 100% to pass and you do not want to record how user's answered quiz questions.

Chantelle N

I have a similar question (I think) - so hopefully I am doing right by posting it here.

I have a course that has the 3 attempt rule enforced through variables as well. Our idea is that we want the student to have to tell someone if they fail 3 times, in order to have the course "re-assigned" with a fresh set of quiz attempts.

The problem we are running into is that even if the course is reassigned in our LMS, it is still remembering the user's last progress (in other words, the retries are not reset so if they fail, reassigning doesn't give them another chance).

We DID find out that if the user clicks "No" to "pick up where you left off" in the bookmarking, the quiz retries are reset. Which I did not know and which is problematic if users find out that they can do that, since in that case they can take it as many times as they want.

The person on the LMS side who was helping me with this said there is no way to "reset" it on their end since the tracking is self-contained within the SCORM.

Any helpful ideas out there?

Chantelle

Ashley Terwilliger

Hi Chantelle, 

You could disable the prompt to resume, and set it to Always resume within Storyline.  Although that won't allow you to "reset" the progress as you've mentioned - the results are stored within your LMS, so the ability to reset the results or remove their previous attempts sounds like something you'd need to do within the LMS itself. 

Chantelle N

Thanks Ashley, I hadn't thought of that! (Sorry for the delay in reply, apparently I wasn't subscribed to the thread). That does only get us halfway there though, since we don't want to prevent them from ever retaking the quiz. We just want to know about it if they don't do well the first time.

I figured the results on the LMS side would need to be managed there. But, like I said, the people on the LMS side don't seem to think they can do anything on their end with resetting the results. I'm not sure how typical that is since my knowledge of the SCORM/LMS interaction from a technical standpoint is pretty slim.

Ashley Terwilliger

Hi Chantelle, 

The results are stored within the LMS itself, so in terms of resetting results, they'd need to handle that. I have seen a few community examples, where on the final results slide, the user is given the option to retry the quiz/course - and based on clicking on that button you could track a number variable (let's call it Attempts with an initial value of 1). The button would bring you back to the beginning and also add one to the Attempts variable. You'd set the Retry button to be disabled once the Attempts variable is equal to three and then the user wouldn't be able to continue to take the quiz any longer. Its up to your LMS to track the individual attempt scores though, and depending on how they track results, it may overwrite the previous scores each time they complete the quiz. 

Chantelle N

Yeah, the variable setup is something that's already present in the course, with the retry button being disabled after 3 attempts. The problem is just what happens if they fail - we wanted them to be able to take the course again, but only after alerting someone that they failed their first 3 tries and need it re-assigned. Our LMS does track the most recent score so it would overwrite any failing scores with the passing one once they do pass.

It seems like the only options we have are allowing unlimited attempts until they pass, or limiting their attempts and not allowing them to be reset, so if they fail they fail and that's the end of it.  For now we've just decided to give them unlimited attempts.