Forum Discussion

Vanessa-RS23's avatar
Vanessa-RS23
Community Member
21 days ago

Adjusting Quiz Score for Screencast Test

Hi everyone!

For a recent project, I inserted a screen recording made in Storyline via the step-by-step "Test" scene, which comes ready-made with a final Quiz Results slide and both a Success and Failure layer.

Like most screencast tests, the user has to select the appropriate hotspot in order to move on to the next slide, ultimately getting a final score based on the number of correct clicks. Since we want to gauge how well our learners are able to navigate, we would love some idea of how many incorrect clicks or attempts it takes them on each step to eventually get to the correct click (hotspot).

I attempted to adjust the score points variable, and frankly I'm confused at the moment because a few days ago, the variable seemed to work (i.e. it impacted the final quiz score) but now it isn't working at all though I hadn't made any changes. The quiz score always ends up at 100% - there's basically no way to fail, even if a user made an incorrect click a hundred times - because they eventually find the correct click, the score jumps to a full 100% by the end. We would like them to eventually find the right click because this would be the most realistic in terms of on-the-job experience.

Some other details:

We offer unlimited tries and the Try Again layer gives some clear hints to the correct answer (I tried with limited attempts and it still doesn't impact the final score). The unlimited tries just allows them to keep trying, as they would while on the job - it's the most realistic simulation of the task.

Once I can figure out how to make this work, my colleagues and I can assess what we would feel is an appropriate passing point score based on incorrect attempts, but it's not worth considering at the moment if we can't get it to work.

 

Here is the original variable I tried:

Subtract value 1 from Quiz1.ScorePoints when the user clicks outside of Hotspot 1

I also tried with an added condition (thinking it maybe wasn't submitting the subtracted value if they ultimately get it correct upon submission)

Subtract value 1 from Quiz1.ScorePoints when the user clicks outside Hotspot 1 if Attempts > 1

 

I also attempted to create a new variable which I called IncorrectClicks - but it doesn't impact the Quiz1.ScorePoints and I don't know if it is worth trying to add a trigger to the Quiz Results to show Success/Failure layers based solely on the IncorrectClicks variable (and removing the stock trigger to show layers based on ScorePoints).

Another note - there isn't a way to assign a negative score to the Try Again layer (at least in the Form View of the quiz, you can only assign points to Correct and Incorrect slides, neither of which are triggered in the screencast test w/ unlimited tries - I also tried adding the above variable to the Try Again layer and it also didn't subtract anything).

If there isn't really a way to adjust the score variable on screencast tests, then I'm open to any other ideas on how to assess user navigation proficiency aside from scoring incorrect attempts.

  • Hi Vanessa! 

    Interesting situation! I wouldn't try adjusting the Quiz1.ScorePoints since as you said, if you give unlimited attempts, eventually they have to get it right and so they'll always get 100%. I think your approach to create a new IncorrectClicks variable is probably the same approach I would take. Knowing that they'll always see the "success" layer on the results slide, I think I'd do something like this:

    • Create IncorrectClicks variable
    • Add 1 to IncorrectClicks when the timeline starts on each "try again" layer
    • On the Results Slide/Success layer (which every learner will see), remove the points and the percentage, and instead just have a generic "You've completed the simulation. You clicked in the incorrect spot %IncorrectClicks% times."
    • You could then have a "try simulation again" button that only shows if IncorrectClicks > whatever amount.

    I made a quick sample with a PPT simulation and have attached it here!