Score and results

Hello all! Sorry I couldn't find an answer for my question in the existing discussions. In a course I am designing right now a learners needs to complete 80% of questions correctly. I have this setting in the result slide: 80% passing score. If they do not, they come back to the beginning of the scene and redo the theory part again and the quiz. I did this, however, a leaners only goes further (to the next scenes) of the course if he answered all of the questions correctly (which is 100% not 80%). I tried to experiment in changing the points in each question slide and I got the same results. (I even made one question 99 points and answered it correctly and the rest just 0 and answered them incorrectly and it still brings me to redo the scene and the test). So I don't quite understand what setting I should make to let them go further if they answered 80% correctly. So I lost a bit.

Thanks in advance!

Yulia

20 Replies
Yulia Seredina

Sorry that I have so many questions today :) If anybody knows could you please share with me what is the difference between 2 triggers: ResultsPassPercent and ResultScorePercent? I tried both of them but the results do not change (I mean when I answer 4 questions out of 5 correctly where weight of each is 20 points) I got the same result) - I pass. 

Joey Buys

Hi Yulia.

Would you be able to share your source file with us so we can have a look?

Regarding the Results.PassPercent and Results.ScorePercent: Wendy's explanation is spot on. One additional thing to note though, it that both these variables are 'system variables' and have a lot of predefined logic applied to them within Storyline. 

When attempting to manipulate scoring parameters, it is better to use the Results.ScorePoints. 

For example, if you have 5 questions that only count for 1 point each, Storyline's mathematical calculations will be able to convert this to a percentile score by using the Results.PassPoints (4/5) and the users Results.ScorePoints. 

In  some instances the point allocation of questions within an assessment makes it impossible to pass the assessment (even with a 80% pass score requirement) unless you correctly answer all the questions. For example, if you have 5 questions, but the point allocation of these questions are not even, you might pass 4 out of the 5 questions, but only achieve a score (rounded by Storyline) of 76%.

Example:

Question 1 - 1 point (user passed)

Question 2 - 1 point (user passed)

Question 3 - 3 points (user failed)

Question 4 - 2 points (user passed)

User's Result.ScorePoints = 4 (out of 7)

Therefore, the Results.ScorePercent = 57%

Required Pass Percent = 80%, thus Pass Points = 6 (out of 7) (Actual percentage will be 85%)

Yulia Seredina

Thank you, Wendy and Joey, for your answers!

Yes, I do understand the concept of pass percent/point and score percent/point, I am confused in what should i choose between the "score" and "pass" if I need the learners to gain 80% correct (or in points). If the don't get these 80, they get back to the beginning of module/training.

I guess I can reach this goal by adding a variable "ResultScorePercent/Point" is greater than or equal 80 to the result slide to the trigger Submit results (please see the test example attached, there are just random questions that first came up to my mind :)), does it mean that when a learner completes the training and gets these 80 points/percent (I set up points equivalent to percentage in the test file) that his results will be in LMS and training will be gone from them.

What will change if I choose: ResultPassPercent/Point?

Sorry if I explain unclear what I am trying to do. Thanks again!

Joey Buys

Hi again Yulia.

I had a look at the sample file you uploaded - from what I can see, and based on my understanding of your requirement, the file in question has the functionality that you are seeking, or am I missing something?

With regards to your LMS reporting question: you can choose what your LMS records when you publish your course. Your LMS will have a API requirement (AICC, SCORM ver. X or TinCan) and also a 'status' requirement (Passed/Incomplete, Passed/Failed, Completed/Incomplete & Completed/Failed).

You can however select when a course is completed via the tracking settings. You can either track course completion via the amount of slides viewed, or alternatively based on the results of a specific results slide (quiz / assessment's results).

Please see attached images.

 

Yulia Seredina

Hi Joey again!

Thank you for your answer.

Sorry that I don't understand this. I don't know if I chose the right settings in the file I shared with you to achieve my goals. I added at the result slide to the trigger "submit results" a variable "if ResultsScorePercent is greater than or equal to 80.00". I don't know if I should choose there "if ResultsPassPercent is greater than or equal to 80.00" for my purposes?

I experimented to change it to a variable with ResultsPassPercent and to complete the module as a learner (making mistakes and not) but I don't see the difference in the results (I mean if I have a setting ResultScorePercent and ResultPassPercent). So my question was: what changes if I choose ResultPassPercent and what out of these options (ResultsScorePercent or ResultsPassPercent) do I need to choose for my purpose for the course, which is if a learner gains less than 80% correct answers he comes back to the beginning of the module and his results are not submitted until he gathers 80% correct (when he follows the module for the second time and the following times if he didn't make it for the second time).

Is there any other additional setting I should add for this purpose in the course?

Sorry again that I don't get this. I found this confusing. 

Thanks,

Yulia

Joey Buys

Hi Yulia.

My apologies. I seem to have misinterpreted your previous message. Thank you for clarifying.

So with regards to the 'Submit results slide_name': you don't need to add additional logic or parameters to this trigger. In fact, I will avoid it entirely since Storyline (as far as I know) will overrule the 'conditions set' and submit the results slide anyway.

So in finaling understanding your request: am I correct in saying that you DO NOT to send a failed attempt to the LMS (for reporting) if the user fails the quiz? You just want to in essence create a infinite loop back to the content until the user finally passes the assessment. If they pass, you want to (and only then) send the passed / complete statement to the LMS?

Yulia Seredina

Thanks, Joey! No worries, it is kind of hard to communicate via messaging :) But I think we understand now what was the question :)

Unfortunately, I cannot open the file you shared with me as we have an old version (Articulate 2), which I cannot influence to upgrade yet :( So if you could share with me what did you do in the file that would be great! (You just removed the variable from a trigger "Submit results"?) I just did it myself and i think it works (I don't know why it didn't work for me before): if I gain at least 80% correct, I see a correct layer and then I set up a trigger on this layer if I click the button to jump to the next scene (or maybe I will set up "exit course" if we split the course into small modules, so people will be looped to the beginning of the module to redo it). If I gain less than 80% correct I see failure layer and I click the button which brings me back to the same module (to redo it again). I attached the file, I guess you can see it in a newer version.

Yes, our purpose is to track only completion (with 80% passed). That's why we needed learners to be looped back. (Otherwise we would need to reassign the course to them or to follow up with them to do the course again if we make this setting in the system that it stays in there for them if they fail etc.) As everybody has to be compliant with the standards they learn in this course no matter what, we basically make them redo the modules if they fail them. That's why I was concerned as submit button is on the base layer and if I fail does it mean LMS will still track my results even though I will redo the course again?... I will test in in our LMS, I just wanted to be sure I do everything correct in Articulate for this purpose.

Thanks,

Yulia

Joey Buys

Hi again Yulia.

Awww so sorry that you could not open the file. I didn't even register that I get the 'Upgrade course' message when opening your files. Oversight on my side hehe.

I'm glad that the course is behaving better now since you made the small change to the 'Submit results' trigger.

To answer your question regarding the LMS tracking: if the course is set to track completion via a score on a results slide, then yes, your LMS will log every single attempt. Meaning that irrespective of whether a user fails or passes, the LMS will record that score and register a pass / fail as part of the completion tracking. I would recommend that you test your course on SCORM Cloud to see this in action.

In your particular case, we can create a work around. I did this in the file I shared with you.

What I did is to create an additional results slide (1.8) after the first one. The second results slide is set to track the previous result slide's parameters (instead of the question answers as the first one does.

So on slide 1.8 (new results slide) click on 'EDIT RESULT SLIDE'. Then at the very top, change the 'Calculate results for:' option to 'Selected results slides'. Select 1.7 from the list provided, I checked the 'Combine points from each quiz' in my example.

Lastly, go to your first results slide (1.7) . Here you can delete the trigger 'Submit results' now since we are doing it on slide 1.8. Go to your success layer, remove all existing triggers and add a single trigger to jump to slide 1.8 when the timeline starts. On the failure layer, you can add a custom message informing the learner that they have not passed and would need to review the content. Here you can leave the Redo module button as is.

This seems like a very random 'hack' but this way you can tell your course to ONLY track progress via slide 1.8's parameters. This will then inform the LMS that if a user has failed on 1.7, simply keep the score, but do not log a 'failed' result, simply keep it as incomplete. Slide 1.8, which is where our LMS tracking is happening, is inaccessible should you fail on 1.7, but will track a pass correctly in your LMS.

Please bear in mind that your LMS will have very specific tracking properties that you need to adhere to (can be obtained from your LMS administrator), but I have tested the above on our local LMS and SCORM cloud and it worked for me. 

Yulia Seredina

Hi Joey!

Thank you for helping me out! I attached the file as I couldn't open your file last time, I was wondering if you could check the file I am sharing now whether I did everything correct on both slides 1.7 and 1.8 triggers' wise? I list the triggers I kept here:

Slide 1.7:

Base layer:
• Show layer Failure when the timeline starts if Results.ScorePoints is less than Results.PassPoints
• Show layer Success when the timeline starts if Results.ScorePoints is greater than or equal to Results.PassPoints

Success layer:
• Jump to 1.8 Results Slide when the timeline starts

Failure layer:
• Reset results 1.7 Results Slide when user clicks continue button
• Jump to 1.1 Slide (beginning of the module) when the user clicks Continue button

Slide 1.8:

Base layer:
• Submit Results 1.8 Results Slide when timeline starts (but it also asks me object: shall I keep 1.8 results slide?)
• Exit course when a user clicks the submit button
• Show layer success when timeline starts

I have a question about one trigger that was added by default when I added a slide 1.8. If I keep it on a slide, it doesn’t allow me to exit then when I click the submit button:
• Submit interaction Results slide 1 (which is 1.8) when a user clicks the submit button.

I don't need it, right?

Success layer and Failure layer on the slide 1.8 do not have any triggers, is this correct?

2 small questions:

About combining points on a slide 1.8: It also asks me Passing Score – shall I keep it the same 80%? (please see the image Combine points from each quiz.PNG

About jumping to the slide 1.8 from the slide 1.7's success layer: It  asks me also object: shall I indicate there Success? (please see image jump to slide 1.8).

I also have a mathematical question:

I don't know who should I address it too but if you can help with that it would be great! Our goal is to make learners gather 80% correct answers from the whole course. Let's say if we have 4 modules in this course and each of these modules have 5 questions they will have to answer 80% correct, which is at least 16 correct answers.

I split the huge course into small separate courses (modules) and I have a setting in each of them - in order to pass you have to gain 80% correct in each module. It is easy if I have 5 questions in each module the learners will need to gain 4 correct answers in each of them (16 in total). However, we do not have equal number of questions in each section (I can tell about only 3 modules now: we have 4, 11 and around 8 questions in the 3-d module. So my question is that proportion of completing of 80% correct answers stays the same if we assign it as one course or separate small courses (modules) if we have different amount of questions if each section? (the smallest amount we have for a module is 4 questions i believe)?

Sorry again if I ask a lot :)  Thanks again.

Yulia

Joey Buys

Hi again Yulia.

Loving the progress you are making. I am going to address your last response per line item below:

Slide 1.7

This is configured perfectly now. Works like a charm.

Slide 1.8

Base layer:
• Submit Results 1.8 Results Slide when timeline starts (but it also asks me object: shall I keep 1.8 results slide?)
• Exit course when a user clicks the submit button
• Show layer success when timeline starts

All of the above is 100% correct. When using objects on the results slide to submit you interactions, opt to use the slide as your object instead of elements - it's safer best practice as you might (in future) delete elements of the slide that will break your logic. You are missing one trigger though - you need to have another trigger that submits the results of 1.7 as well as we require this for tracking to work in the LMS correctly.

I have a question about one trigger that was added by default when I added a slide 1.8. If I keep it on a slide, it doesn’t allow me to exit then when I click the submit button:
• Submit interaction Results slide 1 (which is 1.8) when a user clicks the submit button.

I don't need it, right?

Correct. Since we are already submitting the results when the timeline starts we do not need any additional triggers to submit it again....so get rid of it =). Just a quick tip - you can change what buttons show on the slide (any slide - except layers) by clicking on the base layer and then on the little gear button (see attached image). Here you can select which buttons are present. Just remember to check your button triggers if you change them =).

Success layer and Failure layer on the slide 1.8 do not have any triggers, is this correct?

Correct!

 

2 small questions:

About combining points on a slide 1.8: It also asks me Passing Score – shall I keep it the same 80%? (please see the image Combine points from each quiz.PNG

You can keep it at 80% yes as we are only passing one score. 

About jumping to the slide 1.8 from the slide 1.7's success layer: It  asks me also object: shall I indicate there Success? (please see image jump to slide 1.8).

Correct. You can leave this as is. Success here refers to the layer, which is perfect.

Joey Buys

For the second part of your question (I also have a mathematical question):

It is totally doable. I think that the easiest way to achieve this is to change your score points for you questions to 1 (successful) and 0 (unsuccessful). This way, your scoring system in essence becomes a true/false statement. True (1 point) if answered correctly and False (0 points) if answered incorrectly.

This way, you are drastically simplifying the scoring parameters for your results by only indicating how many question are in your assessment. Keep your percentage at 80% and let Storyline perform the math calculations for you.

For example: 8 questions = correct answers / total questions * 100

If you change the point allocation for your questions, Storyline has to 'work harder' in order to determine the results. 

Example: 8 questions (with random points score) = (correct answers * correct points per question) / (total questions * correct points per question) * 100.

You can see how this can quickly become messy.

Yulia Seredina

Hi Joey!
Thank you for addressing my questions in details. I appreciate this!

Sorry, just to double check: on a slide 1.8 I have to have 4 triggers on Base layer:
• Submit results 1.8 Results Slide when the timeline starts
• Submit results 1.7 Results Slide when timeline starts
• Show layer success when the timeline starts
• Exit course when user clicks the submit button
And in EDIT RESULT SLIDE for 1.8 I have Selected RESULTS slide.

(For the slide 1.7 in EDIT RESULT SLIDE I keep selected QUESTIONS?)

I don’t think I understand what you are talking about in here, sorry about that:
I think that the easiest way to achieve this is to change your score points for your questions to 1 (successful) and 0 (unsuccessful). This way, your scoring system in essence becomes a true/false statement. True (1 point) if answered correctly and False (0 points) if answered incorrectly.
What do you mean by 1 successful/1 unsuccessful?...


Luckily, my answer is quite shorter this time and I finally have less questions :)

Thanks,

Yulia

Joey Buys

Good day Yulia.

Hope you had a good and relaxing weekend.

I reviewed your file. Just one small change - on slide 1.8, move your 'Submit results 1.7 Results slide' trigger to the very top. So it will be Submit 1.7, then submit 1.8 and so on.

What do you mean by 1 successful/1 unsuccessful?...

It is 1 successful and 0 unsuccessful =D. Just like a true/false question. So they only get one point for getting it right and 0 for failing the question.