Is there a way to give partial credit for multiple option, drag and drap and other types of multiple answer questions? In order to do this, you would need to assign a value to each response, but I wasn't able to figure out how to do that if it is indeed possible. Let me know. Thanks.

I can't believed this was raised 8 years ago and has still not been implemented. If a course uses lots of multiple response question types and the learners select most of the correct answers every time, it will be very demoralising to always be told they got it wrong when actually they got a large percentage right.

Hi Miriam, I think the attached achieves what you are trying to do. Although this example uses a multiple response question, the mechanics should be same when applied to other question types. Basically, I have built my own feedback layers (correct, partially correct and incorrect) and have used trggers to display the relevant layer based on the value of a number variable that assigns a score (10 points if 2 AND 4 = 'selected' when the user clicks on submit or 5 points if 2 OR 4 equal 'selected' when the user clicks on submit). The key is to have the triggers that assign the score above the trigger to submit the interaction - SL processes triggers from top to bottom so you want the score to be assigned before the the relevant feedback layer is displayed. Antony

Hi Miraim, I can see no reason why the principle wouldn't work for a D&D - though you will need to use the 'drop correct' and 'drop incorrect' states to control how many points are assigned. For example: If item A and item B are correct, you will need to add a trigger to adjust the number variable to 10 if the states of item A AND item B are equal to 'drop correct' and a further trigger that adjusts it to 5 if the states of item A OR item B are equal to 'drop correct'. To tally the results, you will need to have a seperate number variable for each question (i.e. Q1, Q2 etc.) as well as a further number variable called 'Total' (or something similar). On the results slide, you will need to add triggers that add the question variables to the 'Total' variable and then on screen, add a reference to display the value of the 'Total' variable i.e. %Total%. I hope that makes sense, but post back if you need any further clarification. Antony

I have created a solution that will give partial credit for partial correct answers. This method will send the correct scoring to the LMS. The concept is that we are in fact doing multiple quiz questions, all with a single slide.The original slide is the visual for the user. It collects the correct/incorrect status for each item being questioned and stores them as variables. In my sample, there are 3 questions, each with multiple choices.In addition to storing the variables, it uses the first slide to submit the results for the first question only. I use a correct object and an incorrect object and use a standard Pick 1 to indicate which 1 is correct. The variable is used to determine which one needs to be selected prior to submitting. Note: Pick 1 does not care if the user selected the object or if we did it through triggers, it only looks at the current status.After submitting, it will display the feedback screen appropriate to the Question 1 result only. The next slide immediately converts the variable for the 2nd question into selecting the correct or incorrect object and immediately submits the Pick 1 quiz. So, the user does not see this evaluation process and will not even be aware that they're on a different slide, rather than just moving to the next piece of the feedback. Again, after reviewing the feedback on slide 2, it moves to the next slide which repeats the process for the 3rd question (repeat as many times as needed).And finally, the results page thinks you've done a quiz with 3 questions and will calculate based on each of those questions separately.During actual use, you would move the correct/incorrect objects off screen. Remember, these objects are only reflecting the status of the single question being evaluated on this slide.If you want to "see" the evaluation process on the 2nd/3rd slides (for dev purposes), then just move the Submit trigger further down the timeline.It should be possible to convert this for other visual styles such as a basic multiple response, drag and drop, drop down, hotspot, etc. Just be careful during design that you don't give them the ability to select all answers as a way to accidentally get the correct ones. It should also be possible to compile the feedback into a single feedback form, simply by adding a "When timeline starts" trigger to the unwanted feedback layers, forcing the move to the next slide.

Hi there Miriam! Welcome to the community Currently Storyline doesn’t support partial credit for individual answers, but by all means, please feel free to Submit a Feature Request. Thanks! =)

Partial credit for multiple option question

HVfb0f498d-053b
Community Member
3 years ago
I can't believed this was raised 8 years ago and has still not been implemented. If a course uses lots of multiple response question types and the learners select most of the correct answers every time, it will be very demoralising to always be told they got it wrong when actually they got a large percentage right.
AntonySnow
Community Member
12 years ago

Hi Miriam,

I think the attached achieves what you are trying to do. Although this example uses a multiple response question, the mechanics should be same when applied to other question types.

Basically, I have built my own feedback layers (correct, partially correct and incorrect) and have used trggers to display the relevant layer based on the value of a number variable that assigns a score (10 points if 2 AND 4 = 'selected' when the user clicks on submit or 5 points if 2 OR 4 equal 'selected' when the user clicks on submit). The key is to have the triggers that assign the score above the trigger to submit the interaction - SL processes triggers from top to bottom so you want the score to be assigned before the the relevant feedback layer is displayed.

Antony
partial_2bscoring.story332 KB
AntonySnow
Community Member
12 years ago

Hi Miraim,

I can see no reason why the principle wouldn't work for a D&D - though you will need to use the 'drop correct' and 'drop incorrect' states to control how many points are assigned. For example:

If item A and item B are correct, you will need to add a trigger to adjust the number variable to 10 if the states of item A AND item B are equal to 'drop correct' and a further trigger that adjusts it to 5 if the states of item A OR item B are equal to 'drop correct'.

To tally the results, you will need to have a seperate number variable for each question (i.e. Q1, Q2 etc.) as well as a further number variable called 'Total' (or something similar). On the results slide, you will need to add triggers that add the question variables to the 'Total' variable and then on screen, add a reference to display the value of the 'Total' variable i.e. %Total%.

I hope that makes sense, but post back if you need any further clarification.

Antony
HoneyTurner
Community Member
4 months ago
I have created a solution that will give partial credit for partial correct answers. This method will send the correct scoring to the LMS.
The concept is that we are in fact doing multiple quiz questions, all with a single slide.
The original slide is the visual for the user. It collects the correct/incorrect status for each item being questioned and stores them as variables. In my sample, there are 3 questions, each with multiple choices.
In addition to storing the variables, it uses the first slide to submit the results for the first question only. I use a correct object and an incorrect object and use a standard Pick 1 to indicate which 1 is correct. The variable is used to determine which one needs to be selected prior to submitting. Note: Pick 1 does not care if the user selected the object or if we did it through triggers, it only looks at the current status.
After submitting, it will display the feedback screen appropriate to the Question 1 result only.
The next slide immediately converts the variable for the 2nd question into selecting the correct or incorrect object and immediately submits the Pick 1 quiz. So, the user does not see this evaluation process and will not even be aware that they're on a different slide, rather than just moving to the next piece of the feedback.
Again, after reviewing the feedback on slide 2, it moves to the next slide which repeats the process for the 3rd question (repeat as many times as needed).
And finally, the results page thinks you've done a quiz with 3 questions and will calculate based on each of those questions separately.
During actual use, you would move the correct/incorrect objects off screen. Remember, these objects are only reflecting the status of the single question being evaluated on this slide.
If you want to "see" the evaluation process on the 2nd/3rd slides (for dev purposes), then just move the Submit trigger further down the timeline.
It should be possible to convert this for other visual styles such as a basic multiple response, drag and drop, drop down, hotspot, etc. Just be careful during design that you don't give them the ability to select all answers as a way to accidentally get the correct ones.
It should also be possible to compile the feedback into a single feedback form, simply by adding a "When timeline starts" trigger to the unwanted feedback layers, forcing the move to the next slide.
weighted multiselect quiz.story1.3 MB
NicoleLegault1
Community Member
12 years ago
Hi there Miriam! Welcome to the community Currently Storyline doesn’t support partial credit for individual answers, but by all means, please feel free to Submit a Feature Request. Thanks! =)
MiriamManglani
Community Member
12 years ago
Thanks Anothony! This was really helpful. Any idea if this is possible to do for a drag and drop question and how you would tally results for multiple questions built this way on a results slide?
RebeccaFleischC
Community Member
12 years ago

Hi Antony,

Tx for answering this question, as it's a popular one. I've not yet seen a solution that would work with an LMS...not say it's not out there, but I'm still looking, which is why, even though I should be working , I downloaded your file. I played with it quite a while before posting here, since I kept thinking I was doing something wrong

I have some questions:

First, I THINK shuffle answers needs to be off for this to work? Can you confirm?

Second, I THINK the set score equal to 10 variable needs an addition condition AND Button 3's state (or whichever is the button for the number 5) is not equal to selected. (at least I got a 10 when I had all 3 selected)

Third, no matter what I do, when I add another slide to this story, I'm immediately brought to the new slide after selecting one of the answers. And this is even though I've removed the "jump to the next slide" trigger from the continue button on the partially and incorrect layers. I also tried adding a trigger to jump back to the base slide. That has me really stumped

Fourth: would this work with an LMS? When I add the results slide I get 0% and an indication that I passed..

TIA!
AntonySnow
Community Member
12 years ago

Hi Rebecca,

Thanks for the post and for raising some interesting questions, which I will (try to) answer:

I'm not convinced that shuffle answers needs to be off - the scoring is awarded based on which answer options have a selected state when the user clicks on 'submit', so not shuffling the options shouldn't make a difference?

I agree that the trigger to score 10 needs adjusting to include the condition that button 3's state is equal to 'normal' as well so you don't get 10 points for selecting all 3 options

I too have noticed that if you add a further slide you don't see the feedback layers on question 1 - I'm not sure why, but would love to hear from anyone else who may be able to answer this

I'm not sure how you would get this to work on an LMS. I have had a quick look and none of the default result variables used to pass the score to an LMS are being populated and I can't see a way to adjust them either :-(

Antony
RebeccaFleischC
Community Member
12 years ago

Hi Anthony,

Re shuffling, I thought it wasn't working when it was turned on, but it was perhaps that other things that were happening were muddying things up.

Re it not working with the existing feedback layer, I wonder if a built-in Try Again layer might work better

BUT

I haven't spent time testing because my own completely anecdotal observation is that most people who want this kind of fine-tuned scoring need it for real-world testing that would work in an LMS. That's why I was so intrigued when I saw this thread.

Ah, well, I guess back to the drawing board!
MikeTaylor
Super Hero
11 years ago
This came up again in another thread and I think we might have a good solution. And thanks to Becky for improving on the original idea. You can check it out over at http://community.articulate.com/forums/p/21997/196551.aspx