Random draw from quiz bank

The probability that question 1 will come up every time from 4 random questions is 25%.  That's really good odds.  I would bet on those odds.

If you want to "randomly" force the draw then you might want to set up the questions into 4 banks of 10 questions.  Have them answer the first set.  Pass - done course, fail - trigger set to move them to the next bank of 10 questions.  Pass - done.  Fail....move them to the 3rd bank of questions.  

It could be done.  It's not really random, but may appear so to a learner.  Also would not be very random learner to learner.  Each learner would get the same set of first bank of 10 questions, even if in random order.

Hi Tracy,

Thanks for your feedback.  I thought taking your suggestion to the extreme (1 bank) would be easier to understand.  Here goes.

Let's put all 40 questions in a single bank and serve up 10 randomly.  When a learner re-takes the quiz, the best implementation would randomly draw from the remaining 30, but SL will draw from the complete set of 40. The result is that there is a 25% chance of drawing a previously drawn quiz question on each draw, delivering 2.5 questions (on average) that have previously displayed.

This suggests reducing the number of banks isn't a workaround... it has no net improvement.

Hi Sam,

I know that the re-draw of previously drawn questions has been something other users mentioned before in the form of a feature request - but as the current set up its a random draw each time and there currently isn't a way to change that. 

Hi Ashley,

SL developers need the capability to present a random draw to learners.  If enough authors would chime in, perhaps it would sway Articulate to improve the feature.

Sam

Hi Sam,

Certainly please share your thoughts with our team! The draw right now is random each time, presenting questions you may have already seen - so it sounds like what you're looking for is a random draw that excludes previously seen questions. 

Just reading this, trying to find an answer. It doesn't look like this request made it to SL2 either :(

Agreed. This is a needed feature improvement and it looks like several have commented on it going back a few years. Hopefully this will improve on update. 

Thanks

Hi Tech and Learn,

Unless you have a results slide with a Reset Results trigger, you will always see the same question slide drawn again when revisiting the question bank. 

Let me know if you need more clarification on that or need other help! 

Thank you for the reply. I'm not really concerned about the same slide draw
when revisted, but, rather overall. For example, on the first attempt, I
have had several instances where, out of 20 questions, I get two draws of
the same question. So, in other words, if I ask for 10 slides drawn from a
20 question set, I may get two of the same questions (even in a row).

I suspect the software draws 10 at random from the 20 at the beginning of
the quiz but doesn't check the sample to make sure it hasn't drawn two of
the same question. This should be fairly easy to do as I've done it when
creating javascript-based question banks online. It would be great to have
this feature as there isn't really a time I can think of where anyone
should see duplicate questions in a first quiz draw.

For example, if the system pulls 10 at random from an array of 20
[0,1,2,3,4,5,6,7,8,9,10,11,12,13,14,15,16,17,18,19]
>>>>[0,3,5,7,9,10,13,15,18,20] I would hope that I wouldn't see
[0,3,5,7,9,10,10,10,18,20] but according to the rules of the system, it
seems this can happen even though this is truly random.

Thanks,

Tom

Thanks for that detailed list Tom.

Would you be able to share a .story file demonstrating this behavior.

I built a quick sample and I'm getting a random list of 10 out of 20.

First Test:

6
3
4
17
5
7
10
19
15
12

Second Test:

5
20
12
16
2
19
10
15
18
7

Leslie, thanks for your help. I will get one to you tonight or tomorrow
morning. It is unremarkable - simply quiz draw with the randomize questions
box checked. I have only experienced the problem twice out of the many
times I have used it so it may not show up but once in a while as would be
expected with randomization. I got a call from my client about it the first
time it happened.

I will appreciate your help to see if there is something obvious that is
happening. I will be able to get that tonight or tomorrow morning for you.

Thank you,

Tom

Hello Leslie,

I was able to get some time this morning to do this. I have attached the
quiz. The bank has 17 questions in it.

I have not been able to replicate the issue again so far but did once after
the person sent me a concern. It was very apparent as it was a repeat of
question 2 in the bank (for the person reporting it and I believe he was
sure - very detail oriented). I got it to happen as a repeat of one of the
last 4 slides in the question bank which are all the same images, but
different questions. So the same question came up twice in a row.

I have not been able to replicate this again yet but will be watching
closely as I test.

I would welcome any insight you have on the setup.

Tom

Hi Tom,

Did you respond to this discussion via email? If so, your attachments won't be uploaded and I don't see any .story files shared here. Can you click this link to visit the discussion page and then use the Add Attachment button to upload it here? 

Apologies - yes I answered via email. Here is the attachment. 

Thank you

The setup looks good Tom and I didn't notice any repeats of questions in the groups of 10 during retries. Here is my published output.

I got questions 16 and 2 back to back, but they are different questions. 

Fair enough. I know it happened as it happened to me. Next time it does I will try to document better. As it is random, there is a chance of this happening, although as it doesn't seem to be reproducible in a set of 10, it may be ok for the client. Thanks for the review.