Assessment Not Working - Please Help
Mar 13, 2018
Hello,
I have a complex assessment that intermittently does not work correctly. I am using SL 2.7. My assessment has 3 question banks from which questions are drawn randomly. On the Results slide I allow learners to go back and retake the text if they fail (they must pass the test to get credit for the course).
Sometimes when they retake the test the results appear bizarrely, something like 36.2 for a passing score. I've taken a look at the variables and I've noticed that sometimes the %Results.PassPoints% variable changes from 8 (for 80%) to 15.2. Whenever this happens, the results appear bizarrely. Any idea of what's going on? Is this a known bug?
I know that I can't adjust a system variable, but it would be nice if I could. (This is a real problem with your software.) I would just set the variable to 8 every time someone starts the assessment. Does anyone know of a way to do this with JavaScript?
I'm on a deadline and I need to make this work quickly. Any help is greatly appreciated.
Thank you,
12 Replies
Hi Peter
There have been 5 updates to SL2 since SL2 v7. The first thing I'd do is update to the latest version - here is a link to the version history which includes release notes and a download link.
Hard to say what is happening without seeing your file setup - perhaps sharing your source file or even just the quiz slides and result slide so someone can take a look and try to help you.
Hi Wendy,
Thank you for getting back to me. I work for a large firm (JP Morgan Chase) that has strict rules and firewalls that prevent me from uploading files and downloading and installing newer versions of software. I would still greatly appreciate some help on this though.
I can tell you exactly where the issues is happening. When a learners clicks on the button to retake the assessment, the system variable %Results.PassPoints% sometimes changes from 8, to 15.2. It doesn’t happen all the time, maybe once every 3 or 4 attempts. I know this happens because I print the variable on the first (introduction) page of the test. When it happens the final results are messed up. Is there any way to force this variable to always be set to 8? Perhaps some JavaScript that would work (I’ve tried player.SetVar %Results.PassPoint% = 8).
If you have a few minutes to talk, I would really appreciate it. Maybe we can set up a screen sharing session.
Thank you,
Peter
Peter Chotin | Digital Learning Solutions, VP | 545 Washington Blvd, Jersey City NJ 07310 | Direct: 551-205-1935 | Mobile: 347-749-0135
Hi Peter
Let's see if we can isolate some things to check first (I'm in Australia and it's currently 1.10am and I'm also on webinar :-)
Hi Wendy,
Thank you for getting back to me so quickly and at 1:10 a.m. where you are. In response to your questions:
* Can you screenshot the trigger panel of the result slide which includes the triggers attached to the Retry/Retake quiz button. Also screenshot the Result slide which shows the variables being used.
Here is the screen shot of the trigger panel and also the entire Results slide.
[cid:image003.png@01D3BB9D.BFE28770]
[cid:image002.jpg@01D3BB9F.01740050]
* Are you using a QB
Yes, we’re using three question banks with a random draw from each. The first bank has 11 questions in the pool, drawing 5. The second has 3 questions, drawing 2. The third has 5 questions, drawing 3.
* Can you screenshot the variable list.
Please note there are a lot of variables in this course. In the screen capture, I’ve included the ones I think you’re interested in. Please let me know if I missed anything you need.
[cid:image005.png@01D3BB9E.2C17CAE0]
Thank you,
Peter
Peter Chotin | Vice President | JPMC Learning
JPMorgan Chase & Co | Direct: 551-205-1935 | Mobile: 347-749-0135 | peter.chotin@jpmchase.com | learning@jpmc
Hi Peter,
looks like you have replied via email and unfortunately attachments won't display here in the forum. Can you click the 'view' not 'reply' in the email and use the grey 'add attachment' button at the bottom of the post to upload your screenshots.
Thnx
Let me know if these work. Thank you for all your help.
Are the question point values set to the same value? That is the only reason I can think for the pass points to change especially when you are using randomised questions.
I would also agree that updating latest version of SL2 should be your first step.
Hi Peter
they all look okay ...and the fact it is the pass points that is changing is very odd except I can see that results.passpoints is being used in 4 places
Can you click on the 4 in the variables list and track which slide the variable is being used and in which trigger - that's what I would be checking.
Since you can't upload here publically, I would log a support ticket with Articulate (they can sign an NDA if you need it) and get them to take a look.
Sorry I can't be more help, I'm used to checking the setup to see what's happening so flying blind a little.
Hi Wendy,
I did check the points for each question and found one that had the wrong points; 10 instead of 1. I've changed that. Perhaps since there was a random draw, the issue only came up when that question was picked. Is that possible?
Thank you
This message is confidential and subject to terms at: http://www.jpmorgan.com/emaildisclaimer including on confidentiality, legal privilege, viruses and monitoring of electronic messages. If you are not the intended recipient, please delete this message and notify the sender immediately. Any unauthorized use is strictly prohibited.
That would be the reason because the calculation is run from the pass points and score points. I expected it was the reason when you said it only happened sometimes.
That seems to have done it. THANK YOU! I'd have never found that.
So glad you found what you needed Peter!
Note: Replying via email will include your signature. You can edit out your contact information from your post if you'd like!
This discussion is closed. You can start a new discussion or contact Articulate Support.