How to capture details in assessment scoring

Sep 11, 2011

Sarah Tinson
By Sarah Tinson

 Hello all,

I am in desperate need of assistance.... I have a requirement to create a whole bunch of assessments to benchmark user knowledge.

Each assessment is divided into 5 knowledge categories, with the learner being presented with a randomised selection of questions from each category each time they access it. This part is easy!

What I then need to be able to do it analyse the results to see which category (if any) each learner hasn’t passed. This is where it gets more complicated…

I upload the assessments to our LMS, however it’s not capable of providing me with detailed information – it only presents the number of times the learner has accessed the assessment, and what their last and highest score is. Through the LMS, I have no way of knowing which questions were even presented to the learner, let alone which categories they may have got some questions wrong in.

My clunky workaround is to use the Print Results button at the end of the assessment, and tell learners multiple times (including on the first and last windows of the assessment) that they MUST print results and give to their manager if they don’t pass, and then pass it to me to analyse. Trouble is, this isn’t working – learners are forgetting.

I’ve also tried the Email Results button, but this seems to take ages to do from the learner’s point of view, and the information captured in the email doesn’t contain everything I want, unlike the Print Results output.

All I can think of, short of buying a new LMS, is to see whether I can make the Print Results button mandatory. Is this possible? Or, are there any brilliant ideas out there that I’ve not considered?

Cheers,
Sarah.

13 Replies
Katherine Herbert
over 12 years ago09/15/11 at 4:37 pm (UTC)

Brian Batt said:

Hi Sarah,

There's currently no way to force the end-user to print or email the results of the quiz.  For the best results and most accurate reporting, we recommend Articulate Online: 

http://www.articulate.com/products/articulate-online.php 

Just to reconfirm - when a student completes a quiz (created on quizmaker), the LMS can only record passed or failed scores but cannot actually pull out statistics? Did I understand that correctly? Therefore, if I have  student linked to a manager, and the manager wanted to check what answers the student got wrong, there is no way for the manager to access that information from quizmaker except to request the student to print their own results? I just have the same task objective as Sarah, but unlike Sarah, we cannot utilise another system like Articulate Online. I may have to resort to going to iQBox to get the desired results. It is a shame as quizmaker makes it easy to design quizzes but sad that the results tracking/recording functionality isn't that great.

Sarah Tinson
over 12 years ago09/15/11 at 6:15 pm (UTC)

Hi Katherine,

You've summed up my issue perfectly.

Unfortunately I don't have budget to buy anything else at the moment, so we have to stay with relying on learners to print their own results.

Interestingly, if I created the assessments in our LMS directly then I could pull all the stats I wanted, but our LMS doesn't give me the ability to have a pool of questions to randomly assign, nor the ability to group questions. Sigh.

For now, the print results button is our best workaround.

Brian Batt
over 12 years ago09/16/11 at 7:24 am (UTC)

Katherine Herbert said:

Brian Batt said:

Hi Sarah,

There's currently no way to force the end-user to print or email the results of the quiz.  For the best results and most accurate reporting, we recommend Articulate Online: 

http://www.articulate.com/products/articulate-online.php 

Just to reconfirm - when a student completes a quiz (created on quizmaker), the LMS can only record passed or failed scores but cannot actually pull out statistics? Did I understand that correctly? Therefore, if I have  student linked to a manager, and the manager wanted to check what answers the student got wrong, there is no way for the manager to access that information from quizmaker except to request the student to print their own results? I just have the same task objective as Sarah, but unlike Sarah, we cannot utilise another system like Articulate Online. I may have to resort to going to iQBox to get the desired results. It is a shame as quizmaker makes it easy to design quizzes but sad that the results tracking/recording functionality isn't that great.


Hi Katherine,

Yes, Quizmaker is intended to be used in conjunction with an LMS or Articulate Online.  Quizmaker does send all of the answer data to the LMS:

http://www.articulate.com/support/quizmaker09/kb/?p=137

It's then up to the LMS to decide which information it wants to keep.  Some LMS's keep all of the data & some LMS's don't.  

Katherine Herbert
over 12 years ago09/16/11 at 12:45 pm (UTC)

Hi Brian,

Thanks for your reply. I have been doing research on Quizmaker and have read a few forums - but I guess my only question is, do you know if SumTotal will pull out this information if I publish and upload as SCORM1.2 - or do I need publish and upload as AICC? If you are not familiar with SumTotal LMS, thanks anyway.

Regards,

Katherine

ANNA HIPKISS
over 12 years ago09/17/11 at 8:06 am (UTC)

Hi Brian,

On a slightly different, but related point, how do I capture detailed survey data from Quizmaker?  I will publish it to the web, and ask users to email results back to me.  I don't want to use any other software.  I've tested this, and nothing is attached to the email.  You must have tutorials on this - I've looked but I can't find anything that describes the final step after publishing.  Thanks, Anna

ANNA HIPKISS
over 12 years ago09/19/11 at 8:31 am (UTC)

Thanks Brian.  Just to be sure I know my options, if I've understood correctly, emailing the results is unreliable, and my two options are to do something complex with PHP, which you don't support, or use other software, such as your Online product. 

As far as I can see, there is no simple way to collect survey data.

Thanks,

Anna

Ian Kokki
over 3 years ago10/16/20 at 10:23 pm (UTC)

Hi Brian,

I have similar issues to this and find the jump from the eauthoring to LMS very frustrating in what one with the other can/can't do. So your poing on articulate online is interesting as we looked at that, but realise that Rise.com will supersede this so therefore are I was looking at whether we go from TalentLMS to Rise.com.

So, when you say to try Articulate Online which I assume will be Rise.com now, what will we able to get/do with respect to results if we are using Articulate Storyline 360. i have looked at the website for Rise.com, but it's just a marketing spiel and not very detailed on what you can get with respect to results.

So any information( hopefully detailed) on the functionality would be great with respect to results and what functionality/flexibility we get on results reporting if we use Rise.com

Another related question I had was whether within a course developed by articulate 360 storyline can we make the results available to the user within the course for them to view and or print out.

 

Lauren Connelly
over 3 years ago10/20/20 at 4:06 pm (UTC)

Hi Ian!

You're right, Articulate Online isn't the best long-term option. Rise.com will allow admins to upload content from Storyline 360 and share it with learners as other Learning Management Systems do. You can take a look at the reporting options here. We currently don't offer the option to upload content outside of Rise but this option is being tested in beta!

Giving learners the option to print out results is a Results Slide feature in Storyline 360. Have you added a Results Slide to your course yet?

This discussion is closed. You can start a new discussion or contact Articulate Support.