Tests with multiple types of questions and scoring

Hello,

I have a Storyline 360 test that I created, which includes multiple choice, T/F, matching and essay questions. All but the essay questions are assigned a score. The essays will be graded individually. When I created the Results slide I selected all of the questions so that all answers would be submitted. The score results are pulled from a report in SUMTotal LMS.  The User Response to some of the essay questions appear within the report for some of the questions, but for others the User Reponse just says NULL. I completed the test and I know I answered all of the questions.  I can't figure out if it's something I've done wrong in Articulate or a function of the LMS.  Any thoughts would be welcome.

14 Replies
Leslie McKerchie

Hi Lynn,

Thanks for reaching out and sharing what you are experiencing with your published project.

  • I'm curious if the essay questions have been included in the Result Slide in your project?
  • Are you able to replicate this behavior in another environment like SCORM Cloud?

With your permission, I'd like you to share your project file with our support engineers to investigate what's happening. You can share it privately by uploading it here. It will be deleted when troubleshooting is complete.

Leslie McKerchie

No worries, Lynn.

With your permission, I'd like to take a look at your project file to investigate what's happening. You can share it publicly here, or send it to me privately by uploading it here. I'll delete it when I'm done troubleshooting.

It looks like your email signature came through when you replied via email. You can remove that if needed by clicking ‘Edit’ beneath your response. Here’s a quick Peek video if you need help.

Lynn Cadigan

Hi Leslie,

I wasn't sure who to direct this inquiry to so I figured I'd reach out to you. Please redirect me if needed.  This is related to a previous case #01997455.  In summary, I have created Essay Survey Questions in Articulate 360. The essay answers are not showing up in SUM Total.

I have communicated multiple times with SUM Total and their engineering team. This is my most recent suggestion from them: "We suggest following up with Articulate 360 support to determine why the essay format from their authoring tool is not sending the field type as 'long-fill-in' per the SCORM 2004 standard.

If needed, we can attend a call with you and Articulate 360 support to detail our observations."

The full email from Bill at SUM Total is attached.

Do you think it makes sense to schedule a call?

Best,
Lynn
 

Leslie McKerchie

Hi Lynn,

Thanks for reaching out and letting us know what you are running into with your course now.

I cannot read Bill's message due to the file type shared, but based on your description it sounds like you are not getting your essay questions to report as expected in your LMS.

Are you including the essay questions on a survey result slide and sending that to the LMS? 

With your permission, I'd like to take a look at your project file to investigate what's happening. You can share it publicly here, or send it to me privately by uploading it here. I'll delete it when I'm done troubleshooting.

Lynn Cadigan

Hi Leslie, Thanks. Got sidetracked with another project! 

Yes, the essay questions are on the results slide.  I have attached the project. Your team reviewed this previously.  The response from Bill at SumTotal is below.  He suggests investigating the fill in type field. (?)

Thanks for taking a look!

Lynn

"The course is sending the answer for the question as a 'fill-in' type field, this field is limited to 250 characters. If the answer is longer than that, our content player interprets the answer as NULL to prevent errors with playing the course.

In order to support a longer answer, the field type should be 'long-fill-in' which supports up to 4000 characters. 
 
  “fill-in”: The interaction requires the learner to supply a short response in the form of one or more strings of characters. Typically, the correct response consists of part of a word, one word or a few words. 
 
“long-fill-in”: The interaction requires the learner to supply a response in the form of a long string of characters. 
  
We suggest following up with Articulate 360 support to determine why the essay format from their authoring tool is not sending the field type as 'long-fill-in' per the SCORM 2004 standard.

If needed, we can attend a call with you and Articulate 360 support to detail our observations. 

Lauren Connelly

Hi Lynn!

That's it!

I did some digging to see why the report would include NULL for questions the user answered.  I tested the files in SCORM Cloud and saw the answers that I submitted but the answers that I left blank were displayed as (). This is a good sign because it shows the answers were read correctly.

I entered 1434 characters in the responses and they were all displayed in the report. You can see that here. 

As Bill from SumTotal said, this is how these responses are read in the LMS when there are more than 250 characters. Essay responses can handle the 4,000 character limit, so it would be a setting to change in the LMS.  

Lynn Cadigan

I shared the info above with my contact, Bill, at SumTotal. He suggested scheduling a call with an Articulate Representative and me to collaborate on what might be the best solution.  Who would be the appropriate person to participate in this? I am happy to set something up after January 6, when Bill returns. Thank you.