LMS reporting "undefined" or blanks for some questions

So i've just gone and deleted all of the spaces from the questions in a different module. They are no longer reporting as 'undefined' but for some questions I am only getting the first letter of an answer reported unfortunately.  

For example where I have a list of answers all beginning with the same letter, I am unable to see exactly which answer option a learner has selected. I am just getting a report of "d,d,d,d,d" where the answers are things such as 'data can be gathered...' 'data can be imported...' 'data can be referenced externally...'.

Has anybody else encountered this before? 

Hello Emma - Would you be able to share your .story file for us to take a look. Even just a sample of the slides you're having an issue with would be great. 

Hi Leslie, 

Sure, i'll do that now. Since posting this message i've realised it is for all questions which aren't multiple choice, so multiple response, sequence drag and drop, matching drag and drop etc.

Emma

Hi Emma!

It looks like your file didn't get attached - would you mind trying again? To attach your file to this thread, you'll want to click the View button from the email to open the thread in ELH. Then, at the bottom of the reply window, click the Add Attachment button. 

Hi Alyssa, I opened a support case instead as the attachment is confidential. Thanks!

In some ways I'm glad to see others who struggle with this. As mentioned earlier, we've eliminated most of our undefined errors by removing special characters (", ', $, #, and others). I've also asked my team to make sure they use the Notepad method.

But, I still see cases were a question response comes over as "undefined" for a few users but comes over correctly for others. I don't know if that's tied to user behavior (e.g. using multiple browser windows during a session), network issues, a learner going back through the questions and changing an answer before clicking Submit, or just random.

It's very strange and frustrating.

Hi Robert, i've eliminated the 'undefined' problem but i'm now having an issue with only the first letter of a lot of my multiple response questions being reported. I first thought it was all multiple response questions, but I have had some multiple response questions record the full response in the Interactions Report. I'm now wondering whether it might be related to word length which is causing the issue

Hello Emma - Thanks for letting us know that you reached out to the support team (01031952) and it looks like Abel is taking a look.

I wanted to provide a little more data to show you what we're seeing in the reporting. I hope this comes through (I made a number of the field generic):

Lesson Name

Catalog Course Code (ID)

Interaction ID

Question

Question Type

Correct Response

Learner Response

Result

Score

Time Spent in course

First-Last Name

Interaction Date

Exam Name

Exam LMS Code ID

Scene1

Hi Robert,

Does any of your questions reveal the correct answer to the learner after they've answered it incorrectly?

I've found that this can cause Undefined learner response to be logged. Here's some specific steps to reproduce the problem (I have a hard to explaining it another way hehe):

1. First thing I did was set the slide to "Reset To Initial State" when it is revisited.
2. I create a couple variables for the slide, "Attempts" (A number) and "IsFinished" (A boolean).
3. When the user answers the question incorrectly for the 2nd time, "IsFinished" is set to true and the "Continue" button on the "Incorrect" layer jumps to the same slide (Causing the slide to be reset to initial state).
4. When the timeline of the slide starts, a trigger checks if "IsFinished" is true and if it is, the submit button is hidden and the correct answer is shown to the learner.

In testing, I found that because of step 4, a 3rd response is logged in the LMS as "undefined" as (I believe) Storyline submits the interaction response. A quick solution/way to confirm this as an issue was to change the "Incorrect" layer's "Continue" button to simply jump to the next slide.

Hopefully this makes sense. Good luck :)

That does make sense and it’s something we can check. I believe the exam that had the undefined error was a Submit All exam that allows the learner to revisit the questions afterwards (but does not tell them the correct answer). The learner can go back through all of the questions before submitting, so perhaps something in the way the slide remembers a change could trigger confusion in the question?

I appreciate the steps below.

Join. I have the same problem with undefined variables in questions, Russian.

Hi Oleg,

This issue is reported for Storyline 2 and Storyline 360. Which version of Storyline are you using to publish your course? 

Storyline 3 and Storyline 2.

Thanks Oleg - I'll let the team know that you're experiencing it in SL3 as well. 

Hi,

I would like to ask you about the status of this issue. We have also experienced it in Storyline 360 and two diffrent LMS - Totara and NetDimensions.

We found that when we use language specific characters, for example: ž,š,ť,á,é... then the answers report to LMS as undefined - undefined is the correct answer and the student response when he chooses the correct answer. If he chooses the incorrect answer, then correct answer is undefined, but the student choice is just fine.

And the other thing is - the first question works ok, no matter what.

I hope this will help to resolve the issue if it is not already. We cannot not to use special characters - they are part of our language (Slovak) and simply cannot be replaced or avoided.

Thank you

Hi Elena,

I see that my colleague Vevette responded to your Support case as well and let you know that this is an issue we've reported to our team. Once we have any additional information we'll be certain to share here and as a part of your Support case. Thanks for letting us know that you've been impacted by this as well and I'm really sorry if it's slowing you down. 

I wanted to report back on this. We just changed from SumTotal to Cornerstone and we're seeing the exact same "undefined" error with any answer that starts with a special character. We do not see this error with Adobe Captivate. I think Articulate needs to address this since it's a long standing issue. 

Thanks for circling back, Robert. This issue is a priority for our team, and we'll share the good news here as soon as a fix is released. I appreciate you for sticking with us on this!

Hey Everyone,  

I have some great news! 

We just released another update for Storyline 360, and included a few important fixes and new features that you'll see in the release notes here.  

This update fixes the issue you reported where non-English characters and symbols would cause quiz data to be undefined in LMS logs and reports.

Just launch the Articulate 360 desktop app on your computer and click the Update button for each application. Details here.

Please let us know if you have any questions, either here or by reaching out to our Support Engineers directly!

Does this mean that Storyline 3 was not updated with the same issues??

Hey Allison! We're still working on rolling out a fix for Storyline 3 as well, and we'll keep you posted as soon as it's available. 

Great, thank you!

Hey Allison - It looks like your email signature came through when you replied via email. You can remove that if needed by clicking ‘Edit’ beneath your response. Here’s a quick Peek video if you need help.