Voice Recognition and Storyline Example
May 09, 2017
UPDATE: To answer some questions, I have created a better, improved example that doesn't require any external files and wrote a step to step guide on how to implement this - https://elearningdifferently.com/speech-recognition-and-storyline
Dear all,
This morning, I thought it would be nice to make some quizes I build more fun and make learners to answer by voice. There are already some topics created on this from awhile ago, but most links are dead.
I have build a fresh example - https://elearningdifferently.com/voice/story.html
I am attaching source files for 360 with scripts in the ZIP below. Hope you will find it useful. And thank you to this blog post on explaining how to web speech API work.
P.S. Web speech API is supported only with Chrome.
30 Replies
Very cool, Matthew. Thanks for sharing it with us!
Matthew, I went ahead and added your download .zip to our Downloads hub. Thanks again for your generosity!
Thank you, Trina! =)
This post was removed by the author
Wow! Very cool. Love the doors this opens up.
That is very clever how you are able to pass the transcript from the web object back to Storyline!
That is very cool! Thanks.
This is exactly what I've been looking for! THANK YOU!
Okay, I used this web object in my modules, but I'm not sure how to make them work with an essay question. Yours was looking for the specific word "four", but it still recognized my answer of "blah blah blah" and recorded it in text. I'm a bit confused as to what I'm doing wrong on this. Thank you in advance for any help!
The demo will not open for me. Any ideas?
Are you using Chrome?
This post was removed by the author
Yes, most recent version
It is not working for me either. I tried launching a demo that I made using this API and it is not loading either so I tried launching a couple of other demos I made in Chrome and they are not playing either.
Hi all,
Apologies, and thank you to @Matthew Bibby. It should be sorted now. Site were this demo was hosted is now in the Maintenance mode for redesign, so links died. I have made the links from original post to work again. So it should work now in Chrome ;)
https://elearningdifferently.com/voice/story_html5.html
If you are using this in your work, I would advice to download .zip example from the top post and host all elements on your own site/server. vars.html needs to be hosted online and referenced in the Storyline's project iframe, to evaluate voice using Speech API. Hosting this on your own location means you will have full control and prevent it breaking when my links eventually expire....
Matt.
Of all of the potential applications with Storyline 360, this is the one I am most interested in learning more about...
Please keep up the great work, Matt.
This post was removed by the author
Something to note: when hosting web speech api example or using web speech API, your files need to be hosted over secure HTTPS connection. When using HTTP the domain/browser will not be allowed to access user's microphone.
Here is an example of one I did using the web speech API. I think the example is on the fourth slide. I tried to make it respond to German with mixed results.
https://pinchedhead.com/portfolio?layout=edit&id=87
UPDATE: To answer some questions, I have created a better, improved example that doesn't require any external files and wrote a step to step guide on how to implement this - https://elearningdifferently.com/speech-recognition-and-storyline
Thank you, I'll check out your link!
Hi Matthew! Thanks for the link! I exported the web-demo.story file to SCORM ... but I can't get the mic to work even when I use Chrome. May I know your export setting?
Links are dead again. It seems there is sufficient interest in voice recognition for it to be included as an in-built future feature request... I am also looking forward to a time when results can be sent to email (yes, I know the arguments against this that have been made in the past) or at least a simplified way to export them to a spreadsheet (for those who don't need / want the added work of setting up or even going through an LMS.
Thanks for your feedback! Would you be up for logging a feature request to tell us more about your specific needs?
In the meantime, if there’s anything else I can do to help, please let me know!
I have a project where there is voice controlled software and looking to emulate in Storyline. If there's any updated convos, examples, code snippets, etc, it would be appreciated!