Forum Discussion
Elements Animation and Audio sync
Hi Team,
We are currently working on a UiPath automation requirement integrated with Articulate Storyline 360, where we need precise synchronization between media playback (video/audio) and individual on-screen UI elements/components.
The requirement is to trigger UiPath automation actions based on exact timestamps or interaction points during media playback — similar to element-level cue points or timeline event hooks available in some advanced authoring platforms. The automation flow depends on accurately identifying when specific elements appear, change state, or complete their animations.
However, during implementation, we observed that Articulate Storyline primarily supports slide-level timeline triggers and does not seem to expose native APIs or event listeners for element-level cue point synchronization. Because of this limitation, achieving accurate real-time synchronization for UiPath automation is becoming challenging.
We explored multiple approaches including:
- Timeline triggers
- JavaScript event listeners
- Media completion triggers
- Variables with polling mechanisms
- DOM inspection through browser automation
- Web object integrations
However, none of these approaches currently provide reliable frame-accurate or element-specific synchronization needed for stable UiPath automation.
We would like to know:
- Is there any supported method in Storyline to create or simulate element-level cue points?
- Can JavaScript access the internal media timeline with enough precision to trigger external automation events?
- Are there any recommended workarounds, custom scripting methods, or integrations that could help support UiPath automation use cases?
- Has anyone successfully implemented similar automation-driven synchronization in Storyline 360?
Any suggestions, guidance, or alternative approaches would be greatly appreciated.
Thank you.