@Jürgen Schoenemeyer
Thanks. I want to keep all the layers available and visible so the user can still interact with objects on those layers.
I believe the issue might have something to with the fact that all the "click outside" hotspots trigger together when the use clicks on the screen, which perhaps means that the order they fire in is going to depend on internals which are beyond user control.
I have solved the problem by using timeline overlays instead, pausing and advancing the timer accordingly. This works but I'm not sure it's a considered to be a good approach.