Focus order layers

In a course I'm updating for accessibility (not mine), I'm trying to set the focus order on a slide with separate layers for each of 8 quiz questions, with 10-12 objects on each layer, some of which are the same (title, instructions, etc.). Since there is only one focus order for the entire slide, that means setting the order for nearly 100 objects. To do that I need to see which object on which layer I'm selecting (i.e. via the red selection box).

Am I correct that although Focus Order shows the order for all layers, I can only view my object selections on one layer at a time?  So, I have to select a layer, go to Focus Order, set the order for that layer, save it, select the next layer, go to Focus Order, etc.? Or am I missing something? 

Putting the layers in the correct order helped, but still seems like there should be an easier way of doing this.