Replay button - when there are layers it doesn't replay the slide from original state

Hi, I have a slide that contains 2 steps. Step 1 is on the main slide and step 2 is on another layer. If I replay this slide after step 2 appears, it only replays step 2. Is there a way to have th...