It is expected behavior. It is mainly because you have "Automatically decide" option selected in the slide properties. It is default setting. Switch to "Resume initial state" or delete "Visited" states in your buttons if not needed. Either way will ensure that the layer will be not be visible upon revisiting. More details about determining how slides behave when revisiting can be found below:
https://community.articulate.com/articles/articulate-storyline-360-user-guide-how-to-adjust-slide-properties#:~:text=from%20Articulate%20Presenter.-,Determining%20How%20Slides%20Behave%20When%20Revisited,-Storyline%20360%20lets
