My triggers aren't working. What's wrong?

Hi, All!

I am currently building a custom slide. I want learners to be able to score their own work. My question concerns the layer called "Untitled Layer 1" in the attached file. Everything works right until I, for example, click on 3 and then change my mind and decide to give myself 2 points. Even though I have put the trigger in to have "3" return to its normal (i.e., unhiglighted) state, it stays in its selected (rose-colored) state even though I went back and clicked on 2. I have a mess of triggers on that slide layer so that could be the problem, but I'm not sure how to avoid that. I made (and attached) a video to explain what I mean since it's difficult to explain in words. Can someone tell me what I'm missing?