How to get a motion path to go to a specific end point regardless of where their start point is?

I have 4 answers which are randomly shuffled(using the display -> shuffle answers function under the design tab). Whenever I click on any of these answers, I want the answer to move to a specific spot on the slide. However, I noticed that the answers will "teleport" to their initial position before the shuffling and move to the specific spot from there. I do not want the answers to teleport. If I enable "relative start point" on the motion path, it doesn't end at the spot I want it to. How should I fix this? Is it possible without using javascript?