Question Banks Randomization and LMS

Hello! 

Here is the situation: I am creating question banks to be imported into a quiz portion of a course. The question banks have 50+ questions. When I draw 10 random questions from the bank into the quiz, how do I set it up to pull 10 differing random questions from that bank every time a user opens the course in our LMS system? When testing, it seems to be pulling 10 random questions but when I retake the quiz it is pulling the same 10 questions.