Question Bank ignores other slides

I may not be understanding the concept how question bank works, but I have established a long list of questions in a bank.  I like the idea that they are categorized and saved in one place, but when I pull a question from the bank and made sure the "Draw questions randomly" is unselected to ensure they use the question I picked.  My storyline goes back and forth with videos and questions.  When I reach to the question, the right question appears, but it would go through my whole question bank before it's done instead of going to the "next slide" which is a video.  To get around this, I changed all the questions under the "Include In Shuffle" to "Never" if I don't want them to appear.  The task to do that for each question is a daunting task.  So, bottom line, how to I select a specific question and only shows one question and actually goes to the next slide, not the next question from the Question Bank?