Students failing test after FTF course
This is not an e-elearning question, I just want the opinion of the community as educators.
I ran a two-day Face-to-face course a couple of weeks ago, which involved lecture, students using on-line reference manuals to retrieve technical information, and practical activities which combined both the theories and referencing we did in the classroom (it was automotive training).
I decided to drop the usual multi-choice final test in favour of an on-line test a week later, which required the students to access and find information in the on-line manuals. The reason for this change was my changing the objective of the course from "remembering information" (impossible) to "finding information" (useful).
There were only 5-questions, which have to be completed in 30 mins, but many students are failing the test!
I have set the required pass rate to 100%, but I don't think that is too stringent as we practiced using the on-line manual at least 15 times during the training (although the students were sitting two to a computer). All they had to do in the test was look up the answer in the on-line manual!
How would you go about finding the reason for this failure-rate? I would love to hear any suggestions. I am fluent with the reference material, so can't really objectively judge how difficult the questions were. Should I ask the students why they think they failed? This is a real shock to me, as I thought I was the best trainer since sliced bread (don't we all?).
Any ideas on how I can get to the bottom of this, and still respect myself (and the students still respect me) would be much appreciated. I do understand, it is possible that I just didn't give them enough practice with the on-line manuals during the Face-to-face training (perhaps that needs its own separate training), and also that it may just be a sign of the effort the students are, or aren't making.
For the record, one not-so-experienced student who passed the test said it was tight, but they got there in the end. Maybe I should be talking to them first.
This is horrible for me. I was hoping to start freelancing next year and this has knocked my confidence right back...