12 Replies
Trina Rimmer

Great question, Tracy. I'm not aware of any industry-wide best practice or standard for pilot group size. I'm sure each person has their own ideas, but I prefer a group of 3 to 5. I tend to prototype as I go along, so a pilot group of this size is small enough to be manageable, but still large enough to give me some diversity of opinions, experiences, and operating environments. Obviously if I was working on a really high-risk, high-profile project the pilot group might be a bit larger. 

Brenda Tyedmers

I've used groups of 5 to 15 depending on the content. In the case of two critical HS modules for supervisors, where 2000 people would be taking 1.75 hours of training, we designated a group of 15 that included supervisors with either an affinity for and an aversion to e-learning (as well as HS coordinators who had no involvement with the course development, and a couple people from the HelpDesk who would be fielding help requests). We also tried to choose people who are known for being picky and giving very specific constructive feedback.  We also had people launch the learning on business and home devices and a range of browsers to see what if any technical issues emerged. As a result, the full release was  smooth, the voluntary completion rate high, the feedback very positive. 

Luke Dart

6-9 people, In my experience different people look for different things so I would have a number of people who know the content inside out, a couple of people who have a vague idea of the content and a group of people who have no idea of the subject. I find that the SMEs will concentrate of the subject but may miss the finer points as they understand the message, the people who have no idea of the subject usually concentrate on the navigation or the look and feel of the course while the people who have a vague idea provide feedback on the understanding of the content.

All very important views but for different reasons.