PILOT STUDIES
Whatever research method you have chosen to employ, you will find that your exact procedure and resources will develop as you take your research forward. No researcher can decide on the perfect procedure on the first draft of their research proposal. Instead it should evolve as more information becomes available. However, once you start collecting data, in most methods it is imperative that the procedure remains constant. To ensure that the optimum procedure has been selected it is essential that a pilot study is performed. Sommer and Sommer (2002, p9) describe this effectively.
“No matter how carefully you reviewed the background literature and designed the study, there is no substitute for a pilot study before the actual data are collected. A pilot study is a preliminary use of a procedure designed to identify problems and omissions before the actual study is conducted. Remember Murphy’s Law – if something can go wrong, it will. Even the best designed experiments will have flaws, and the most carefully developed interview sheet will have ambiguous questions or words that the respondent will misinterpret. There is no way to predict all potential problems in advance. Not even the most experienced survey researcher can compose a perfect questionnaire on the first try. Survey research firms test out their questions in a pilot study before beginning formal data collection. You should plan to do the same in your own research. Set aside a designated time for this after the procedures have been developed. Don’t skip the pilot study in a rush to collect data. A little effort put into it will pay big dividends in improving the precision, reliability, and validity of the data collected in the actual study.”
The pilot study doesn’t have to be a major task; just make sure you get the most from it. So, for example, if you want to pilot the questionnaire you have designed, get a small sample of people to use it and question them afterwards on their understanding of the questions and answer options. Alternatively you can ask them to say aloud what they are thinking as they complete the form (they may feel a little self-conscious doing this). Using their comments you can refine or reword questions, leave out some or put new ones in.
Finally, make sure that you report on this in the Method section of your report. It doesn’t have to be too detailed. Something along the lines of:
A short pilot study with 5 participants resulted in the amendment of question 5, the removal of questions 3 and 10, and the inclusion of an additional question (see appendix A for details).
Sommer, R. & Sommer, B. (2002) A Practical Guide to Behavioural Research. Tools and Techniques. 5th Ed. Oxford: Oxford University Press
societyandtechnology 
Leave a comment