Improving Survey Design Through Pilot Testing

         Pilot testing is an initial examination or investigation before a more extensive study. It aims to assess the practicality, duration, expenses, and potential risks and enhance the study's overall design before conducting a comprehensive research project (Moyer, 2015). 

        Pilot testing can significantly contribute to the enhancement of research quality. By conducting a pilot study, researchers can identify and address any potential issues with the study's design or methodology before conducting the full-scale investigation (Etchegaray & Fischer, 2011).

Updating and Revising the Approach:

Considerations for updating and revising my current approach based on the future telephone survey responses about construction pollution:

  • Double-barreled questions: They occur when a single question incorporates multiple ideas or concepts (Menold, 2020). For instance, the question "Do you think construction pollution is a serious problem and should be regulated more?" combines two distinct inquiries: the seriousness of construction pollution and the need for increased regulation. To improve the clarity of responses, avoiding such double-barreled questions in surveys is crucial.

  • Biased statements: They exhibit a preference or favoritism towards one side of an issue (Hube & Fetahu, 2018). For example, the statement "Construction pollution is a major problem that needs to be addressed" implies a biased perspective on the severity of construction pollution. It is essential to eliminate biased survey statements to ensure neutrality and prevent influencing respondents' answers.

  • Leading questions: They are phrased to direct respondents towards a specific answer or imply a preferred response. An example of a leading question is "Do you agree that construction pollution is a serious problem?" as it suggests agreement with the seriousness of construction pollution. Avoiding leading questions is crucial to maintain the survey's objectivity and obtaining unbiased responses.

The Proposed Pilot Sample:

         It is challenging to predict with certainty how my proposed pilot sample will perceive and respond to the items discussed in section 1a above. Nevertheless, I can offer some theoretical insights:

Firstly, it is probable that my pilot sample will demonstrate a higher willingness to participate in the survey compared to the general population. This inclination arises from their more significant interest in the survey's topic and their recognition of its significance.

Secondly, my pilot sample is likely to possess more knowledge about the survey's subject matter than the general population. This is due to their increased likelihood of personal experiences with construction pollution and their higher chances of being exposed to related information through news sources or online platforms.

Thirdly, my pilot sample is expected to be more ready to express their opinions regarding construction pollution than the general population. This inclination stems from their perception that their viewpoints hold value and that their input can make a difference.

Conclusion

         Overall, my pilot sample will be a valuable asset for my research. It possesses the potential to provide valuable insights into the public's perception of construction pollution, aiding in the refinement of my survey questions and methodology (Schachtebeck, Groenewald & Nieuwenhuizen, 2018). By addressing the aspects discussed in this discussion, I can enhance the quality and reliability of my research findings in the study on construction pollution. Ensuring clarity, neutrality, and objectivity in survey questions will enable me to obtain accurate and meaningful data from respondents.

References

Etchegaray, J. M., & Fischer, W. G. (2011). Understanding Evidence-Based Research Methods: Pilot Testing Surveys. Health Environments Research &

Design Journal (HERD) (Vendome Group LLC), 4(4), 143–147. Retrieved from EBSCO Multi-search database (Dated but very relevant).

Hube, C., & Fetahu, B. (2018, April). Detecting biased statements in wikipedia. In Companion proceedings of the the web conference 2018 (pp. 1779-

1786).

Menold, N. (2020). Double barreled questions: An analysis of the similarity of elements and effects on measurement quality. Journal of Official Statistics,

36(4), 855-886.

Moyer, L. (2015). Surveys and pilot testing. Retrieved from https://www.youtube.com/watch?v=bLsslL7HLOc (13:11).

Schachtebeck, C., Groenewald, D., & Nieuwenhuizen, C. (2018). Pilot studies: Use and misuse in south African SME research. Acta Universitatis

Danubius.Oeconomica, 14(1). Retrieved from ProQuest Central.

Post a Comment

Previous Post Next Post

Contact Form