Modern Psychological Studies
University of Tennessee at Chattanooga
Place of Publication
The popularity of online research is increasing but the validity of the results obtained is not yet clear. The purpose of this study was to examine the factors that influence the validity of computerized data collection in an undergraduate sample. Participants were 99 university students randomly assigned to one of three data collection conditions: online survey platform, in-person computerized survey platform, and in-person pencil-and-paper survey. Results from statistical analyses suggest self-reported inattention symptoms, exposure to more stressors, and computerized platforms predict more invalid responding. In contrast, personality, self-reported impulsivity symptoms, and shorter completion times do not predict invalid responding. Overall, more than half of the participants failed at least one validity check and 11% failed three or more validity checks. Researchers, particularly those working with undergraduate samples, should consider implementing procedures to ensure the data collected are valid.
BF1 .M63 v. 22 no. 2 2017
Al-Salom, Patricia and Miller, Carlin J.
"The problem with online data collection: predicting invalid responding in undergraduate samples,"
Modern Psychological Studies: Vol. 22:
2, Article 2.
Available at: https://scholar.utc.edu/mps/vol22/iss2/2