MetaTOC stay on top of your field, easily

Cognitive Effects of Inattentive Responding in an MTurk Sample

,

Social Science Quarterly

Published online on

Abstract

["Social Science Quarterly, Volume 102, Issue 4, Page 2020-2039, July 2021. ", "\n\nObjective\nMechanical Turk (MTurk) has become an increasingly valuable sampling tool for social scientists. At the same time, concern has emerged about the quality of responses obtained from MTurk workers. This article demonstrates several screening practices for identifying problematic or inattentive MTurk participants. The study also examines how inattentive responding affects psychometric properties of measures and relationships between substantive variables.\n\n\nMethod\nA sample of 498 MTurk workers participated in an experimental study for developing and validating scales of public confidence in the criminal justice system. Multiple screening procedures were used to identify inattentive participants and their potential effects on study measures and hypothesis testing.\n\n\nResults\nResults reveal adverse impacts on psychometric properties of measures as well as inflated observed relationships between substantive variables.\n\n\nConclusion\nScreeners used in this study work well in identifying attention problems among MTurk participants. The present study expands guidance for improving quality of responses from MTurk participants for social science research.\n\n"]