You Get What You Pay For: An Empirical Examination of the Use of MTurk in Legal Scholarship.

Item request has been placed! ×
Item request cannot be made. ×
  Processing Request
  • Additional Information
    • Abstract:
      In recent years, legal scholars have come to rely on Amazon's Mechanical Turk ("MTurk") platform to recruit participants for surveys and experiments. Despite MTurk's popularity, there is no generally accepted methodology for its use in legal scholarship, and many questions remain about the validity of data gathered from this source. In particular, little is known about how the compensation structure affects the performance of respondents recruited using MTurk. This Essay fills both of these gaps. We develop an experiment and test the effect of various compensation structures on performance along two dimensions: effort and attention. We find that both the level and the structure of the compensation scheme have substantial effects on the performance of MTurk workers, and that these effects differ across question types. We then propose a series of best practices for scholars to follow in conducting research using MTurk. Adoption of these guidelines will improve both the transparency and the robustness of research conducted using this platform. [ABSTRACT FROM AUTHOR]
    • Abstract:
      Copyright of Vanderbilt Law Review is the property of Vanderbilt Law Review and its content may not be copied or emailed to multiple sites or posted to a listserv without the copyright holder's express written permission. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)
    • Author Affiliations:
      1Assistant Professor, University of Toronto Faculty of Law & Rotman School of Management
      2Professor and Chair in Law and Economics, University of Toronto Faculty of Law
    • ISSN:
      0042-2533
    • Accession Number:
      139303406
  • Citations
    • ABNT:
      ROBERTSON, A. Z.; YOON, A. H. You Get What You Pay For: An Empirical Examination of the Use of MTurk in Legal Scholarship. Vanderbilt Law Review, [s. l.], v. 72, n. 5, p. 1633–1674, 2019. Disponível em: http://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=asn&AN=139303406&custid=s8280428. Acesso em: 15 dez. 2019.
    • AMA:
      Robertson AZ, Yoon AH. You Get What You Pay For: An Empirical Examination of the Use of MTurk in Legal Scholarship. Vanderbilt Law Review. 2019;72(5):1633-1674. http://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=asn&AN=139303406&custid=s8280428. Accessed December 15, 2019.
    • APA:
      Robertson, A. Z., & Yoon, A. H. (2019). You Get What You Pay For: An Empirical Examination of the Use of MTurk in Legal Scholarship. Vanderbilt Law Review, 72(5), 1633–1674. Retrieved from http://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=asn&AN=139303406&custid=s8280428
    • Chicago/Turabian: Author-Date:
      Robertson, Adriana Z., and Albert H. Yoon. 2019. “You Get What You Pay For: An Empirical Examination of the Use of MTurk in Legal Scholarship.” Vanderbilt Law Review 72 (5): 1633–74. http://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=asn&AN=139303406&custid=s8280428.
    • Harvard:
      Robertson, A. Z. and Yoon, A. H. (2019) ‘You Get What You Pay For: An Empirical Examination of the Use of MTurk in Legal Scholarship’, Vanderbilt Law Review, 72(5), pp. 1633–1674. Available at: http://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=asn&AN=139303406&custid=s8280428 (Accessed: 15 December 2019).
    • Harvard: Australian:
      Robertson, AZ & Yoon, AH 2019, ‘You Get What You Pay For: An Empirical Examination of the Use of MTurk in Legal Scholarship’, Vanderbilt Law Review, vol. 72, no. 5, pp. 1633–1674, viewed 15 December 2019, .
    • MLA:
      Robertson, Adriana Z., and Albert H. Yoon. “You Get What You Pay For: An Empirical Examination of the Use of MTurk in Legal Scholarship.” Vanderbilt Law Review, vol. 72, no. 5, Oct. 2019, pp. 1633–1674. EBSCOhost, search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=asn&AN=139303406&custid=s8280428.
    • Chicago/Turabian: Humanities:
      Robertson, Adriana Z., and Albert H. Yoon. “You Get What You Pay For: An Empirical Examination of the Use of MTurk in Legal Scholarship.” Vanderbilt Law Review 72, no. 5 (October 2019): 1633–74. http://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=asn&AN=139303406&custid=s8280428.
    • Vancouver/ICMJE:
      Robertson AZ, Yoon AH. You Get What You Pay For: An Empirical Examination of the Use of MTurk in Legal Scholarship. Vanderbilt Law Review [Internet]. 2019 Oct [cited 2019 Dec 15];72(5):1633–74. Available from: http://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=asn&AN=139303406&custid=s8280428