Department of Communication Studies
Title of Conference Paper
Scott’s π (1955) and Krippendorff's α (1980) have been among the most-often used or recommended general indicators of reliability. This article presents paradoxes showing that neither can be a general indicator. We show that π or α should be used only when (a) coders enforce a predetermined quota as the first priority and (b) coders maximize chance coding as the second priority. Because the two conditions rarely hold, π or α should rarely be used.
Annual conference of Association for Education in Journalism and Mass Communication
Zhao, Xinshu (2011). “When to use Scott’s π or Krippendorff's α, if ever?” paper presented at the annual conference of Association for Education in Journalism and Mass Communication, St. Louis, USA, August