Focus on quantitative methods - Interpreting kappa values for two-observer nursing diagnosis data

Author(s): Fielding, J.

Journal/Book: Res Nurs Health. 1997; 20: 605 Third Ave, New York, NY 10158-0012. John Wiley & Sons Inc. 465-470.

Abstract: Reliability of nursing observations often is estimated using Cohen's kappa, a chance-adjusted measure of agreement between observer RNs. However, use of kappa as an omnibus measure sometimes can be misleading. In a study partly designed to describe the frequency and reliability of nursing diagnoses in long-term care facilities, 360 residents each were assessed independently by two registered nurses, and kappa and observed proportion of agreement were calculated as estimates of reliability. For some diagnoses we observed high proportions of agreement, yet paradoxically low kappa values. This article presents an in-depth statistical analysis to resolve this paradox. Results from our analysis also suggest means for planning improvements in the diagnostic performance of participating RNs. Consequently, our approach can be used in similar studies of diagnosis reliability to enhance nursing research, education, and practice.

Note: Article Banerjee M, Wayne State Univ, Dept Pathol, Detroit,MI 48201 USA

Keyword(s): agreement; bias; kappa; prevalence; HIGH AGREEMENT; PARADOXES

Zurück | Weiter