Interrater Agreement Example 1 (Statistica)


Notes and Considerations

 
This example is based on the example given in the article "(citizendium) Fleiss kappa.pdf" attached at the bottom of this page.

It demonstrates only one of several aspects of the use of this method, the inter-rater agreement.  Other aspects of this method that are not included in this example are intra-rater agreement, and agreement (inter- and intra-) with a known standard.




Data Set

 
The data is available in the file "Example (citizendium) Fleiss kappa.xlsx" attached at the bottom of this page.  It is also available in the Statistica workbook, also attached at the bottom of this page.




Analysis or Script File

 
The analysis file is the Statistica workbook "Example (citizendium) Fleiss kappa.stw" attached at the bottom of this page.

A 'how-to' document is also provided that provides screen shots showing how to conduct the analysis, and guidance on how to interpret the results.  See "Example (citizendium) Fleiss kappa.docx" attached at the bottom of this page.





Comments