Exploring inter-rater reliability and measurement properties of environmental ratings using kappa and colocation quotients

Table 2 Index – nearest neighbor rater agreement on species richness collapsed into a 3 × 3-table

	Rel	Nearest neighbor rater
	freq^a	1-2 Disagree completely/Disagree		3-4 Agree/Agree completely		5-6 Cannot say/Not answered
	(%)	Obs/Exp^b	CLQ (K %)	Obs/Exp^b	CLQ (K %)	Obs/Exp^b	CLQ (K %)
Index rater
1-2 Disagree completely/Disagree	43	24/19	1.3 (21)^***	14/19	0.71 (−23)^***	5.1/4.8	1.1 (1.5)^*
3-4 Agree/Agree completely	46			27/21	1.3 (26)^***	4.3/5.1	0.84 (−3.3)^***
5-6 Cannot say/Not answered	11					1.7/1.3	1.3 (4.9)^***

*0.01≤ p <0.05; ***p <0.001.
^aRelative frequency of index ratings in each category.
^bObserved/Expected relative frequency (%) used in the calculation of the colocation quotient (CLQ).

ISSN: 1476-069X