Skip to main content

Table 3 Index – nearest neighbor rater agreement on serenity in the close outdoor environment

From: Exploring inter-rater reliability and measurement properties of environmental ratings using kappa and colocation quotients

 

Rel

Nearest neighbor rater

freqa

1. Disagree completely

2. Disagree

3. Agree

4. Agree completely

5. Cannot say

6. Not answered

 

(%)

Obs/Expb

CLQ (K %)

Obs/Expb

CLQ (K %)

Obs/Expb

CLQ (K %)

Obs/Expb

CLQ (K %)

Obs/Expb

CLQ (K %)

Obs/Expb

CLQ (K %)

Index rater

             

 1 Disagree completely

5.7

0.60/0.32

1.9 (5.9)***

1.6/10

1.6 (4.6)***

2.2/2.4

0.91 (−1.1)

0.77/1.6

0.49 (−4.8)***

0.29/0.20

1.5 (1.9)

0.25/0.20

1.3 (1.7)

 2 Disagree

18

  

4.8/3.1

1.5 (11)***

7.3/7.3

0.99 (−0.2)

2.5/4.9

0.51 (−13)***

0.80/0.62

1.3 (1.7)

0.67/0.62

1.1 (0.7)

 3 Agree

42

    

19/17

1.1 (4.6)***

11/12

0.92 (−3.7)***

1.5/1.5

1.0 (−0.0)

1.4/1.5

0.95 (−0.2)

 4 Agree completely

28

      

12/7.8

1.6 (23)***

0.56/0.98

0.57 (−2.9)**

0.79/0.98

0.80 (−1.2)

 5 Cannot say

3.5

        

0.21/0.12

1.7 ( 2.2)

0.17/0.12

1.4 (2.2)

 6 Not answered

3.5

          

0.20/0.12

1.6 (3.0)

  1. **p <0.01; ***p <0.001.
  2. aRelative frequency of index ratings in each category.
  3. bObserved/Expected relative frequency (%) used in the calculation of the colocation quotient (CLQ).