Spreadsheet: 841704d1693884009-need-to-create-a-matrix-that-sums-the-number-of-paired-observations-ratingscomparisons
Sheet: Sheet1

Raw Data:
 |  | Task: |  |  |  |  |  |  |  |  |  |  |  |  |  | Condition: Both observer's ratings must match the trainer's ratings.
 |  | AT1 | AT2 | AT3 | PT1 | PT2 | PT3 | DT1 | DT2 | DT3 | DT4 |  |  |  | Matrix 1: Count of individual paired ratings that match the trainer's ratings |  |  |  |  |  |  |  |  |  |  |  |  |  |  | Matrix 1
 | Trainer | A | D | B | D | B | D | D | D | A | D |  |  |  |  | GH | AR | TH | CS | ES | AT | MC | DL | BT | HB | TJ | LF | DT | SS |  | GH | AR | TH | CS | ES | AT | MC | DL | BT | HB | TJ | LF | DT | SS | IR | GH to: | AT1 | AT2 | AT3 | PT1 | PT2 | PT3 | DT1 | DT2 | DT3 | DT4 | Sum |  | AR to: | AT1 | AT2 | AT3 | PT1 | PT2 | PT3 | DT1 | DT2 | DT3 | DT4 | Sum |  | TH to: | AT1 | AT2 | AT3 | PT1 | PT2 | PT3 | DT1 | DT2 | DT3 | DT4 | Sum |  | CS to: | AT1 | AT2 | AT3 | PT1 | PT2 | PT3 | DT1 | DT2 | DT3 | DT4 | Sum |  | ES to: | AT1 | AT2 | AT3 | PT1 | PT2 | PT3 | DT1 | DT2 | DT3 | DT4 | Sum |  | AT to: | AT1 | AT2 | AT3 | PT1 | PT2 | PT3 | DT1 | DT2 | DT3 | DT4 | Sum |  | MC to: | AT1 | AT2 | AT3 | PT1 | PT2 | PT3 | DT1 | DT2 | DT3 | DT4 | Sum |  | DL to: | AT1 | AT2 | AT3 | PT1 | PT2 | PT3 | DT1 | DT2 | DT3 | DT4 | Sum |  | BT to: | AT1 | AT2 | AT3 | PT1 | PT2 | PT3 | DT1 | DT2 | DT3 | DT4 | Sum |  | HB to: | AT1 | AT2 | AT3 | PT1 | PT2 | PT3 | DT1 | DT2 | DT3 | DT4 | Sum |  | TJ to: | AT1 | AT2 | AT3 | PT1 | PT2 | PT3 | DT1 | DT2 | DT3 | DT4 | Sum |  | LF to: | AT1 | AT2 | AT3 | PT1 | PT2 | PT3 | DT1 | DT2 | DT3 | DT4 | Sum |  | DT to: | AT1 | AT2 | AT3 | PT1 | PT2 | PT3 | DT1 | DT2 | DT3 | DT4 | Sum |  | SS to: | AT1 | AT2 | AT3 | PT1 | PT2 | PT3 | DT1 | DT2 | DT3 | DT4 | Sum
 | GH | C | D | B | B | A | D | D | D | A | D |  |  |  | GH |  |  |  |  |  |  |  |  |  |  |  |  |  |  | GH |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  | AR |  |  |  |  |  |  |  |  |  |  |  |  | TH |  |  |  |  |  |  |  |  |  |  |  |  | CS |  |  |  |  |  |  |  |  |  |  |  |  | ES |  |  |  |  |  |  |  |  |  |  |  |  | AT |  |  |  |  |  |  |  |  |  |  |  |  | MC |  |  |  |  |  |  |  |  |  |  |  |  | DL |  |  |  |  |  |  |  |  |  |  |  |  | BT |  |  |  |  |  |  |  |  |  |  |  |  | HB |  |  |  |  |  |  |  |  |  |  |  |  | TJ |  |  |  |  |  |  |  |  |  |  |  |  | LF |  |  |  |  |  |  |  |  |  |  |  |  | DT |  |  |  |  |  |  |  |  |  |  |  |  | SS |  |  |  |  |  |  |  |  |  |  |  |  | IR
 | AR | B | D | B | C | A | D | C | D | A | D |  |  |  | AR |  |  |  |  |  |  |  |  |  |  |  |  |  |  | AR | 6 |  |  |  |  |  |  |  |  |  |  |  |  |  |  | TH |  |  |  |  |  |  |  |  |  |  |  |  | CS |  |  |  |  |  |  |  |  |  |  |  |  | ES |  |  |  |  |  |  |  |  |  |  |  |  | AT |  |  |  |  |  |  |  |  |  |  |  |  | MC |  |  |  |  |  |  |  |  |  |  |  |  | DL |  |  |  |  |  |  |  |  |  |  |  |  | BT |  |  |  |  |  |  |  |  |  |  |  |  | HB |  |  |  |  |  |  |  |  |  |  |  |  | TJ |  |  |  |  |  |  |  |  |  |  |  |  | LF |  |  |  |  |  |  |  |  |  |  |  |  | DT |  |  |  |  |  |  |  |  |  |  |  |  | SS |  |  |  |  |  |  |  |  |  |  |  |  | IR
 | TH | B | D | C | C | A | C | D | C | B | C |  |  |  | TH |  |  |  |  |  |  |  |  |  |  |  |  |  |  | TH | 2 | 1 |  |  |  |  |  |  |  |  |  |  |  |  |  | CS |  |  |  |  |  |  |  |  |  |  |  |  | ES |  |  |  |  |  |  |  |  |  |  |  |  | AT |  |  |  |  |  |  |  |  |  |  |  |  | MC |  |  |  |  |  |  |  |  |  |  |  |  | DL |  |  |  |  |  |  |  |  |  |  |  |  | BT |  |  |  |  |  |  |  |  |  |  |  |  | HB |  |  |  |  |  |  |  |  |  |  |  |  | TJ |  |  |  |  |  |  |  |  |  |  |  |  | LF |  |  |  |  |  |  |  |  |  |  |  |  | DT |  |  |  |  |  |  |  |  |  |  |  |  | SS |  |  |  |  |  |  |  |  |  |  |  |  | IR
 | CS | C | D | A | C | A | D | D | D | A | D |  |  |  | CS |  |  |  |  |  |  |  |  |  |  |  |  |  |  | CS | 6 | 5 | 2 |  |  |  |  |  |  |  |  |  |  |  |  | ES |  |  |  |  |  |  |  |  |  |  |  |  | AT |  |  |  |  |  |  |  |  |  |  |  |  | MC |  |  |  |  |  |  |  |  |  |  |  |  | DL |  |  |  |  |  |  |  |  |  |  |  |  | BT |  |  |  |  |  |  |  |  |  |  |  |  | HB |  |  |  |  |  |  |  |  |  |  |  |  | TJ |  |  |  |  |  |  |  |  |  |  |  |  | LF |  |  |  |  |  |  |  |  |  |  |  |  | DT |  |  |  |  |  |  |  |  |  |  |  |  | SS |  |  |  |  |  |  |  |  |  |  |  |  | IR
 | ES | A | D | B | D | B | D | D | D | A | D |  |  |  | ES |  |  |  |  |  |  |  |  |  |  |  |  |  |  | ES | 7 | 6 | 2 | 6 |  |  |  |  |  |  |  |  |  |  |  | AT |  |  |  |  |  |  |  |  |  |  |  |  | MC |  |  |  |  |  |  |  |  |  |  |  |  | DL |  |  |  |  |  |  |  |  |  |  |  |  | BT |  |  |  |  |  |  |  |  |  |  |  |  | HB |  |  |  |  |  |  |  |  |  |  |  |  | TJ |  |  |  |  |  |  |  |  |  |  |  |  | LF |  |  |  |  |  |  |  |  |  |  |  |  | DT |  |  |  |  |  |  |  |  |  |  |  |  | SS |  |  |  |  |  |  |  |  |  |  |  |  | IR
 | AT | C | D | B | B | C | D | C | D | A | B |  |  |  | AT |  |  |  |  |  |  |  |  |  |  |  |  |  |  | AT | 5 | 5 | 1 | 4 | 5 |  |  |  |  |  |  |  |  |  |  | MC |  |  |  |  |  |  |  |  |  |  |  |  | DL |  |  |  |  |  |  |  |  |  |  |  |  | BT |  |  |  |  |  |  |  |  |  |  |  |  | HB |  |  |  |  |  |  |  |  |  |  |  |  | TJ |  |  |  |  |  |  |  |  |  |  |  |  | LF |  |  |  |  |  |  |  |  |  |  |  |  | DT |  |  |  |  |  |  |  |  |  |  |  |  | SS |  |  |  |  |  |  |  |  |  |  |  |  | IR
 | MC | C | D | A | A | B | D | D | D | A | D |  |  |  | MC |  |  |  |  |  |  |  |  |  |  |  |  |  |  | MC | 6 | 5 | 2 | 6 | 7 | 4 |  |  |  |  |  |  |  |  |  | DL |  |  |  |  |  |  |  |  |  |  |  |  | BT |  |  |  |  |  |  |  |  |  |  |  |  | HB |  |  |  |  |  |  |  |  |  |  |  |  | TJ |  |  |  |  |  |  |  |  |  |  |  |  | LF |  |  |  |  |  |  |  |  |  |  |  |  | DT |  |  |  |  |  |  |  |  |  |  |  |  | SS |  |  |  |  |  |  |  |  |  |  |  |  | IR
 | DL | A | A | B | A | A | D | D | D | A | A |  |  |  | DL |  |  |  |  |  |  |  |  |  |  |  |  |  |  | DL | 5 | 4 | 1 | 4 | 6 | 4 | 4 |  |  |  |  |  |  |  |  | BT |  |  |  |  |  |  |  |  |  |  |  |  | HB |  |  |  |  |  |  |  |  |  |  |  |  | TJ |  |  |  |  |  |  |  |  |  |  |  |  | LF |  |  |  |  |  |  |  |  |  |  |  |  | DT |  |  |  |  |  |  |  |  |  |  |  |  | SS |  |  |  |  |  |  |  |  |  |  |  |  | IR
 | BT | B | D | B | B | B | D | D | D | A | B |  |  |  | BT |  |  |  |  |  |  |  |  |  |  |  |  |  |  | BT | 6 | 5 | 2 | 5 | 7 | 5 | 6 | 5 |  |  |  |  |  |  |  | HB |  |  |  |  |  |  |  |  |  |  |  |  | TJ |  |  |  |  |  |  |  |  |  |  |  |  | LF |  |  |  |  |  |  |  |  |  |  |  |  | DT |  |  |  |  |  |  |  |  |  |  |  |  | SS |  |  |  |  |  |  |  |  |  |  |  |  | IR
 | HB | D | A | B | B | A | D | D | D | A | D |  |  |  | HB |  |  |  |  |  |  |  |  |  |  |  |  |  |  | HB | 6 | 5 | 1 | 5 | 6 | 4 | 5 | 5 | 5 |  |  |  |  |  |  | TJ |  |  |  |  |  |  |  |  |  |  |  |  | LF |  |  |  |  |  |  |  |  |  |  |  |  | DT |  |  |  |  |  |  |  |  |  |  |  |  | SS |  |  |  |  |  |  |  |  |  |  |  |  | IR
 | TJ | A | D | B | C | B | D | D | A | A | D |  |  |  | TJ |  |  |  |  |  |  |  |  |  |  |  |  |  |  | TJ | 6 | 5 | 2 | 5 | 8 | 4 | 6 | 5 | 6 | 5 |  |  |  |  |  | LF |  |  |  |  |  |  |  |  |  |  |  |  | DT |  |  |  |  |  |  |  |  |  |  |  |  | SS |  |  |  |  |  |  |  |  |  |  |  |  | IR
 | LF | A | A | A | D | B | D | D | D | A | D |  |  |  | LF |  |  |  |  |  |  |  |  |  |  |  |  |  |  | LF | 5 | 4 | 1 | 5 | 8 | 3 | 6 | 5 | 5 | 5 | 6 |  |  |  |  | DT |  |  |  |  |  |  |  |  |  |  |  |  | SS |  |  |  |  |  |  |  |  |  |  |  |  | IR
 | DT | B | D | B | D | B | D | D | D | A | D |  |  |  | DT |  |  |  |  |  |  |  |  |  |  |  |  |  |  | DT | 7 | 6 | 2 | 6 | 9 | 5 | 7 | 5 | 7 | 6 | 7 | 7 |  |  |  | SS |  |  |  |  |  |  |  |  |  |  |  |  | IR
 | SS | A | D | A | D | B | D | D | D | A | D |  |  |  | SS |  |  |  |  |  |  |  |  |  |  |  |  |  |  | SS | 6 | 5 | 2 | 6 | 9 | 4 | 7 | 5 | 6 | 5 | 7 | 8 | 8 |  |  | IR
 | IR | A | D | B | D | A | D | D | C | A | D |  |  |  | IR |  |  |  |  |  |  |  |  |  |  |  |  |  |  | IR | 6 | 5 | 2 | 5 | 8 | 4 | 5 | 5 | 5 | 5 | 7 | 6 | 7 | 7
Raw Data (identical to above): |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  | Condition: Both of the observer's paired ratings differ from the trainer's ratings.
 |  | Task: |  |  |  |  |  |  |  |  |  |  |  |  |  | Clarification: The observer's ratings do not need to match each other's ratings.
 |  | AT1 | AT2 | AT3 | PT1 | PT2 | PT3 | DT1 | DT2 | DT3 | DT4 |  |  |  | Matrix 2: Count of individual paired ratings that differ from the trainer's ratings
 | Trainer | A | D | B | D | B | D | D | D | A | D |  |  |  |  | GH | AR | TH | CS | ES | AT | MC | DL | BT | HB | TJ | LF | DT | SS |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  | GH to: | AT1 | AT2 | AT3 | PT1 | PT2 | PT3 | DT1 | DT2 | DT3 | DT4 | Sum |  | AR to: | AT1 | AT2 | AT3 | PT1 | PT2 | PT3 | DT1 | DT2 | DT3 | DT4 | Sum |  | TH to: | AT1 | AT2 | AT3 | PT1 | PT2 | PT3 | DT1 | DT2 | DT3 | DT4 | Sum |  | CS to: | AT1 | AT2 | AT3 | PT1 | PT2 | PT3 | DT1 | DT2 | DT3 | DT4 | Sum |  | ES to: | AT1 | AT2 | AT3 | PT1 | PT2 | PT3 | DT1 | DT2 | DT3 | DT4 | Sum |  | AT to: | AT1 | AT2 | AT3 | PT1 | PT2 | PT3 | DT1 | DT2 | DT3 | DT4 | Sum |  | MC to: | AT1 | AT2 | AT3 | PT1 | PT2 | PT3 | DT1 | DT2 | DT3 | DT4 | Sum |  | DL to: | AT1 | AT2 | AT3 | PT1 | PT2 | PT3 | DT1 | DT2 | DT3 | DT4 | Sum |  | BT to: | AT1 | AT2 | AT3 | PT1 | PT2 | PT3 | DT1 | DT2 | DT3 | DT4 | Sum |  | HB to: | AT1 | AT2 | AT3 | PT1 | PT2 | PT3 | DT1 | DT2 | DT3 | DT4 | Sum |  | TJ to: | AT1 | AT2 | AT3 | PT1 | PT2 | PT3 | DT1 | DT2 | DT3 | DT4 | Sum |  | LF to: | AT1 | AT2 | AT3 | PT1 | PT2 | PT3 | DT1 | DT2 | DT3 | DT4 | Sum |  | DT to: | AT1 | AT2 | AT3 | PT1 | PT2 | PT3 | DT1 | DT2 | DT3 | DT4 | Sum |  | SS to: | AT1 | AT2 | AT3 | PT1 | PT2 | PT3 | DT1 | DT2 | DT3 | DT4 | Sum
 | GH | C | D | B | B | A | D | D | D | A | D |  |  |  | GH |  | 3 | 3 | 3 | 0 | 3 | 2 | 2 | 2 | 3 | 1 | 0 | 1 | 0 |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  | AR |  |  |  |  |  |  |  |  |  |  |  |  | TH |  |  |  |  |  |  |  |  |  |  |  |  | CS |  |  |  |  |  |  |  |  |  |  |  |  | ES |  |  |  |  |  |  |  |  |  |  |  |  | AT |  |  |  |  |  |  |  |  |  |  |  |  | MC |  |  |  |  |  |  |  |  |  |  |  |  | DL |  |  |  |  |  |  |  |  |  |  |  |  | BT |  |  |  |  |  |  |  |  |  |  |  |  | HB |  |  |  |  |  |  |  |  |  |  |  |  | TJ |  |  |  |  |  |  |  |  |  |  |  |  | LF |  |  |  |  |  |  |  |  |  |  |  |  | DT |  |  |  |  |  |  |  |  |  |  |  |  | SS |  |  |  |  |  |  |  |  |  |  |  |  | IR
 | AR | B | D | B | C | A | D | C | D | A | D |  |  |  | AR |  |  | 3 | 3 | 0 | 4 | 2 | 2 | 2 | 3 | 1 | 0 | 1 | 0 |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  | TH |  |  |  |  |  |  |  |  |  |  |  |  | CS |  |  |  |  |  |  |  |  |  |  |  |  | ES |  |  |  |  |  |  |  |  |  |  |  |  | AT |  |  |  |  |  |  |  |  |  |  |  |  | MC |  |  |  |  |  |  |  |  |  |  |  |  | DL |  |  |  |  |  |  |  |  |  |  |  |  | BT |  |  |  |  |  |  |  |  |  |  |  |  | HB |  |  |  |  |  |  |  |  |  |  |  |  | TJ |  |  |  |  |  |  |  |  |  |  |  |  | LF |  |  |  |  |  |  |  |  |  |  |  |  | DT |  |  |  |  |  |  |  |  |  |  |  |  | SS |  |  |  |  |  |  |  |  |  |  |  |  | IR
 | TH | B | D | C | C | A | C | D | C | B | C |  |  |  | TH |  |  |  | 4 | 0 | 4 | 3 | 3 | 3 | 3 | 2 | 1 | 1 | 1 |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  | CS |  |  |  |  |  |  |  |  |  |  |  |  | ES |  |  |  |  |  |  |  |  |  |  |  |  | AT |  |  |  |  |  |  |  |  |  |  |  |  | MC |  |  |  |  |  |  |  |  |  |  |  |  | DL |  |  |  |  |  |  |  |  |  |  |  |  | BT |  |  |  |  |  |  |  |  |  |  |  |  | HB |  |  |  |  |  |  |  |  |  |  |  |  | TJ |  |  |  |  |  |  |  |  |  |  |  |  | LF |  |  |  |  |  |  |  |  |  |  |  |  | DT |  |  |  |  |  |  |  |  |  |  |  |  | SS |  |  |  |  |  |  |  |  |  |  |  |  | IR
 | CS | C | D | A | C | A | D | D | D | A | D |  |  |  | CS |  |  |  |  | 0 | 3 | 3 | 2 | 2 | 3 | 1 | 1 | 1 | 1 |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  | ES |  |  |  |  |  |  |  |  |  |  |  |  | AT |  |  |  |  |  |  |  |  |  |  |  |  | MC |  |  |  |  |  |  |  |  |  |  |  |  | DL |  |  |  |  |  |  |  |  |  |  |  |  | BT |  |  |  |  |  |  |  |  |  |  |  |  | HB |  |  |  |  |  |  |  |  |  |  |  |  | TJ |  |  |  |  |  |  |  |  |  |  |  |  | LF |  |  |  |  |  |  |  |  |  |  |  |  | DT |  |  |  |  |  |  |  |  |  |  |  |  | SS |  |  |  |  |  |  |  |  |  |  |  |  | IR
 | ES | A | D | B | D | B | D | D | D | A | D |  |  |  | ES |  |  |  |  |  | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  | AT |  |  |  |  |  |  |  |  |  |  |  |  | MC |  |  |  |  |  |  |  |  |  |  |  |  | DL |  |  |  |  |  |  |  |  |  |  |  |  | BT |  |  |  |  |  |  |  |  |  |  |  |  | HB |  |  |  |  |  |  |  |  |  |  |  |  | TJ |  |  |  |  |  |  |  |  |  |  |  |  | LF |  |  |  |  |  |  |  |  |  |  |  |  | DT |  |  |  |  |  |  |  |  |  |  |  |  | SS |  |  |  |  |  |  |  |  |  |  |  |  | IR
 | AT | C | D | B | B | C | D | C | D | A | B |  |  |  | AT |  |  |  |  |  |  | 2 | 3 | 3 | 3 | 1 | 0 | 1 | 0 |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  | MC |  |  |  |  |  |  |  |  |  |  |  |  | DL |  |  |  |  |  |  |  |  |  |  |  |  | BT |  |  |  |  |  |  |  |  |  |  |  |  | HB |  |  |  |  |  |  |  |  |  |  |  |  | TJ |  |  |  |  |  |  |  |  |  |  |  |  | LF |  |  |  |  |  |  |  |  |  |  |  |  | DT |  |  |  |  |  |  |  |  |  |  |  |  | SS |  |  |  |  |  |  |  |  |  |  |  |  | IR
 | MC | C | D | A | A | B | D | D | D | A | D |  |  |  | MC |  |  |  |  |  |  |  | 1 | 2 | 2 | 1 | 1 | 1 | 1 |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  | DL |  |  |  |  |  |  |  |  |  |  |  |  | BT |  |  |  |  |  |  |  |  |  |  |  |  | HB |  |  |  |  |  |  |  |  |  |  |  |  | TJ |  |  |  |  |  |  |  |  |  |  |  |  | LF |  |  |  |  |  |  |  |  |  |  |  |  | DT |  |  |  |  |  |  |  |  |  |  |  |  | SS |  |  |  |  |  |  |  |  |  |  |  |  | IR
 | DL | A | A | B | A | A | D | D | D | A | A |  |  |  | DL |  |  |  |  |  |  |  |  | 2 | 3 | 1 | 1 | 0 | 0 |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  | BT |  |  |  |  |  |  |  |  |  |  |  |  | HB |  |  |  |  |  |  |  |  |  |  |  |  | TJ |  |  |  |  |  |  |  |  |  |  |  |  | LF |  |  |  |  |  |  |  |  |  |  |  |  | DT |  |  |  |  |  |  |  |  |  |  |  |  | SS |  |  |  |  |  |  |  |  |  |  |  |  | IR
 | BT | B | D | B | B | B | D | D | D | A | B |  |  |  | BT |  |  |  |  |  |  |  |  |  | 2 | 1 | 0 | 1 | 0 |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  | HB |  |  |  |  |  |  |  |  |  |  |  |  | TJ |  |  |  |  |  |  |  |  |  |  |  |  | LF |  |  |  |  |  |  |  |  |  |  |  |  | DT |  |  |  |  |  |  |  |  |  |  |  |  | SS |  |  |  |  |  |  |  |  |  |  |  |  | IR
 | HB | D | A | B | B | A | D | D | D | A | D |  |  |  | HB |  |  |  |  |  |  |  |  |  |  | 1 | 1 | 1 | 0 |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  | TJ |  |  |  |  |  |  |  |  |  |  |  |  | LF |  |  |  |  |  |  |  |  |  |  |  |  | DT |  |  |  |  |  |  |  |  |  |  |  |  | SS |  |  |  |  |  |  |  |  |  |  |  |  | IR
 | TJ | A | D | B | C | B | D | D | A | A | D |  |  |  | TJ |  |  |  |  |  |  |  |  |  |  |  | 0 | 0 | 0 |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  | LF |  |  |  |  |  |  |  |  |  |  |  |  | DT |  |  |  |  |  |  |  |  |  |  |  |  | SS |  |  |  |  |  |  |  |  |  |  |  |  | IR
 | LF | A | A | A | D | B | D | D | D | A | D |  |  |  | LF |  |  |  |  |  |  |  |  |  |  |  |  | 0 | 1 |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  | DT |  |  |  |  |  |  |  |  |  |  |  |  | SS |  |  |  |  |  |  |  |  |  |  |  |  | IR
 | DT | B | D | B | D | B | D | D | D | A | D |  |  |  | DT |  |  |  |  |  |  |  |  |  |  |  |  |  | 0 |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  | SS |  |  |  |  |  |  |  |  |  |  |  |  | IR
 | SS | A | D | A | D | B | D | D | D | A | D |  |  |  | SS |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  | IR
 | IR | A | D | B | D | A | D | D | C | A | D |  |  |  | IR
Raw Data (identical to above):
 |  | Task: |  |  |  |  |  |  |  |  |  |  |  |  |  | Condition: The paired observer's ratings match each other, but do not match the trainer's ratings.
 |  | AT1 | AT2 | AT3 | PT1 | PT2 | PT3 | DT1 | DT2 | DT3 | DT4 |  |  |  | Matrix 2:  Count of individual paired ratings that match each other, but NOT do not match the trainer's
 | Trainer | A | D | B | D | B | D | D | D | A | D |  |  |  |  | GH | AR | TH | CS | ES | AT | MC | DL | BT | HB | TJ | LF | DT | SS |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  | GH to: | AT1 | AT2 | AT3 | PT1 | PT2 | PT3 | DT1 | DT2 | DT3 | DT4 | Sum |  | AR to: | AT1 | AT2 | AT3 | PT1 | PT2 | PT3 | DT1 | DT2 | DT3 | DT4 | Sum |  | TH to: | AT1 | AT2 | AT3 | PT1 | PT2 | PT3 | DT1 | DT2 | DT3 | DT4 | Sum |  | CS to: | AT1 | AT2 | AT3 | PT1 | PT2 | PT3 | DT1 | DT2 | DT3 | DT4 | Sum |  | ES to: | AT1 | AT2 | AT3 | PT1 | PT2 | PT3 | DT1 | DT2 | DT3 | DT4 | Sum |  | AT to: | AT1 | AT2 | AT3 | PT1 | PT2 | PT3 | DT1 | DT2 | DT3 | DT4 | Sum |  | MC to: | AT1 | AT2 | AT3 | PT1 | PT2 | PT3 | DT1 | DT2 | DT3 | DT4 | Sum |  | DL to: | AT1 | AT2 | AT3 | PT1 | PT2 | PT3 | DT1 | DT2 | DT3 | DT4 | Sum |  | BT to: | AT1 | AT2 | AT3 | PT1 | PT2 | PT3 | DT1 | DT2 | DT3 | DT4 | Sum |  | HB to: | AT1 | AT2 | AT3 | PT1 | PT2 | PT3 | DT1 | DT2 | DT3 | DT4 | Sum |  | TJ to: | AT1 | AT2 | AT3 | PT1 | PT2 | PT3 | DT1 | DT2 | DT3 | DT4 | Sum |  | LF to: | AT1 | AT2 | AT3 | PT1 | PT2 | PT3 | DT1 | DT2 | DT3 | DT4 | Sum |  | DT to: | AT1 | AT2 | AT3 | PT1 | PT2 | PT3 | DT1 | DT2 | DT3 | DT4 | Sum |  | SS to: | AT1 | AT2 | AT3 | PT1 | PT2 | PT3 | DT1 | DT2 | DT3 | DT4 | Sum
 | GH | C | D | B | B | A | D | D | D | A | D |  |  |  | GH |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  | AR |  |  |  |  |  |  |  |  |  |  |  |  | TH |  |  |  |  |  |  |  |  |  |  |  |  | CS |  |  |  |  |  |  |  |  |  |  |  |  | ES |  |  |  |  |  |  |  |  |  |  |  |  | AT |  |  |  |  |  |  |  |  |  |  |  |  | MC |  |  |  |  |  |  |  |  |  |  |  |  | DL |  |  |  |  |  |  |  |  |  |  |  |  | BT |  |  |  |  |  |  |  |  |  |  |  |  | HB |  |  |  |  |  |  |  |  |  |  |  |  | TJ |  |  |  |  |  |  |  |  |  |  |  |  | LF |  |  |  |  |  |  |  |  |  |  |  |  | DT |  |  |  |  |  |  |  |  |  |  |  |  | SS |  |  |  |  |  |  |  |  |  |  |  |  | IR
 | AR | B | D | B | C | A | D | C | D | A | D |  |  |  | AR |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  | TH |  |  |  |  |  |  |  |  |  |  |  |  | CS |  |  |  |  |  |  |  |  |  |  |  |  | ES |  |  |  |  |  |  |  |  |  |  |  |  | AT |  |  |  |  |  |  |  |  |  |  |  |  | MC |  |  |  |  |  |  |  |  |  |  |  |  | DL |  |  |  |  |  |  |  |  |  |  |  |  | BT |  |  |  |  |  |  |  |  |  |  |  |  | HB |  |  |  |  |  |  |  |  |  |  |  |  | TJ |  |  |  |  |  |  |  |  |  |  |  |  | LF |  |  |  |  |  |  |  |  |  |  |  |  | DT |  |  |  |  |  |  |  |  |  |  |  |  | SS |  |  |  |  |  |  |  |  |  |  |  |  | IR
 | TH | B | D | C | C | A | C | D | C | B | C |  |  |  | TH |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  | CS |  |  |  |  |  |  |  |  |  |  |  |  | ES |  |  |  |  |  |  |  |  |  |  |  |  | AT |  |  |  |  |  |  |  |  |  |  |  |  | MC |  |  |  |  |  |  |  |  |  |  |  |  | DL |  |  |  |  |  |  |  |  |  |  |  |  | BT |  |  |  |  |  |  |  |  |  |  |  |  | HB |  |  |  |  |  |  |  |  |  |  |  |  | TJ |  |  |  |  |  |  |  |  |  |  |  |  | LF |  |  |  |  |  |  |  |  |  |  |  |  | DT |  |  |  |  |  |  |  |  |  |  |  |  | SS |  |  |  |  |  |  |  |  |  |  |  |  | IR
 | CS | C | D | A | C | A | D | D | D | A | D |  |  |  | CS |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  | ES |  |  |  |  |  |  |  |  |  |  |  |  | AT |  |  |  |  |  |  |  |  |  |  |  |  | MC |  |  |  |  |  |  |  |  |  |  |  |  | DL |  |  |  |  |  |  |  |  |  |  |  |  | BT |  |  |  |  |  |  |  |  |  |  |  |  | HB |  |  |  |  |  |  |  |  |  |  |  |  | TJ |  |  |  |  |  |  |  |  |  |  |  |  | LF |  |  |  |  |  |  |  |  |  |  |  |  | DT |  |  |  |  |  |  |  |  |  |  |  |  | SS |  |  |  |  |  |  |  |  |  |  |  |  | IR
 | ES | A | D | B | D | B | D | D | D | A | D |  |  |  | ES |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  | AT |  |  |  |  |  |  |  |  |  |  |  |  | MC |  |  |  |  |  |  |  |  |  |  |  |  | DL |  |  |  |  |  |  |  |  |  |  |  |  | BT |  |  |  |  |  |  |  |  |  |  |  |  | HB |  |  |  |  |  |  |  |  |  |  |  |  | TJ |  |  |  |  |  |  |  |  |  |  |  |  | LF |  |  |  |  |  |  |  |  |  |  |  |  | DT |  |  |  |  |  |  |  |  |  |  |  |  | SS |  |  |  |  |  |  |  |  |  |  |  |  | IR
 | AT | C | D | B | B | C | D | C | D | A | B |  |  |  | AT |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  | MC |  |  |  |  |  |  |  |  |  |  |  |  | DL |  |  |  |  |  |  |  |  |  |  |  |  | BT |  |  |  |  |  |  |  |  |  |  |  |  | HB |  |  |  |  |  |  |  |  |  |  |  |  | TJ |  |  |  |  |  |  |  |  |  |  |  |  | LF |  |  |  |  |  |  |  |  |  |  |  |  | DT |  |  |  |  |  |  |  |  |  |  |  |  | SS |  |  |  |  |  |  |  |  |  |  |  |  | IR
 | MC | C | D | A | A | B | D | D | D | A | D |  |  |  | MC |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  | DL |  |  |  |  |  |  |  |  |  |  |  |  | BT |  |  |  |  |  |  |  |  |  |  |  |  | HB |  |  |  |  |  |  |  |  |  |  |  |  | TJ |  |  |  |  |  |  |  |  |  |  |  |  | LF |  |  |  |  |  |  |  |  |  |  |  |  | DT |  |  |  |  |  |  |  |  |  |  |  |  | SS |  |  |  |  |  |  |  |  |  |  |  |  | IR
 | DL | A | A | B | A | A | D | D | D | A | A |  |  |  | DL |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  | BT |  |  |  |  |  |  |  |  |  |  |  |  | HB |  |  |  |  |  |  |  |  |  |  |  |  | TJ |  |  |  |  |  |  |  |  |  |  |  |  | LF |  |  |  |  |  |  |  |  |  |  |  |  | DT |  |  |  |  |  |  |  |  |  |  |  |  | SS |  |  |  |  |  |  |  |  |  |  |  |  | IR
 | BT | B | D | B | B | B | D | D | D | A | B |  |  |  | BT |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  | HB |  |  |  |  |  |  |  |  |  |  |  |  | TJ |  |  |  |  |  |  |  |  |  |  |  |  | LF |  |  |  |  |  |  |  |  |  |  |  |  | DT |  |  |  |  |  |  |  |  |  |  |  |  | SS |  |  |  |  |  |  |  |  |  |  |  |  | IR
 | HB | D | A | B | B | A | D | D | D | A | D |  |  |  | HB |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  | TJ |  |  |  |  |  |  |  |  |  |  |  |  | LF |  |  |  |  |  |  |  |  |  |  |  |  | DT |  |  |  |  |  |  |  |  |  |  |  |  | SS |  |  |  |  |  |  |  |  |  |  |  |  | IR
 | TJ | A | D | B | C | B | D | D | A | A | D |  |  |  | TJ |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  | LF |  |  |  |  |  |  |  |  |  |  |  |  | DT |  |  |  |  |  |  |  |  |  |  |  |  | SS |  |  |  |  |  |  |  |  |  |  |  |  | IR
 | LF | A | A | A | D | B | D | D | D | A | D |  |  |  | LF |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  | DT |  |  |  |  |  |  |  |  |  |  |  |  | SS |  |  |  |  |  |  |  |  |  |  |  |  | IR
 | DT | B | D | B | D | B | D | D | D | A | D |  |  |  | DT |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  | SS |  |  |  |  |  |  |  |  |  |  |  |  | IR
 | SS | A | D | A | D | B | D | D | D | A | D |  |  |  | SS |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  |  | IR
 | IR | A | D | B | D | A | D | D | C | A | D |  |  |  | IR