survey along with demographic information about the raters’ sex and age. These judgments were made on a 5-point likert scale, where 1 = ‘Definitely False,’ 2 = ‘Possibly False,’ 3 = ‘Unable to Judge Veracity,’ 4 = ‘Possibly True,’ and 5 = ‘Definitely True.’ We also collected the sex of the rater, as well as asking females a few questions to discern their current place in the menstrual cycle while rating the videos, as we suspected that it may have made a difference. However, we did not include those data in the analysis, as several female raters thought that we were asking about the average length of their menstruation, rather than the average length of their entire menstrual cycle (see Appendix). Lastly, as a control, we had 12 independent raters give attractiveness scores to the 10 male claimants and 10 female claimants on a 5-point likert scale, where 1 = ‘Very Unattractive,’ 2 = ‘Unattractive,’ 3 = ‘Neither Unattractive Nor Attractive,’ 4 = ‘Attractive,’ and 5 = ‘Very Attractive.’ We then averaged the scores for each claimant to assign them a mean “Attractiveness Rating.” We conducted this step so we could examine the effects of claimant attractiveness on raters’ deception accuracy in the future, and did not include them in our analyses at this time. Procedure Participants from the UAlbany Research Pool were recruited to complete the study, for which they were granted course credit. They gathered in a large lecture hall on the the campus for mass testing, facing the projector screen in the room. These participants, who were different from the claimants, will be referred to as raters from now on. Raters were handed copies of the consent form and coded surveys when they entered. 15 minutes after the start time of the experiment, the research assistants read the consent form to the raters, collected signed consent forms from raters, granted course credit to raters, and then requested that they complete the
demographics survey. Once all raters were ready to begin evaluating the claims, the researchers explained the procedure to the raters in detail, and then showed them a practice snippet that was recorded by one of the research assistants, and edited and embedded into the slide show in the same manner as the other snippets to familiarize the raters with the video presentation format. Once the practice was concluded, raters were shown the data-relevant portion of the presentation, and asked to rate the veracity of each individual claim using the questionnaire. After the final snippet was shown, raters were instructed to leave their surveys on their desks. Researchers waited until all the raters had exited the room before collecting the surveys, which were checked to ensure that each raters’ surveys kept together, and coded to correspond with each other. This procedure was conducted two times; once for each presentation set. Data Analysis Before analyzing the data, we excluded 4 raters’ responses: 2 for completing less than half of the ratings, 1 for putting the same rating for all 40 claims, and 1 because the rater was 17 years old, which is younger than what the IRB allowed. We used IBM SPSS Version 20 to analyze the data we collected. Results We had five independent variables for this study, using a 2 x 2 x 2 x 2 x 2 design. The first was the sex of the rater (Sex of Rater). The second was the sex of the claimant (Sex of Claimant). The third was the actual veracity of the claim that was made (Actual Veracity): true or false. The type of claim that was made was broken down into the last two independent variables, each with two levels. Claimants either said they were in or not in a committed romantic or sexual relationship. Thus, our next independent variable was the current relationship
Table 11. Significant levels of Sex of Claimant by Actual Veracity by Current Status and their effect on Accuracy Sex of Claimant Actual Veracity Current Status Accuracy Difference p Male False In More Accurate .202 <.001 Male False Not In Less Accurate .248 <.001 Male True Not In More Accurate .430 <.001 Female False In Less Accurate .340 <.001 Female False Not In Less Accurate .162 .003 Female True In More Accurate .273 <.001 Table 12. Significant levels of Sex of Rater by Sex of Claimant by Actual Veracity by Type of Relationship and their effect on Accuracy Sex of Rater Sex of Claimant Actual Veracity Type of Relationship Accuracy Difference p Male Male False Romantic Less Accurate .181 .019 Male Male False Sexual More Accurate .113 .001 Male Female False Romantic Less Accurate .182 .013 Male Female False Sexual Less Accurate .437 <.001 Male Female True Romantic More Accurate .246 .001 Female Male True Sexual More Accurate .373 <.001 Female Female False Romantic Less Accurate .149 .021 Female Female False Sexual Less Accurate .299 >.001 Female Female True Romantic More Accurate .409 <.001 Table 13. Comparisons of accuracy between levels of 5-way interaction First Comparison Accuracy Direction Second Comparison Differences Between Comparisons Mean Difference p
(1)## A male rating a male who lied when he said he was in a committed romantic relationship More accurate than (2)# A male rating a male who lied when he said he was not in a committed romantic relationship Current Status .695 .005 (1)## A male rating a male who lied when he said he was in a committed romantic relationship More accurate than (11)# A male rating a female who lied when she said she was in a sexual relationship Type of Relationship Sex of Claimant 1.081 <.001 (1)## A male rating a male who lied when he said he was in a committed romantic relationship More accurate than (18)# A female rating a male who lied when he said he was not in a committed romantic relationship Sex of Rater Current Status .642 .012 (1)## A male rating a male who lied when he said he was in a committed romantic relationship More accurate than (27)# A female rating a female who lied when she said she was in a sexual relationship Sex of Rater Type of Relationship Sex of Claimant .837 <.001 (2)# A male rating a male who lied when he said he was not in a committed romantic relationship Less accurate than (3)## A male rating a male who lied when he said he was in a sexual relationship Current Status Type of Relationship .740 <.001
(2)# A male rating a male who lied when he said he was not in a committed romantic relationship Less accurate than (6)## A male rating a male who told the truth when he said he was not in a committed romantic relationship Actual Veracity .830 <.001 (2)# A male rating a male who lied when he said he was not in a committed romantic relationship Less accurate than (8)## A male rating a male who told the truth when he said he was not in a sexual relationship Type of Relationship Actual Veracity .831 <.001 (2)# A male rating a male who lied when he said he was not in a committed romantic relationship Less accurate than (13)## A male rating a female who told the truth when she said she was in a committed romantic relationship Current Status Sex of Claimant Actual Veracity .835 <.001 (2)# A male rating a male who lied when he said he was not in a committed romantic relationship Less accurate than (17)## A female rating a male who lied when he said he was in a committed romantic relationship Sex of Rater Current Status .718 <.001 (2)# A male rating a male who lied when he said he was not in a committed romantic relationship Less accurate than (22)## A female rating a male who told the truth when he said he was not in a committed romantic relationship Sex of Rater Actual Veracity .773 <.001
(2)# A male rating a male who lied when he said he was not in a committed romantic relationship Less accurate than (23)## A female rating a male who told the truth when he said he was in a sexual relationship Sex of Rater Current Status Type of Relationship Actual Veracity .680 <.001 (2)# A male rating a male who lied when he said he was not in a committed romantic relationship Less accurate than (24)## A female rating a male who told the truth when he said he was not in a sexual relationship Sex of Rater Type of Relationship Actual Veracity .895 <.001 (2)# A male rating a male who lied when he said he was not in a committed romantic relationship Less accurate than (29)## A female rating a female who told the truth when she said she was in a committed romantic relationship Sex of Rater Current Status Sex of Claimant Actual Veracity 1.092 <.001 (2)# A male rating a male who lied when he said he was not in a committed romantic relationship Less accurate than (30)## A female rating a female who told the truth when she said she was not in a committed romantic relationship Sex of Rater Sex of Claimant Actual Veracity .587 .001 (2)# A male rating a male who lied when he said he was not in a committed romantic relationship Less accurate than (31) A female rating a female who told the truth when she said she was in a sexual relationship Sex of Rater Current Status Type of Relationship Sex of Claimant Actual Veracity .477 .035
(3)## A male rating a male who lied when he said he was in a sexual relationship More accurate than (11)# A male rating a female who lied when she said she was in a sexual relationship Sex of Claimant 1.126 <.001 (3)## A male rating a male who lied when he said he was in a sexual relationship More accurate than (18)# A female rating a male who lied when he said he was not in a committed romantic relationship Sex of Rater Current Status Type of Relationship .688 <.001 (3)## A male rating a male who lied when he said he was in a sexual relationship More accurate than (21)# A female rating a male who told the truth when he said he was in a committed romantic relationship Sex of Rater Type of Relationship Actual Veracity .577 .005 (3)## A male rating a male who lied when he said he was in a sexual relationship More accurate than (27)# A female rating a female who lied when she said she was in a sexual relationship Sex of Rater Sex of Claimant .883 <.001 (4) A male rating a male who lied when he said he was not in a sexual relationship More accurate than (11)# A male rating a female who lied when she said she was in a sexual relationship Current Status Sex of Claimant .948 <.001
(6)## A male rating a male who told the truth when he said he was not in a committed romantic relationship More accurate than (18)# A female rating a male who lied when he said he was not in a committed romantic relationship Sex of Rater Actual Veracity .778 <.001 (6)## A male rating a male who told the truth when he said he was not in a committed romantic relationship More accurate than (25) A female rating a female who lied when she said she was in a committed romantic relationship Sex of Rater Current Status Sex of Claimant Actual Veracity .548 .020 (6)## A male rating a male who told the truth when he said he was not in a committed romantic relationship More accurate than (26) A female rating a female who lied when she said she was not in a committed romantic relationship Sex of Rater Sex of Claimant Actual Veracity .626 .021 (6)## A male rating a male who told the truth when he said he was not in a committed romantic relationship More accurate than (27)# A female rating a female who lied when she said she was in a sexual relationship Sex of Rater Current Status Type of Relationship Sex of Claimant Actual Veracity .973 <.001
(8)## A male rating a male who told the truth when he said he was not in a sexual relationship More accurate than (10)# A male rating a female who lied when she said she was not in a committed romantic relationship Type of Relationship Sex of Claimant Actual Veracity .781 .011 (8)## A male rating a male who told the truth when he said he was not in a sexual relationship More accurate than (11)# A male rating a female who lied when she said she was in a sexual relationship Current Status Sex of Claimant Actual Veracity 1.217 <.001 (8)## A male rating a male who told the truth when he said he was not in a sexual relationship More accurate than (18)# A female rating a male who lied when he said he was not in a committed romantic relationship Sex of Rater Type of Relationship Actual Veracity .779 <.001 (8)## A male rating a male who told the truth when he said he was not in a sexual relationship More accurate than (21)# A female rating a male who told the truth when he said he was in a committed romantic relationship Sex of Rater Current Status Type of Relationship .668 .001 (8)## A male rating a male who told the truth when he said he was not in a sexual relationship More accurate than (25) A female rating a female who lied when she said she was in a committed romantic relationship Sex of Rater Current Status Type of Relationship Sex of Claimant Actual Veracity .549 .023
(9) A male rating a female who lied when she said she was in a committed romantic relationship Less accurate than (24)## A female rating a male who told the truth when he said he was not in a sexual relationship Sex of Rater Current Status Type of Relationship Sex of Claimant Actual Veracity .609 .001 (9) A male rating a female who lied when she said she was in a committed romantic relationship Less accurate than (29)## A female rating a female who told the truth when she said she was in a committed romantic relationship Sex of Rater Actual Veracity .807 <.001 (10)# A male rating a female who lied when she said she was not in a committed romantic relationship Less accurate than (13)## A male rating a female who told the truth when she said she was in a committed romantic relationship Current Status Actual Veracity .786 .005 (10)# A male rating a female who lied when she said she was not in a committed romantic relationship Less accurate than (22)## A female rating a male who told the truth when he said he was not in a committed romantic relationship Sex of Rater Sex of Claimant Actual Veracity .724 .022 (10)# A male rating a female who lied when she said she was not in a committed romantic relationship Less accurate than (24)## A female rating a male who told the truth when he said he was not in a sexual relationship Sex of Rater Type of Relationship Sex of Claimant Actual Veracity .845 .001
(10)# A male rating a female who lied when she said she was not in a committed romantic relationship Less accurate than (29)## A female rating a female who told the truth when she said she was in a committed romantic relationship Sex of Rater Current Status Actual Veracity 1.043 <.001 (11)# A male rating a female who lied when she said she was in a sexual relationship Less accurate than (12) A male rating a female who lied when she said she was not in a sexual relationship Current Status .679 .002 (11)# A male rating a female who lied when she said she was in a sexual relationship Less accurate than (13)## A male rating a female who told the truth when she said she was in a committed romantic relationship Type of Relationship Actual Veracity 1.221 <.001 (11)# A male rating a female who lied when she said she was in a sexual relationship Less accurate than (14) A male rating a female who told the truth when she said she was not in a committed romantic relationship Current Status Type of Relationship Actual Veracity .840 <.001 (11)# A male rating a female who lied when she said she was in a sexual relationship Less accurate than (15) A male rating a female who told the truth when she said she was in a sexual relationship Actual Veracity .805 <.001
(11)# A male rating a female who lied when she said she was in a sexual relationship Less accurate than (16) A male rating a female who told the truth when she said she was not in a sexual relationship Current Status Actual Veracity .831 <.001 (11)# A male rating a female who lied when she said she was in a sexual relationship Less accurate than (17)## A female rating a male who lied when he said he was in a committed romantic relationship Sex of Rater Type of Relationship Sex of Claimant 1.104 <.001 (11)# A male rating a female who lied when she said she was in a sexual relationship Less accurate than (19) A female rating a male who lied when he said he was in a sexual relationship Sex of Rater Sex of Claimant .767 <.001 (11)# A male rating a female who lied when she said she was in a sexual relationship Less accurate than (20) A female rating a male who lied when he said he was not in a sexual relationship Sex of Rater Current Status Sex of Claimant .665 .002 (11)# A male rating a female who lied when she said she was in a sexual relationship Less accurate than (21)# A female rating a male who told the truth when he said he was in a committed romantic relationship Sex of Rater Type of Relationship Sex of Claimant Actual Veracity .549 .027
(11)# A male rating a female who lied when she said she was in a sexual relationship Less accurate than (22)## A female rating a male who told the truth when he said he was not in a committed romantic relationship Sex of Rater Current Status Type of Relationship Sex of Claimant Actual Veracity 1.159 <.001 (11)# A male rating a female who lied when she said she was in a sexual relationship Less accurate than (23)## A female rating a male who told the truth when he said he was in a sexual relationship Sex of Rater Sex of Claimant Actual Veracity 1.066 <.001 (11)# A male rating a female who lied when she said she was in a sexual relationship Less accurate than (24)## A female rating a male who told the truth when he said he was not in a sexual relationship Sex of Rater Current Status Sex of Claimant Actual Veracity 1.281 <.001 (11)# A male rating a female who lied when she said she was in a sexual relationship Less accurate than (25) A female rating a female who lied when she said she was in a committed romantic relationship Sex of Rater Type of Relationship .668 <.001 (11)# A male rating a female who lied when she said she was in a sexual relationship Less accurate than (28) A female rating a female who lied when she said she was not in a sexual relationship Sex of Rater Current Status .680 <.001
(12) A male rating a female who lied when she said she was not in a sexual relationship Less accurate than (29)## A female rating a female who told the truth when she said she was in a committed romantic relationship Sex of Rater Current Status Type of Relationship Actual Veracity .799 <.001 (13)## A male rating a female who told the truth when she said she was in a committed romantic relationship More accurate than (18)# A female rating a male who lied when he said he was not in a committed romantic relationship Sex of Rater Current Status Sex of Claimant Actual Veracity .783 <.001 (13)## A male rating a female who told the truth when she said she was in a committed romantic relationship More accurate than (20) A female rating a male who lied when he said he was not in a sexual relationship Sex of Rater Current Status Type of Relationship Sex of Claimant Actual Veracity .556 .032 (13)## A male rating a female who told the truth when she said she was in a committed romantic relationship More accurate than (21)# A female rating a male who told the truth when he said he was in a committed romantic relationship Sex of Rater Sex of Claimant .672 <.001
(13)## A male rating a female who told the truth when she said she was in a committed romantic relationship More accurate than (25) A female rating a female who lied when she said she was in a committed romantic relationship Sex of Rater Actual Veracity .552 .007 (13)## A male rating a female who told the truth when she said she was in a committed romantic relationship More accurate than (26) A female rating a female who lied when she said she was not in a committed romantic relationship Sex of Rater Current Status Actual Veracity .630 .010 (13)## A male rating a female who told the truth when she said she was in a committed romantic relationship More accurate than (27)# A female rating a female who lied when she said she was in a sexual relationship Sex of Rater Type of Relationship Actual Veracity .978 <.001 (13)## A male rating a female who told the truth when she said she was in a committed romantic relationship More accurate than (28) A female rating a female who lied when she said she was not in a sexual relationship Sex of Rater Current Status Type of Relationship Actual Veracity .540 .016
(13)## A male rating a female who told the truth when she said she was in a committed romantic relationship More accurate than (32) A female rating a female who told the truth when she said she was not in a sexual relationship Sex of Rater Current Status Type of Relationship .561 .049 (14) A male rating a female who told the truth when she said she was not in a committed romantic relationship More accurate than (27)# A female rating a female who lied when she said she was in a sexual relationship Sex of Rater Current Status Type of Relationship Actual Veracity .597 .011 (14) A male rating a female who told the truth when she said she was not in a committed romantic relationship Less accurate than (29)## A female rating a female who told the truth when she said she was in a committed romantic relationship Sex of Rater Current Status .638 .002 (15) A male rating a female who told the truth when she said she was in a sexual relationship More accurate than (27)# A female rating a female who lied when she said she was in a sexual relationship Sex of Rater Actual Veracity .562 .010 (15) A male rating a female who told the truth when she said she was in a sexual relationship Less accurate than (29)## A female rating a female who told the truth when she said she was in a committed romantic relationship Sex of Rater Type of Relationship .673 <.001
(16) A male rating a female who told the truth when she said she was not in a sexual relationship Less accurate than (29)## A female rating a female who told the truth when she said she was in a committed romantic relationship Sex of Rater Current Status Type of Relationship .648 .025 (17)## A female rating a male who lied when he said he was in a committed romantic relationship More accurate than (18)# A female rating a male who lied when he said he was not in a committed romantic relationship Current Status .666 <.001 (17)## A female rating a male who lied when he said he was in a committed romantic relationship More accurate than (21)# A female rating a male who told the truth when he said he was in a committed romantic relationship Actual Veracity .555 .018 (17)## A female rating a male who lied when he said he was in a committed romantic relationship More accurate than (27)# A female rating a female who lied when she said she was in a sexual relationship Type of Relationship Sex of Claimant .861 <.001 (18)# A female rating a male who lied when he said he was not in a committed romantic relationship Less accurate than (22)## A female rating a male who told the truth when he said he was not in a committed romantic relationship Actual Veracity .721 <.001
(18)# A female rating a male who lied when he said he was not in a committed romantic relationship Less accurate than (23)## A female rating a male who told the truth when he said he was in a sexual relationship Current Status Type of Relationship Actual Veracity .627 <.001 (18)# A female rating a male who lied when he said he was not in a committed romantic relationship Less accurate than (24)## A female rating a male who told the truth when he said he was not in a sexual relationship Type of Relationship Actual Veracity .842 <.001 (18)# A female rating a male who lied when he said he was not in a committed romantic relationship Less accurate than (29)## A female rating a female who told the truth when she said she was in a committed romantic relationship Current Status Sex of Claimant Actual Veracity 1.040 <.001 (18)# A female rating a male who lied when he said he was not in a committed romantic relationship Less accurate than (30)## A female rating a female who told the truth when she said she was not in a committed romantic relationship Sex of Claimant Actual Veracity .535 .002 (19) A female rating a male who lied when he said he was in a sexual relationship Less accurate than (24)## A female rating a male who told the truth when he said he was not in a sexual relationship Current Status Actual Veracity .513 .028
(19) A female rating a male who lied when he said he was in a sexual relationship More accurate than (27)# A female rating a female who lied when she said she was in a sexual relationship Sex of Claimant .524 .033 (19) A female rating a male who lied when he said he was in a sexual relationship Less accurate than (29)## A female rating a female who told the truth when she said she was in a committed romantic relationship Type of Relationship Sex of Claimant Actual Veracity .711 <.001 (20) A female rating a male who lied when he said he was not in a sexual relationship Less accurate than (24)## A female rating a male who told the truth when he said he was not in a sexual relationship Actual Veracity .616 .002 (20) A female rating a male who lied when he said he was not in a sexual relationship Less accurate than (29)## A female rating a female who told the truth when she said she was in a committed romantic relationship Current Status Type of Relationship Sex of Claimant Actual Veracity .813 <.001 (21)# A female rating a male who told the truth when he said he was in a committed romantic relationship Less accurate than (22)## A female rating a male who told the truth when he said he was not in a committed romantic relationship Current Status .610 .001
(22)## A female rating a male who told the truth when he said he was not in a committed romantic relationship More accurate than (27)# A female rating a female who lied when she said she was in a sexual relationship Current Status Type of Relationship Sex of Claimant Actual Veracity .916 <.001 (23)## A female rating a male who told the truth when he said he was in a sexual relationship More accurate than (27)# A female rating a female who lied when she said she was in a sexual relationship Sex of Claimant Actual Veracity .822 <.001 (24)## A female rating a male who told the truth when he said he was not in a sexual relationship More accurate than (25) A female rating a female who lied when she said she was in a committed romantic relationship Current Status Type of Relationship Sex of Claimant Actual Veracity .612 <.001 (24)## A female rating a male who told the truth when he said he was not in a sexual relationship More accurate than (26) A female rating a female who lied when she said she was not in a committed romantic relationship Type of Relationship Sex of Claimant Actual Veracity .690 .001 (24)## A female rating a male who told the truth when he said he was not in a sexual relationship More accurate than (27)# A female rating a female who lied when she said she was in a sexual relationship Current Status Sex of Claimant Actual Veracity 1.037 <.001
(24)## A female rating a male who told the truth when he said he was not in a sexual relationship More accurate than (28) A female rating a female who lied when she said she was not in a sexual relationship Sex of Claimant Actual Veracity .600 .001 (24)## A female rating a male who told the truth when he said he was not in a sexual relationship More accurate than (32) A female rating a female who told the truth when she said she was not in a sexual relationship Sex of Claimant .621 .004 (25) A female rating a female who lied when she said she was in a committed romantic relationship Less accurate than (29)## A female rating a female who told the truth when she said she was in a committed romantic relationship Actual Veracity .810 <.001 (26) A female rating a female who lied when she said she was not in a committed romantic relationship Less accurate than (29)## A female rating a female who told the truth when she said she was in a committed romantic relationship Current Status Actual Veracity .888 <.001 (27)# A female rating a female who lied when she said she was in a sexual relationship Less accurate than (29)## A female rating a female who told the truth when she said she was in a committed romantic relationship Type of Relationship Actual Veracity 1.235 <.001
(29)## A female rating a female who told the truth when she said she was in a committed romantic relationship More accurate than (32) A female rating a female who told the truth when she said she was not in a sexual relationship Current Status Type of Relationship .818 <.001 This table depicts significant differences in mean Accuracy scores between levels of the 5-way interaction of the IVs. # indicates a level that is less accurate, ## indicates a level that is more accurate, and no #’s indicate a lack of difference in accuracy. The “Differences Between Comparisons” column indicates which IVs varied between the first and second comparison in that row.
Figures: Lines between bars indicate significant difference between the means of those two groups. * indicates a p<.05 ** indicates a p<.01 *** indicates a p<.001 Figure 1. Sex of Claimant Figure 2. Actual Veracity