Approved For Release 4g0N@Gb#, SGIRDE9-00789R002200460001-7 Principal Investigator Subject ID Monitor ID P One-to—Many ‘arameters Relationship Entity Relationship UNCLASSIFIED FIGURE 2. (U) DATABASE SCHEMA DESIGN FOR META-ANALYSIS (U) The Appendix contains examples of the DBMS input sheets that were used to encode psychoenergetic data for the database, and the instructions that were givén to analysts. They are included in the Appendix for completeness; there is no further discussion about them in this report. Cc. (U) Statistical Methods 1. (U) Effect Size Calculations (U) Effect sizes were calculated for each experiment or condition using the formula given by Rosenthal:? Z d= where n is the number of trials and z is the usual normalized output score. If no z score was given for an experiment, but a p value was, the z that would have given that p value was computed and used in the formula. The exception to this procedure was for experiments based on a sum-of-rank statistic. For those, a more appropriate effect size formula was used and is given by UNCLASSIFIED - Approved For Release 2000/08/08 : CIA-RDP96-00789R002200460001 -7
UNCLASSIFIED Approved For Release 2000/08/08 : CIA-RDP96-00789R002200460001-7 (U) s- Rt) de 2 R?-1 12 where S is the average rank and R is the number of choices for each rank. 2. (U) Comparisons Across Classes (U) Experiments can be categorized in accordance with a number of specific variables (e.g., type of feedback, type of target, distance between the viewer and the target). Effect sizes can be examined within a given category and compared across categories. For each categorization, the following questions are of interest: (1) Question 1: Is there any evidence of psychoenergetic functioning within each of the individual categories? (2) Question 2: Is the level of psychoenergetic functioning constant across all experiments within a category? (3) Question 3: Is the level of psychoenergetic functioning constant across categories? (4) Question 4: If there are differences across categories, what is the relative size of the effect in each category? (U) Table 1 shows the notation that is used in the formalism that answers these questions. (U) To answer question 1, compare the average z score in each category with the standard normal tables. (U) To answer question 2, compute k OM; Ow= > > ni(diy- di)? f=ije1 If effect sizes are homogeneous within categories, the distribution of Qw will be approximately X2 with v = (Zmi - k) degrees of freedom. The hypothesis of homogeneity is rejected if Qw is large compared to the chi-square table entry with v degrees of freedom. To test for homogeneity within a single category, i, compute mj Owi= > nid di.)?. jet 8 UNCLASSIFIED Approved For Release 2000/08/08 : CIA-RDP96-00789R002200460001-7
Approved For Release 2PNHE/pA § GIA E{G-00789R002200460001-7 (U) Similarly, the distribution of Qwi will be approximately X2 with v = (mi — k) degrees of freedom, and can be examined as above. Table 1 (U) DEFINITIONS AND META-ANALYSIS FORMALISM Basic Definitions k = number of categories m; = number of experiments in category ij; i= 1, ...,k dij = effect size for experiment j in category i; i= 1, ..., ks j ny = number of trials in experiment j in category / zij= z score for experiment / in category i = Siny = number of trials J > nydij = j ni. > vn / i, a a = dj. nj. = average z score ni. Within Category i = average effect size a= dni. = total number of trials i ; > > nijdiy Across Categories 7 4 = overall average effect size n.. ..=vn,.d,. = overall average z score UNCLASSIFIED (U) To answer question 3, compute k Op= > nj.(dj. -d..)?. i=l If effect sizes are homogeneous across categories, the distribution of Qs will be approximately X? with v = k-J degrees of freedom. Therefore, the hypothesis of homogeneity across categories is rejected if Qs is large compared to the appropriate entry in the chi-square table with v degrees of freedom. 9 UNCLASSIFIED Approved For Release 2000/08/08 : CIA-RDP96-00789R002200460001-7
Approved For Release 24g ids AGS REHS B00789R002200460001-7 (U) Finally, to answer question: 4, approximate 95% confidence intervals may be computed for the average effect size within a category using 4: 1.96 Nj. dj. 10 UNCLASSIFIED Approved For Release 2000/08/08 : CIA-RDP96-00789R002200460001-7
Approved For Release 2b) DWG/bAA SiS HolEdD.00789R002200460001-7 age Appendix CODING SHEETS AND INSTRUCTIONS FOR THE META-ANALYSIS (This Appendix is UNCLASSIFIED) 25 UNCLASSIFIED Approved For Release 2000/08/08 : CIA-RDP96-00789R002200460001-7
Approved For Release 2bdDG/baA SiS HiliEd)00789R002200460001-7 Page: Coder |.D: Date: Form I.D: Unit Information Data Session Viewer Viewer within Condition Trial Experiment O: L.D. Experienced Novice | Time Duration Viewer Location Client: Parameters That Differ | Circle or write in all appropriate conditions Target Name PE Targeting Method Beacon Abstract Coordinates Prompting Self Unknown Oo: Ops Real Site Photograph Alpha/Numeric Person Objects O; Target Distance (km) | <1 <50 <5000 >5000 Unknown 0: Target: When Selected | Inten~ tlonal4 Retrocognition Real Time Precognition O: Shielding Type Unknown E&M Cage/Room Water SCIF O: Feedback Type | None Visual Audio Verbal Intermediate Site Unknown O: Feedback: When | Immediate <5 min <1 hr <1 day >1 day Unknown O: See UNCLASSIFIED Approved For Release 2000/08/08 : CIA-RDP96-00789R002200460001-7