bluuebunny/crossref_metadata_2025 huggingface dataset:
A Quick Method for Determining Test Bias
Authors: Echternacht Gary
Published: March 2007

The problem of test bias has been a growing concern in recent years. Of the several available methods for determining test bias, probably the most effective means involves collecting criterion information. This data collection process often provides a considable barrier to the researcher, especially for the small test user and for someone who needs an immediate solution to a test bias question. This paper presents a method for identifying and analyzing the nature of test bias. This method is intended as only a preliminary analysis prior to, or concurrently to, a criterion data collection process.
The MMPI-168 for Psychiatric Screening
Authors: Overall John E. , Gomez-Mont Francisco
Published: March 2007

A convenient short-form administration of the MMPI is described. Rather than selecting items out of context, it is recommended that the abbreviated administration consist of the first 168 items of the standard MMPI. The usual scoring stencils can be applied to obtain scores which can be used to estimate k-corrected clinical scale scores by application of regression weights.
"Top-Down" Trees of Educational Values
Authors: Page Ellis B.
Published: March 2007

The connection between highest purpose and lowest objective may be visualized as a multi-level hierarchy or tree. Most measurement work emphasizes the actual test item or behavioral objective, but such a "bottom-up" approach is here criticized as uncontrollable. A more feasible "top-down" approach begins with the definition of highest value, here called bentee (for benefit T-score). This measure is a normalized and weighted sum of a profile of test scores. The weighting may be done at each node of the tree for the branches below, by judges selected for authority or expertise. It may be done for a total society, or for specific groups, occupations, or individuals. Such a tree has mathematical properties similar to those for a tree of independent probabilities.
The G Index of Agreement in Multiple Ratings
Authors: Holley J.W. , Lienert G.A.
Published: March 2007

A generalization of the G index of agreement is presented, allowing for its application in multiple ratings. The generalized coefficient is intended for use in the psychiatric clinic. An illustrative example is provided, using hypothetical data.
A Population Subgroup Multiple Comparison Computer Program Based Upon Categorical Data
Authors: Rafacz Bernard A.
Published: March 2007

Much of the information obtained on a particular population within psychological and educational research involves categorical data, usually in the form of nominal responses to items on a questionnaire. It is often of interest to compare various sets of subgroups of the population with respect to their response distributions to the items on the questionnaire. Procedures for performing multiple subgroup comparisons have been presented by Snee (1974) and Gabriel (1966). The question considered is whether or not a set of subgroups is homogeneous over the item response categories. Furthermore, if a set of subgroups is declared heterogeneous for an item, which subsets of that set may also be declared heterogeneous? It could be necessary to perform subgroup comparisons based upon a combination of some categories of the item. The computer program presented in this paper allows a researcher to determine which subgroups of the population are heterogeneous for some combination of categories of a questionnaire item.
Configural Frequency Analysis As a Statistical Tool for Defining Types
Authors: Lienert G.A. , Krauth J.
Published: March 2007

Configural frequency analysis (CFA) is a new method for identifying types. Types are defined as patterns (configurations) of binary variables occurring more frequently than may be expected under the assumption of complete independence of the respective variables, and are tested for significance by multiple binomial tests or suitable approximations. CFA is illustrated numerically by an example. Relations to latent class analysis and to factor analysis are discussed. It is suggested to use CFA as a type-defining method instead of factor analysis if the variables are linked to each other not only by first but also by higher-order associations.
A Study of the Effect of the Violation of the Assumption of Independent Sampling Upon the Type I Error Rate of the Two-Group t-Test
Authors: Lissitz Robert W. , Chardos Steve
Published: March 2007

This paper describes some of the situations in which a psychologist is likely to violate the assumption of independent errors. A Monte-Carlo study of the effects of this violation is then described. A number of examples of different kinds and degrees of dependency are included along with a table that gives the effect of the dependency upon the shape of the test statistic's distribution. The results of this study demonstrate that this assumption is a critical one. Researchers are strongly urged to avoid hypothesis testing if they suspect that the assumption of independence has been violated.
Interrelationships Among Psychological Measures of Cognitive Style and Fantasy Predisposition in a Sample of 100 Children in the Fifth and Sixth Grades
Authors: McNary Susan , Michael William B. , Richards Leo , Lovell Constance
Published: March 2007

For a sample of 100 fifth and sixth grade pupils of middle-class background (51 girls and 49 boys), intercorrelations among measures of three cognitive style constructs of reflection-impulsivity, field dependence-independence, and internal-external locus of control and three measures of fantasy predisposition were for the most part low and statistically not significant. Exceptions were noted in the instance of the sample of girls for whom coefficients of .36, .38, and .51 between the measure of locus of control and each of three measures of fantasy predisposition were statistically reliable beyond the .01 level. The hypothesis of a positive relationship between a measurable construct of fantasy predisposition and each of three measurable constructs of cognitive style received only limited support. Furthermore, it did not appear that fantasy was a part of a larger or more general construct of cognitive style or that a universal construct of cognitive style existed.
A Program for the T-Score Normal Standardizing Transformation
Authors: Wimberley Ronald C.
Published: March 2007

This FORTRAN program transforms raw values of a variable into T-scores having a normal distribution with a mean of 50 and a standard deviation of 10. Options are available for the categorization of data, the assignment of missing data, and the merging of old input data records with new output records which contain T-scores of the variables for each case. New records alone or new plus old record output may be placed on cards, tape, or disk.
A Computer Program to Determine Relations Among Genuine Dichotomies: the Phi and G Statistics
Authors: Chamberlain Howard , Van Fleet David D.
Published: March 2007

The Phi and G statistics for dichotomus variables are discussed and a Fortran program to compute them is described. Input is to be in card form, output may be printed, punched, or placed on magnetic tape. The punch or tape output is designed to be used as input for the BMD X72 factor analysis program.
Comparing the Variances of Several Treatments With a Control
Authors: Levy Kenneth J.
Published: March 2007

The Dunnett procedure for comparing several treatment means with a control is applied to the problem of comparing several treatment variances with the variance of a control. Appropriate critical values are specified and an example is provided.
The Differential Formation of Response Sets By Specific Determiners
Authors: Jones Phillip D. , Kaufman Gary G.
Published: March 2007

This investigation was conducted to determine if both position and alternative length specific determiners cause a differential formation of response sets on tests in high and low scoring groups. A 46 item vocabulary test with 10 alternate forms varied by type and frequency of specific determiners was administered to 1000 undergraduate Psychology students. Results indicated that as the frequency of specific determiners increased, they formed increasingly strong but differential guessing response sets in high and low scoring groups; however, the magnitude of the effect was much stronger for position specific determiners. Results were interpreted in terms of differing frequencies of appearance in existing tests and the actual nature of the responses an examinee makes to multiple-choice items.
Itema: An Improved Item Analysis Procedure
Authors: Lewis Robert A.
Published: March 2007

An item analysis and test-scoring procedure was developed based on a model proposed by Menne (1970). In addition to standard distractor analysis and test scoring, ITEMA includes an interface with data produced by optical scanning equipment. Program features include differential weighting of test items; unique identification of items from question files; and summary analyses suitable for automated gradebook programs. The program can select any part of the test analysis as options.
The Validity of Each of the Four Scales of the Survey of Study Habits and Attitudes (SSHA) for Each of Two Samples of College Students and Under Each of Two Treatment Conditions Involving Use of Released Class Time
Authors: Wen Shih-Sung , Liu An-Yen
Published: March 2007

A validity study of each of the four subscales of the Survey of Study Habits and Attitudes (SSHA) indicated (a) moderate to high degree of correlations between each SSHA subscale and course examination scores for 43 female black undergraduates but an absence of such correlations for 37 male black undergraduates and (b) significant correlations between each of three SSHA subscales (Work Methods, Teacher Approval, and Education Acceptance) and the course examination scores for a sample of 50 students who preferred released time (free Fridays) by taking each of four biweekly course examinations just once, but no significant correlations between each of four SSHA subscales and the course examination scores for a sample of 30 students who preferred taking the same biweekly course examination twice on two consecutive Fridays without released time.
Context-Independence of Items Designed to Measure the Ability to Derive the Meanings of Words from their Context
Authors: Pyrczak Fred
Published: March 2007

Items designed to measure the ability to derive the meanings of words from context (vocabulary-in-context items) were drawn from seven published reading tests. The items were administered to junior-and senior-high school students without the context. The percentage of students who marked the individual items correctly varied from zero to 91. In response to the average item 14% more students marked it correctly than would be expected to do so on the basis of random guessing alone. Only one published test had vocabulary-in-context items that were consistently context-dependent.
The Preschool Attainment Record: a Concurrent Validity Study With Cerebral Palsied Children
Authors: Krasner Paul R. , Silverstein Leonard
Published: March 2007

Twenty-seven multiply handicapped cerebral palsied children, whose mean age was three years and three months, were administered the Preschool Attainment Record, The Vineland Social Maturity Scale, and the Gesell Developmental Schedules. Significant correlation coefficients were obtained among the scores on the three tests. As far as can be determined, this study which represents the first one presenting concurrent validity data on the Preschool Attainment Record suggests that the Preschool Attainment Record is a valid measure of Doll's (1953) social maturity construct. Furthermore, when used with the neurologically impaired, the Preschool Attainment Record affords a useful alternative to the Vineland Scale.
The Subject-Item Interaction in Itemmetric Research
Authors: Kuncel Ruth Boutin
Published: March 2007

In their investigation of the relationship between item properties and test quality, itemmetricians rely too heavily upon inference about the nature of the subject-item interaction. Itemmetric research can be improved by employing data, specifying variables, and selecting an order of data analysis which are more directly related to this interaction. Some predicted relationships among certain item characteristics, response processes, instability of response, and nearness of subject and item on a trait continuum are used to compare the traditional and proposed approaches. Stronger relationships and clearer interpretations arise from the proposed approach.
Factor Scales of the CPI: Do they Capture the Valid Variance?
Authors: Reynolds Carl H. , Nichols Robert C.
Published: March 2007

Using data collected in 1962 and 1963 from a sample of 861 male and female National Merit Scholarship participants, the investigators studied the validity of 16 of the 18 CPI scales. In particular, the study was designed to discover whether the common factor variance of the CPI scales carries the valid scale variance or whether the unique scale variance contains the information critical to scale validity. Each CPI scale score was broken down into a portion attributable to the two principal factor scales (Nichols and Schnell, 1963) and a portion not so attributable. With one exception, the tolerance scale, the CPI scales showed considerable validity. That is, they were substantially more strongly related to particular criterion variables (8 to 20 criteria) than to variables in general (178 variables). With four exceptions, the valid scale variance was carried in the common factor portion rather than in the unique portion of the scale variance. The exceptions to this rule showed the valid variance being shared roughly equally between the common factor and unique portions of the scale variance. The investigators concluded that for the most part the factor scales do indeed capture the valid variance in the CPI profile.
The Personal Attribute Inventory for Children: a Report on its Validity and Reliability as a Self-Concept Scale
Authors: Parish Thomas S. , Taylor James C.
Published: March 2007

Forty seven third-grade children and 28 sixth-grade children were administered both the Personal Attribute Inventory for Children (PAIC) and the Piers-Harris (1969) Children's Self Concept Scale (PHCSCS). A correlation of .67 (p < .001) was found between these two scales. Based on four week test-retest reliability coefficients for third grade pupils, the PHCSCS (r = .86, p < .001) was found to be more reliable than was the PAIC (r = .61, p < .001). For sixth grade pupils, however, both instruments were found to be about equally reliable (PHCSCS, r = .85, p < .001; PAIC, r = .83, p < .001). Researchers might wish to consider using the PAIC, as it provides not only a relatively valid and reliable measure of children's self-concepts, but also one that is very easy to administer and to score.
The Impact of a Foundations of Education Course on Attitudes: Results of a Longitudinal Study
Authors: Smith Joan K. , Hickman Roy D.
Published: March 2007

This study investigated attitude changes of university undergraduate students enrolled in a foundations of education course assigned two different types of reading materials, (1) materials of a controversial and very persuasive nature, and (2) a traditional foundations textbook. Attitudes toward 13 concepts were measured by an evaluative form of the sematic differential. Ss were tested on the first and last day of class and again three and one-half years later. Results indicated that, for 10 concepts, the experimental approach produced attitude changes in the Ss; such changes were maintained over time for nine concepts. Furthermore, for five of the 10 concepts, the experimental approach resulted in greater attitude changes than did the traditional approach.
Interactive Maximum Reliability Cluster Analysis
Authors: Mays Robert
Published: March 2007

A FORTRAN program for clustering variables using the alpha coefficient of reliability is described. For batch operation a unique rule for stopping the agglomerative procedure is available which maximises the internal reliability of successive clusters. The conversational version of the program allows the user to intervene in the stepwise process in order to test the final solution for sensitivity to changes in prior steps.
On the Occurrence of Standardized Regression Coefficients Greater Than One
Authors: Deegan John
Published: March 2007

For some investigators, the occurrence of standardized regression coefficients greater than one in a model raises questions concerning the legitimacy of such coefficients, and poses serious problems of interpretation (particularly for those employing path analytic procedures). It is demonstrated here that standardized regression coefficients greater than one can legitimately occur. Furthermore, the relationship between the occurrence of such coefficients and the extent of multicollinearity present among the set of predictor variables in an equation is examined. Comments on the interpretation of these coefficients, including a discussion of their interpretation in the context of path analysis, are provided.
Validity Studies Using the Comprehensive Ability Battery (Cab): II. Relationships With the Dat and Gatb
Authors: Hakstian A. Ralph , Bennet Richard W.
Published: March 2007

Three multiple-abilities batteries—the Comprehensive Ability Battery (CAB), Differential Aptitude Tests (DAT), and General Aptitude Test Battery (GATB)—are briefly discussed, and results of a study involving cross-correlations of the tests in these batteries are presented. The measures included are 11 of the 20 CAB tests, plus two simple composite measures, all eight of the DAT tests, plus two composites, and seven of the eight paper-and-pencil tests of the GATB, plus the GATB general composite measure. The results are based on one sample of males and one of females from predominantly middle and upper-middle class homes in a large city. In addition to between-battery correlations involving tests and composites, criterion-related validity results are also given with year-end course grades as criteria and with the various composite measures as predictors.
Holland's Theory of Vocational Choice and Postulated Value Dimensions
Authors: Laudeman Kent A. , Griffeth Paul
Published: March 2007

The validity of J. L. Holland's vocational personality types and their relationship to value dimensions were examined in light of Holland's theory of vocational choice. Male seniors (N = 316) completing their college program of study and representing the six personality types (realistic, investigative, social, enterprising, conventional, and artistic) were administered the Vocational Preference Inventory (identification of personality type) and the Allport-Vernon-Lindzey Study of Values (identification of value dimensions). The results generally supported Holland's postulated personality typologies and value dimensions. A few inconsistencies concerning engineering and education majors and implications concerning personality type profile are discussed.
On the Application of a Probability Index, PM, in Discriminating Between Psychiatric Groups
Authors: Meyer Lennart
Published: March 2007

Describes the use of the statistical index, PM, a coefficient indicating the probability that a person will belong to a particular clinical class. PM, which is much easier to compute than its G index equivalent, is used with dichotomous scores and is based on elementary probability theory. Using empirical clinical data for a demonstration study, the placement accuracy of the P M index was compared with that of G analysis. The techniques gave equivalent results.
Validity Studies Using the Comprehensive Ability Battery (Cab): III. Performance in Conjunction With Personality and Motivational Traits
Authors: Hakstian A. Ralph , Gale Cheryl A.
Published: March 2007

Results of a study are presented in which 129 grade 10 male and female students were measured by batteries from three individual-difference domains: the Comprehensive Ability Battery (CAB), the High School Personality Questionnaire (HSPQ), and the School Motivation Analysis Test (SMAT). Four ability measures from the CAB found previously to be maximally predictive of academic achievement, and three factor scales from each of the personality temperament trait (HSPQ) and motivational trait (SMAT) domains, isolated by stepwise multiple regression methods, are dealt with in detail. Correlations between measures of these traits or of simple linear composites of these measures, on the one hand, and year-end grades in various academic courses, on the other, are presented separately by sex. Information from the personality and motivational trait domains is shown to add significantly to the already-efficient prediction obtained from the ability variables.
Tap: An Interactive Test Analysis Program for Health Education
Authors: Maisiak Richard , Kellerman John , Williams George , Scott Lowell K.
Published: March 2007

Tap is a comprehensive, flexible computer system designed to score and to analyze objective educational tests. The goals of the designers were to construct a program which would be user-oriented, flexible, and clear in structure and in output. TAP includes a wide variety of features.
Relationship of Affective Characteristics of Students to Their Evaluations of Instructors
Authors: Reynolds William M.
Published: March 2007

This research was designed to assess the relationships between each of four measures of student affective characteristics and students' evaluations of college instructors. Sixty-six students completed measures of locus of control, achievement motivation, anxiety, and social desirability as well as provided end-of-term evaluations of their instructors. A significant relationship (p < .01) occurred between the locus of control measure and instructor evaluations. No significant differences were observed between students' sex and instructor evaluations. Although only one of four affective variables was found to relate to students' evaluations of instructors, this study supports the need for further research in this area.
The Predictive Validity of Verbal and Numerical Subtests of the Personnel Tests for Industry (PTI) in a Sample of Highly Skilled Employees
Authors: Wood Donald A.
Published: March 2007

This study sought to moderate the overall validity coefficients (.24 and .23 respectively, p > .05) of the verbal and numerical subtests of the Personnel Tests for Industry (PTI) for 59 top level employees by testing the proposition that high ability workers should be more predictable when job motivation is also defined as high. Support for the proposition was provided when relative to the criterion of job success, the predictive validity of the verbal subtest increased to .64 (p < .001), whereas the predictive validity of the numerical subtest reached .42 (p < .05) when only those subsamples of individuals in the high ability ranges (above the medians) were considered. A rationale for the interactive relationship between test scores and performance ratings was discussed.
The Reliability and Factorial Validity of a Scale for Measuring Teachers' Attitudes Towards Mainstreaming
Authors: Reynolds William M. , Greco Victor T.
Published: March 2007

This paper reports the development of a scale entitled the Educational Attitude Survey (EAS) that was designed to measure teachers' attitudes toward the mainstreaming of handicapped children into regular classrooms. Consisting of 16 items, the EAS yields scores on two factorially determined subscales as well as a total scale score. The psychometric characteristics of the EAS indicate it to be a reliable and factorially valid measure of teachers' attitudes toward mainstreaming. The EAS should provide a useful measure for researchers and educators involved in examining teachers' attitudes toward the integration of handicapped students into regular classrooms.
Sampling From Samples: a Comparison of Strategies in Longitudinal Research
Authors: Pedulla Joseph J. , Airasian Peter W.
Published: March 2007

In this study, estimates of population values obtained using three sampling techniques (simple random sampling, stratified random sampling, and cluster sampling) and three size samples for each technique (10%, 25% and 50%) were compared with known "popu lation" values. The objective of the study was to determine if second stage sampling was justifiable, and if so, which sampling strategy and what size sample yielded adequate estimates of the known "population" values. The data were the responses to a questionnaire administered to 1481 teachers as part of a long term societal experi ment dealing with the effects of standardized testing upon a society. The results supported the feasibility of sampling from samples and showed that a 25% simple random sample provided quite good esti mates of the "population" values.
Graduate Record Examination and Miller Analogies Test Scores: Examining Four Methods of Equivalencing
Authors: Stock William A. , Kagan Dona M. , Van Wagenen R. Keith
Published: March 2007

MAT and GRE scores were equated by regression, conditional mean, linear and equipercentile methods using data from a sample that had taken both tests. The regression and linear methods were preferred, and shown to be equivalent when the correlation between scales is perfect. The choice between the two rests on the decision to include or not include the correlation in the equation.
Assessment of Dispersion in Categorical Data
Authors: Schafer William D.
Published: March 2007

Four separate approaches to the problem of assessing variation in categorical data are developed, each of which results in an identical index of dispersion (D). An unbiased sample estimator of D is pre sented, which bears an analogy with the common unbiased sample estimator of variance for quantitative data. An additional index, re lated to a measure of entropy for categorical data, is mentioned and some applications are discussed.
The Misplaced Illusion? The Case of the Mueller-Lyer Perceptual Incongruity Figure
Authors: Krus David J. , Krus Patricia H.
Published: March 2007

Development of the computer-based analogue to the Mueller-Lyer apparatus was described along with the significance of this perceptual illusion figure to the history of psychometrics. Parallels between the computer generated graphics display field and the theoretical principles of structuring perceptual fields were discussed in light of epistemological and ontological problems related to the controversy between rational and neoromantic Dionysian modes of scientific thought.
The Predictive Validity of the Sixteen Personality Factors Questionnaire Relative to Three Independent Criterion Measures of Military Performance
Authors: Fox Shaul , Haboucha Soly , Dinur Yossi
Published: March 2007

This study examined the validity of the Sixteen Personality Factors Questionnaire (16PFQ) as a predictor of the success of female military officers. Subjects were 84 volunteers for officers' training, 18-19 years old. Of the 84 who participated in a three-day assessment-center-type selection program, 34 were admitted to officers' school. Three independent criteria were measured: (a) officers' ratings (n ≅ 80), (b) peer nominations (n = 84), and final course grades (n = 34). The results showed that Factors E, H. L, M, N, Q,, Q2, and Q 3 of the 16PFQ were correlated significantly with at least one of the criteria. Although the findings generally supported the interpretation of many of the 16PF scales, as rendered by Cattell, Eber, and Tatsuoka (1970), the outcomes suggested an alternative inter pretation of Factor M.
A Predictive Validity Study of the Metropolitan Readiness Test and Meeting Street School Screening Test Against First Grade Metropolitan Achievement Test Scores
Authors: Swanson Beverly B. , Payne David A. , Jackson Barbara
Published: March 2007

Samples of 72 and 64 entering first-grade students were used to examine the predictive validity (one school year) of the group administered Metropolitan Readiness Test (MRT) and the individually administered Meeting Street School Screening Test (MSSST). The Metropolitan Achievement Test (MAT) was used as the criterion. Validity coefficients, all of which were statistically different from zero ranged from .73 to .84, with 84% of the possible validity coefficients for the MRT and 81% of the coefficients for the MSSST being equal to or greater than .60.
Moderating Effect of Achievement Motivation and Locus of Control on the Relationship Between Academic Ability and Academic Performance
Authors: Edwards Jack E. , Waters L.K.
Published: March 2007

The relationship between ability and grade point average was examined for the moderating effects of achievement motivation and locus of control for 223 college students. When median splits in distributions of scores on measures of achievement motivation and internal-external locus of control were used, a significant difference was found between resulting high and low achievement motivation groups; no difference was present between high (internal) and low (external) locus of control groups. When the median splits were employed jointly, locus of control did not enhance the moderating effect of achievement motivation.
The Power of the F Test in Normal Populations with Heterogeneous Variances
Authors: Budescu David V.
Published: March 2007

An empirical study of the power of the F test in normal populations with variances proportional to the cell means is reported. The results indicate that the power of the test can be approximated by the noncentral F distribution with a modified parameter of noncentrality.
Cognitive Differentiation and Verbal Intelligence: Clarifying Relationships
Authors: Sypher Howard E. , Applegate James L.
Published: March 2007

This study principally explored the interrelationship of Crockett's (1965) Role Category Questionnaire (RCQ) measure of cognitive differentiation with various measures of verbal intelligence in order to determine the extent to which the RCQ measure is confounded by verbal ability. Participants included 285 undergraduates from a large southern university. The results show the RCQ to be independent of the verbal abilities measures. Further, a significant negative correlation in this study between differentiation and participants' intolerance of ambiguity provides some additional validation for the differentiation construct.
A Comparison of Five Methods for Combining Multiple Criteria into a Single Composite
Authors: Fralicx Rodney D. , Raju Nambury S.
Published: March 2007

Five weighting methods for combining multiple criteria into a single composite were evaluated on 117 bank tellers. It was found that four out of the five methods (Management Weights, Equal Weights, Unit Weights and Factor Weights) yielded nearly identical results, whereas the fifth method (Canonical Weights) correlated almost zero with the other methods.
Discriminant and Concurrent Validity of Two Commonly Used Measures of Test Anxiety
Authors: Thyer Bruce A. , Papsdorf James D.
Published: March 2007

For each of two groups of 34 and 71 undergraduate college students respectively categorized as clinically test anxious (CTA sample) and as non-test anxious (NTA sample), evidence was sought regarding the discriminant validity and the concurrent validity of each of two measures—the 20-item self-report Test Anxiety Inventory (TAI) and the 8-item behavior analogue measure of test-taking performance entitled Anagram Solution Task. Normative information was also obtained for each measure to provide a basis for classifying students as being test anxious or as being non-test anxious. The statistical outcomes led to the conclusion that both the TAI and AST exhibit substantial discriminant validity, but relatively little concurrent validity. The creation of 90% confidence scoring intervals for each of the two measures shows considerable promise as a means for identifying students with differential levels of test anxiety. These instruments appear to afford a basis for both counseling and research purposes. Future directions in the assessment of test anxiety are discussed.
Behavioral Correlates of the Interpersonal Jealousy Scale
Authors: Mathes Eugene W. , Phillips John T. , Skowran Julie , Dick William E.
Published: March 2007

To establish further the validity of the Interpersonal Jealousy scale, the investigators correlated it with each of two behavioral measures of (a) threat when one is confronted by a rival and (b) expressions of possessiveness toward the partner. Significant correlations were found to provide evidence of validity. As the Interpersonal Jealousy Scale and the behavioral measures of threat and possessiveness did not share method variance, the obtained validity data were judged to be impressive.
Redundancy in the California Achievement Test
Authors: Powers Stephen , Crowder Christopher
Published: March 2007

The factorial structure of the California Achievement Test was examined for 3813 public school students (2266 fifth-grade subjects and 1547 seventh-grade participants) in the Tucson Unified School District. Intercorrelation matrices were analyzed by using principal factors solutions. The factorial structure consisted of one large common factor in each grade analysis. The findings of this study indicated that there was considerable redundancy among subtests. The use of subtest scores as measures of independent abilities is questioned.
The Measurement of Effectance Motivation
Authors: Pearlman Charles
Published: March 2007

Three indicators of effectance motivation were devised. A sample of 600 sixth graders was assessed on these measures and IQ scores were collected where available ( N = 359). Two of the measures of effectance motivation were ratings that were completed by each student's teacher in regard to the student. The other measure was a direct observation of each student's choice of either a hard problem or an easy problem, the choice of the hard problem being indicative of effectance motivation. It was found that these ratings are related to each other when IQ is controlled using a partial correlation analysis. The ratings also discriminate between students choosing the hard or easy problem. One of the ratings continues to discriminate between those choosing the hard or easy problem after IQ is eliminated. The methods devised are recommended for use in empirical explorations of the relationship of effectance motivation to individual differences in cognitive development, risk-taking, and creativity, among other constructs.
Maximizing Reliability in Multiple Choice Questions
Authors: Willson Victor L.
Published: March 2007

Multiple choice test reliability can be improved by allowing several or all options of a given item to be correct. A procedure due to Serlin and Kaiser (1978) is used to compute a principal components solution for scoring weights for all options. With this procedure coefficient alpha is maximized for a given multiple choice test.
Correcting for BIAS in the Canonical Redundancy Statistic
Authors: Dawson-Saunders Beth K.
Published: March 2007

The canonical redundancy statistic, an estimate of the amount of shared variance between two sets of variables, has been proposed as an alternative to the squared canonical correlation coefficient in the interpretation of the results of canonical correlation analysis. The present study was undertaken to investigate the bias of the canonical redundancy statistic and to evaluate methods to correct for any bias.

Using Monte Carlo methods, the redundancy statistic was found to exhibit an amount of bias similar to that of the first squared canonical correlation coefficient. Bias is most affected by sample size: bias was observed to decrease by half each time the sample size was doubled. Bias also decreases as the intercorrelations between the two sets of variables increase. The number of predictor and criterion variables, as well as the size of the correlations between variables in each set, have relatively minimal effect on bias. Two formulae, Wherry and Olkin-Pratt, that were developed to estimate the population value of the squared multiple correlation coefficient, were found to correct adequately the bias of the redundancy statistic.

As an example of the use and interpretation of canonical redundancy analysis, a set of data relating consumer health values and health behaviors was analyzed. While the results indicate that only a small amount of redundant information is shared between these two sets of measures, the redundancy statistic provides a more conservative interpretation of this overlap than do the squared canonical correlation coefficients.
A Re-Analysis of "Lord's Paradox"
Authors: Locascio Joseph J. , Cordray David S.
Published: March 2007

"Lord's Paradox" is a term applied to a hypothetical situation illustrated by Frederic M. Lord in which Gain Score Analysis (GSA) and the Analysis of Covariance (ANCOVA) yield conflicting results in testing differential treatment effects for natural groups. This paper demonstrates that GSA and ANCOVA will always yield conflicting results unless the slopes of within group regression lines of posttest on pretest equal one. It is also pointed out that in Lord's specific hypothetical example, trait instability accounts for regression line slopes not equaling one and invalidates the ANCOVA. An analysis that corrects for this problem is demonstrated.
A Computer Program for Cumulative Item Statistics
Authors: Smith Jerry D.
Published: March 2007

A computer program was developed for the accumulation of reliability information for items which are repeatedly administered to groups of examinees. The program, ISTAT, is a more general alternative to a program provided by Morris (1979). ISTAT is intended primarily for the pretesting of items in which tests composed of subsets of an item pool are administered to separate groups of examinees. In addition to accumulating item means and covariances across examinees, the user may elect to obtain a variety of ancillary item statistics. Written in standard FORTRAN, ISTAT can be easily adapted to permit use on many computers.
Minimum Competency Standards Set by Three Divergent Groups of Raters Using Three Judgmental Procedures: Implications for Validity
Authors: Halpin Gerald , Sigmon Gary , Halpin Glennelle
Published: March 2007

The Ebel, Nedelsky, and Angoff approaches to standard setting were utilized to determine cut-off scores on the Missouri College English Test for admission to teacher education at a large university by three groups that, themselves, were at different levels with regard to the competencies being measured. Even though significantly different cut-off scores resulted with the use of the different methods, more nearly comparable standards were achieved through a modification in the expected success proportions used with the Ebel method than through employment of the Nedelsky or Angoff procedures. Further, similar standards were set by the groups combining all three methods. Implications for validity are discussed.
A Measure of Experimental Effect Size Based on Success Rates
Authors: Preece Peter F. W.
Published: March 2007

It is shown how the difference between the success rates in two treatment groups is related to the treatment-outcome correlation and the overall success rate. A new measure of effect size is proposed, which is easily calculated and readily interpretable in terms of the ratio of success rates in the treatment groups.
Toward Uniformity of Clusters Across Methods by Reducing Errors in Data
Authors: McQuitty Louis L.
Published: March 2007

Iterative Intercolumnar Correlation Classification (IICC) computes the correlation coefficients for the entries of every column of a matrix with those of every other column of the matrix. The procedure is iterated until a matrix is generally realized of only two clusters. Every object of each cluster has an index of plus-one with every other object of its cluster. Indices of minus one only mediate between objects across clusters.

IICC probably goes to an extreme. It disallows that any object of a cluster can be less than a perfect respresentative of that cluster. This extreme derives from the definition of a cluster by IICC. The stringency of the definition is reduced. This justifies discontinuing iteration earlier.

Both initial indices and those of the middle iteration were clustered by four methods.

Iteration increases the size and validity of indices, reduces errors in the indices, and increases homogeneity amongst them. Increased similarity in procedures ensues as at least some methods are adapted to middle-iteration indices. Both the validity of clusters and their similarity across methods are increased.

Other sets of data, other methods, and other definitions need to be studied in the above fashion.
Factorial Validity of the Armed Services Vocational Aptitude Battery (ASVAB), Forms 8, 9 and 10: 1981 Army Applicant Sample
Authors: Kass Richard A. , Mitchell Karen J. , Grafton Frances C. , Wing Hilda
Published: March 2007

The purpose of this paper was to examine the factor structure of the Armed Services Vocational Aptitude Battery (ASVAB), Forms 8, 9, and 10. This standardized multiple cognitive abilities battery is the primary selection and classification instrument used by all military services. It consists of eight power and two speed tests. In this investigation the ASVAB 8/9/10 factor structure was compared with that observed for previous samples and for previous forms of the ASVAB. The similarity of factor structure for racial/ethnic and sex subgroups was examined for the purpose of establishing the possible invariance of ASVAB factorial validity across groups. A factor analysis of a sample of 98,689 male and female Army applicants yielded four orthogonal factors accounting for 93% of the total variance: Verbal Ability, Speeded Performance, Quantitative Ability, and Technical Knowledge. Factor analyses of male, female, white, black, and Hispanic subgroups yielded similar results. These analyses provided evidence of the replicability of ability constructs across diverse samples.
The Aiken Attitude to Mathematics Scales: Psychometric Data on Reliability and Discriminant Validity
Authors: Watson Jane M.
Published: March 2007

Data from 287 subjects were used to provide reliability figures for Aiken's Enjoyment of Mathematics and Value of Mathematics Scales. Principal factoring with iterations followed by varimax rotation of the entire attitude scale supported its two-dimensional structure. The degree of correlation between scales was lower than that for Aiken's data. Also the correlation of the scales with other variables supported the view that the scales measure different aspects of attitude toward mathematics.
The Multidimensional Structure of Verbal Comprehension Test Items
Authors: Peled Zimra
Published: March 2007

This article investigates the mutidimensional structure of verbal comprehension test items. Empirical evidence, based upon results of a verbal comprehension test (a subtest of the Lorge-Thorndike Intelligence Test) administered to Israeli sixth graders, is provided to support the theory that item tasks are multivariate-multiordered composites of three faceted components: language, contextual knowledge and cognitive operation. Guttman's "Order" and "Facet" theory, as well as his Smallest Space Analysis (SSA) were used with the data. The SSA yielded a "cylindrical" structure suggesting that (a) language and cognitive-operation components represent additive "key" skills that maintain the cognitive knowledge processing skills, and (b) that a differentiation can be made between skills that are automatically applied and those that are applied through processing operations. Linear and circular properties of the cylindrical manifestation were demonstrated by the serially ordered character of the sub-matrices of the matrix of interitem correlation coefficients.
Is Lawson's Classroom Test of Formal Reasoning Valid?
Authors: Pratt C. , Hacker R. G.
Published: March 2007

Lawson's Classroom Test of Formal Reasoning was administered to 150 subjects. A unidimensional latent trait model was used to test a single-factor hypothesis. This hypothesis was rejected, both for the original test and for a modified version. It was concluded that the test failed to provide a valid measure of formal reasoning. This failure may be associated with a test format which neglects essential aspects of formal reasoning emphasised by Inhelder and Piaget.
Personalization of Mail Surveys: Too Much of a Good Thing?
Authors: Rucker M. , Hughes R. , Thompson R. , Harrison A. , Vanderlip N.
Published: March 2007

Cover letters with and without pictures of the researcher were included with questionnaires to test the effects of this type of personalization on responses to a mail survey. In addition, the researcher's attire, title, and affiliation were varied across different forms of the cover letter to evaluate the effects of status, role-clothing consistency, and similarity to the perceiver on perceiver's willingness to return the survey form. The questionnaires were mailed to a sample of 384 university alumni. The total number of returned questionnaires, after the initial mailing and two personalized follow-ups, were lower in the researcher-pictured cover letter conditions than in the control conditions. This finding offers some support for the hypothesis that repeated use of personalized mailings may have a negative effect on response rate. Response latencies suggest that within the researcher-pictured conditions, inconsistency of cues may also inhibit questionnaire returns.
The Evaluation of a Peer Tutoring Program: A Quantitative Approach
Authors: Brandwein Ann Cohen , Divittis Anthony
Published: March 2007

Over the past several years, peer tutoring programs have been developed and utilized in higher education. Subjective studies have been made on the effectiveness of these programs, but no quantitative measures of effectiveness exist in the literature. We present a quantitative way of measuring peer tutor training programs and peer tutor effectiveness. Since so many peer tutoring programs are fashioned in a similar way, this quantitative measure will be easily adaptable to most situations.
Factor Structure of the MCAT and Pilot Essay
Authors: Mitchell Karen J. , Molidor John B.
Published: March 2007

The Association of American Medical Colleges is examining the desirability and feasibility of including an essay on the Medical College Admission Test (MCAT). This endeavor calls for administration of a trial essay with the 1985 through 1987 MCAT examinations. Research reported in this paper considered the construct validity of the essay and its effect on the measurement domain tapped by the operational MCAT. The objective was to examine the factor structure of the MCAT and pilot essay and compare it to structures observed for previous MCAT versions and examinee groups. Factor analyses of data for 2,876 Spring 1985 examinees yielded two factors: 1. a science/quantitative factor defined by the science tests and Skills Analysis: Quantitative, and 2. an analysis/communication factor including the two Skills Analysis exams and pilot essay. The addition of the essay caused the non-science factor observed in previous MCAT research to be more strongly defined. Factor analyses of data for male, female, black, white, Hispanic, and Asian examinees supported the invariance of factor content across samples.