bluuebunny/crossref_metadata_2025 huggingface dataset:
The Variances of Empirically Derived Option Scoring Weights1
Authors: Echternacht Gary
Published: March 2007

Estimates for the variances of empirically determined scoring weights are given. It is also shown that test item writers should write distractors that discriminate on the criterion variable when this type of scoring is used.
Validity of the MMPI-168 for Psychiatric Screening1
Authors: Overall John E. , Butcher James N. , Hunter Sara
Published: March 2007

Validity of an abbreviated 168-item administration and the standard MMPI was compared with reference to discriminating psychiatric patients from normal college students. Better discrimination was obtained from clinical scale scoring than from factor scoring. The abbreviated MMPI-168 actually produced slightly better discrimination than did the longer parent instrument. Revised equations for converting MMPI-168 scores to conventional MMPI validity and clinical scale scores are presented.
Validity of Awarding College Credit by Examination in Mathematics and English'
Authors: Tittle Carol Kehr , Weiner Max , Phelps Fred D.
Published: March 2007

The present study was concerned with the validity of the College-Level Examination Program General Examinations (CLEP) in Mathematics and English Composition. The two-fold purpose of the study was to provide an estimate of the number of credit hours likely to be earned if students took CLEP as well as to examine the interrelationships among the two previously mentioned subtests from CLEP, an end-of-year achievement test in Mathematics, and a prior measure in English Composition. First-year students at a senior college of the City University of New York were recruited for an experimental administration of the CLEP, the final examination from the first year mathematics course, and a college-developed English placement essay. Students with high scores on the American College Testing Program Examination (ACT) and high school averages were predominant in the sample selected for testing. From the data, inferences were made that (1) the CLEP Mathematics test could be used to grant credit in mathematics, but that the current cutting score should be examined in view of standards used in the course; (2) there was little relationship between CLEP English Composition scores and present college placement procedures for first-year English; and (3) the number of students who could earn college credit by examination was much higher than was the number presently taking CLEP at the college.
The Relationship Between Academic Aptitude and Occupational Success for a Sample of University Graduates
Authors: Lewis John
Published: March 2007

The academic aptitude at the time of admission to college and level of occupation later in life were collected for 619 male college graduates. The statistically significant relationship indicated that the graduates with higher aptitude scores as compared with those with lower scores were more likely to report higher level occupations.
Predicting Achievement in an Upper-Division Bachelor's Degree Nursing Major
Authors: Lewis John , Welch Margaret
Published: March 2007

A study of the correlations between objective background variables and achievement in an upper-division bachelors degree program in nursing revealed significant correlations for grade point average in required college pre-nursing courses, grade point average in elective college pre-nursing courses, and rank in high school graduating class. The results of a multiple regression analysis showed that grade point average in required pre-nursing courses was the only variable to yield a significant regression weight.
Esteem Construct Generality and Academic Performance
Authors: Simpson C. Kenneth , Boyle David
Published: March 2007

Measures of global, specific, and task-specific self-esteem were administered to 78 male and 81 female college students and related to predicted and actual performance on a midterm examination. Significant correlations were found between global and specific measures and between specific and task measures, but not between global and task measures. The relationship between the esteem measures and actual performance was strongest for the task measures, next strongest for the specific measures, and nonsignificant for the global measures. Specific measures were also significantly related to predicted performance, but global measures were not. The findings were discussed in terms of four criticisms of global measures, and it was suggested that more specific self-esteem measures be developed.
Comprehensive Analysis of Test Item Variance
Authors: McQuitty Louis L.
Published: March 2007

This paper develops and illustrates a comprehensive method for analyzing the endorsements to test items (called CATIV). It (1) accounts for whatever kind of variance is present; (2) is analogous to analysis of variance, but is applied to test-item responses; (3) can analyze many more variables than analysis of variance; (4) shows which test items are additive and which are configural; (5) includes a criterion for identifying test-item answers which belong to a universe of answers other than the one dominant in the study; (6) selects patterns of answers which yield substantive types; (7) assesses the relative dependability of the types which are isolated; (8) isolates all substantive types present in the data; and (9) can be applied by pencil and paper to a column matrix which shows the number of endorsements of every answer to every item of a test, provided these are arranged in order from the most popular to the least popular answer in terms of number of endorsements.
Test Theory With Minimal Assumptions
Authors: Zimmerman Donald W.
Published: March 2007

Using the concepts of conditional probability, conditional expectation, and conditional independence, the main results of the classical test theory model can be derived in a very few steps with minimal assumptions. It is well known that the variance of a random variable is the sum of the variance of its conditional expectation and the expectation of its conditional variance. These concepts lead to another fundamental relation: the reliability coefficient, regarded as a correlation between two conditionally independent, conditionally identically distributed random variables (exchangeable random variables, parallel measurements) is the ratio of the variance of their common conditional expectation to their common unconditional variance. Formulas describing the reliability of lengthened tests follow easily, and the same result also applies to stochastic processes involving joint distributions of many dependent random variables.
Canonical Correlation Programs: a Comparative Analysis of Performance
Authors: Schnittjer Carl J. , Showalter Benjamin L.
Published: March 2007

This study was designed to compare and contrast generally available computer programs which provide canonical correlation analysis. The same set of data was analyzed by each of four canonical correlation programs. The four programs compared came from the Biomedical Computer Programs (BMD), Miami Multivariate Statistical Programs (Miami), Statistical Analysis System (SAS), and Statistical Package for the Social Sciences (SPSS). Following the analyses detailed comparisons were tabulated using the following criteria: (1) Run Characteristics, (2) Limitations, and (3) Analysis Features and Options. The newer programs (i.e., SPSS CANCORR and SAS CANCORR) tended to have more features and greater versatility. However, each program had certain uniquenesses which might make it more nearly appropriate for a given analysis requirement.
A Within-Subjects Technique for Comparing College Grading Standards: Implications in the Validity of the Evaluation of College Achievement
Authors: Goldman Roy D. , Widawski Mel H.
Published: March 2007

Differential standards of college grading were examined, and an index of grading standards was computed using pairwise comparisons of grades in 17 major fields. These grades were obtained by an analysis of the transcripts of a randomly selected sample of 475 undergraduates at a medium sized public university. This index correlates highly in a negative direction with scores on the verbal and mathematical portions of the Scholastic Aptitude Test of the College Entrance Examination Board (SAT—V and SAT—M) and HSGPA. These results further support the application of adaptation level theory to college grading standards, for it was found that at the institution studied fields with lower ability students as compared with those with higher ability students employed less stringent grading criteria. The results are discussed in regard to graduate school admission and to the need for a weighting system for grades earned in different fields.
An Alternate Statistic for Testing the Slow Change Assumption of the Shine-Bower Error Term
Authors: Shine Lester C.
Published: March 2007

It is indicated that the Mean Square Successive Difference test is not always suitable for testing the slow change assumption of the Shine-Bower error term. A more suitable alternate statistic is presented. The two statistics are compared.
A Computer Program for Maximizing and Cross-Validating Split-Half Reliability Coefficients
Authors: Callender John C. , Osburn H.G.
Published: March 2007

A FORTRAN program for maximizing and cross-validating split-half reliability coefficients is described. Externally computed arrays of item means and covariances are to be supplied as input for each of two samples of persons. The user may select a number of subsets from the complete set of items for analysis in a single run.
On the Weighted G Index
Authors: Vegelius Jan
Published: March 2007

The G index of agreement does not permit the use of various weights for its various items. The weighted G index described here, makes it possible to use unequal weights. The weighted G index satisfies the requirements of a scalar product between normalized vectors, and a Q component analysis may, therefore, be based on it. It is also invariant over item reflection.
The Modification and Validation of the Behavior Coding System for School Settings
Authors: Harris Alice , Kreil Dennis , Orpet Russel
Published: March 2007

The major purpose of this study was to validate the noxious codes of the Behavioral Coding System for the measurement of aggressive behavior in schools. Subjects were 20 fifth and sixth grade boys identified as either aggressive ( N = 10) or prosocial ( N = 10). Six 10-minute observations were made of the subjects in both classroom and playground settings. The noxious codes were found to discriminate between aggressive and prosocial subjects and to discriminate between playground and classroom settings for the aggressive subjects.
Leniency and Halo in Student Ratings of College Instructors: a Comparison of Three Rating Procedures with Implications for Scale Validity
Authors: Reardon Maryellen , Waters L.K.
Published: March 2007

Nine college instructors were rated by their students on five performance dimensions. Randomized thirds of each class used either standard graphic, behaviorally anchored, or mixed standard scales to make their ratings. Analyses of the ratings indicated (a) somewhat less positive leniency when the mixed standard scales were used rather than the graphic or behaviorally anchored rating scales, (b) generally lower interdimension correlations for ratings made on mixed standard or behaviorally anchored scales than on standard graphic scales, and (c) no significant relationship between mean instructor ratings and instructor leniency in assigning grades. Implications for scale validity were also considered.
The Relationship Between the Graduate Record Examinations Aptitude Test and Graduate Grade Point Average in a Master of Arts in Counseling Program
Authors: Camp Joseph , Clawson Thomas
Published: March 2007

This study was concerned with a determination of the predictive validity of the Graduate Record Examinations Aptitude Test: the verbal section (GRE-V), the quantitative portion (GRE-Q) and the total score (GRE-T). The criterion variable was the graduate grade point average (GGPA); subjects were 135 students enrolled in a Master of Arts in Counseling Program (MAC) at an urban university. The GRE-V part was correlated significantly with GGPA (.26), whereas the GRE-Q was not. The GRE-T score was correlated .24 with GGPA. It would appear that the GRE-V portion largely contributed to this correlation. These findings raise questions regarding the adequacy of the predictive validity of the GRE Aptitude Test for this sample of students for the criterion measure employed.
One: a Computer Program for One-Way Analysis of Variance Based on Summary Data
Authors: Rimon Jonathan
Published: March 2007

A computer program written in BASIC is described which performs one-way analysis of variance based on the mean, standard deviation and size of each group. Output lists a full analysis of variance table.
On Rotation of a Johnson Hierarchical Tree Structure
Authors: Tzeng Oliver C.S. , May William H.
Published: March 2007

A strategy for reordering the hierarchical tree structure is presented. While the order of terminal nodes of Johnson's (1967) procedure is arbitrary, depending simply upon the order of input data, the present procedure will rearrange every triad of nodes under a common least upper node at all levels so that the node in the middle is always non-arbitrarily closest to the anchored node. Solutions for data from Miller and Nicely (1955) by Johnson and two rotational schemes are discussed.
Discriminant Validity of the Leisure Activity Questionnaire and the Paragraphs About Leisure
Authors: Tinsley Howard E.A. , Kass Richard A.
Published: March 2007

The Leisure Activity Questionnaire (LAQ) was administered to a developmental sample of 418 undergraduate college students and to a cross-validation sample of 209 students. The Paragraphs About Leisure (PAL) questionnaire, an alternative form of the LAQ, was administered to a second cross-validation sample of 215 students. Subsequent to the completion of a discriminant function analysis, the hit rates obtained in the two cross-validation samples were determined. It was concluded that the use of the PAL with results reported in terms of factor scores is the most valid and parsimonious measurement strategy of those investigated.
The Relationship Between Performance on the Mazes Subtest of the Wechsler Intelligence Scale for Children—Revised (WISC-R) and Speed of Solving Anagrams With Simple and Difficult Arrangements of Letter Order
Authors: Ireland-Galman Michelle M. , Padilla Gilbert J. , Michael William B.
Published: March 2007

From a total sample of 100 seventh grade students who had been given nine maze tests, two subgroups of the 30 highest-scoring and the 30 lowest-scoring subjects (the HSM and LSM groups) were formed. Within each of these two group 15 members were randomly assigned to an experimental condition involving exposure to a list of 10 5-letter anagrams with a simple letter order (SLO) arrangement, and the other 15 members to an experimental condition necessitating exposure to a list of 10 5-letter anagrams with a difficult letter order (DLO) arrangement. Each anagram required a single solution. In the resulting 2 x 2 factorial design the two-way analysis of vari ance revealed statistically significant differences in mean amount of time required to solve the anagrams relative to placement in the HSM or LSM group ( p < .001) and with respect to exposure to the SLO or DLO anagram task ( p < .001). No statistically reliable interaction effect was noted. About 18% of the variance in time scores for solution of anagrams was associated with the complexity level of the anagram task; approximately 20%, with placement in the HSM or LSM group. Within the subsample exposed to the SLO anagram task the concurrent validity (point biserial) coefficient between time scores and the criterion variable of placement in the HSM or LSM group was -.489 ( p < .01); within the subsample given the DLO anagram task, the corresponding coefficient was -.633 ( p < .01). It was concluded that a relationship existed between success in maze performance and proficiency in solving anagrams. It appeared that a common psychological construct of flexibility might account for this association.
Structure, Redundancy and Measures of Association Statistics for a Canonical Correlation Analysis
Authors: Hollingsworth Holly
Published: March 2007

A computer program, written in BASIC, is described which computes structure correlations, redundancy indices, and some measures of associations for canonical correlation analyses. Input consists of a correlation matrix, the coefficients of the canonical variates, and the canonical correlation.
Convergent and Discriminant Validity of Measures: Sources of Self-Esteem in the Classroom
Authors: Turner Carol J.
Published: March 2007

The purpose of this study was to evaluate the convergent and discriminant validity of teacher and student ratings of classroom sources of self-esteem in terms of a formulation offered by William James (1893). Fifteen seventh and eighth grade classes were randomly selected from five junior high schools to complete one of three forms of a student questionnaire while the teachers in each class completed independent ratings. The internal-consistency estimates of student ratings ranged from .72 to .87; non-zero convergent validity values (correlations between independent measures of the same trait) ranged from .20 to .31. These non-zero convergent validity values were higher than correlations between independent measures of different traits (heteromethod values) which may provide some evidence of discriminant validity. Elevations of correlations between repeated measures of different traits (monomethod values) were indicative of shared method variance in both teacher and student ratings. Although non-zero convergent validity values in this study were not large, they compared favorably with those in other studies of self-esteem variables based on independent ratings of the same trait (Wylie, 1974) and similar ratings of different traits (Campbell and Fiske, 1959).
Construct Validity of the Personality Research Form: Further Evidence
Authors: Bridgwater Carol Austin
Published: March 2007

The Personality Research Form (PRF) was administered to 118 ski instructors. Twelve of the 21 scales were significantly correlated with non-test variables, such as age, amount of education, number of years teaching experience, and teaching effectiveness. The relationships met a priori expectations, given theoretical and experiential knowledge of these variables and constructs. The data were cited as evidence contributing to the construct validity of the PRF.
Change Scores—Necessarily Anathema?
Authors: Maxwell Scott E. , Howard George S.
Published: March 2007

Psychologists have been warned repeatedly in recent years of the hazards of change scores. Unfortunately, these warnings seem to have created the belief among many researchers that the use of change scores is universally misleading and therefore should be avoided at all costs. However, the use of change scores is perfectly legitimate in certain circumstances and at times may even be preferable to other methods of analysis. The ANOVA of change scores is acceptable in randomized pretest-posttest designs, where it is equivalent to a repeated measures approach to the data. In addition, the unreliability of difference scores poses no problem here. Despite this, the analysis of covariance is generally preferred, because it is more powerful. However, in at least two situations the analysis of change scores is preferable to the analysis of covariance.
A Cross-Sectional Cross-Lagged Panel Analysis of Mathematics Achievement and Attitudes: Implications for the Interpretation of the Direction of Predictive Validity
Authors: Wolf Fredric M. , Blixt Sonya L.
Published: March 2007

Results of the differences between cross-lagged panel correlations and of the consistency of them for 2,429 students within the first eight grades weakly suggested that attitudes toward mathematics is causally predominant over mathematics achievement for what variance is shared in common. The correlations, which were generally positive and low, were strongest within the fourth through the seventh grades.
The Development and Validation of an Auditory Perception Test in Spanish for Hispanic Children Receiving Reading Instruction in Spanish
Authors: Morrison James A. , Michael William B.
Published: March 2007

In view of the apparent absence of an auditory perception test in Spanish for Hispanic children that could be related to reading performance in Spanish, an attempt was made to develop and to validate a 32-item measure entitled La Prueba de Analisis Auditivo (PAA) by replicating for a sample of 158 Latino children whose primary or dominant language was Spanish, the 1971 study by Rosner and Simon, who for a group of Anglo children had developed an auditory perception measure entitled Auditory Analysis Test (AAT) and validated it against standardized tests in reading and language arts. The psychometric data of the investigation indicated for the sample of 158 Latino pupils in kindergarten and in grades one, two, and three in a suburban elementary school in a lower middle-class neighborhood that (a) the higher the grade equivalent placement in a criterion-referenced Spanish reading measure entitled SOBER, the higher was the average level of performance in the PAA measure, (b) the presence of substantial variation in the difficulty index of a given item across SOBER grade equivalent reading levels and in difficulty indices of several items within a specified SOBER reading level affords a means for studying developmental changes in auditory perceptual skills and for identifying strengths and weaknesses in these skills, (c) the PAA measure yields relatively high internal-consistency and test-retest estimates of reliability for subsamples of Hispanic children classified as falling at different reading placement levels as determined by the SOBER test, and (d) the concurrent and predictive validity of the PAA measure relative to the SOBER test as the criterion variable appears to be promising.
Convergent and Divergent Validity of the Revised Children's Manifest Anxiety Scale
Authors: Reynolds Cecil R.
Published: March 2007

A modified multitrait multimethod validation matrix was generated to evaluate the construct validity of the newly revised Children's Manifest Anxiety Scale (RCMAS). For both males ( N = 49) and females (N = 37) a pattern of results occurred that was generally consistent with the use of the RCMAS as a measure of chronic, manifest anxiety levels in children. Large correlations occurred with other trait measures of anxiety but not with state anxiety measures or IQ. Smaller but consistently positive correlations occurred between children's ratings of their anxiety and teacher observations of behavior problems.
A Construct Validation of the Good and Good Measure of Social-Power Motivation
Authors: Golden Stanford B. , Royal Elaine Good
Published: March 2007

Evidence is reported for construct validation of the Good and Good measure of social-power motivation. Subjects (N = 121) completed the Good and Good social-power motivation scale. A questionnaire also developed for the present study requested certain biographical data as well as information believed by the present authors to be indicative of manifestations of the need to obtain social power. Of the 20 variables studied as a basis for construct validation of the Good and Good measure of social-power motivation, 15 demonstrated significant results in the expected direction. Of the two biographical variables, age emerged as a significant variable, but sex did not.
Cross-Validation of a Short Form of the Position Description Questionnaire
Authors: Colarelli Stephen M. , Wall Stephen J. , Stumpf Stephen A.
Published: March 2007

Although several managerial job analysis questionnaires have been developed, they are not widely used in industrial situations. One reason for this lack of use may be that the available instruments tend to require one or more hours to complete. The current study reports the cross-validation of the Short Form of the Position Description Questionnaire (PDQ). A secondary analysis of data with the PDQ on a cross-validation sample of 2,280 managers indicates that the PDQ-Short Form has measurement properties similar to the PDQ and that it its stable across samples. Applications of the PDQ Short Form for individualized training, career pathing, and research are discussed.
On Post-Hoc Blocking
Authors: Bonett Douglas G.
Published: March 2007

Post-hoc blocking and the analysis of covariance (ANCOVA) are two alternative procedures that employ a concomitant variable as a means of increasing statistical power relative to the completely randomized design. The assumptions underlying the ANCOVA are generally considered to be too restrictive for most applications and the use of this statistical technique is often discouraged. It will be argued that the advantages attributed to the block design are not always valid and that there are circumstances when the ANCOVA would be preferred to post-hoc blocking.
Suppressor Structures in the General Linear Model
Authors: Holling Heinz
Published: March 2007

Recent theoretical analyses of the concept of suppression are identified and discussed. A generalized definition of suppression is presented and the conditions for suppressor structures in the context of the General Linear Model are derived.
An Investigation of the Robustness of the t Test to Unit of Analysis Violations
Authors: Blair R. Clifford , Higgins J. J. , Topping Mary E. H. , Mortimer Allen L.
Published: March 2007

In the first part of this study, sampling experiments were used to assess the Type I error rates of the t test in situations where classes or schools were randomly assigned to groups but analyses were carried out on individual student scores. It was found that Type I error rates were grossly inflated under all conditions investigated. In the second part of the study, mathematical analysis was used to demonstrate the fact that even small amounts of between class (or school) variation can cause large inflations in the Type I error rate of the t test when analyses are incorrectly carried out on individual student scores.
Long-Range Predictive and Differential Validities of the Scholastic Aptitude Test in Medical School
Authors: Zeleznik Carter , Hojat Mohammadreza , Veloski Jon
Published: March 2007

With regard to the recent controversy about the predictive validity of the College Board Scholastic Aptitude Test (SAT), the present study was designed to investigate the long-range predictive and differential validities of this measure. Data for 1284 students who entered the Jefferson Medical College from 1965 through 1974 were analyzed by dividing them into four quarter groups from high to low based upon their scores on the Verbal and Mathematics portions of the SAT. By applying analysis of variance, statistically significant differences were found among high scorers (examinees in the top quarter) and low scorers (examinees in the bottom quarter) of the SAT relative to the yearly grade point averages (GPAs) and average standing on comprehensive examinations in medical school in the favor of high SAT scorers. The convergent and divergent validities of the SAT over an extended range of time were supported.
Construct Validity of the Divergent Production Subtests from the Structure-of-Intellect Learning Abilities Test
Authors: Thompson Bruce , Andersson Billie V.
Published: March 2007

The Structure of Intellect Learning Abilities (SOI-LA) test has been widely recommended for use in placement, diagnostic, and prescriptive applications. However, the validity of the test has not been fully explored. This study investigated the construct validity of the three divergent production subtests on the SOI-LA test. Subjects were 205 sixth-grade pupils from New York and Louisiana schools. The evidence generally supported the validity of the three subtests, although results were somewhat mixed with respect to one subtest.
Some Univariate-Multivariate Generalizations
Authors: Huberty Carl J.
Published: March 2007

The mathematical extension from scalars to matrices as a prerequisite for univariate to multivariate generalizations of statistical concepts and methods is discussed. The basic notion of variability is generalized from a univariate context to a multivariate context using two matrix functions, a determinant and a trace. These two means of generalizing variance are shown to yield a number of alternative multivariate indices of shared variation. Multivariate partial indices are proposed. The complexity of multivariate test statistics and some problems in the interpretation of tests of multivariate hypotheses are reviewed.
A Vector Model for Describing and Comparing Profiles
Authors: Butler John K.
Published: March 2007

This paper develops and tests an algorithm for computing indices for scoring and comparing multidimensional psychometric profiles. A Euclidean distance, d, derived from the Pythagorean theorem, is generally preferred over other indices of profile similarity. However, d assumes orthogonal profile dimensions. A model, which relaxes the orthogonality assumption, is offered. The model calculates a distance vector that comprises elevation, scatter and shape to describe a profile. It also operationalizes a new concept, the angular orientation of a profile. In addition, it calculates two indices of profile similarity: a distance vector and a measure of angular alignment. A brief example follows the model.
The Measurement of the Obsessive-Compulsive Personality
Authors: Gibb Gerald D. , Bailey James R. , Best Randall H. , Lambirth Thomas T.
Published: March 2007

The present study presents information regarding the development and validation of a new personality instrument which is intended to measure the degree of obsessive-compulsive traits. Data indicate that the instrument shows both promising reliability and concurrent validity. Developed primarily for research purposes, the scale may have therapeutic assessment applicability in a clinical setting.
A Cross-Cultural Study of the Reliability of the Coopersmith Self Esteem Inventory
Authors: Prewitt Diaz Joseph O.
Published: March 2007

The purpose of the study was to determine the realiability of the spanish translation of the Self Esteem Inventory (SEI) with a group of Puerto Rican students on the island and another on the mainland. The sample was composed of 296 high school students ages 15-18. The study concluded that the Spanish translation of the SEI was a reliable instrument in evaluating the personal judgment of worthiness for Puerto Rican students in the island and the mainland United States.
Methods of Analysis with Response-Shift BIAS
Authors: Bray James H. , Maxwell Scott E. , Howard George S.
Published: March 2007

Howard and his colleagues have discovered an instrumentation related contamination which confounds the results of studies which employ self-report measures in a pre/post or posttest only design. This confounding influence is referred to as response-shift bias. Research has demonstrated that the traditional methods of analysis (i.e., analysis of posttests only, analysis of pre/post difference scores, and analysis of covariance using prescores (ANCOVA)) do not consider response-shift bias and produce biased estimates of the treatment effect. A retrospective pre/post design is recommended by Howard and his colleagues to control for response-shift bias. The only method of analysis which yields an unbiased estimate of the treatment effect is posttest minus retrospective pretest difference scores. The purpose of the present study is to determine the relative loss in statistical power of the traditional methods of analysis when response-shift bias is present. Analytic and Monte Carlo techniques were employed to compare the powers of five methods of analysis under various conditions. The results indicate that when there is a response-shift the most powerful method of analysis, overall, is the retrospective pre/post method and the loss in statistical power of the traditional methods can be substantial under many conditions. Recommendations and applications to applied research are discussed.
RMAX: A Microcomputer Program that Performs a Rasch Calibration of Test Items
Authors: Powers Stephen
Published: March 2007

This paper describes a BASIC microcomputer program that computes estimates of item difficulty parameters and person ability parameters for the Rasch model by using an unconditional maximum likelihood procedure. Inputs to the program are the number of items, the number of subjects, the test score frequencies, and the item score frequencies.
An Empirical Examination of Two Transformations of Sample Correlations
Authors: Alexander Ralph A. , Hanges Paul J. , Alliger George M.
Published: March 2007

This paper examines the differential accuracy of the Fisher and Hotelling transformations of the correlation coefficient. Contrary to expectation, the Hotelling transformation provided a minimal gain in power and was associated with a larger Type I error rate when compared to Fisher's formula with small sample sizes. The two transformations produced essentially identical results for larger sample sizes.
The Predictive Validity of the Spanish Translation of the WISC-R (EIWN-R) with Puerto Rican Students in Puerto Rico and the United States
Authors: Diaz Joseph O. Prewitt , Rodriguez Maria D. , Ruiz David Rivera
Published: March 2007

The WISC-R was translated into Spanish and published by the Psychological Corporation as a research edition in 1982. The Escala de Inteligencia Wechsler para Ninos-Revisada (EIWN-R) was published as a research edition. This paper reports on two preliminary studies with Puerto Rican children and adolescents. The first study was performed in Puerto Rico with 51 upper elementary school children. The EIWN-R was found to be a reliable instrument for this population. The second study was performed with a population of 80 students in Hartford, Connecticut. The purpose of the Hartford study was to determine if the EIWN-R would be a good predictor of achievement for students in a bilingual program. The results indicated that the EIWN-R is an appropriate predictor of academic achievement for the population in this study.
Expectancy Motivation Scales for School Principals: Development and Validity Tests
Authors: Kottkamp Robert B. , Derczo Michael T.
Published: March 2007

The Principal Expectancy Motivation Scales (PEMS) measure the constructs of expectancy, instrumentality and valence. The PEMS produce separate measures of motivation toward managerial and instructional aspects of the school principal's role and a total motivational score. Construct validity was assessed through factor analyses and tests of several hypothesized relationships with a sample of 140 New Jersey principals. Coefficient alpha estimates ranged from .74 to .91 for the five scales.
Computing Reproduced Correlations in Structural Equation Models
Authors: Haase Richard F. , Juster Harlan R.
Published: March 2007

The formidable computational techniques for structural equation models require matrix based operations and computer solutions. A method of testing the goodness of fit of such structures involves the discrepancies between original correlations among variables and the correlations estimated by use of the solved path coefficients. A BASIC computer program is presented which provides a solution to the matrix algebraic algorithm provided by Heise (1969) for estimating correlations from solved path coefficients. Example input and output of the program are presented and discussed.
Invariance of Factorial Validity of a Job Performance Scale
Authors: Albert Terri C. , Schriesheim Chester A. , Michael William B.
Published: March 2007

On ajob performance appraisal scale comprising 25 4-choice items in Likertstyle format, factor analyses of intercorrelations of item ratings by one group of supervisors and of intercorrelations of item ratings by a second independent group of supervisors six months later for the same sample of 615 unskilled female textile workers yielded four identifiable matched dimensions of Assertive Commitment, Identification with Significant Others, Sense of Responsibility, and Productivity/Industriousness. Congruence coefficients of .98, .90, .94, and .96, respectively, for these four factor dimensions across two rater groups lent support to the invariance of factorial validity of the scales.
A Frequency-Based Test of Valid Responding in Questionnaires
Authors: Huba G. J.
Published: March 2007

A simple statistical test procedure for assessing questionnaire response validity is proposed. The technique assesses the joint probability that frequently reported behaviors are not reported and infrequently reported behaviors are reported.
Use of the Simple Change Score in Correlational Analyses'
Authors: Gardner R. C. , Neufeld Richard W. J.
Published: March 2007

This article examines the simple difference score (Y-X) as used in three different correlational analyses. As discussed in this paper, this difference score is viewed as a simple change from a pretest (X) to a posttest (1Y), but the generalizations apply to any difference score of the type (Y-X). The three classes of correlational analyses considered involve the correlation of initial score (X) with change (Y-X); the correlation of another variable (A) with change (Y-X); and the correlation of one change score (B-A) with another (Y-X). In each case, the complexity of the change score and the ambiguity of the resulting correlation are demonstrated. It is proposed that attention should be directed to the elements making up each correlation in addition to attempting to use and interpret the correlation itself.
Actual Course Difficulty as a Factor in Accounting for the Achievement and Attrition of College Students
Authors: Schurr K. Terry , Ellen Arthur S. , Ruble Virgil E.
Published: March 2007

The difficulty of 548 sections of 55 courses taken by 2906 freshmen during their first two quarters at a university were examined in light of the influence of these sections on student attrition, and long-term and short-term grades. Approximately 18% of the courses (sections) were identified as difficult, and 18% were identified as easy. The difficulty of courses taken by students during these terms was found to influence long-term grades and attrition through their influence on short-term grades.
Exact Confidence Limits for Proportions
Authors: Berry Kenneth J. , Mielke Paul W. , Helmericks Steven G.
Published: March 2007

A subroutine is presented to calculate exact confidence limits for the number of successes in a finite population, given a random sample drawn without replacement. The limits are calculated recursively from a series of hypergeometric probability distributions. The use of arbitrary starting values in each recursion eliminates the computation of initial probability values based on cumbersome factorial expressions.
Validity and Temporal Stability Issues Regarding Two Measures of Computer Aptitudes and Attitudes
Authors: Roszkowski Michael J. , Devlin Steven J. , Snelbecker Glenn E. , Aiken Robert M. , Jacobsohn Hannah G.
Published: March 2007

Psychometric information regarding the Computer Aptitude, Literacy, and Interest Profile and the Computer Attitude Scale was obtained from an NSF retraining project preparing computer science teachers for the secondary school level. Data address: (1) pre-/post-training stability; and (2) validity information involving (2.a.) course achievement predictions, (2.b.) CALIP-CAS interrelationships, and (2.c.) intra-instrument relationships.
A BASIC Program for the Shell-Metzner Sort Algorithm
Authors: Dreger Ralph Mason
Published: March 2007

The Shell-Metzner sort algorithm is a very fast sorting routine which surpasses other more well-known routines. The BASIC program written here allows for sorting data from a disk or diskette or from DATA statements.
The Reliability and Validity of the Self-Appraisal Scale of the Career Maturity Inventory
Authors: Westbrook Bert W. , Sanford Eleanor E. , Donnelly Miriam H.
Published: March 2007

The purpose of this study was to determine whether there is a relationship between scores on the CMI Self-Appraisal scale and scores on a measure of accuracy of self-appraisal. A total of III ninth-grade students in a rural public school were administered the Self Appraisal scale of the Career Maturity Inventory, the ACT Career Planning Program, and a new measure of accuracy of self-appraisal. The CMI Self-Appraisal scale was found to correlate significantly with measures of accuracy of self-appraisal and with measures of scholastic aptitude. Scholastic aptitude accounts for four times as much variance in CMI Self-Appraisal scores as it does in accuracy of self-appraisal scores.
Assessing the Construct Validity of a Life Skills Competency Test
Authors: Reynolds Arthur J. , Bezruczko Nikolaus
Published: March 2007

The proliferation of minimum competency tests in recent years has not resulted in a critical analysis of their construct validity. The present study examined the dimensionality and construct validity of an urban life skills competency test. Results of a double cross-validation factor analysis identified one factor underlying performance. This factor was stable across three independent samples. It was also highly correlated with reading and math subtests of the ITBS. Thus, life skills competency may not be operationally different than traditional achievement tests. Additional validity studies are needed.
Parallel Analysis Criteria: Revised Equations for Estimating the Latent Roots of Random Data Correlation Matrices
Authors: Lautenschlager Gary J. , Lance Charles E. , Flaherty Vicki L.
Published: March 2007

Regression equations may be used for estimating givenvalues to serve as parallel analysis criteria for determining the number of factors to retain. The accuracy of the first givenvalue's estimate directly influences the accuracy of subsequent estimates of given-values in regression equations derived to predict the latent roots of random data correlation matrices. Augmenting an equation presented by Allen and Hubbard (1986) with a variables-to-subjects ratio term leads to a significant improvement in predicting the first, as well as subsequent, givenvalues. Squared multiple correlations are .993 or higher for predicting all givenvalues. Parameter estimates for the augmented equation are presented to permit calculation of more nearly precise estimates of up to 48 givenvalues of a random data correlation matrix.
Predicting Later Academic Achievement from Kindergarten Scores on the Metropolitan Readiness Tests and the Lollipop Test
Authors: Chew Alex L. , Morris John D.
Published: March 2007

The long-term predictive validities of the Metropolitan Readiness Tests (MRT) and the Lollipop Test: A Diagnostic Screening Test of School Readiness were examined. The achievement of 246 students in reading and mathematics as measured by the Stanford Achievement Test and teacher assigned grades in first, third, and fourth grades was predicted from kindergarten administrations of each of these test batteries. All multiple correlations for the Lollipop Test and the MRT were found to be significant and similar in magnitude. Perhaps particularly noteworthy, was that the Lollipop Test, a shorter screening instrument, performed as well as the lengthier MRT in predicting school achievement.
Testing the Factor Structure Invariance of a Computer Attitude Scale Over Two Grouping Conditions
Authors: Bandalos Deborah , Benson Jeri
Published: March 2007

A computer attitude scale is tested for invariance over the grouping conditions of males/females and graduate/undergraduate. Through both exploratory and confirmatory factor analysis, the original scale, developed by Loyd and Gressard (1984a), was revised to 23 items representing three factors. The revised scale was found to be invariant over both conditions in terms of number of factors and intercorrelations among the factors. Although there were slight differences in the item loadings and the item errors, the differences were not practically significant. Thus, the construct of computer anxiety appears to be multidimensional with highly correlated factors.
An Empirical Investigation of the Motivation to Manage among Blacks and Women in Business School
Authors: Stevens George E. , Brenner O. C.
Published: March 2007

Race and gender differences in motivation to manage were examined using the Miner Sentence Completion Scale. While there was no significant difference between blacks and whites on the total scale, scores for males reflected a higher motivation to manage than did scores for females. A number of significant interactions and race and gender main effects were evident on various subscales. Implications of the results are discussed.
Dealing with Nonnormal Data: Parametric Analysis of Transformed Data vs Nonparametric Analysis
Authors: Rasmussen Jeffrey Lee , Dunlap William P.
Published: March 2007

Researchers have typically employed parametric analysis of raw data to test experimental data for statistical significance. When the data are not normally distributed, data transformation or nonparametric analysis are often recommended. The present study compares parametric analysis of raw data to parametric analysis of transformed data and to nonparametric analysis when the tests are carried out under population nonnormality. The results of a Monte Carlo simulation indicate that when distributions depart markedly from normality, nonparametric analysis and parametric analysis of transformed data show superior power to parametric analysis of raw data. Furthermore, under the conditions studied, parametric analysis of transformed data appears to be somewhat more powerful than nonparametric analysis.
The Angoff Cutoff Score Method: The Impact of Frame-of-Reference Rater Training
Authors: Fehrmann Melinda L. , Woehr David J. , Arthur Winfred
Published: March 2007

One of the most preferred and widely used methods for generating cutoff scores in content-related validity situations is the Angoff procedure. This procedure, however, typically displays low inter-rater reliability. Very little is known about the accuracy of the cutoff scores. The present study compares the effect of two frame-of-reference rater training approaches on the reliability and accuracy of cutoff scores generated by the Angoff procedure. Results indicate that both frame-of-reference rater training strategies resulted in significantly higher levels of interrater reliability and more accurate decisions than a non-frame-of-reference condition.
A Structural Analysis of Religious Orientation and its Relation to Sexual Attitudes
Authors: Reed Leslie A. , Meyers Lawrence S.
Published: March 2007

A total of 201 individuals completed a revision of Allport and Ross' Religious Orientation Scale (ROS) in addition to the Derogatis Sexual Functioning Inventory. A factor analysis of the ROS confirmed previous research by finding two extrinsic dimensions of personal and social orientation. In addition, two intrinsic factors interpreted as representing ethical and intellectual dimensions were also identified. Generally, stronger intrinsic religious orientation was associated with the holding of conservative sexual attitudes while stronger extrinsic religious orientation was associated with the holding of more liberal sexual attitudes and less overall satisfaction with one's sexual relationship.
The Revised Children's Manifest Anxiety Scale and Social Desirability
Authors: Hagborg Winston J.
Published: March 2007

The present study examined the relationship between the Revised Children's Manifest Anxiety Scale (RCMAS) and social desirability (Marlowe-Crowne Social Desirability Scale), with a sample of nonclinical high school students (N = 78). Findings support the concurrent validity of the RCMAS' Lie Scale as a measure of social desirability. The pattern of variable correlates indicated that higher levels of male social desirability is significantly related to lower levels of self-report anxiety, while a significant relationship between these measures was not found for females.