bluuebunny/crossref_metadata_2025 huggingface dataset:
A Q-Analysis for Nominal Data'
Authors: Vegelius Jan
Published: March 2007

The possibility of using a Q-analysis also for nominal data is discussed. The J-index is suggested as a suitable measure of similarity between the persons in this case. An example is given where ten persons should sort sixteen playing cards into as many groups as they wished. A Q-analysis was made on these data giving a natural two-dimensional structure.
New Developments in the Assessment of Reliability: The Linrel Program
Authors: Levine Lawrence M. , Bohrnstedt George W.
Published: March 2007

A program is described that computes six reliability coefficients that reflect recent advances in the assessment of reliability. The program also outputs a variety of statistics, needed to compute the six coefficients, that are also useful for further item analysis. LINREL was designed to be portable and easy to use, and a detailed user's manual is available. A brief historical overview is given before program features are discussed.
Predicting Academic Achievement Over a One Year Period
Authors: Gross Alan L.
Published: March 2007

This investigation considered the prediction of academic achievement over a one-year time period. Academic achievement was assessed in terms of four scales of the CTBS battery. The predictor variables were academic aptitude (assessed in terms of the SFTAA battery), age, sex, and grade level. A one-year time period intervened between the administration of the CTBS and SFTAA batteries. The results showed high levels of predictive validity in terms of multiple correlations, cross-validated correlations, and prediction intervals.
Factorial Validity of the Health Locus of Control (HLC) Scale
Authors: Snow Mark , Thurber Steven
Published: March 2007

The factor structure of the Health Locus of Control (HLC) scale is compared for two groups of women differing in regard to experience with major illness and physical fitness activities. Although both groups yielded a two-factor structure, certain noteworthy contrasts emerged. For healthy women engaged in physical fitness activities, a personal responsibility dimension was found to be central. For a group of cancer patients, a "fate" component appeared primary in variance accounted for in the HLC scale. Implications of these findings are discussed.
Unbiased Estimation in a Closed Sequential Testing Procedure
Authors: Wilcox Rand R.
Published: March 2007

Let p be the proportion of items in an item domain that an examinee would answer correctly if every item were attempted. This brief note provides unbiased estimates of pt, for any integer t, when a closed sequential testing procedure is used.
The Validity of the Information and Vocabulary Subtests of the WAIS for Predicting College Achievement
Authors: Feingold Alan
Published: March 2007

Reviews on the validity of the WAIS have shown that the Information and Vocabulary subtests are valid measures of general intelligence. The present review investigated the ability of each of these two subtests to predict college grade point average (GPA) compared to that of well-established college aptitude tests (ACE, ACT, SAT, SCAT). The means of the comparative validity coefficients indicated that in spite of their greater brevity, the Information and Vocabulary subtests predicted college GPA more accurately than did the verbal sections and as validly as the composite scores of college aptitude tests. It was concluded that the subtests (and their recent revisions on the WAIS-R) could justifiably be used for the quick assessment of academic ability in higher educational settings.
The Reliability of a Profile
Authors: Yarnold Paul R.
Published: March 2007

The problem of the unreliability of a single scale, test, or inventory has an extensive literature, while discussion regarding the reliability of a profile or battery of measurements cannot be found. A profile exists when an individual has been scored or rated on two or more measures. Unreliable profiles impose the difficulty that ordinal and interval relations among the individual's scores become uncertain or unstable. A profile reliability coefficient r,,(K) is derived to estimate the relative expected extent of this ordinal and interval "inversion" for any profile of K measures.
Level of Self-Actualization among Process and Reactive Schizophrenics, Alcoholics, and Normals: A Construct Validity Study of the Personal Orientation Inventory
Authors: Murphy Thomas J. , Dewolfe Alan S. , Mozdzierz Gerald J.
Published: March 2007

To extend its validity, the Personal Orientation Inventory (POI) was administered to hospitalized patients including 24 classified as Process Schizophrenics, 24 as Reactive Schizophrenics, 22 as Alcoholics, and 24 as Normals (medical patients). Considerable support was found for the predicted order from most to least self-actualized of Normal, Alcoholic, Reactive Schizophrenic, and Process Schizophrenic. Significantly consistent patterns and frequently significant differences on individual measures were found when Normals and Alcoholics were compared with Process and Reactive Schizophrenics. A significantly consistent pattern of higher scores for Reactives than for Process Schizophrenics was found but only one significant difference in subscales occurred. Smaller differences were found among the Schizophrenics than between them and the nonpsychotic groups. No significant differences were found between the Alcoholic and Normal groups. Findings were interpreted as generally supporting the construct validity of the POI.
FACTOREP: A Pascal Program to Examine Factor Replication
Authors: Walkey Frank H. , Mccormick Iain A.
Published: March 2007

FACTOREP is a computer program which provides information to solve the problem of determining the most appropriate number of factors to be rotated in order to produce a replicable and stable factor structure. This objective is accomplished by using the s index which enables a researcher to make comparisons of similarity across different factor structures. Matrices of s index values are produced to indicate the degree of similarity in analyses across different numbers of factors, subject groups, and cut off levels for factor loadings. Written in Pascal, the program affords readily interpretable information leading to the identification of replicable factor structures.
An Index of Fit for Factor Scales
Authors: Fleming James S.
Published: March 2007

An index is defined for each column of a factor matrix to measure the goodness of fit for scale defining items, where the latter are determined in advance by the investigator. Let MS(S), MS(NS), and MS(T) be the mean-square loadings for scale items, nonscale items, and total items, respectively, for a given factor. A measure denoted IFFS (index of fit for factor scales) is defined as the signal-to-signal plus noise ratio: IFFS = 1 - MS(NS)IMS(T). The highest possible value of IFFS is 1.00, with .50 indicating that scale items are no better than nonscale items in defining the construct. An overall measure is also defined. The index is complemented by Kaiser's index of factor simplicity (IFS) as computed for each scale item. Evaluative criteria and examples are presented.
Variability of Deviation IQ's Based on Multiple Choice Test Scores
Authors: Zimmerman Donald W.
Published: March 2007

A computer program simulated guessing on multiple-choice test items and calculated deviation IQ's from observed scores which contained a guessing component. The entire procedure was replicated 5000 times for each of a variety of assumptions about the number of test items, the number of choices per item, and the distribution of the number of items "known" by examinees before guessing. Extensive variability in deviation IQ's due entirely to chance was found. The degree of variability was sensitive to the scale location of the distribution of number of items "known" but not to the shape or variance of that distribution. For all distributions, the degree of variability consistently depended inversely on the number of items and inversely on the number of choices per item.
Assessing the Dimensionality of Dichotomous Data Using Modified Order Analysis
Authors: Wise Steven L. , Tatsuoka Maurice M.
Published: March 2007

Previous research has shown that order analysis and factor analysis typically yield different results in assessing the dimensionality of dichotomous data. This paper demonstrates that, through the inclusion of item proximity information, the dimensions identified by order analysis can be highly congruent with the results of factor analysis. A modified order analysis procedure is presented and compared to factor analysis using both simulated data of known dimensionality and real data.
Raw Score and Factor Score Multiple Regression: An Evaluative Comparison
Authors: Dobie Tam , McFarland Ken , Long Nigel
Published: March 2007

An empirical investigation and theoretical examination was made of the issues arising out of the use of factor scores in multiple regression from the perspective of exploratory analysis. Using data collected on 189 subjects, two raw score regressions were compared to and contrasted with a single factor score regression. Issues examined included: the relative predictive power and generalizability of each solution, the effect of factor score regression on the degrees of freedom in the analysis, and for each solution the relative ease of interpretation and loss of predictors. It is argued that in cases of consistently large commonalities across a large predictor set factor score regression is the more appropriate solution. In cases of consistently low commonalities across a small predictor set a raw score solution appears the more appropriate. With various sizes of commonalities, semi-partial correlations, and zero-order correlations, "research specific" requirements of the exploratory analysis will often predetermine the priority to be given one or other regression solution.
The Effects of Mode of Test Administration on Test Performance
Authors: Lee Jo Ann , Moreno Kathleen E. , Sympson J. B.
Published: March 2007

This study sought to determine whether the mean score on the computerized version of an arithmetic reasoning test would be significantly lower than that on the paper-and-pencil version when there was no time limit. It was hypothesized that there would be no significant difference between the mean scores. A test for an interaction between Mode of Administration and ability was also performed. Test performance was measured by the number-correct score on the Experimental Arithmetic Reasoning Subtest; ability was measured by the Arithmetic Reasoning subtest of the Armed Services Vocational Aptitude Battery. Subjects were 585 military recruits between the ages of 18 and 25. There were 300 subjects in the Paper-and-Pencil Mode and 285 in the Computer Mode. Subjects were randomly assigned to either mode. A significant main effect for Mode (p < .05) was found, with the mean score obtained by computer lower than that obtained by paper-and-pencil. No interaction between Mode and ability was found. Possible explanations are given and discussed.
Are Learning Disabled Students "Test-Wise?": An Inquiry into Reading Comprehension Test Items
Authors: Scruggs Thomas E. , Lifson Steve
Published: March 2007

Previous research has indicated that students in many cases can answer reading comprehension test questions correctly without having read the accompanying passage. The present research compared, in two experiments, the ability of learning disabled (LD) students and more typical age peers to answer such reading comprehension questions presented independently of reading passages. In Study 1, learning disabled students scored appreciably lower under conditions resembling standardized administration procedures. In Study 2, reading decoding ability was controlled for; however, the performance differential remained the same. Results suggested a relative deficiency on the part of LD students with respect to reasoning strategies and test-taking skills. In addition, the validity of some tests of "reading comprehension" was discussed.
Convergent Validity of Four Innovativeness Scales
Authors: Goldsmith Ronald E.
Published: March 2007

Intercorrelations of four scales purporting to measure innovativeness indicate that they generally exhibit convergent validity in two samples of student subjects.
A Comparison of High School Student Ratings of Teaching Effectiveness with Teacher Self-Ratings: Factor Analytic and Multitrait-Multimethod Analyses
Authors: Aubrecht Judith D. , Hanna Gerald S. , Hoyt Donald P.
Published: March 2007

Two classes of each of four hundred high school teachers were rated for teaching effectiveness by the teachers and by their students using the same instrument. Separate factor analyses yielded highly similar underlying dimensions. Convergent validity coefficients were significant for all factors. These findings provide support for the validity of high school student ratings of instruction.
Within-Variable, between Occasion Error Covariances in Models of Educational Achievement
Authors: Wolfle Lee M. , Ethington Corinna A.
Published: March 2007

To correct for the effects of measurement error on structural parameter estimates, many researchers are now estimating models of educational achievement with LISREL. In order to estimate such models it is desirable to obtain multiple manifest measures of the latent constructs. Many researchers restrict their models to two manifest measures per latent construct for reasons of economy, but doing so assumes in the absence of external information that all of the covariance between the within-variable measures is reliable covariance. Such an assumption may or may not hold in practice. Using data from High School and Beyond, the present study empirically investigates the extent of within-variable, between-occasion error covariances among variables typically included in models of educational achievement.
Validity of the Standard Progressive Matrices as a Predictor of Achievement of Sixth and Seventh Grade Students
Authors: Powers Stephen , Jones Patricia B. , Barkan Jerry H.
Published: March 2007

The predictive validity of the Standard Progressive Matrices(SPM) was examined with a sample of 212 sixth grade students and 214 seventh grade students. Correlation coefficients between the SPM and the California Achievement Tests of Reading, Language, and Mathematics ranged from .34 to .60. Those coefficients were similar in range and magnitude to those coefficients reported by the SPM Manual.
What's Wrong with Three-Option Multiple Choice Items?
Authors: Owen Steven V. , Froman Robin D.
Published: March 2007

Despite evidence supporting 3-option items, text authors and practitioners continue to advocate the use of four or five options. We designed an experiment to test further the efficacy of 3-option achievement items. Parallel tests of 3- and 5-option items were built and distributed randomly to college students. Results showed no differences in mean item difficulty, mean discrimination, or total test score, but a substantial reduction in time spent on 3-option items. The straightforward implication is that content validity may be boosted by writing additional 3-option items to tap more content.
The Predictive Validity of a Parents' Support Scale in Relation to Occupational Aspirations and Attainment
Authors: Marjoribanks Kevin
Published: March 2007

Scales were developed to assess adolescents' perceptions of their parents' support for learning. The predictive validities of the scales were examined in relation to young adults' occupational aspirations and attainment, after considering associations involving children's ability and adolescents' occupational aspirations. Data were collected from 170 female and 140 male Australians, during three surveys, as part of a longitudinal investigation. The results indicated that the scales were sensitive enough to gauge the differential impact of family learning environments on young adults' occupational outcomes.
Attitudes toward Statistics: An Evaluation of Multiple Measures
Authors: Waters L. K. , Martelli Theresa A. , Zakrajsek Todd , Popovich Paula M
Published: March 2007

The two subscales of the Attitude Toward Statistics scale (Wise, 1985), Attitude Toward the Field and Attitude Toward Course, were administered on the first and last day of class, and the Statistics Attitude Survey (Roberts and Bilderback, 1980) on the last day of class to 302 students in ten sections of an undergraduate introductory statistics course. The scales were reliable measures of students' attitudes toward statistics, were essentially unrelated to sex of respondent and year in college, and on last class administration correlated with course grade. The two subscales of the Attitude Toward Statistics scale were highly correlated with the Statistics Attitude Survey.
A Confirmation of the Three-Factor Structure of the Maslach Burnout Inventory
Authors: Green Dianne E. , Walkey Frank H.
Published: March 2007

The Maslach Burnout Inventory (MBI) is a widely used measure of three specific aspects of the burnout syndrome-namely; emotional exhaustion, depersonalization, and lack of personal accomplishment. It is rapidly becoming a valued tool in assessment of perceived burnout in human service professionals. Although its reliability and validity are well established, its factor structure is not. In previous studies different researchers have found very different factor solutions. In the present study this problem was solved by principal components analysis of previously published American data and New Zealand data, followed by three- and four-factor varimax rotations. The outcome produced a clear, replicable three-factor solution consistent with that of the MBI authors' descriptions. No replicable four-factor structure was found.
Power Estimates in the Presence of a Covariate and Measurement Error
Authors: Rogers W. Todd , Hopkins Kenneth D.
Published: March 2007

The statistical power of a test of significance for the difference among means is dependent upon a number of factors, among them the presence of a covariate, which often serves to increase power, as well as measurement error, which reduces power. Formulas are provided for adjusting Cohen's (1977) f value for these two sources of variability. These adjusted f values can then be used with Cohen's power tables. An example of the use of these formulas in the planning stage of a study is given, followed by a description of the complex nature of the relationship between power and covariance and measurement error.
Measuring Perceived Supervisory and Organizational Support
Authors: Kottke Janet L. , Sharafinski Clare E.
Published: March 2007

Organizational commitment has traditionally been measured by focusing on the employees' identification with the organization. Eisenberger, Huntington, Hutchison, and Sowa have suggested that employees' commitment is affected by their perception of the organization's commitment to the employees. We propose that this type of commitment consists of both a perception of a global, organizational commitment to employees and a perception of support from supervisors. This study describes the translation of the Survey of Perceived Organizational Support and the development of a Survey of Perceived Supervisory Support to measure these concepts.
Analyzing Independence in R-Way Contingency Tables
Authors: Berry Kenneth J. , Mielke Paul W.
Published: March 2007

A subroutine is presented to calculate two test statistics for analyzing independence in r-way contingency tables. These test statistics are based on the exact first three cumulants of both the Pearson chi-squared statistic and a recent modification of the Pearson chi-squared statistic.
Classification Reliability of the DIAL-R Preschool Screening Test
Authors: Suen Hoi K. , Mardell-Czudnowski Carol , Goldenberg Dorothea S.
Published: March 2007

Norming data of DIAL-R, a preschool screening test, were reanalyzed. The squared-error loss generalizability approach was used to assess the classification reliability of subscale and total scale scores by age group. It was found that the classification reliabilities were uniformly high for all age groups. Since DIAL-R is explicitly designed for screening purposes only and individual subscale scores are not interpreted independently, despite earlier criticisms of low classical reliability estimates, it is suggested that DIAL-R is quite reliable for its intended use.
Screening Ability of the Broad-Band versus Narrow-Band Intellectual Scales of the Personality Inventory for Children (PIC)
Authors: Durrant Joan E. , Porter James E.
Published: March 2007

The present study sought to shed light on the relative effectiveness of the narrow-band and broad-band intellectual scales of the Personality Inventory for Children (PIC) as screening measures for the need for an intensive assessment. Following family interviews and extensive psychological testing, 40 preschool children had been placed in either the treatment (n = 20) or regular (n = 20) nursery program. The ability of the PIC narrow-band scales Achievement (ACH), Intellectual Screening (IS), and Development (DVL), and the PIC broad-band Cognitive Development scale (Scale IV) to differentiate these two groups of children was assessed. Analysis of covariance procedures revealed that all four PIC scales were able to significantly differentiate the two groups, with the broad-band scale (Scale IV) as effective as the most effective of the narow-band scales. Chi-square analysis indicated that high versus low scores on Scale IV correctly identified the group placement of 36 of the 40 children. The results strongly support the proposition that Scale IV: Cognitive Development, a broad-band scale derived from a considerably abbreviated version of the PIC, is an effective, economical screening measure for the need for intensive assessment within a preschool population.
Validity Evidence for the Myers-Briggs Type Indicator as a Measure of Hemisphere Dominance
Authors: Shiflett Samuel C.
Published: March 2007

Myers-Briggs Type Indicator (MBTI) scores were correlated with the Human Information Processing Survey (Taggart and Torrance, 1984) scales designed to measure brain hemisphere dominance to test the hypothesis that SN and JP scales of the MBTI are indicators of brain dominance. Correlations were in the expected directions, providing evidence of convergent and discriminant criteria of construct validity. A possible moderator effect involving gender was discovered, with significantly higher correlations occurring for females than for males.
Issues Related to the Validation of the Iowa Self-Assessment Inventory
Authors: Morris Woodrow W. , Buckwalter Kathleen C. , Cleary T. Anne , Gilmer Jerry S. , Hatz Deborah L. , Studer Marie
Published: March 2007

This paper reports on a study which examined psychometric properties of the Iowa Self-Assessment Inventory (ISAI), an instrument designed to assess functional characteristics of the elderly across six dimensions: social resources, economic resources, mental health, physical health, activities of daily living, and cognitive status. The ISAI differs from some other multidimensional functional assessment instrument like the Duke Older Americans Resources and Services Methodology in that it is a self-report type of instrument and is convenient to complete and efficient to score. The results include acceptable reliabilities for each of the six scales and correlations between the scales and certain demographic variables which are generally consistent with expectations.
Examining the Stability of Angoff's Delta Item Bias Statistic Using the Bootstrap
Authors: Harris Deborah J. , Kolen Michael J.
Published: March 2007

Item bias indices are frequently used in the process of screening items. Although many bias indices exist and much has been written about the agreement between indices, relatively little has been done to investigate the stability of a particular index across comparable samples. Using the bootstrap methodology, this study investigated the stability of the Angoff delta item bias index. The results support this use of the new methodology, but suggest that sampling error in estimating the statistic needs to be closely monitored.
Measuring Dyadic Perspective-Taking: Two Scales for Assessing Perspective-Taking in Marriage and Similar Dyads
Authors: Long Edgar C. J.
Published: March 2007

This article reports on the development and preliminary assessment of two paper-and-pencil measures of dyadic perspective-taking. Dyadic perspective-taking is defined as the imaginative tendency to put oneself in the place of a partner. The Self Dyadic Perspective-Taking Scale (SDPT) assesses the dyadic perspective-taking of self. The Other Dyadic Perspective-Taking Scale (ODPT) evaluates the dyadic perspective-taking of the other. Three separate studies evaluated the reliability and validity of the two measures. Results indicated that both scales had what could be considered adequate validity and reliability. Shortcomings, uses for the scales, and suggestions for future research were discussed.
Reliability, Construct Validity, and Response- Set Bias of the Revised Learning-Style Inventory (LSI-1985)
Authors: Ruble Thomas L. , Stout David E.
Published: March 2007

This research investigated the internal consistency and construct validity of the revised Learning-Style Inventory (LSI-1985). In particular, the study examined the possibility of a response-set bias based on the single-scale-per-column format of the instrument. Order effects were considered as well. To study the possible response set, two versions of the instrument were administered: (a) the standard LSI-1985 and (b) a scrambled version. Estimates of scale consistency were less in the scrambled version suggesting the presence of a response set for the standard LSI-1985. Factor analyses failed to support the construct validity of the revised instrument and also seemed to indicate the presence of a response set. In addition, completing the LSI after the administration of a second instrument seemed to affect the reliabilities of some scales. Further research is needed to clarify the effects of the psychometric properties and underlying assumptions of the LSI-1985.
Agreement between Mothers and Sons on Ratings of Creative Activity
Authors: Runco Mark A. , Noble Ernest P. , Luptak Yara
Published: March 2007

Creative Activities and Accomplishments Check Lists are often used to assess the creative performance of children. Check Lists are attractive because the respondent is generally well informed about his or her own past achievements, and the focus is on actual rather than potential performance. Additionally, Check Lists can be used to assess creative activity in a variety of domains. This is very important given the current view of creativity as involving domain-specific skills. The present investigation was conducted to evaluate the validity of ratings of children's creativity obtained with a Creative Activities Check List. A Check List was administered independently to sons ( n = 73) and their mothers ( n = 60). It contained 55 items from four domains: math-science, art, crafts, and writing. Correlational analyses indicated that the four domain ratings given by the mothers concerning their sons' creativity were significantly related to the four domain ratings of their sons. Four canonical functions were derived, accounting for a total of 85% of the variance ( p < .001) of the ratings. Similarly, the mean ratings given by mothers and their sons were not significantly different, suggesting that mothers' ratings might be used when ratings from children cannot be obtained. These results support the validity of the Activities Check List.
Dimensionality of Raven's Advanced Progressive Matrices Items
Authors: Alderton David L. , Larson Gerald E.
Published: March 2007

Raven's Advanced Progressive Matrices (APM) was designed as a nonverbal measure of "Spearman's g" and it is frequently used as the best or only measure of intelligence in current research. As Spearman believed g to be unidimensional, the items comprising the test should define a single factor. Two independent samples of Navy recruits (N = 874 and N = 857) were employed. The data indicated that only a single factor solution was warranted in both samples. A number of technical issues are discussed concerning item factor analysis.
Comparing the Reliability of Difference Scores and Residuals in Analysis of Covariance
Authors: Malgady Robert G. , Colon-Malgady Gerardita
Published: March 2007

In pretest-posttest designs, residual scores created in the analysis of covariance commonly are preferred to difference scores because the latter suffer from reliability problems. This paper develops the reliability of residuals adjusted for a single covariate for comparison to the reliability of difference scores. Comparisons reveal that little is gained by analysis of covariance, which also suffers from reliability problems as the pretest and posttest reliabilities decrease and as their intercorrelation increases.
A Discriminant Function Analysis of Type A Behavior Using the 16PF Personality Questionnaire
Authors: Kunen Seth , Stamps Leighton
Published: March 2007

The purpose of this study was to investigate the relationship of personality factors as measured by the 16PF Personality Questionnaire to Type A behavior as measured by the Student Form of the Jenkins Activity Survey (SJAS). One hundred and fourteen under-graduates were administered the SJAS and the 16PF Personality Questionnaire. Correlational and discriminant analyses revealed several systematic relationships between specific personality factors and Type A Behavior. The correlational analyses revealed nine significant correlations, while the discriminant analysis revealed six factors that discriminated between Type A and Type B personalities. The most important of these were the factors Venturesome, Suspicious, and Conscientious. These results indicate that the 16PF is a useful personality inventory that can discriminate Type A from Type B personalities as measured by the SJAS.
The Distributional Properties of Rasch Item Fit Statistics
Authors: Smith Richard M.
Published: March 2007

This study reports the results of an empirical investigation of the distributional properties of the item fit statistics that are commonly used in Rasch model calibration programs as indices of the fit of the responses to individual items to the measurement model. There are two aspects of this study: an investigation of the distributional properties of the item fit statistics when the data fit the model, and the power of the item fit statistics to detect measurement disturbances. This study is based on simulated data to control for the presence of confounding factors, such as multidimensionality, differences in the slopes of item characteristic curves, and guessing. The results indicate that, when that data fit the model, the distributional properties of the item fit statistics, corrected for use of estimated person parameters, are close to hypothesized mean and standard deviation and that it is possible to construct reasonable Type I error rates that can be used as a frame of reference when investigating the fit of actual data to the Rasch model. The item fit statistics also have the power to detect measurement disturbances of reasonable magnitude.
Two Fortran Programs for Testing Hypotheses about Fully Disattenuated Correlation Coefficients: Atteni and Attend
Authors: Hakstian A. Ralph , Schroeder Marsha L.
Published: March 2007

Recent advances in the development of asymptotic theory concerning correction coefficients corrected for attentuation due to unreliability have resulted in large-sample inferential procedures where none existed before. The present article describes two FORTRAN programs written for mainframe use. The first of these is for use with disattenuated correlations obtained from independent samples; the second is for inferential tests with dependent-sample coefficients.
Identifying Negatively Discriminating Items When Test Scores are Not Normally Distributed
Authors: Fowler Robert L. , Clingman Joy M.
Published: March 2007

Traditional item analysis procedures for norm referenced testing have often included the selection of the upper and lower 27% groups for performing item discriminations. Such procedures are based upon assumptions of (a) normality, (b) score independence in the tails, and (c) equality of standard deviations in the tails of the criterion distribution. However, these characteristics may not apply to the distributions of typical classroom examinations, which tend to be negatively skewed. This study used Monte Carlo techniques to examine the power of Brennan's (1972) B to detect negatively discriminating items drawn from a variety of nonnormal population distributions. In general, it was found that power is lost when choosing equal-sized groups from asymmetric distributions. A simplified procedure for conducting an item discrimination analysis on typical classroom objective examinations is offered.
Tetra: A Fortran IV Program for Computing the Cosine-Pi Approximation to the Tetrachoric Correlation Coefficient
Authors: Becker Gilbert , Hilton John
Published: March 2007

Research design features relating to the use of a binary response format to measure a continuous latent variable and to the arbitrary dichotomization of graduated data are discussed in connection with the advantages and disadvantages inherent in the use of the tetrachoric correlation. A FORTRAN IV program for computing the cosine-pi approximation to the tetrachoric correlation is described, and the nature and extent of systematic error found in that approximation are summarized.
Sequential Anovas and Type I Error Rates
Authors: Mccarroll David , Crays Nancy , Dunlap William P.
Published: March 2007

Monte Carlo simulations were used to examine three different cases of using analysis of variance sequentially. The first case dealt with adding additional data to original data that were not significant and then reanalyzing. Alpha levels reached a high of .086 in this case. In the second case, data were added only when the F-ratio was not significant but exceeded 1.00; in this case, the alpha level reached a high of .16. The third case added data only when the p value exceeded 0.05 but was less than a predetermined limit (between .06 and .10); alpha levels rose to as much as .39 in this case. The message is clear: ANOVA was not intended as a sequential test and should not be used as such.
Item Homogeneity in Verbal Tests: A Rasch Analysis of Amthauer'S Verbal Tests
Authors: Van Der Ven Ad H.G.S.
Published: March 2007

The dichotomous Rasch model was applied to the verbal subtests of the Intelligence Structure Test Battery (IST) developed by Amthauer (1973). Three tests were used: (a) Word-grouping, (b)Word Analogies, and (c) Word-pairing. The first two are similar to tests which have been used by Thurstone (1938) in his search for the "Primary Mental Abilities." The tests were administered with a time-limit. Hence, not all items were completed in the time given. The Rasch model held for neither of the tests, when all items were included in the analysis. Importantly, van den Wollenberg's 02statistic was highly significant, which may indicate multidimensionality of the items. A thorough analysis based on subsets of items made quite clear that the following five factors should be taken into account to understand the poor model fit: (1) ambiguity in the formulation of the items; (2) the use of specific knowledge to solve the problems; (3) the use of distractors by which the subject may easily be tempted to resort to responses which seem to be correct, but are actually incorrect; (4) the use of specific problem solving strategies, which appear in some of the items, but not in all;(5) positional effects, in which some alternatives attract the attention more than others. The factors as such do not violate the Rasch model. The Rasch model may only be violated when such a factor plays a role in some of the items, but not in all. In order to establish item homogeneity one should take into consideration the following rule: if any factor is used to increase the difficulty of the items, then that factor should be used in all items.
Toefl Performance and Success in a Masters Program in Engineering
Authors: Ayers Jerry B. , Quattlebaum Rebecca F.
Published: March 2007

Scores on the Test of English as a Foreign Language (TOEFL), achieved by 67 Asian graduate students seeking the Master of Science in engineering, were examined in relationship to scores on the Graduate Record Examination (GRE) and success in completing their program of study as measured by final grade point average. Significant correlations (p < .01) were obtained between TOEFL and GRE Verbal (r = .63), GRE Quantitative (r = .30), and GRE Analytical (r = .35) scores. The best predictor of success in graduate study was the Quantitative score from the GRE (r = .32,p < .01).
The Suinn-Lew Asian Self-Identity Acculturation Scale: Concurrent and Factorial Validation
Authors: Suinn Richard M. , Ahuna Carol , Khoo Gillian
Published: March 2007

The current report covers the reliability and validity data on an extensive study of the Suinn-Lew Asian Self-Identity Acculturation Scale (SL-ASIA) involving a sample of 324 adults. Concurrent validity results showed that the SL-ASIA scores were significantly correlated with demographic information hypothesized to reflect levels of Asian-American identity. For example, high SL-ASIA scores were found associated with having attended school in the U.S. over a longer period of time, during which time the subject's Asian identity would have been reduced. Factorial validity was determined by comparing factors obtained for the SL-ASIA with factors reported for a similar scale measuring ethnic identity of Hispanics, the ARSMA. Of the four interpretable factors reported for the ARSMA, three were identified for the SL-ASIA.
The Mstat-I: A New Measure of an Individual'S Tolerance for Ambiguity
Authors: Mclain David L.
Published: March 2007

This paper describes a new 22-item measure of an individual's tolerance for ambiguity. This new measure is based on a revised construct definition which more comprehensively addresses characteristics of ambiguous stimuli and individuals' reactions to perceived ambiguity. Reliability and convergent and discriminant validity evidence support the psychometric quality of this new measure.
Tests of Multivariate Independence: A Critical Analysis of "A Monte Carlo Study of Testing the Significance of Correlation Matrices" by Silver and Dunlap
Authors: Fouladi Rachel T. , Steiger James H.
Published: March 2007

Silver and Dunlap (1989) reviewed several tests for the hypothesis of multivariate independence, and, on the basis of Monte Carlo results, recommended a procedure by Brien, Venables, and Mayo (1984) as providing best overall performance. More recently (Silver and Dunlap, 1990), they have distributed computer software implementing this recommendation. In this paper, the writers demonstrate that Brien et al.'s test is not a proper test for multivariate independence, and propose a revised appraisal of the Silver and Dunlap (1989) results.
Measurement Properties of the Revised Job Diagnostic Survey: More Promising News from the Public Sector
Authors: Renn Robert W. , Swiercz Paul M. , Icenogle Marjorie L.
Published: March 2007

This field study extended research on the measurement properties of the revised Job Diagnostic Survey (JDS). Responses from 219 employees performing jobs in the public-sector and LISREL VII confirmatory factor analysis were used to examine the revised JDS's factor structure. Results supported the revised JDS's hypothesized 5-factor structure but indicated the scales' 3-anchor 7-point response format produced a weak artifactor. Results also demonstrated that the revised JDS exhibited strong criterion-related validity for affective but not behavioral outcomes. Suggestions for further improving the measurement properties of revised JDS are discussed.
Assessing the Effects of Standardized Testing on Schools
Authors: Herman Joan L. , Abedi Jamal , Golan Shari
Published: March 2007

This study brings empirical data to the debate about the efficacy of standardized tests. A teacher questionnaire containing 81 Likert-type items was mailed to 450 upper elementary school teachers in 48 schools. Questions of interest included (a) What are the effects of these tests on the teaching and learning process in schools? (b) What is the meaning of test score gains? and (c) Does such testing have differential effects in schools serving students at different socioeconomic status (SES) levels? Approximately 75% of the teachers (n = 341) completed the questionnaires. Results of Cronbach's alpha and principal components analyses indicated that items within specified subscales were internally consistent. Results of a confirmatory factor analysis showed that the interitem correlations within subscales were stronger than those across subscales. The results of multiple discriminant analysis (DA) using categories of TREND (schools with increasing vs. stable or decreasing test scores) as the grouping variable indicated that only two subscales were significantly different across TREND categories. However, the results of a second multiple DA showed that many subscale scores significantly discriminated groups formed by student SES levels. The DA by SES findings suggest that teachers of lower SES students are under greater pressure to improve test scores and focus more on test content in their classroom instruction than teachers of higher SES students.
Univariable Optimal Discriminant Analysis:One-Tailed Hypotheses
Authors: Soltysik Robert C. , Yarnold Paul R.
Published: March 2007

For applications involving a single attribute, univariable optimal discriminant analysis (UniODA) is appropriate when one desires to identify a discriminant classifier that explicitly maximizes classification accuracy for a given sample of data. An open-form enumerable solution for the theoretical distribution of optimal values (number of misclassifications) arising from two-category UniODA of continuous random data has recently been discovered, for the case of a two-tailed (nondirectional) hypothesis. This article describes the theoretical distribution of optima arising from two-category UniODA of continuous random data for a one-tailed (directional) hypothesis. Enumeration of the one-tailed distribution and examination of the corresponding figurate triangle reveals a closed-form solution, for which computation time is linear over sample size. Using this result, the exact Type I error rate may also be easily computed for any orthogonal (equal class sizes) two-tailed UniODA design when classification accuracy is at least 75%. Directional two-category UniODA is illustrated using an application investigating the relationship between depression and monamine turnover in the brain.
Some Zimbabwean Evidence of the Internal Structure of the Self Description Questionnaire-I
Authors: Watkins David , Mpofu Elias
Published: March 2007

This article examines the appropriateness for Zimbabwe students of the Self Description Questionnaire-I (SDQ-1) and the Shavelson model of self-concept on which it is based. The results of an administration of the SDQ-1 to 270 Zimbabwean 12- to 13-year-olds are reported. The internal consistency reliability coefficients obtained were moderate. Factor analysis generally supported both the specific facets of the SDQ-1 and the existence of an underlying general self-concept factor. Some evidence of construct validity was provided by the SDQ-1 scales generally correlating as predicted with learning process and locus of control scales.
Personality as a Predictor of College Performance
Authors: Wolfe Raymond N. , Johnson Scott D.
Published: March 2007

Total SAT score, average grade earned in high school, and 32 personality variables are examined via forward multiple regression analyses to identify the best combination for predicting GPA in a sample of 201 psychology students. Average grade earned in high school enters first, accounting for 19% of the variance in GPA. Self-control enters second, and SAT third; these account for 9% and 5% of the variance, respectively. No other predictors accounted for substantial portions of variance. This pattern of results converges with findings reported by other investigators using other measures of personality. It was recommended that the global trait of self-control or conscientiousness be systematically assessed and used in college admissions decisions.
A SAS Macro for Bootstrapping the Results of Discriminant Analyses
Authors: Dalgleish Lenard I. , Chant David
Published: March 2007

In discriminant analysis, the correlations between the variables and the discriminant functions-structure coefficients-are used in interpretation. Rules of thumb are used to set a cutoff value because there are no formulas for the standard error of structure coefficients. The bootstrap procedure can be used to estimate standard errors and confidence intervals via resampling. A set of SAS macros are described that perform a bootstrap analysis on structure coefficients from a discriminant analysis.
Psychometric Effects of Altering the Ceiling Criterion on the Passage Comprehension Test of the Woodcock-Johnson Psycho-Educational Batftery-Revised
Authors: Simpson Robert G. , Halpin Gerald
Published: March 2007

The Passage Comprehension Test of the Woodcock-Johnson Psycho-Educational Battery-Revised (WJ-R) was administered to 77 elementary and middle school students and was scored according to ceiling criteria contained in the test manual (i.e., six consecutive errors). The protocols were then rescored using the following ceiling criteria: (a) five consecutive errors, (b) five errors in six consecutive responses, and (c) five errors in seven consecutive responses. There was a strong relationship between raw scores obtained using all four scoring methods, and there were consistent correlations between each group of raw scores and an external measure, full-scale intelligence quotient. The investigators found that relaxing the ceiling criterion reduced, to a statistically significant degree, the number of administered items needed to establish a ceiling without negatively affecting the psychometric properties of the test. Regression equations were presented so that raw scores obtained using the alternate scoring methods could be used to access the WJ-R norm tables. Practical implications and limitations of the results were discussed.
An Examination of the Validity of the Sex-Role Egalitarianism Scale (SRES-KK) Using Confirmatory Factor Analysis Procedures
Authors: Scandura Terri A. , Tejeda Manuel J. , Lankau Melenie J.
Published: March 2007

Validity of the Sex-Role Egalitarianism Scale (SRES) was examined employing LISREL confirmatory factor analysis (CFA) procedures for a managerial sample (N = 268) and for a student sample (N= 519). Results of the CFAs indicated that the proposed one- and five-dimensional models of the SRES did not fit the data from the managerial sample but were partially confirmed on the student sample. Further analyses suggested the use of a revised, five-item version of the SRES measure comprising an employment egalitarian dimension, based upon the conceptual definitions provided by the developers of the instrument. This measure was confirmed on both the managerial and student samples using LISREL CFA and represents a valid one-dimensional measure for future use in research on sex role egalitarianism with managerial samples.