bluuebunny/crossref_metadata_2025 huggingface dataset:
Robust Tests for the Equality of Two Correlation Coefficients: A Monte Carlo Study
Authors: Yu Mimi C. , Dunn Olive Jean
Published: March 2007

When several variates are measured on the individuals of a single sample, it is often of interest to test whether or not two population correlation coefficients are equal. For example, in the behavioral sciences, it is often desirable to know whether two mental tests have equal test-retest reliability. In the present paper, eight asymptotically robust tests are proposed and are studied along with two parametric tests recommended by previous studies. Monte Carlo simulation is used to compare the small sample performance of these ten tests under the null hypothesis Ho: ρ12 = ρ34 where ρ ab is the population product moment correlation coefficient between variables Xa and Xb. Seven distributions are considered; a normal distribution, two mixed normal distributions, and four other nonnormal distributions.
An Approximate Hotelling's T2 Test for Matched Group Designs with SPSS
Authors: Deaton William L.
Published: March 2007

This paper describes the procedures that may be used to compute Hotelling's T2 for matched group designs using the RELIABILITY routine of SPSS. Modifications of a normal SPSS job necessary for the test are described. An example data set is used to illustrate the procedure.
The Development and Validation of the Macro-Practice Social Work Knowledge Test
Authors: Whiteman Victor L.
Published: March 2007

The purpose of the study was to construct and to provide initial evidence of reliability and of content and concurrent validity for the Macro-Practice Social Work Knowledge Test which measures cognitive learning of Social Work students in the subject areas of policy, administration, research, and evaluation. The total (the Allitem) scale which measures overall knowledge in these areas was divided into subscales representing policy-administration and research-evaluation. The Allitem scale was also divided into subscales measuring recall of factual knowledge and knowledge of more complex cognitive processes. Test items were administered to 80 Master of Social Work students at Michigan State University. The five scales exhibited Cronbach alpha coefficients ranging from.73 to .85, and a mean index of discrimination ranging from 24 to 28. Initial supporting evidence for the validity of the test is reported.
Microcomputer-Administered Research: A Generalized Basic Subroutine for Administering Likert Items
Authors: Johnson Craig W.
Published: March 2007

A generalized BASIC program subroutine is described which may be used by educational researchers who want to collect data by microcomputer by using Likert type items. The subroutine may be easily modified for special purposes and may be employed by investigators for collecting certain types of attitudinal or cognitive data. Versions of the routine that are available for Commodore and Apple computers may be easily modified for use with other microcomputer systems running a Microsoft BASIC.
Effects of Item Arrangement, Sex of the Subject, and Test Anxiety on Cognitive and Self-Perception Scores in a Nonquantitative Content Area
Authors: Plake Barbara S. , Ansorge Charles J.
Published: March 2007

Previous research using an examination with a quantitative emphasis revealed a significant sex effect and an item arrangement x sex interaction for a cognitive variable (number right) and an item arrangement effect for self-perception scores pertaining to difficulty, fairness, and anticipated performance on the test. Scores representing number of items right and self-perceptions were analyzed for nonquantitative examination that was assembled into three forms: easy-hard, spiral cyclical, random. Multivariate ANCOVA revealed no significant effects (α = .05) for the cognitive measure. However, significant (α = .05) sex and sex x order effects were found for perceptions scores which were not parallel to those reported previously for a quantitative examination. Implications for the valid interpretation of test scores also are briefly discussed.
The Measurement of Selfism
Authors: Phares E. Jerry , Erskine Nancy
Published: March 2007

Narcissism has become a matter of increasing concern in recent years. In this paper it is referred to as selfism and construed as a problem solving generalized expectancy in the framework of Rotter's social learning theory. The development of a 28-item objective scale is described along with preliminary evidence for its validity.
The Use of a Probit Model for the Validation of Selection Procedures
Authors: Dagenais Denyse L.
Published: March 2007

After a review of the disadvantages of linear models for estimating the probability of academic success from previous school records and admission test results, we propose the use of a probit model. In contrast to a number of linear regression models which use academic results as a dependent variable, the probit model allows the retention of drop-out cases within the sample; in addition, the coefficients as well as the probability estimates obtained from the probit model by the maximum likelihood method have satisfactory asymptotic properties. The model is calibrated on admissions data for the Ecole des Hautes Etudes Commerciales in Montreal for the years 1979 and 1980. It is noted that both of the variables used in selection have a significant impact on the probability of success, and each variable seems to be associated with a specific aspect of the phenomenon. Furthermore, when the candidates are grouped into quintiles, the deviations of the estimated probabilities from actual success rates are extremely small.
Convergent and Discriminant Validity of Measures: Employee Problem Appraisal Form
Authors: Turner Carol J. , Walton Duncan
Published: March 2007

The purpose of this study was to evaluate the convergent and discriminant validity of counselor and client ratings of common presenting problems at a counseling center for unviersity employees. Each subject was asked to complete the Employee Problem Appraisal Form (EPAF) at three points in time: during the intake interview (N = 306); after eight weeks of counseling (N = 114); and at termination after 16 or more counseling sessions (N = 80). The counselor for each client also completed a parallel form of the EPAF at each time interval. Five scales on the EPAF were selected for multitrait-multimethod analysis on the basis of internal-consistency estimates. Non-zero convergent validity values (correlations between independent measures of the same trait) ranged from .27 to .66. That four of these non-zero convergent validity values were higher than correlations between independent measures of different traits (heterotrait-heteromethod values) provided some evidence of discriminant validity. Elevations of correlations between repeated measures of different traits (heterotrait-monomethod values) were indicative of shared method variance in both counselor and client ratings. Although non-zero convergent validity values in this study were not large, they increased over time and compared favorably with measures of similar psychological variables based on independent ratings of the same trait (Campbell and Fiske, 1959). These results were discussed relative to improvement of the EPAF, and suggestions were offered for further research using this instrument.
Producing more Interpretable Test Analyses and Reports
Authors: Oosterhof Albert C. , Oosterhof Darlene K.
Published: March 2007

An item analysis and test report program is described. Focus has been placed on using statistics and descriptors which are more readily conceptualized by classroom teachers. The FORTRAN program is usable on many microcomputers and larger systems. An accompanying tutorial. assists with the interpretation of output.
Institutional Research Productivity in Quantitative Psychology
Authors: Maxwell Scott E. , Howard George S.
Published: March 2007

Research productivity in quantitative psychology at various institutions was assessed for the years 1976 through 1982. Authorship credits were obtained for 72 institutions in seven quantitative journals. Three approaches to obtaining a global summary measure of productivity by averaging across the seven journals were compared. Although institutional rankings based on the three approaches were highly correlated, systematic differences for specific institutions were noted.
Dollar-Value Utility of Alternative Procedures for Selecting School Principals
Authors: Hogan Joyce , Zenke Larry L.
Published: March 2007

This paper evaluates four selection procedures for hiring school principals. These procedures (interviews, assessment center, selected assessment center exercises, and paper and pencil inventories) were compared in terms of validity, processing costs, and dollar gain expected from implementation. Using a pool of 115 individuals who applied for 7 principal positions, the selected assessment center exercises had the greatest utility with an expected dollar-value performance gain in excess of $58,000 over the traditional interview alternative. Use of utility analyses highlights the economic impact staffing procedures have on the educational organization.
Relationships between the Gesell School Readiness Test and Standardized Achievement and Intelligence Measures
Authors: May Deborah
Published: March 2007

The relationships between the Gesell School Readiness Test and standardized achievement and intelligence measures were examined. The scores of 152 children on the Gesell Screening Test administered before kindergarten, and the full Gesell School Readiness Test administered at the end of kindergarten, and again at the end of first grade were correlated with each other, as well as with the scores from the Stanford Achievement Test and the Otis Lennon Mental Ability Test. These correlations were generally low; further study of the Gesell School Readiness Test, its reliability, and validity for predicting future school success is recommended.
A Study of Four Psychometric Properties of the Jenkins Activity Survey Type a Scale with Suggested Modifications and Validation
Authors: Shipper Frank , Kreitner Robert , Reif William E. , Lewis Kathryn E.
Published: March 2007

Despite much evidence that the Jenkins Activity Survey Type A scale is lacking in essential psychometric properties, it continues to be widely used for measuring coronary-prone behavior in both research and applied settings. Four psychometric properties-internal consistency, construct validity, criterion validity, and generalizability-of the JAS Type A scale were assessed relative to coronary risk measurements in a sample of 227 male and female hospital employees. Even when the JAS Type A scale was psychometrically enhanced, it failed to satisfy accepted reliability and validity criteria. Researchers are cautioned against using the JAS Type A scale without performing routine tests of psychometric soundness and controlling for gender differences.
Components of Clinical Competence Ratings of Physicians: An Empirical Approach
Authors: Hojat Mohammadreza , Veloski J. Jon , Borenstein Bette D.
Published: March 2007

This study investigated the underlying structure of ratings of clinical competence. The study sample was comprised of 609 physicians graduating from Jefferson Medical College between 1980 and 1983. The rating instrument consisted of 33 statements on clinical behavior in Likert-type format filled out by directors of medical education programs at postgraduate training institutions. The data were subjected to factor analysis. Three factors emerged involving "data gathering and processing skills," "interpersonal and attitudinal," and "socioeconomic" dimensions. Correlations of factor scores with independent measures of conceptually related and unrelated constructs supported the appropriateness of the assigned factor titles. It was concluded that ratings of clinical competence represent a multidimensional construct involving at least three dimensions.
Reliability of Holistic Scoring for the MCAT Essay
Authors: Mitchell Karen , Anderson Judy
Published: March 2007

The Association of American Medical Colleges is conducting research on the incremental validity associated with adding an essay to the Medical College Admission Test (MCAT). The present research examined the reliability of holistic scoring for a sample of essays written during the Spring 1985 MCAT administration. Analysis of variance techniques were used to estimate the reliability of scoring and to partition score variance into that due to level differences between papers and to context-specific factors such as rater, time of scoring, etc. Recommendations for structuring and managing large-scale scoring sessions are presented based on the results.
Bootstrap Applications for the Behavioral Sciences
Authors: Lunneborg Clifford E.
Published: March 2007

BOOTSTRAP APPLICATIONS is a book supported by personal computer programs. It introduces the method of bootstrap inference and provides complete support for applying the bootstrap to common data analyses.
The Predictive Validity of a Study Habits Inventory for First Semester Undergraduates
Authors: Houston Lawrence N.
Published: March 2007

In an effort to provide additional information concerning the relationship between study habits and college grade-point average (GPA), the College Adjustment and Study Skills Inventory (CASSI), high school rank (HSR), and the Verbal as well as the Mathematics scores on the College Board Scholastic Aptitude Test (SAT-V and SAT-M) were intercorrelated. Three stepwise multiple regression analyses were computed, with GPA as the criterion measure. One multiple regression equation used as predictors six subscales of the CASSI; another employed HSR, SAT-V and SAT-M; and the third, used a combination of HSR and the Time Distribution scale of the CASSI. Also, differences between means of males and females on all measures were calculated.

Results showed that all the academic variables and all but one of the CASSI variables were correlated significantly with GPA; females were significantly higher than males on HSR and GPA; and males were significantly higher than females on SAT-M. The combination of SAT-V, SAT-M, HSR, and Time Distribution yielded a coefficient of multiple determination (R2) that was 16% higher than that obtained from HSR alone.
Variability in Reading Achievement Test Scores as Related to Reading Curriculum
Authors: Webster Raymond E.
Published: March 2007

The extent of curriculum biasing was examined for seven criterion-referenced and standardized reading achievement tests in relation to five widely used commercial reading programs at the third grade level. Because of the exaggerated bias found to exist, especially with the standardized achievement tests, caution must be exercised when interpreting test results and using them for educational placement decisions. These types of decisions can best be made when the teacher is aware of the direction and degree of bias for obtained test scores.
Small Sample Difference Tests of Goodness of Fit and Independence
Authors: Aiken Lewis R.
Published: March 2007

Small sample difference ratio statistical procedures for testing goodness of fit to a uniform distribution of n observations in c categories and testing the independence of n observations in the cells of an r x c contingency table are described. The procedures make use of a D statistic ranging from a minimum value equal to or close to 0 to a maximum value of I. Larger values of D indicate greater deviations of the observed frequencies from a specified theoretical frequency distribution. Programs for computing the D values and for generating discrete and right-tail probabilities associated with various values of the D statistic are discussed; probability tables for determining the significance of D are provided.
The Gregorc Style Delineator: Internal Consistency and its Relationship to Kirton's Adaptive-Innovative Distinction
Authors: Joniak Andrew J. , Isaksen Scott G.
Published: March 2007

The primary purpose of the studies was to examine the relationship between the Gregorc Style Delineator and Kirton's adaptive-innovative distinction. The structure and internal consistency of the Style Delineator were also examined. Two samples (N = 109, N = 135) were given the Style Delineator and the Kirton Adaption-Innovation Inventory. Results showed that the Style Delineator's sequential types and random types (irrespective of concreteness or abstractness) were KAI adaptors and innovators, respectively. Factor analysis of responses to the Style Delineator revealed several orthogonal factors, although factor-items were dispersed among the subscales. Cronbach's alphas indicated that the KAI was reliable, but the alphas for the Style Delineator's 4 subscales ranged from .23 to .66. Issues regarding the construction of the Style Delineator were discussed.
Factor Analytic Study of Bales' Interaction Process Analysis
Authors: Allen William R. , Comerford Robert A. , Ruhe John A.
Published: March 2007

To examine the validity of Bales' Interaction Process Analysis (IPA), a factor analysis was performed on existing data from two independent but similarly designed studies wherein the 12 IPA variables were observed and recorded as groups completed two different tasks. None of the four possible structures imputed to the IPA clearly emerged from the data. The results offer only partial support for collapsing the 12 response categories into four, or for treating the 12 response categories as pairwise opposites. One imputed category, negative social-emotional behavior, was confirmed.
The Shape of the Inverse Scree Test for Cluster Analysis
Authors: Lathrop Richard G. , Williams Janice E.
Published: March 2007

A Monte Carlo study to determine the shape of the Inverse Scree test with various numbers of true groups and under different conditions of both distribution shape and sample size. Six distributions of 3000 computer "subjects" each and a seventh (Low N) distribution of 1500 computer "subjects" were created using a random number generator. Fifty Ward hierarchical cluster analyses were completed on each distribution and medians and 96% confidence intervals were computed for clustering steps 1 through 8. The results indicated that the graphic Inverse Scree test may be distribution-independent, N-independent, and modestly curvilinear. Inferences for additional studies and guidelines for Scree analysts were presented.
The Effect of Response Format on Ratings of Teaching
Authors: Newstead Stephen E. , Arnold John
Published: March 2007

An experiment is reported in which students rated the effectiveness of their lecturers by using three different types of response format. No differences were found between a scale in which all the points were verbally labelled and one in which only the end points were labelled. However a third scale, in which each point was given a precise percentage label, differed from the other two, and proved to give a more nearly accurate measure of the performance being rated. It is concluded that such percentage scales should be used wherever possible, although they may be inappropriate for some groups of subjects.
The Principal's Power Tactics Survey: The Measurement of Administrative Power Strategies of Elementary School Principals
Authors: Landry Richard G. , Porter Ann W. , Lemon Donald K.
Published: March 2007

Measurement instruments for the use of administrative power strategies in schools are not available. The purpose of the present study was to develop an instrument to measure the power strategies of elementary school principals. The researchers developed an instrument to measure the overall strategies of Personal Power and Position Power as well as the subsidiary strategies of Assertiveness, Sanctions, Upward Appeal, Ingratiation, Rationality, Exchange, and Coalition. A sample of 297 teachers provided data about 50 principals. After psychometric analysis, the instrument was determined reliable and valid enough for research purposes although further psychometric analyses were recommended.
Validation of the Learning Style Survey: An Interactive Videodisc Instrument
Authors: Gretes John A. , Songer Tim
Published: March 2007

This article is an account of the design, development and evaluation of the interactive videodisc Learning Style Survey, an instrument based on sections of the paper-pencil version of the Hill Cognitive Style Interest Inventory. Psychometric properties of the instrument are discussed, including face, content, and construct validity as well as stability, equivalence, and internal consistency. Suggestions for the possible use of the instrument in the identification of learning style for the improved instructional success of low-literate adults are included.
Coefficients of Response Homogeneity and Congruence
Authors: Aiken Lewis R.
Published: March 2007

Two coefficients (H and C) for evaluating the homogeneity or congruence of a set of n ratings or scores are described. Tests for determining the statistical significance of the coefficients in small and large samples are also provided. These procedures may be used to determine the consistency of measurements made of n persons or situations on one characteristic or the consistency of measurements made of one person or situation on n characteristics. A computer program is available for calculating the coefficients and evaluating their statistical significance for given data sets.
Extension of Margin Sum and Cell Variances to Repeated Measures/Randomized Blocks Analysis of Variance and Criterion-Scaled Regression Analysis
Authors: Finstuen Kenn
Published: March 2007

Gibbons and Sherwood demonstrated the use of three types of criterion-scaled code vectors in regression analyses to test the hypothesis of mean treatment differences from repeated measures, an equivalent hypothesis to that of a randomized blocks analysis of variance (ANOVA) design. This short paper shows that the analysis of variance (ANOVA) source table and the regression analysis R2`s may be recovered quickly from the margin sums and cell variances of the design matrix exclusive of ANOVA "correction" factor or actual regression equation computations.
The Effects of Variable Entry for a Bayesian Adaptive Test
Authors: Hankins Janette A.
Published: March 2007

A comparison was made of the effects of a fixed and variable entry procedure on bias and information of a Bayesian adaptive test. It was found that neither the fixed nor the variable entry procedure produced biased ability estimates on the average. Both procedures did, however, offer biased ability estimates at the extremes of the ability distribution. Both procedures yielded peaked and asymmetric information curves, rather than ideal flat curves. Relative efficiency curves indicated that at no point along the ability continuum was one procedure more efficient than the other. The two procedures generate different item subsets for administration. In almost half the cases, the variable, in comparison with the fixed entry procedure, required more items to reach termination.
The Personal and Academic Self-Concept Inventory: Factor Structure and Gender Differences in High School and College Samples
Authors: Fleming James S. , Whalen D. Joel
Published: March 2007

The Personal and Academic Self-Concept Inventory (PASCI) measures global, social, physical, and academic components of self-concept, as well as social anxiety. Several competing structural models were tested by confirmatory factor analysis for a sample of high school (N = 222) and college (N = 338) students. Seven oblique factors which included two social factors (Social Acceptance and Social Anxiety) fit the data best, and a second-order model supported the hierarchical structure of the data. Internal-consistency and test-retest measures indicated that the scales were reliable. Girls and women scored lower than the boys and men on Physical Ability and on Math Ability, consistent with other findings. Self-Concept scales were stable across high school grades, but global self-concept was higher in the college group, also consistent with prior research.
The Factorial Structure of the Chinese Version of the State-Trait Anxiety Inventory: A Confirmatory Factor Analysis
Authors: Shek Daniel T.L.
Published: March 2007

The factor structure of responses to the Chinese version of the State-Trait Anxiety Inventory (C-STAI) in a sample of 2150 Chinese secondary school students was examined using the LIS-REL approach to confirmatory factor analysis. The results showed that a 3-factor model (State+, Calmness, and Happiness) and a 2-factor model (Trait+ and Trait-) could provide an adequate fit for the item responses to the A-State and A-Trait scales, respectively. When all item responses were included for analyses, it was found that while a 4-factor model (State+, State-, Trait+, and Trait-) was able to fit the data, a 5-factor model (State+, Calmness, Happiness, Trait+, and Trait-) was found to provide the best fit. The factorial structure of the C-STAI is discussed with reference to previous research findings and conceptual frame-works on the STAI.
Two Fortran Programs for Testing Hypotheses about Partially Disattenuated Correlation Coefficients: Parti and Partd
Authors: Hakstian A. Ralph , Schroeder Marsha L.
Published: March 2007

The recent development of inferential theory for correlation coefficients corrected for attenuation in one variable-coefficients termed partially disattenuated correlation coefficients (PDCCs)-has lead to hypothesis-testing procedures for these coefficients. The present article contains a description of two mainframe FORTRAN programs that permit the researcher to test hypotheses about PDCCs obtained according to one of four measurement models. One program is for use with coefficients obtained on independent samples; the second is for use with coefficients obtained in a dependent-samples context.
Mathematics Anxiety and Mathematics Avoidance Behavior: a Validation Study of Two Mars Factor-Derived Scales
Authors: D'Ailly Hsiao , Bergering Antony J.
Published: March 2007

Discriminant and concurrent validity of two factor-derived sub-scales, mathematics test anxiety (MTA) and numerical anxiety (NA), of the Mathematics Anxiety Rating Scale (MARS) were tested. Sixty-eight females and 44 males from the pre-service program of the Faculty of Education, the University of Western Ontario, completed the Mathematics Avoidance Behavior Test (MABT), the Test Anxiety Inventory (TAI), and the two MARS factor-derived subscales. A significant difference was found between the correlations of MTA and NA with the emotionality subscale of the TAI for the female group, but not for the male group. MTA scores correlated significantly with the scores on the MABT but the NA did not. Problems in these instruments and the implications for future research were discussed.
Covariance Structure Analysis of a Test of Moral Orientation and Moral Judgment
Authors: Sachs John
Published: March 2007

Covariance structure analysis was used to confirm that the moral orientation and moral judgment subtests of the Moral Development Test (MDT) (Ma, 1987) captured the hierarchical stage structure of moral development predicted by Kohlberg's stage theory of moral development. Furthermore, the simplex ordering between the stage scores of the MDT subtests was shown to be invariant in adolescents and adults across two cultures-British and Hong Kong Chinese. In addition, the structural part of the simplex model for the moral judgment subtest was shown to be invariant across the two cultures. However, the hypothesis of invariance of the structural part of the simplex model across the two cultures for the moral orientation was rejected.
Tukey-Like Pairwise Comparisons among Proportions
Authors: Williams Richard H.
Published: March 2007

A Quick BASIC microcomputer program for conducting Tukey-Like pairwise comparisons on k independent sample proportions is described. It was written on a 386 SX and can accommodate applications involving equal or unequal sample sizes.
A Simplex Fitting Approach to Dimensionality Assessment of Binary Data Matrices
Authors: Roznowski Mary , Humphreys Lloyd G. , Davey Tim
Published: March 2007

A Monte Carlo investigation of simplex fitting as a method of determining the dimensionality of binary data matrices was carried out. The simplex is an index of dimensionality having considerable appeal on a priori grounds. The study was carried out to explore the adequacy of simplex fitting for estimating dimensionality of binary item pools. To achieve this objective, an examination was made of the fit of correlation matrices with known factor structure to a correlation matrix representing a perfect simplex. Results indicated that the simplex fitting method is a viable approach to dimensionality assessment under certain situations. However, simplex fitting breaks down under extreme values of two important parameters. At less extreme levels of these parameters, the simplex fitting method is more effective than are the usual factor analytic dimensionality criteria. Results are discussed within the realm of considering the tenability of the goal of strict unidimensionality and the consequences of failure to assess correctly the dimensionality of a data matrix. The importance of attempting to measure major or dominant factors is also described. Finally, the need for examining whether current methods fail under similar conditions and suggestions for future research involving simplex fitting are discussed.
Atitudes of Suburban High School Students Toward Behaviors Associated With High-Achieving Peers: Development and Validation of the Peer Assessment Scale
Authors: Purcell Jeanne H. , Gable Robert K. , Caillard Florence
Published: March 2007

The primary purpose of the present study was to investigate the acceptance of high school students (Grades 9-12) of the behavioral characteristics associated with high-ability peers. A secondary purpose was to develop an attitude instrument to assess this acceptance, the Peer Assessment Scale (PAS). The procedures used to develop the instrument and the results obtained from the pilot of the instrument in three Connecticut high schools are described. Factor analysis identified the two behavioral characteristics supported in the literature and identified by the judges in the content validity stage: (a) an Academic factor and (b) a Social/Emotional factor. Results indicated that females were significantly more accepting of the behaviors associated with Factors 1 and 2, as were students who reported themselves to be above average in scholastic ability. Although there were no significant differences among females of average and above average ability at each grade level with respect to the social and emotional behaviors associated with high-ability peers, above average males in Grades 10, 11, and 12 were significantly more accepting of the aforementioned behaviors than their above average counterparts in Grade 9.
Perceived Stress among Graduate Students: Development and Validation of the Graduate Stress Inventory
Authors: Rocha-Singh Indra A.
Published: March 2007

This article presents evidence from three samples, one of graduate students at both doctoral and master's level, another entirely of first-year doctoral students, and the other solely of master's students, to assess the psychometric characteristics of a theory-driven measure of perceived stress for graduate students, the Graduate Stress Inventory-Revised (GSI-R). Results of the first study allowed for the evaluation of the original scale, the Graduate Stress Inventory (GSI), and led to a few deletions and improvements in the wording of a significant number of items. It also indicated that the GSI-R possessed moderate to high internal-consistency reliability. Three-factor structures were identified. Results of the second study determined the concurrent validity of the GSI-R using Spielberger's Trait Anxiety scale. The third study showed adequate retest reliability of the GSI-R. The GSI-R is suggested for examining the role of appraised stress in the lives of graduate students.
Differential Prediction of College Grades by Gender and by Ethnicity: A Replication Study
Authors: Young John W.
Published: March 2007

Differential predictive validity in forecasting academic performance in college has been observed for a number of years. A common finding is that the use of a single regression equation generally under predicts the grades of women and over predicts the grades of minority students. This study was undertaken to determine whether differential prediction was evident for a recent cohort of students at a state university. The results confirm that the phenomenon still exists. For women, but not for minority students, the difference in predictive validity appears to be related to the effects of course selection.
The Relationship of Creativity Measures to School Achievement and to Preferred Learning and Thinking Style in a Sample of Korean High School Students
Authors: Kim Junghee , Michael William B.
Published: March 2007

Two major purposes of this study were to ascertain for a sample of 193 11th-grade Korean high school students (92 males and 101 females) the extent to which performance in selected measures of creativity involving both verbal and visual tasks was related to (a) school achievement as revealed by a quantitative indicator (percentage score) and (b) the expressed preference for a given learning and thinking style as revealed in a standardized measure (Style of Learning and Thinking by Torrance) intended to portray left-brain, right-brain, or an integrated left-brain right-brain function. A secondary purpose was to identify possible gender differences of Korean students in the variables under study. The following conclusions became evident. First, measures of creativity translated from the Torrance Tests of Creative Thinking show little, if any, relationship to school performance. Second, Korean high school females may be expected to exhibit higher average levels of performance on creativity tests than will their male counterparts. Third, irrespective of gender, but especially in the instance of females, those students classified as showing a learning and thinking style preference hypothesized to be associated with right-brain dominance are likely to earn higher scores on creativity measures than will those students classified as displaying a learning and thinking style preference hypothesized to correspond to either a left-brain dominance or an integrated-brain dominance.
Psychometric Properties of the Life Role Salience Scales: Some Construct Validation Evidence from a Sample of Nonprofessional Women
Authors: Campbell Kathleen M. , Campbell Donald J.
Published: March 2007

For work-family research to progress satisfactorily, investigators need questionnaire instruments that possess adequate construct validity. The Life Role Salience Scales (LRSS) displayed promising psychometric characteristics in the initial normative samples of college students and professional employees. This study provides additional construct validation evidence for the LRSS within a sample of 94 nonprofessional working women. Three kinds of information are examined: (a) comparisons with the original sample in terms of means, intercorrelations, and reliabilities; (b) effects of actual role status on the various life role scales; and (c) evidence of scale convergence and divergence with a selected set of appropriate variables. Overall, with the exception of this study's inability to reproduce the "value" and "commitment" distinctions found in the original analyses, the results of this examination offer reasonable evidence supporting the scales' construct validity and provide another normative base against which future research can be compared.
Composite Reliability in Structural Equations Modeling
Authors: Bacon Donald R. , Sauer Paul L. , Young Murray
Published: March 2007

Two composite reliability measures, coefficient alpha and coefficient omega with unit weights (otherwise known as construct reliability), are commonly used in structural equations modeling. However, a third measure, omega with unequal weights, is more theoretically appropriate. The potential for bias in reliability estimation and for errors in item selection when alpha or unit-weighted omega are used are explored under a variety of simulated conditions. The results suggest that composite reliability may be used as an assessment tool, but should not be used as an item selection tool in structural equations modeling.
Unicorn: A Program for Transforming Data to Approximate Normality
Authors: Allison David B. , Gorman Bernard S. , Kucera Elizabeth M.
Published: March 2007

Unicorn, a BASIC computer program that automates the Box-Cox transformation, is described. Unicorn reads free field ASCII data files, is completely interactive, and is user friendly. Unicorn can handle files with or without missing data. Descriptive statistics and tests of normality are provided for each variable in untransformed format. Statistics include the first four moments of the distribution, the third and fourth L-moments, the Kolmogorov-Smirnov test, and D'Agostino et al.'s tests of normality. The user is then offered a choice of minimizing skewness or departures from normality overall. The optimal transformation is then found and descriptive statistics and tests of normality are provided for the transformed data. A new ASCII data file is written with transformed data. This new data file is then available for further analysis.
Factor Analytic Study of Interracial Similarity for the Supervisory Behavior Description Questionnaire
Authors: Allen William R.
Published: March 2007

To examine interracial similarity of the leadership dimensions Initiating Structure and Consideration, a factor analysis was performed on the responses of 224 Black and White male naval recruits to the Supervisory Behavior Description Questionnaire. Coefficients of factorial congruence were computed between the factor structures of two-factor solutions for Black and White subsamples. As hypothesized, no differences were found. The leadership dimensions were found to be stable with respect to race.
Connotatively Consistent and Reversed Connotatively Inconsistent Items are Not Fully Equivalent: Generalizability Study
Authors: Chang Lei
Published: March 2007

This article redefines what has been referred to as "negatively worded items" in the literature. The new term—"connotatively inconsistent items"—is more nearly accurate because it has a broader base for generalization. Using generalizability theory with a sample of 102 graduate students, the study showed that connotatively consistent and reversed connotatively inconsistent items were not fully equivalent.
Development and Initial Validation of the Quick Discrimination Index (QDI)
Authors: Ponterotto Joseph G. , Burkard Alan , Rieger Brian P. , Grieger Ingrid , D'Onofrio Amelio , Dubuisson Anne , Heenehan Margaret , Millstein Beth , Parisi Melinda , Rath Joseph F. , Sax Garrin
Published: March 2007

A series of empirical studies was conducted to develop and validate the Quick Discrimination Index (QDI), a 30-item, Likert-type self-report inventory. The QDI measures attitudes toward racial diversity (multiculturalism) and women's equality and is appropriate for late adolescents and adults. The instrument has applicability across racial/ethnic groups. Exploratory factor analyses examining both orthogonal and oblique rotations indicate that the QDI is best conceptualized as a tridimensional measure of attitudes. Three oblique factors emerged: (a) general (cognitive) attitudes about racial diversity and multiculturalism, (b) affective attitudes regarding racial diversity related to one's personal life, and (c) general attitudes regarding women's equity issues. The QDI total score and subscale scores were found to be internally consistent, to be stable over a 15-week test-retest period, and to have promising indexes of face, content, construct, and criterion-related validity. A confirmatory factor analysis examining competing factor solutions supported the three-factor oblique extraction.
A Comparison of the Rasch Separate Calibration and between-Fit Methods of Detecting Item Bias
Authors: Smith Richard M.
Published: March 2007

The objective of this study is to compare two methods of detecting item bias within the framework of Rasch measurement. To accomplish this objective, it was first necessary to arrive at a clear understanding of the definition of bias as commonly used with Rasch measurement models. The comparison between the two methods was based on the Type I error rates in data that contain no bias and the power of the statistics to detect item bias when bias is present. The variables manipulated in this study included sample size, magnitude of bias, number of biased items present on the tests, and mean differences in the ability of the reference and focal groups. The two methods compared were the separate calibration t-test approach proposed by Wright and Stone in 1979 and the common calibration between-fit approach proposed by Wright, Mead, and Draba in 1976.The results indicate that the arbitrary use of bias levels such as +2 can result in the misidentification of biased items.
Evaluating the Structural Validity of Measures of Hierarchical Models: An Illustrative Example Using the Social Problem-Solving Inventory
Authors: Christiansen Neil D. , Lovejoy M. Christine , Szymanski Jeff , Lang Alison
Published: March 2007

The usefulness of examining the structural validity of scores on multidimensional measures using nested hierarchical model comparisons was evaluated in two studies using the Social Problem-Solving Inventory (SPSI). In Study 1, the authors systematically explored the factor structure of the measure using hierarchical confirmatory factor analysis, contrasting the results with past research using more traditional approaches. In Study 2, the authors developed and validated a shorter version of the SPSI based on the most promising items identified in the first study. Results from Study 2, using an independent sample, confirmed the stability of the structure and offered construct-related validity evidence for the new scales. Taken together, the results suggest that the modest fit of the SPSI measurement model reported in past research is principally the result of the inclusion of psychometrically poor items rather than a problem with the conceptual model itself. Implications are discussed as related to the organization of social problem-solving dimensions and strategies for evaluating structural validity.
The Fields Teaching Tests
Authors: Sax Gilbert
Published: March 2007

Using various Latin square and incomplete Latin square formats, the Fields test formats provide a novel way of presenting tests to students using machine scoreable answer sheets that can be item analyzed. These formats are based on Pressey's early work on the use of "teaching machines" and can be developed for most classes. Items can be constructed for students at the initial stages of learning to help them acquire knowledge or they can be used to measure the attainment of course objectives.
The Rasch Model Plus Guessing
Authors: Weitzman R. A.
Published: March 2007

The need for equating is one of the principal reasons for using an item response model rather than the classical model to guide test construction. Use of the Rasch item response model in test construction makes equating especially easy. The Rasch model, however, does not have a guessing parameter, whereas most tests that require equating contain multiple-choice items subject to guessing. This limitation of the Rasch model has led many test developers to use a three-parameter model that accounts for guessing, though at the expense of increased difficulty in equating. Despite the Rasch model's limitations with respect to guessing, some test developers still use it in multiple-choice testing. This article examines the use of the Rasch model in multiple-choice testing, particularly with respect to the problems of goodness of fit and equating. Although goodness of fit turns out to be a problem small enough to ignore, modification of the Rasch model to account for guessing may be necessary to ensure accurate equating.
The Role of Item Feedback in Self-Adapted Testing
Authors: Roos Linda L. , Wise Steven L. , Plake Barbara S.
Published: March 2007

Previous research has shown self-adapted testing to be a promising alternative to computerized adaptive testing. The present study looked at the importance of item feedback in self-adapted testing. Computerized adaptive tests and self-adapted tests were compared under both feedback and no-feedback conditions. The self-adapted tests yielded higher test performance and lower anxiety than the computerized adaptive tests regardless of feedback condition. These findings indicate that item feedback is not necessary for the score differences between self-adapted testing and computerized adaptive testing to be ralized.
How Reliable are TOEFL Scores?
Authors: Wainer Howard , Lukhele Robert
Published: March 2007

The reliability of scores on four forms of the Test of English as a Foreign Language (TOEFL) was estimated using a hybrid IRT model. It was found that there was very little difference between their overall reliability when the testlet items were assumed to be independent and when their dependence was modeled. A larger difference in reliability was found when test sections were analyzed individually. Then we found as much as a 40% overestimate in reading comprehension testlets, with the longer testlets of the newest form of TOEFL showing the most local dependence. The listening comprehension testlets exhibited much less local dependence. We also found that the test was unidimensional enough for the use of univariate item response theory (IRT) to be efficacious, and that the reading comprehension testlets showed essentially no differential functioning by sex.
A Psychometric Study of Three Coping Measures
Authors: Cook Stephen W. , Heppner P. Paul
Published: March 2007

This article examines the psychometric properties of three coping inventories: the Coping Inventory for Stressful Situations, the COPE, and the Coping Strategies Inventory. First, the stability of the factor structure for each inventory was examined using confirmatory factor analysis. Second, confirmatory and exploratory factor analyses were used to ascertain the common constructs underlying these coping scales. The results indicate preference for particular factor structures for each coping measure, although none of the factor structures examined provided a strong fit with data in this study. Three general factors were found across the three instruments: Problem Engagement, Avoidance, and Social/Emotional. These results suggest more complex conceptualizations of coping.
Scheffe-Marascuilo Comparisons among Independent Binomial Samples
Authors: LeBlanc William G. , Williams Richard H.
Published: March 2007

A large-sample technique attributable to Leonard Marascuilo, which is based on Henry Scheffe's well-known multiple comparison procedure, was programmed with the SAS System. The focus was on comparisons among independent binomial samples. As in Scheffe's "data snooping" analytic method, the comparisons can be planned or post hoc, they can be simple or complex, and they need not be orthogonal, but none of them will be statistically significant unless the omnibus statistic, which in this case is chi-square rather than F, is statistically significant. This SAS program can be applied when thedesign is not balanced.