bluuebunny/crossref_metadata_2025 huggingface dataset:
Biweight Estimates of Latent Ability
Authors: Mislevy Robert J. , Bock R. Darrell
Published: March 2007

Maximum likelihood estimates of subjects' abilities in item response curve models are overly sensitive to disturbances that are common in educational testing, such as carelessness and random guessing. Recently Waller (1974) and Wainer and Wright (1980) have suggested more robust methods of estimation. This paper presents an alternative estimator, based on the principle of Tukey's biweight—a robust estimator of location. Among the advantages of the biweight estimator of latent ability are the following: (1) the nature and extent of disturbances are not assumed to be the same for all subjects; (2) each response is utilized in proportion to its apparent value; (3) the biweight estimate agrees with the maximum likelihood estimate when no disturbances are present; and (4) computation requires only a minor modification of the Newton-Raphson method commonly used to obtain maximum likelihood estimates of ability. The biweight estimator is demonstrated with artificial data, and shown to produce smaller meansquared errors than the maximum likelihood estimator even in the presence of only slight disturbances.
The Effects of Guessing and Item Dependence on the Reliability and Validity of Recognition Based Cloze Tests
Authors: Baldauf Richard B.
Published: March 2007

Matching doze and multiple-choice doze tests of elementary level reading comprehension have demonstrated promising construct and concurrent validity. However, their formats include guessing and, in the case of matching cloze, item dependence effects. This study used a Monte Carlo design to examine how these effects influence test characteristics and student scores. First, a true score test with six levels of difficulty was constructed. Then, two versions of matching doze and three of multiple-choice doze results were generated for each level of difficulty of the true score data by applying the doze assumptions of random guessing and item dependence. Although validity for all five doze variants was high, multiple-choice doze had significantly lower reliabilities than did the true score equivalents. Item dependence found in matching doze had little or no effect on the characteristics of these tests.
Construct Validation of Imaginative Assessment of Family Orientation and Status Perception: Theoretical and Methodological Implications for the Thematic Apperception Test
Authors: Richardson Virginia , Partridge Susan
Published: March 2007

In two different investigations constructs of family orientation (including marital perception) and status perception were exposed to construct validation procedures involving a sample of 1,428 respondents randomly selected from two larger representative national samples of American adult men and women utilized in a 1957 study and in a replication of that study in 1976. Data were based upon a thematic apperceptive procedure in which projective stories were coded for perceptions of family and marital relations, interpersonal conflict, and status differences. With selected variables from the coding and from the questionnaire, these concepts were validated according to two independent procedures. Support for face validity was obtained only with demographic variables, and in construct validity the strongest relationships were observed with variables from the projective measure rather than from the questionnaire. Theoretical issues pertaining to the meaning of the Thematic Apperception Test and to the advantages and disadvantages of different methodological approaches to validity are discussed. Particular attention is given to the influence of picture stimuli in the interpretation of results.
A Study of the Criterion-Related Validity of Crites' Career Maturity Inventory
Authors: Alvi Sabir A. , Khan Sar B.
Published: March 2007

A study of the criterion-related validity of the Crites' Career Maturity Inventory (CMI) was undertaken in a secondary school. Success and satisfaction in a work-study program and grade-point average were used as the criterion measures. Correlational analyses provided generally promising results on the validity of the Competence Test in the CMI.
A Computer Program for Pattern Analysis of Rod-and-Frame Tests
Authors: Haller Otto , Edgington Eugene S.
Published: March 2007

Pattern analysis for rod-and-frame tests has been developed to identify a subject's test score patterns in relation to hypothesized patterns. This task can be done by calculating p values as a measure of strength of a relationship between hypothesized patterns and test data. The p values are obtained by means of a special randomization correlation test. A FORTRAN program for this test is briefly described.
Approximating the Probability of Identifying the Most Effective Treatment for the Case of Normal Distributions Having Unknown and Unequal Variances
Authors: Wilcox Rand R.
Published: March 2007

When comparing k normal populations, an investigator might want to know the probability that the population with the largest population mean will have the largest sample mean. Put another way, what is the probability of correctly identifying the most effective treatment? The paper describes and illustrates methods of approximating this probability when the variances are unknown and possibly unequal. The results described here can also be used to measure the extent to which the populations differ for one another.
Factor Structure on the Semantic Differential as a Function of Method of Analysis
Authors: Piotrowski Chris
Published: March 2007

Researchers and critics of the semantic differential technique have recently cautioned about the problem of concept-scale interaction. The present study compared the factor structures obtained when the same data were factor analyzed in several ways: (a) for the total sample and by sex for collapsed concepts and (b) by individual concept for the total sample, by sex, and for internal and external locus of control groups. Three concepts (HURRICANE, MY CITY, and MYSELF) were analyzed which yielded 18 factor matrices. The semantic differential instrument was composed of 19 scales purporting to measure the dimensions of Evaluation, Potency, and Activity. In 16 of the 18 factor matrices, four of the five scales (fair-unfair, friendly-unfriendly, good-bad, and pleasant-unpleasant) expected to measure Evaluation had loadings of 1.301 or higher on Factor I. There was moderate consistency in scales which comprised the Potency dimension for several of the 18 analyses. There was little, if any, consistency in scale composition for the Activity dimension. If these findings can be generalized to other populations and concepts, it appears that the method of analysis, whether by concept or by population, is relatively unimportant for the Evaluation dimension (Factor I), but very important for other "meaning" dimensions.
Multitrait-Multimethod Analysis: Distinguishing between Items and Traits
Authors: Marsh Herbert W.
Published: March 2007

Multitrait-multimethod analysis is designed to assess convergent and discriminant validity, and to also detect method/halo effects. However, the distinction between discriminant validity and method/halo effect is ambiguous when the relationship between the observed measures and underlying traits is unclear. The purpose of this study is to compare MTMM analyses performed on items and factor scores derived from the items. MTMM analyses of the individual items indicated modest support for convergent and divergent validity, and a substantial method/halo effect. The same analyses performed on factor scores showed substantial increases in convergent and divergent validity, and a substantial decrease in the method/halo effect. Based upon this demonstration, researchers are encouraged to conduct a preliminary factor analysis before analyzing MTMM data whenever there is doubt about the underlying trait structure.
Dimensionality of the Attitudes toward Disabled Persons Scale Revisited
Authors: Hafer Marilyn , Wright W. Russell , Godley Susan H.
Published: March 2007

Data from the responses of 104 medical and rehabilitation students to the Attitudes toward Disabled Persons Scale-Form B (ATDP-B) were factor analyzed using a principal components solution, with particular attention to the problem of the number of factors to retain. Bartlett's test of the residuals was significant after the extraction of one factor, suggesting a multifactor solution. Conversely, examination of eigenvalues using the scree test, and a comparison of eigenvalues of the real data matrix with those extracted from a random numbers data matrix of the same dimensions support the unidimensionality of the ATDP-B.
Validity of Srinakharinwirot University Scholastic Aptitude Tests
Authors: Boonruangrutana Samrerng
Published: March 2007

The study explored the validity of a battery of scholastic aptitude tests of Srinakharinwirot University in predicting grade point averages (GPAs) of students in natural science and social science programs. The tests provided measures of (1) verbal ability (2) numerical ability and (3) reasoning ability which included subtests involving (a) classification (b) inference, and (c) association. The samples consisted of 82 natural science and 212 social science students. The multiple correlation between each of 7 GPA measures and a weighted composite of 5 aptitude tests for 82 students in a natural science program varied between .32 and .48. The most valid predictor for this group was the classification subtest. For the 212 students in the social science program, the corresponding multiple correlations ranged between .14 and .33. The most valid predictor for this group was the verbal ability test.
A Confirmatory Factoring of the California Psychological Inventory
Authors: Bernstein Ira H. , Garbin Calvin P. , McClellan Pamela G.
Published: March 2007

Two matrices of intercorrelations among the scales of the California Psychological Inventory (CPI) were subjected to oblique multiple group factor analysis. In contrast to previous studies, this approach allows a direct test of the factor structure implicit in its standard use. We found this structure to provide a satisfactory representation of the data as long as one realizes that the resulting six factors are correlated and contain one dependency and that Scales Wb and Cm fulfill their postulated roles somewhat more poorly than the remaining scales.
Towards a Taxonomy of Verbal Tests Based on Logic
Authors: Colberg Magda
Published: March 2007

This paper presents a discussion of the problems inherent in verbal test taxonomies which are not based on the schematic domain of logic. This discussion is made in the context of syntactically complex tests such as reading comprehension and inference. A suggested structure for a logically-constructed taxonomy, which has been developed for use in a Federal testing program, is delineated.
Validity and Reliability of the Vowel Matching Test
Authors: Perney Jan , Morris Darrell
Published: March 2007

Validity and reliability evidence is presented for the Vowel Matching Test (VMT), an instrument that measures primary grade children's ability to discriminate medial vowel sounds. The VMT consists of a series of seven picture sets, each set containing a stimulus picture and three item pictures. Based on the responses of 43 first-grade pupils, the results indicated that the VMT correlated .76 with a word recognition test. It exhibited an internal consistency coefficient of .78. The VMT may be useful for researchers studying early reading acquisition or for learning disability specialists diagnosing children referred for reading problems.
Reliability and Factorial Validity of the Artes De Lenguaje
Authors: Powers Stephen , Paz Estanislado , Escamilla Kathy
Published: March 2007

A total of 91 Spanish-speaking first-grade pupils was administered the Artes de Lenguaje (ADL)—a Spanish criterion-referenced test of language arts. Reliability analyses indicated that three of the four subscales were adequate. A principal factors analysis of the intercorrelation matrix of the nine objective scores revealed two main factors. The findings provided some support for the reliability and validity of the ADL. Several limitations of the instrument are discussed.
The Development and Validation of an Instrument to Measure Student Orientation to Humanistic Instructional Values
Authors: Shapiro Stewart B.
Published: March 2007

IN an attempt to identify the essential components in humanistic instruction, a content analysis of the writings of 40 well-known and representative humanistic educators yielded 15 major operating values. An interrater index of agreement of .83 was found. Preliminary construct validity on two of the 15 variables was demonstrated in that a sample of Master of Arts (MA) students in Confluent Education (involving a humanistic orientation) at the University of California at Santa Barbara (UCSB) showed significantly higher scores than did other MA groups of comparable ability and educational background. In the current study all 15 variables were measured in two 135-item equivalent forms A and B of the Orientation to Learning (OTL) scale. Predictions were that Confluent Education students would score highest, that Counseling Psychology students would fall at an intermediate level, and that three remaining MA and Credential groups would score lowest. Further, to establish external validity, Forms A and B were correlated with the N plus F subscales (NF Temperament) on the Kiersey Temperament Sorter instrument and with the Concrete plus Reflective subscales (Divergent Learning Style) on the Kolb Learning Style Inventory (LSI). A sample of 99 students from five programs was randomly assigned forms A and B of the OTL questionnaire. Reliabilities for Forms A and B of the OTL ranged from .93 to .95. The rank order of student groups on the variables studied was as predicted. There was a highly significant main effect associated with group differences, (p < .0001). Correlations with the NF temperament (Kiersey) and the Concrete learning subscale (LSI) were statistically significant. It was concluded that the instrument is apparently reliable and that it has promising construct and external validity.
An Ordering-Analytic Approach to the Study of Group Differences in Intelligence
Authors: Bart William M. , Rothen Wolfgang , Read Sherry
Published: March 2007

In the past, studies of group differences in intelligence have primarily used summative test scores and group means as a basis for analysis. This type of analysis can lead to the use of comparative, evaluative terms such as superiority and inferiority of groups. The authors propose an alternative way of studying group differences based on ordering analysis which uses item hierarchies as a basis of comparison between two groups. The subjects were 181 sets of black twins and 223 sets of white twins of elementary school age from the Philadelphia area. Subjects were administered the Raven's (1958) Standard Progressive Matrices Test, Subtests A, B, C, and D. Separate item hierarchies resulting from the use of ordering analysis were generated for each subtest for each of the following groups within the sample: blacks, whites, males, females, monozygotic twins, dizygotic twins, and low and medium SES subjects. The item hierarchies were then compared with respect to the independent variables of race, sex, zygosity, and socioeconomic status by using the Baker-Hubert inference procedure for ordering analysis. Among the findings were that blacks and whites and males and females had similar item hierarchies for complex items but different item hierarchies for simpler items. The implications of this analysis are discussed.
Correcting Doubly Truncated Correlations: An Improved Approximation for Correcting the Bivariate Normal Correlation when Truncation has Occurred on Both Variables
Authors: Alexander Ralph A. , Carson Kenneth P. , Alliger George M. , Carr Linda
Published: March 2007

Although the problem of correcting correlation coefficients that have arisen from range-restricted distributions has received a great deal of attention in the psychological testing and measurement literature, very little of that literature has dealt with the problem of restriction on both the independent (X) and dependent (1) variable. Wells and Fruchter (1970) presented an approximate correction in such situations. This article reports and improved approximation. This new approximation is recommended for all situations where restriction of range is suspected on either variable or on both X and Y.
The Reliability and Classification Stability of the Learning Style Inventory in Corporate Settings
Authors: Veres John G. , Sims Ronald R. , Shake Leasa G.
Published: March 2007

The Revised Learning Style Inventory (LSI II) was examined for internal consistency, test-retest reliability and stability of the four classifications resulting from the scores of subjects employed in industry. The results from this study were compared to the results of similar research conducted on a student sample (Sims, Veres, Watson, and Buckner, 1986). The internal consistency of the industrial sample was comparable to that of the students. Test-retest indices and classification stability, however, remained low for the industrial sample, a fact failing to support the Sims et al. hypothesis that the learning styles of students were not fully developed and thus contributed to observed instability. The results of this preliminary study in industry indicate that problems noted with students continue to operate in the assumably "more stable" industrial setting. Further research is discussed to identify the source of LSI instability.
Parameter Estimation for Peer Grading under Incomplete Design
Authors: Wilson Hoyt G.
Published: March 2007

Methodology developed in the paper supports administration and analysis of peer grading exercises. The technique is especially useful for the incomplete design case, wherein each grader does not grade each paper. The procedure produces simultaneous estimates of (a) bias of each grader, (b) "true" grade for each paper, and (c) relative consistency of each grader. The approach is based on a simple linear statistical model, augmented by a zerosum constraint on grader bias parameters. Ordinary least squares (OLS) estimates are computed and then refined via generalized least squares (GLS) estimation. Case weights for the GLS are based on consistency patterns of the graders, as revealed in the OLS step. The methodology is applied to artificial data to demonstrate its effectiveness. The methodology applies to any situation wherein multiple raters rate multiple ratees on an additive scale.
The Factor Structure and Internal Consistency of the Self-Concept and Motivation Inventory: What Face would you Wear? Preschool/Kindergarten Form
Authors: Davis Todd M. , Sellers Patricia A. , Johnston John M.
Published: March 2007

The Self-Concept and Motivation Inventory: What Face Would You Wear? Preschool/Kindergarten Form has the potential to be of use in measuring the academic self-concept of preschoolers. This study sought to determine if the theoretical, three-factor structure of the SCAMIN could be recovered in a state-wide sample of kindergarten students. In 1986, 5742 kindergarteners from Tennessee schools participating in the Reduced Pupil/Teacher Ratio Project were given the Preschool/Kindergarten form of the SCAMIN. The sample was drawn from 42 school districts in all geographic regions of Tennessee and represented a mix of inner-city, urban, rural, and suburban schools. The intercorrelation matrix of the 24 SCAMIN items was analyzed by the principal components method and extracted factors were rotated to a varimax solution. An initial analysis suggested the presence of an atheoretical factor, and two items which appeared to be unrelated to any obtained factor. Subsequent refactoring of the SCAMIN resulted in the successful recovery of the expected three factor structure. Cronbach's alpha, for the scales Academic Self-Concept; Achievement Investment; and Achievement Needs were .666, .599, and .598, respectively. The results of this factor analysis of the Early Preschool/Kindergarten Form of the SCAMIN suggest both strengths and weaknesses in the factorial composition of the 24 SCAMIN items. Users of the SCAMIN are cautioned against a naive application of this instrument's scales.
Psychometric CHaracteristics of Scores on a Patient Management Problem Test
Authors: Grosse Martin E. , Wright Benjamin D.
Published: March 2007

Total scores on a patient management problem (PMP) test can be divided into two subscores-one based on all options keyed select; the other, on all options keyed omit. A pervasive feature of the component scores, across a variety of examinations studied, is that they are correlated negatively. This negative correlation is reflected in reduced discrimination indices and reliability for the total test scores. The implications of this finding for previous research with PMPs are reviewed.
Program Facstrap: A Program that Computes Bootstrap Estimates of Factor Structure
Authors: Thompson Bruce
Published: March 2007

In this paper program FACSTRAP is described. The program computes factor analytic results from either correlation or variance-covariance matrices. Pooled estimation procedures are accomodated by rotating each sample result into a common factor space. The program is useful for resolving numbers of factors questions, for estimating structure coefficients, and for estimating the invariance of results across samples.
Parent as a Teacher Inventory: Factor Analyses for Fathers, Mothers, and Teachers
Authors: Thornburg Kathy R. , Gray Mary McPhail , Ispa Jean M.
Published: March 2007

Strom (1974) developed the Parent as a Teacher Inventory (PAAT) to measure parents' feelings and beliefs regarding interaction with their young children. Parents indicate their level of agreement with 50 Likert-type statements. A factor analysis was performed on the responses of 615 parents of preschool children. In addition, items were slightly re-worded and given to 267 early childhood teachers. Results indicated that 33 of the 50 PAAT items are included in 5 separate factors for fathers; 29 items are included in 5 factors for mothers; and 35 items are in 5 factors for teachers. Next, two techniques comparing factor structures were employed to determine if this instrument could be used in a comparative manner among fathers, mothers and/or teachers. These analyses strongly support the idea of factor congruence across the three samples.
The Measurement of Self-Concept in an Employment Setting
Authors: Crowder Betty , Michael William B.
Published: March 2007

A rationale is described for the measurement of self-concept in the employment setting that involves the translation of six postulated constructs into six factor scales entitled Level of Aspiration, Anxiety, Job Interest and Satisfaction, Leadership and Initiative, Identification versus Alienation, and Job Stress. An experimental form of a test entitled Dimensions of Self-Concept, Form W with 30 self-report items for each of the six factor scales was administered to a sample of 201 employees in a mid-sized division of approximately 700 individuals working in a major electronics/computer company. Internal-consistency estimates of reliability varied between .84 and .91 for the six scales. Approximately 75.6% of the items registered at least as high a correlation with the total score of the factor scale of which they were intended members as with the total score on any of the other remaining five factor scales. An exploratory factor analysis revealed that four of the hypothesized constructs received empirical support in terms of sets of five subtests from the factor scales defining quite clearly four factor dimensions. The 10 subtests from the Level of Aspiration and Job Interest and Satisfaction factor scales fused to describe one factor dimension-an outcome consistent with the observed correlation of .76 between the two factor scales. Attempts already are underway to construct a shorter form with 20 and subsequently with 15 items per factor scale without appreciable loss of reliability but with substantially increased differential validity among the factor scales.
The Construct Validities of Some Group Tests of Intellectual Development
Authors: Hacker R. G.
Published: March 2007

Four Piagetian group tests called the Science Reasoning Tasks (SRT) were administered to 201 subjects. For each test, a unidimensional latent trait analysis confirmed a single factor hypothesis. Comparison with a similar analysis of Lawson's Classroom Test of Formal Reasoning (CTFR) led to the conclusion that the SRT's succeeded where the CTFR failed, in providing a valid measure of the unitary formal reasoning construct. This success was attributed to aspects to test format.
A Comparison of Two Equipercentile Equating Methods for Common Item Equating
Authors: Harris Deborah J. , Kolen Michael J.
Published: March 2007

Two general procedures have been suggested for equating form X to form Y when an internal anchor test V with nonequivalent groups is used. In one method, X is equated to V by using equipercentile equating on one group of examinees. Then V is equated to Y by employing equipercentile equating on the other group of examinees. From these two equatings one can arrive at an equating of X to Y. This procedure is referred to in this paper as the Design V (Angoff, 1984) method. The second method is referred to as the frequency estimation method. The frequency estimation procedure requires consideration of the joint X, V frequency distribution for one examinee group and the joint Y, V frequency distribution for the other examinee group. The Design V method requires consideration of only the marginal distributions. Braun and Holland (1982, pp. 39-42) indicated that there are theoretical problems with the Design V method. However, the data requirements for the Design V method are many fewer than those for the frequency estimation method, and the Design V method is computationally much less burdensome. Computer storage requirements and computational burden are important considerations in the development of transportable computer systems for equating. The purpose of this study was to compare results for the two methods to determine whether or not they produce similar results in actual equatings. The results indicated that in the examples studied the two methods could not be considered interchangeable. These results have practical implications for the development of transportable computer systems for equating in practical settings.
The Construct and Concurrent Validity of the Social Dimension of the Brown Locus of Control Scale
Authors: Brown Ric
Published: March 2007

This paper presents data regarding the reliability and validity of a new locus of control scale. In addition to items measuring internality and powerful others externality, the scale has a conceptually new dimension referred to as external social.
Criterion-Related Validity of Composite Scores Based on the Highest (or Smallest) Observations
Authors: Huynh Huynh
Published: March 2007

Under the assumption of normality, a formula is derived for criterion-related validity of a partial composite score based on the highest (or lowest) of several equivalent observations. This partial composite score has higher validity than each single observation. However, it has less validity than the composite score based on all observations.
Factors Related to Dropping Out of School in an Incarcerated Population
Authors: Ahrens Julia A. , Evans Ronald G. , Barnett Robert W.
Published: March 2007

This study examined 1757 incarcerated felons to determine personality, social history, and intellectual characteristics associated with dropping out of school. A stepwise discriminant function analysis compared junior high and high school dropouts with high school completors on variables including the Wide-Range Achievement Test, the Multidimensional Aptitude Battery and the Millon Clinical Multi-axial Inventory. A significant discriminant function differentiated the three groups on reading level, substance abuse history, age, verbal IQ, and the personality factors of dependency and borderline personality. Results validate the use of the WRAT and MAB for incarcerated populations, and identify personality factors to be considered in rehabilitative efforts with felons who have not completed high school.
Factor and Cluster Analyses of the Special Assignment Battery
Authors: Urban Gloria D. , McDaniel Michael A.
Published: March 2007

The Special Assignment Battery (SAB) is an interest and biographical data instrument developed to meet personnel screening needs of the United States Marine Corps and Navy. Previous research on the SAB has focussed on the empirical keying of the instrument for the prediction of performance as a recruiter or drill instructor. Although both useful and well-conducted, past research on the SAB has done little to explicate the construct structure of the instrument. The present study fills this research gap. The construct structure of the SAB can be summarized with 8 factors and 16 subordinate clusters. This research also serves as a methodological case study in the value of exploring construct structure through multiple analysis methods.
The Use of Classical and Rasch Latent Trait Models to Enhance the Validity of Affective Measures
Authors: Gable Robert K. , Ludlow Larry H. , Wolf Marian B.
Published: March 2007

The purpose of this study was to compare the utility of the information yielded by the classical and latent trait psychometric models employed to examine the psychometric qualities of the School Situation Survey (SSS) (Helms and Gable, 1989), a 34-item attitude scale that assesses four sources and three manifestations of school-related stress. The first analysis employed classical principal component analyses followed by oblique rotations and was applied to data collected from a sample of 1111 students in Grades 5, 7, and 9. The second approach utilized a Rasch rating scale model and analyzed SSS data from 1958 students in Grades 6, 7, and 8. Practical aspects of instrument development including (a) lack of adequate variable definition and (b) the use of item-fit and person-fit statistics to reveal item content ambiguity were presented. In general, it was concluded that factor analytic procedures, while necessary, may not provide sufficient support for the adequacy of variable definition.
Management Selection by Multiple-Domain Assessment: I. Concurrent Validity
Authors: Hakstian A. Ralph , Woolley Ross M. , Woolsey Lorette K. , Kryger Barbara R.
Published: March 2007

A large-scale concurrent validity study is described in which 321 first-level management employees in a Canadian provincial telephone company were given a comprehensive assessment battery and were rated on their work performance. Measures from five assessment domains-cognitive abilities, personality/motivational traits, administrative skills, biodata, and supervisory judgment were administered in one-day assessment sessions. Independent assessments of 12 work-performance appraisal dimensions were provided by 165 higher-level supervisors of the 321 participants, using a combination of behaviorally anchored rating scales and behavioral observation scales. The assessment domains were examined individually as to their predictive efficacy, and simple composites of measures from several domains were correlated with the criterion appraisal dimension scores. Concurrent validity coefficients obtained for all 12 criterion dimensions and for an overall management performance criterion ranged from .36 to .56 for women and from .33 to .51 for men.
The Effect of Negation and Polar Opposite Item Reversals on Questionnaire Reliability and Validity: An Experimental Investigation
Authors: Schriesheim Chester A. , Eisenbach Regina J. , Hill Kenneth D.
Published: March 2007

This research was concerned with the effect of item wording on questionnaire reliability and validity. The subjects were 280 business undergraduate students who read a scenario describing a hypothetical leader's behavior and then completed one of four different questionnaires to describe that leader. Comprising the experimental treatments, the questionnaires included four different types of items: regular (e.g., "I am happy"), polar opposite (e.g., "I am sad"), negated polar opposite (e.g., "I am not sad"), and negated regular (e.g., "I am not happy") items. The results indicated significantly lower coefficient alpha internal-consistency reliabilities for the polar opposite and negated polar opposite items as compared with those for the regular and negated regular items. Using accuracy scores, one-way analyses-of-variance and posthoc directional t-tests showed the same results for validity of measurement. Implications for future questionnaire development and research are briefly considered.
Content Validation of Teacher Subject Matter Test Ratings of Knowledge and Skill Statements by Teachers vs Teacher-Trainers
Authors: Lavely Carolyn , Berger Neal , Blackman Joseph , Follman John , Kromrey Jeff
Published: March 2007

An investigation was conducted of differences between ratings provided by Florida practicing public school teachers and teacher trainers on knowledge and skill statements used in the development of teacher subject matter knowledge tests for initial teacher certification in the fields of (a) elementary education, (b) English,(c) gifted, and (d) specific learning disability. Respondents rated each statement on 5-point Likert scales on three dimensions: (a) job relatedness, (b) frequency of use, and (c) importance for initial certification. Surveys for each of the four fields were sent to Florida practicing teachers and to teacher training faculty. A two-stage cluster PPS sampling yielded eight response rates which ranged from 41% to 63% across the four fields. Statistically significant differences on 29 of the 60 factor comparisons were obtained between the two major group of raters (teachers vs teacher-trainers). Generally, teacher trainers registered higher ratings than did practicing teachers on all variables, especially in English.
Use of an Inclusive Option and the Optimal Number of Options for Multiple-Choice Items
Authors: Crehan Kevin D. , Haladyna Thomas M. , Brewer Britton W.
Published: March 2007

This study examined the validity of two item-writing rules in the design of test items: (a) the desirable number of options for a multiple-choice test item and (b) use of the inclusive none of these option. An experimental repeated measures design found that items with three options were more difficult than those with four options and items employing the none of these option were more difficult than those not using this inclusive option format. Neither format manipulation affected item discrimination. Therefore, evidence allows no recommendation for the none of these option but suggests an advantage for multiple-choice items with fewer than the traditional four or five options.
Comments on the Measurement of Halo
Authors: Fisicaro Sebastiano A. , Vance Robert J.
Published: March 2007

The most frequently used measures of halo are based on interdimension correlations (the correlation, or r, measure) or within-ratee variability across dimensions (the standard deviation, or SD, measure). Pulakos, Schmitt, and Ostroff argued that the r measure is conceptually appropriate and demonstrated that the SD measure does not always yield results consistent with the r measure. They therefore concluded that the SD measure should not be used. This article critiques the r measure, responds to criticisms of the SD measure, and describes conditions under which halo effects can occur and (a) both measures can be obtained, (b) one of the measures can be obtained, but the other measure either cannot be obtained or should not be used, and (c) neither measure can be obtained. Thus neither measure is uniformly superior to the other. It is therefore recommended that both measures be obtained when possible and when there is no basis for selecting one over the other.
Reliability and Validity Estimates of the Parker Team Player Survey
Authors: Kirnan Jean Powell , Woodruff Diane
Published: March 2007

The Parker Team Player Survey (PTPS) is designed as a self-report assessment of team player style as described in Parker's theory. In an attempt to estimate the psychometric properties of this instrument, both organizational and academic subject pools were used to demonstrate reliability and validity. The PTPS demonstrated acceptable test-retest reliability for all four team styles of Communicator, Collaborator, Challenger, and Contributer. The measures of internal consistency were low for the Challenger and Collaborator styles given the small number of items and the tendency for individuals to report more than one style. No significant differences were found in the reliability coefficients calculated for the business or student samples. Validity was measured through a comparison of self and peer ratings on the PTPS gathered at a variety of organizations. Whereas the correlations were all statistically significant, the correlation for the Collaborator score was low. Additionally, a panel of trained student judges participated in a sorting task in which they sorted the survey stimulus items into one of the four team style categories. This attempt at construct validity showed good agreement for all four styles, with the Collaborator again being the weakest.
Development and Psychometric Properties of the Organizational Diversity Inventory (ODI)
Authors: Hegarty W. Harvey , Dalton Dan R.
Published: March 2007

A newly developed 20-item Organizational Diversity Inventory (ODI) is described. A battery of 200 statements dealing with various aspects of diversity was evaluated as to the statements' relevancy by a diverse group of 40 middle managers. Thirty-five items were selected for further exploration. Four hundred and fifty managerial employees from 27 organizations completed this 35-item inventory. Relying on half of the sample, a factor analytic solution was generated that comprised 20 items and five factors. The second half of the sample was used to cross-validate these results. A structural equations confirmatory factor analysis (LISREL 8.03) also supported these five factors. The resulting factors were labeled (a) Existence of Discrimination, (b) Discrimination Against Specific Groups, (c) Managing Diversity, (d) Actions Regarding Minorities, and (e) Attitudes Toward Religion.
Structural Equivalence of a Measure of Cross-Cultural Adjustment
Authors: Robie Chet , Ryan Ann Marie
Published: March 2007

This study investigated the structural equivalence of a measure of cross-cultural adjustment in culturally dissimilar samples using confirmatory factor analysis. The two samples consisted of 155 international students studying at a midwestern American university and 153 American expatriate managers on assignment in either Taiwan or Belgium. Results indicated that the hypothesized factor structure was invariant and had a relatively good fit in both samples. The implication of these results is that adjustment may have similar dimensions across cultures. If substantiated through future studies, these results would enable researchers to have more confidence in cross-cultural comparisons of mean levels of adjustment or correlations of adjustment with external variables.
Improving The Estimation of Moderating Effects by Using Computer-Administered Questionnaires
Authors: Aguinis Herman , Bommer William H. , Pierce Charles A.
Published: March 2007

A program designed to administer questionnaires on IBM and IBM-compatible personal computers is documented. The program prompts subjects to indicate their response by clicking on a graphic line segment displayed on the screen or by entering a numeric value using the keyboard. Features of the program include (a) easily modifiable anchors for the graphic line segment (e.g., agree-disagree, satisfied-dissatisfied), (b) no limit to the number of questions included, and (c) responses that are stored directly into an ASCII file. The program enhances the accuracy in estimating moderating effects because it overcomes two limitations of the more traditional paper-and-pencil mode of administration: (a) transcriptional errors and (b) scale coarseness.
Development and Validation of the School Achievement Motivation Rating Scale
Authors: Chiu Lian-Hwang
Published: March 2007

This article describes the development and validation of the School Achievement Motivation Rating Scale (SAMRS). A group of 30 teachers participated in the construction and selection of behavioral characteristics related to achievement motivation in school situatiops based on the literature in the field. A total of 2,063 elementary and secondary students participated in this study. Evidence showed that the SAMRS scores were internally consistent and stable. High correlations were found between the SAMRS scores and grades or grade point averages, and moderate correlations were found between scores of the SAMRS and those of standardized tests. Evidence of concurrent and construct validity was established through correlating the SAMRS scores with scores on a number of measures including scales measuring need for achievement, locus of control, self-esteem, and anxiety as well as two measures of peer observation.
Correlationvalidity Coefficients Disattenuated for Score Reliability: A Structural Equation Modeling Approach
Authors: Hancock Gregory R.
Published: March 2007

The purpose of the current article is to offer methods for conducting hypothesis testing associated with disattenuated validity coefficients that overcome potential limitations of some previously suggested approaches. Through casting classical test theory's notion of reliability in the form of structural path models, such hypothesis testing may be accomplished in a fairly straightforward manner using hierarchically related structural equation models. Methods for hypothesis testing of single disattenuated correlations, as well as for testing of independent and dependent disattenuated correlations, are presented.
Conditional Scale-Score Standard Errors of Measurement under Binomial and Compound Binomial Assumptions
Authors: Brennan Robert L. , Lee Won-Chan
Published: March 2007

This article develops two procedures for estimating individual-level conditional standard errors of measurement (SEMs) for scale scores, assuming tests consist of dichotomously scored items. Using binomial model assumptions, one procedure provides a scale-score analogue of Lord’s raw-score SEM. Assuming a compound binomial model, another procedure provides a scale-score analogue of Feldt’s raw-score SEM. These two procedures are compared to a polynomial procedure and a procedure developed by Feldt and Qualls using data from the Iowa Tests of Basic Skills.
Location and Interaction in Row-and-Column Seating Arrangements
Authors: Koneya Mele
Published: March 2007

The verbal behavior, physical locations, and seat preferences of members of large groups assembled in row-and-column seating arrangements were investigated. In several trials of the experiment subjects had been categorized a priori as "high," "moderate," or "low" in respect to verbalization rates and then were randomly assigned to seats without regard for these rates. Subsequent research procedures revealed that location significantly affected the verbalization rates of the "highs" and the "moderates." Centrally located seats were associated with significantly higher verbalization rates on the part of their occupants than were noncentrally located seats. These findings confirmed the observations of previous investigators that there is an "ecology of participation" in classrooms which may make it possible to predict from which locations most verbalizations would emanate.

Through the administration of a projective procedure it was also revealed that "high" verbalizers chose central seats to a greater degree and extent than did "low" verbalizers. The seat preferences of "high" and "moderate" verbalizers also differed significantly; "high" verbalizers preferred central seats to a greater extent than did "moderate" verbalizers. Some aspects of coping theory were offered as a possible explanation of this behavior.
Preferences in Nursing Home Design
Authors: Duffy Michael , Bailey Su , Beck Bets , Barker Donald G.
Published: March 2007

This action research project explored discrepancies in design preference among designers and two groups of users: nursing home residents and administrators. Each group was asked to select its preference among a series of design alternatives, several of which were visually illustrated on a questionnaire. Participants were presented two or more alternatives on a series of design issues: lounge design, dining room table design, dining room seating arrangements, overall nursing home design, residents' room furnishings. Significant differences among groups were found on all design choices except table design and overall nursing home design. The major pattern in the results is that although both administrators and designers favored designs that promote social interaction, nursing home residents consistently selected designs that enhance privacy. Implications for the inclusion of resident data in the nursing home design process are discussed.
Government Programs for Soil Conservation
Authors: Green Gary P. , Heffernan William D.
Published: March 2007

Farmers and landowners are increasingly looking to the federal government for financial support and a comprehensive policy that would encourage the reduction of soil loss on agricultural lands. One general problem has been developing a policy that is both effective and equitable. Of the options available, the most discussed proposal has been the cross-compliance program that bases other agricultural program benefits on the ability of the farmer to meet a specified soil conservation standard. This study concludes that such a policy would have a regressive impact on farmers, and probably consumers, and would in the long run be ineffective.
Furnishing and Status Attributes
Authors: Amaturo Enrica , Costagliola Simonetta , Ragone Gerardo
Published: March 2007

In a society in which leisure and consumption have become increasingly central in the lives of individuals, the interior of a person's home may facilitate the pursuit of social goals and symbolize his or her status. This study, carried out in Italy, identifies two dimensions useful to characterize in a meaningful way the styles of interior decoration found in the living rooms of 100 homes in a metropolitan area. Findings indicate that the choice of a style of decor seems not to be mainly dependent upon income, but to be more related to the degree of status consistency and social mobility of the individuals.
The Political Uses of Territoriality
Authors: Merelman Richard M.
Published: March 2007

This article describes the territorial dimensions of a recurrent struggle between authority and community. Authority prefers and requires the expansion of territorial units; community prefers and requires the contraction of units. A model is proposed that attempts to synthesize these countertendencies by arguing that territorial expansion occurs as part of a process of expanding production, but that the consumption of the resulting productive surplus contracts territories and creates waste. The process is entropic, and helps explain why neither authority nor community triumphs.