bluuebunny/crossref_metadata_2025 huggingface dataset:
Development and Application of a Quickly-Scored In-Basket Exercise in an Organizational Setting
Authors: Hakstian A. Ralph , Woolsey Lorette K. , Schroeder Marsha L.
Published: March 2007

This article contains a description of the development of an In-Basket exercise designed to be scored quickly by unsophisticated workers. Results are presented of a study using this In-Basket exercise, along with other measures, in a large-scale industrial setting to predict first-level supervisory performance. Reliability results suggested that the two scored dimensions of this exercise possess adequate reliability for most purposes. Correlations with other predictive measures indicated that the exercise dimensions have moderate relationships with certain intellectual variables, but few with personality traits. Concurrent validities with various performance criteria indicated that the In-Basket dimensions provide predictive information about supervisory performance and represent a worthwhile component of a supervisory/management assessment battery.
A Validation Study of the Diagnostic Analysis of Reading Errors (DARE) Screening Test
Authors: Tramill James L. , Kleinhammer-Tramill P. Jeannie , Ellsworth Randy
Published: March 2007

The ability of the Diagnostic Analysis of Reading Errors (DARE) test to differentiate among students representing special populations was investigated. The DARE was administered to adolescents who had been previously placed in classes for learning disabilities, emotional disturbance, giftedness, and regular education. Data were analyzed by comparing group differences in scores on the DARE correct scale and by determining how accurately the DARE classification criteria reflected differences in actual educational placement. Results indicated that the DARE might have some value as a preliminary screening instrument for identifying adolescents who are at risk for educational problems. The results also indicated, however, that no consistent pattern of scores was unique to any educational grouping of students.
The Use of the Runs Test for Assessing Response Validity in Computer Scored Inventories
Authors: Huba G. J.
Published: March 2007

The runs test for random sequences of responding is proposed for application in long inventories with dichotomous items as an index of stereotyped responding. This index is useful for detecting whether the client shifts between response alternatives more or less frequently than would be expected by chance. If the items in the inventory are not counterbalanced, the index can be individually normed for particular applications.
An Empirical Investigation of the Standard Error of Measurement at Different Ability Levels
Authors: Blixt Sonya L. , Shama Deborah D.
Published: March 2007

Methods of estimating the standard error at different ability levels were compared. Overall, it was found that at a given ability level the standard errors calculated using different formulas are not appreciably different. Further, for most situations the traditional method of calculating a standard error probably provides sufficient precision.
Resolving Differences among Methods of Establishing Confidence Limits for Test Scores
Authors: Glutting Joseph J. , Mcdermott Paul A. , Stanley Julian C.
Published: March 2007

Microcomputer scoring and interpretation systems are making it easier for psychologists to report confider -e limits for test scores. This paper focuses on the basic theory underlying confidence limits and presents reasons why psychologists should incorporate confidence ranges in their narrative reports. The paper also compares four methods for establishing confidence limits. In particular, the standard error of measurement procedure is compared to three lesser-known procedures that establish limits around an estimated true score. Equations are presented for calculating confidence limits, and recommendations are made for the appropriate application of such limits during psychodiagnostic evaluations.
Test Pac: A Program for Comprehensive Item and Reliability Analysis
Authors: Luecht Richard M.
Published: March 2007

This paper describes Test Pac, a test scoring and analysis computer program for moderate-sized sample designs using dichotomous response items. In addition to comprehensive item analyses and multiple reliability estimation, the program performs single-facet Generalizability analyses of variance components, and single-parameter IRT analyses, with respective, applicable parameter estimates. As a further educational resource, test score reporting, student performance tracking and computer-assisted grading capabilities are provided.
Construct Space of the Least Preferred Co-Worker (LPC) Scale
Authors: Kennedy John K. , Houston John M. , Korsgaard M. Audrey , Gallo Donald D.
Published: March 2007

An attempt was made to determine the meaning of the least preferred co-worker (LPC) score by means of a confirmatory analysis. The LPC score is considered to be a measure of leader-ship style which distinguishes people motivated primarily by task accomplishment from those motivated by successful interpersonal relations. One hundred and sixty-three subjects completed a test battery containing eight measures which were expected to be related to LPC and 10 measures which were not. The results of the analyses indicated that LPC and two of its component subscores occupy a construct space independent of all the other measures. These findings have negative implications for Fiedler's contingency model since they cast doubt upon the validity of LPC, the model's central construct, as a measure of leadership style.
CORALL-2: A Fortran Program for Correlation and Similarity Measures
Authors: Vegelius Jan , Dahlqvist Bengt
Published: March 2007

This new version of the CORALL program contains around 50 various measures of similarity and correlation-as well as some other elementary statistical measures.
Investigation of the Lollipop Test as a Pre-Kindergarten Screening Instrument
Authors: Chew Alex L. , Morris John D.
Published: March 2007

The validity of the Lollipop Test: A Diagnostic Screening Test of School Readiness was examined for a group of pre-kindergarten subjects using the Developmental Indicator for the Assessment of Learning (DIAL) as the criterion. Both instruments were individually administered by qualified examiners to a sample of 129 prekindergarten pupils. The statistical significance of all the correlations (p < .01) between respective subtests demonstrated concurrent validity across the test batteries. Further, a canonical correlation indicated a high degree of multivariate relationship between the tests. As the Lollipop Test also appeared to overcome the limited ceiling of the DIAL, and requires fewer resources to administer, it would appear to be an attractive alternative prekindergarten screening instrument.
Convergent and Discriminant Validity of the Myers-Briggs Type Indicator as a Measure of Sociability and Impulsivity
Authors: Sipps Gary J. , DiCaudo James
Published: March 2007

This study examined the nature of the Myers-Briggs Type Indicator (MBTI) extraversion-introversion (El) and judging-perceiving (JP) subscales. The MBTI, Barratt Impulsiveness Scale (BIS-5), and the EASI-III were given to 185 subjects. All subscale scores for each instrument were entered into a principal component factor analysis with orthogonal rotation. Results support the MBTI-EI scale as a measure of sociability and the MBTI-JP scale as a measure of impulsivity. Convergent and divergent validity of these scales was provided as expected, although the constructs differ from those cited in the MBTI manual (Myers, 1962). Implications are discussed.
Reference-Reliability as a Concept of Reliability of Change in Times Series Data
Authors: Schweizer Karl
Published: March 2007

The concept of reference-reliability relates variability that is due to change to variability that is due to change and error. It is suitable for deciding whether some suspected change can reliably be differentiated from random fluctuations. This task requires a means by which to measure the process of change at different points in time. Aggregating the data in various ways is used to average out various sources of variation. The variation due to change and/or error is estimated via that part of variation that is not due to individual stability. The many ways to arrange the data yield the possibility to screen them for different kinds of fluctuations. Empirical findings support the usefulness of the coefficient of reference-reliability.
Comparability of Traditional and Computer Western Personnel Test (WPT) Versions
Authors: Huba George J.
Published: March 2007

Alternate versions of the Western Personnel Test (WPT; Gunn and Manson, 1962) were administered via computer and in the standard paper and pencil format. There were no mean differences in the number of items correct over the two versions of the test. Additionally, computer Form A and standard Form B were correlated as highly as standard Form A and computer Form B or standard Form A and standard Form B. The evidence suggests that the computer and pencil-and-paper administration of the WPT yield comparable results.
A Validation of the Social-Religious-Political Scale
Authors: Katz Yaacov J
Published: March 2007

The aim of the present study was to ascertain the validity of the Social-Religious-Political Scale, a new questionnaire specially compiled to measure social, religious and political attitudes of adult respondents. The findings of the validation study indicate that the SRP Scale is a valid and reliable measure of socio-political and religious attitudes for a sample of adult white South African students.
The Dimensionality of a Modified Form of the Maslach Burnout Inventory for University Students in a Teacher-Training Program
Authors: Gold Yvonne , Bachelor Patricia , Michael William B.
Published: March 2007

For a sample of 147 fifth-year students enrolled in a teacher training program at the elementary school level, both exploratory and confirmatory factor analyses involving orthogonal and oblique solutions were carried out on a correlation matrix of scores on 22 items from a self-report inventory of teacher burnout that was adapted with permission from the Maslach Burnout Inventory (MBI). The modifications incorporated within the new instrument, which is referred to as the College Student Survey (CSS), constituted the substitution of words within several item statements that would be more suitable in a teaching context than were the statements in the MBI which were oriented toward workers in other forms of public service. As in the instance of other factor analytic studies with the MBI, the three hypothesized constructs of burnout described as emotional exhaustion, depersonalization, and personal accomplishment were clearly defined in all factor solutions irrespective of whether the items were scored for frequency or intensity.
A Validation of Ebel's Method for Performance Standard Setting through its Application with Comparison Approaches to a Selected Criterion-Referenced Test
Authors: Cantor Jeffrey A.
Published: March 2007

This paper seeks to describe the research and development into performance standard setting processes used by the U.S. Navy's Strategic Weapon System Training Program for developing Criterion-Referenced System Achievement Tests (C-R SAT) for selected Naval Enlisted Classifications (NECs) or job titles in the Strategic Weapon System (SWS). The design of the C-R SAT involves identification of essential skills and knowledge for each NEC. This process entails planned workshops involving selected senior fleet and supervisory personnel drawn from the NEC. Following this test development process each C-R SAT is then subjected to a performance standard setting process. As all performance standard setting methodologies are subjective, the decision was made to validate the Ebel process and its outputs. Two alternative performance standard setting methodologies were applied to data generated from the two versions (watch stander and supervisor) of a recently administered TRIDENT Technician C-R SAT.
A Comparison of the Nominal Response Model and the Three-Parameter Logistic Model in Computerized Adaptive Testing
Authors: De Ayala R. J.
Published: March 2007

It is intuitive to presume that when an examinee incorrectly answers a test item that he or she may possess partial knowledge of the item's correct answer. However, current use of dichotomous item response theory (IRT) models in IRT-based computerized adaptive testing (CAT) ignore this partial information in their ability estimation. In this study a (polychotomous) nominal response model-based CAT (NR CAT) was simulated using an empirical data set. The ability estimation of NR CAT as well as its overall performance was compared to that of a dichotomous three-parameter logistic model-based CAT (3PL CAT). Results showed that the NR CAT's ability estimates were highly correlated with an external criterion and with those of the 3PL CAT. Both CATs showed only a slight bias in their ability estimates for that region of the ability continuum where their respective model did not provide a great deal of information. Despite the positively skewed information function afforded by the nominal response model the NR CAT was able to provide relatively accurate ability estimates in the upper 6 range, and its convergence rate was superior to that of the 3PL CAT. The implications of a nominal response model-based CAT are discussed.
Psychometric Evaluation of the Microcomputerized Personality Research Form
Authors: Fekken G. Cynthia , Holden Ronald R.
Published: March 2007

This study examined the psychometric properties of a microcomputerized version of the Personality Research Form-Form E (PFR-E; Jackson, 1984). Scale means and standard deviations were generally similar to published norms for the paper-and-pencil version. In addition, content scales were homogeneous and stable, and showed evident of convergent and discriminant validity. Although the Social Desirability response style scale was reliable, the Infrequency scale was not and its inclusion in the computerized PRF-E was questioned. The factor structure of the PRF-E scales was compatible with previous interpretations of PRF-E dimensionality. In conclusion, the computerized PRF-E is parallel to the traditional paper-and-pencil version.
A Basic Program for Determining Reliability and Validity of Subtest Combination Short Forms
Authors: Atkinson Leslie , Yoshida Glen
Published: March 2007

With increasing time pressure psychologists must often rely on results gleaned from partially administered tests. The most common type of short form involves administering a subset of scales, and the resulting score is then used to estimate the score which would have been derived if the entire test had been administered. Tellegen and Briggs (1967) have provided formulae for determining the reliability and validity of such short forms. This paper describes six GWBASIC programs which determine every possible combination of 2, 3, 4, 5, 6, and 7 subtests, lists what they are, and calculates their reliabilities and validities.
Evaluation of Computer Simulated Baseline Statistics for Use in Item Bias Studies
Authors: Rogers H. Jane , Hambleton Ronald K.
Published: March 2007

Though item bias statistics are widely recommended for use in test development and test analysis work, problems arise in their interpretation. The purpose of the present research was to evaluate the validity of logistic test models and computer simulation methods for providing a frame of reference for item bias statistic interpretations. Specifically, the intent was to produce simulated sampling distributions of item bias statistics under the hypothesis of no bias for use in determining cut-off points to provide guidelines for interpreting item bias statistics obtained with actual test data. The results provided support for the basic data simulation approach used in the study. Real and simulated distributions for three item bias statistics when bias was not present were very similar and the minor differences that were found between the distributions had little effect on the interpretations of item bias statistics obtained with actual test data. Seven steps for applying the method of computer-simulated baseline statistics in test development settings were outlined in the paper.
Measuring Subordinate Perceptions of Supervisor Feedback Intentions: Some Unsettling Results
Authors: Fedor Donald B. , Buckley M. Ronald , Eder Robert W.
Published: March 2007

To demonstrate the importance of subordinate perceptions of supervisor intentions in the feedback process, individuals were asked to report the perceived efficacy of supervisor intentions under a variety of criteria related to the impact of supervisor feedback. In Study 1, 49 participants were asked to generate an exhaustive list of all possible supervisor feedback intentions. In Study 2, 220 participants were asked to evaluate the perceived frequency of the supervisor intentions generated in Study 1, and the extent to which the supervisor intentions were related to four outcome criteria (self-evaluation, building relationships, self-serving for the supervisor, and facilitating subordinate productivity). It was found that subordinates do make fine distinctions concerning their perceptions of supervisor intentions for providing feedback. The research and practical implications of these results are discussed.
A Computer Program for Calculating Subject-by-Subject Kappa or Weighted Kappa Coefficients
Authors: Cicchetti Domenic V. , Showalter Donald , McCarthy Paul
Published: March 2007

This computer program calculates individual subject kappa or weighted kappa coefficients for each of the following three types of categorical data: (a) nominal (dichotomous/polychotomous), (b) ordinal (dichotomous /continuous), and (c) mixed scales of measurement (containing both nominal and ordinal features). Additional output includes criteria for determining levels of both statistical and clinical significance as well as specific tests of examiner bias.
A Coefficient for Measuring the Agreement on Bipolar Rating Scales
Authors: Viernstein Nikolaus
Published: March 2007

A new coefficient for measuring agreement on bidirectional response continua, called ψ*, is presented. ψ* is based on Holley and Guilford's "G index of agreement," which is restricted to measuring agreement in 2 × 2 tables. ψ* instead is designed to measure agreement in larger square contingency tables with even numbers of rows and columns. ψ* avoids some of the shortcomings of other measures of agreement; it is, e.g., independent of scale direction.
Self-Ratings in Attitude Measurement: Resistance to Short-Term Recalibration and Contrast
Authors: Maurer Todd J. , Alexander Ralph A. , Stevens Sean E.
Published: March 2007

An extension has been made of past research on the theory of "psychological perspective" (Ostrom and Upshaw, 1968) that emphasizes the concept of rating scale calibration in attitude measurement. Perspective theory may hold implications for attitude surveys in that differences in attitude across groups or individuals may be diluted, exaggerated, or real depending on differences in perspective when completing self-ratings of attitude on a graphic scale. A second implication, however, is that scales may become recalibrated transiently, as in the classic contrast effect. A conservative test of this second implication of the model was provided to investigate whether the use of simple graphic rating scales in attitude measurement may be complicated by this type of transient scale shift. Hypothesized initial shifts and their temporal decay were investigated. However, the data did not support the short term recalibration effect. Overall, the data supplemented past research that supports the use of graphic rating scales as valid and reliable measures of attitude. It is also suggested that in some situations, a single graphic rating may be effectively substituted for longer and more sophisticated scaling techniques.
Statistical Power Analysis for Multiple Regression/Correlation: A Computer Program
Authors: Rothstein Hannah R. , Borenstein Michael , Cohen Jacob , Pollack Simcha
Published: March 2007

A micro-computer program has been developed which enables researchers to compute statistical power for analyses performed by multiple regression/correlation (MRC). The program's structure mirrors the logical application of MRC as a data analytic system, to wit: It allows the user to group variables into sets which will be employed as predictors; it allows the user to determine power for the cumulative impact of any set(s) of variables, and also for the unique impact of any set over and above other sets. The program features a spreadsheet-like interface; the user enters the number of variables included in each set, the proportion of variance hypothesized to be explained by that set, the sample size, alpha, and whether Model I error or Model 2 error will be used in the analyses. The program then reports the effect size (f) and the value of power corresponding to these parameters.
Averaging Correlation Coefficients: A Basic Program
Authors: Barker Donald G.
Published: March 2007

A computer program is presented for averaging correlation coefficients, using Fisher's Z transformation.
Convergent and Discriminant Validity for Family Self-Report Measures
Authors: Perosa Linda M. , Perosa Sandra L.
Published: March 2007

Cohesion and adaptability have been postulated as underlying dimensions of several models and measures of family systems. The convergent and discriminant validity of the Family Environment Scale, the Family Assessment Device, the Structural Family Interaction Scale, Revised, and the Family Adaptability and Cohesion Evaluation Scale (III) was examined for the dimensions of cohesion and adaptability. The measures were administered to 183 high school seniors and college undergraduates. Correlational and factor analytic results showed that the convergent validity of self-report family measures was stronger than the discriminant validity. A comparative analysis of themes underlying cohesion and adaptability scales is presented and suggestions for future study are offered.
Partial Credit Analysis of Writing Ability
Authors: De Ayala R. J. , Dodd Barbara G. , Koch William R.
Published: March 2007

The direct assessment of the writing ability of 2000 randomly selected secondary school students was performed using the partial credit model. The effects on item parameter estimates of rating scale and type of writing sample were investigated. The rating scales used were a sum and an averaging of the individual raters' ratings and the types of items were expository and narrative. Results showed that expository items tended to provide more information for high ability examinees than did narrative items and that the sum holistic rating method yielded greater information than did the average holistic rating scale. Additional analyses of the rating scales used as well as implications for test construction are discussed.
Sixteen Computerized Perceptual Performance Tests for Psychological Assessment Courses
Authors: Aiken Lewis R.
Published: March 2007

Sixteen perceptual performance test programs, written in BASICA for administration by IBM-PCs and clones, are described. These programs, a subset of four dozen verbal and performance tests designed for psychological and educational testing courses, have also been used in research projects concerned with perceptual-motor skills and problem solving. A diskette containing the pro- grams, and a descriptive manual, are available at no charge from the author.
Validity Evidence for the Myers-Briggs Type Indicator as a Measure of Hemisphere Dominance: Another View
Authors: Taggart William M. , Kroeck K. Galen , Escoffier Marcel R.
Published: March 2007

Shiflett reported results to support the use of the Myers-Briggs Type Indicator (M-BTI) scales as surrogates for the assessment of brain dominance. The M-BTI scales were compared to the Left and Right Dominance Scales of the Human Information Processing Survey (HIP-S). The current research employing the same instruments with 554 college students, both confirmed Shiflett's findings and yielded results contrary to those of the Shiflett study. Specifically the association between M-BTI Intuition and both HIP-S Right and Left scales was in the opposite direction, with more intuitive types being more Right and less Left dominant in the current study. Shiflett also reported a reverse finding to those obtained with regard to the M-BTI Perception scale. In the current study, perceptive types were found to be more Right and less Left dominant. Finally, Shiflett reported that sex moderated the relationships among many of the HIP-S and M-BTI variables. The current study only found one significant difference between males and females among the correlations for these variables.
A Comparison of Non-Adjusted and Bootstrapped Methods: Bootstrapped Diagnosis Might be Worth the Trouble
Authors: Greenblatt Richard L. , Mozdzierz Gerald J. , Murpphy Thomas J. , Trimakas Kestutis
Published: March 2007

This study compared the diagnostic accuracy of non-adjusted (Rorer, Hoffman, LaForge, and Hsieh, 1966) and bootstrapped (Rorer and Dawes, 1982) diagnosis using a sample of 1,455 psychiatric inpatients who had completed the Millon Clinical Multiaxial Inventory. The usefulness of bootstrapping depended on the criteria for accuracy. Bootstrapping showed no benefit with regard to overall accuracy. Sensitivity increased for five scales upon bootstrapping, although specificity decreased on two scales. The strongest support for bootstrapped diagnosis was in terms of positive and negative predictive power. Positive predictive power increased for 10 scales upon bootstrapping, with no loss in negative predictive power. The discussion examines the conditions under which bootstrapping might increase diagnostic accuracy.
The Optimization of Multivariate Generalizability Studies with Budget Constraints
Authors: Marcoulides George A. , Goldstein Zvi
Published: March 2007

The optimization of multivariate measurement designs when limited resources are available is not a simple task. This paper presents a method for determining the optimal number of conditions to use in measurement designs when resource constraints are imposed.
Testing the Simplex Assumption Underlying the Erikson Psychosocial Stage Inventory
Authors: Thornburg Kathy R. , Ispa Jean M. , Adams Nicholas A. , Lee Byung S.
Published: March 2007

This study examined whether or not the Erikson Psychosocial Stage Inventory (EPSI) measured the hierarchical model of development proposed by Erikson. Over 1000 college students responded to the inventory. Using the simplex pattern, the EPSI did not measure Erikson's stages for this sample of students. An examination of the EPSI for subgroups by race and gender did not yield positive results. Possible explanations of the findings are included.
Correlational Meta-Analysis: Independent and Nonindependent Cases
Authors: Tracz Susan M. , Elmore Patricia B. , Pohlmann John T.
Published: March 2007

The purpose of this study was to determine the effect of the violation of the assumption of independence when combining correlation coefficients in a meta-analysis. In this Monte Carlo simulation the following four parameters were used with the values specified: N-the sample size within a study (20, 50, 100), p-the number of predictors (1, 2, 3, 5), rho( i)-the population intercorrelation among predictors (0, .3, .7), rho( p)-the population correlation between predictors and criterion (0, .3, .7). When cnly one predictor was used or when the intercorrelation among predictors equaled zero, the assumption of independence was not violated. The assumption of independence was violated when more than one predictor with an intercorrelation exceeding zero were used. Therefore, rho( i) the index of nonindependence was the main parameter of interest. For both r's and Fisher's z's, the means, medians, and standard deviations showed no discernible change over levels of rho( i) or p, but the precision of estimation of the expected values improved as N increased. The 90%, 95%, and 99% confidence intervals for both r's and Fisher's z's showed no change over levels of rho( i) or p, but the intervals narrowed as N increased.
Relation between Self-Appraisal and Appropriateness of Career Choices of Male and Female Adolescents
Authors: Westbrook Bert W. , Sanford Eleanor E.
Published: March 2007

In a study of 163 ninth-grade students, the Self Appraisal subtest of the Career Maturity Inventory Competence Test was found to be related to appropriateness of career choices of female adolescents but not male adolescents. Significant gender differences were not found on the Self Appraisal subtest or the measure of appropriate-ness of career choices.
Report on an Alternative Measure of Affective Disposition
Authors: Judge Timothy A. , Bretz Robert D.
Published: March 2007

Researchers investigating the dispositional source of job satisfaction often have used negative or positive affectivity to measure affective disposition. The present study tested the validity of an alternative measure of affective disposition which consists of an assessment of affective reactions to neutral stimuli common to everyday life. Results indicated that the measure, termed the Neutral Objects Satisfaction Questionnaire (NOSQ), displayed favorable psychometric properties. Furthermore, the NOSQ may be a better assessment of affective disposition than positive or negative affectivity because it had greater stability over time than one of the most common measures of positive and negative affectivity.
Fitting Item Response Models to the Epi-A Impulsivity Sub Scale
Authors: Ferrando Pere J.
Published: March 2007

A parameterization of the EPI-A Impulsivity subscale (Spanish version) by means of the one- and two-parameter logistic item response models is presented. A two-parameter model seems to fit the data reasonably well and renders interesting information about the items. Parameter invariance is also verified.
Procedures for Designing Course Evaluation Instruments: Masked Personality Format Versus Transparent Achievement Format
Authors: Carey Lou M. , Dedrick, Robert F. , Carey James O. , Kushner Susan N.
Published: March 2007

One important consideration in designing instruments to measure students' attitudes about a course or an instructor is the influence of the format of the instrument on students' responses. This study contrasted the effects of randomly distributing the items throughout the questionnaire (personality format) versus grouping the items together from the same dimension (achievement format) on students' end-of-term course evaluations. On the last day of class, 376 undergraduate students were randomly assigned to complete anonymously the Academic Motivation Profile (AMP) constructed using either a personality or achievement format. A 2 (Format) x 10 (Class Section) MANOVA of the 12 scales of the course evaluation instrument demonstrated a statistically significant Format effect (Wilks's lambda = .85, p < .001), a statistically significant Section effect (Wilks's lambda =.37, p < .001), and no significant Format x Section interaction (Wilks's lambda = .70, p >.05). Examination of the factor structures using confirmatory factor analysis indicated that the measurement model underlying the AMP fit the data reasonably well for both the achievement and personality formats; however, the achievement format provided a better fit. Based on the statistical results and the fact that the achievement format may be more straightforward, produce less suspicion from the student, and be more time efficient, it should be considered when designing course evaluation instruments.
The Equal-Interval Nature of Semantic Differential Scales: An Empirical Investigation Using Fiedler'S Least Preferred Coworker (Lpc) Scale And Magnitude Estimation and Case Iii Scaling Procedures
Authors: Schriesheim Chester A. , Cogliser Claudia C. , Newmark Richard I. , Lowensohn Suzanne H.
Published: March 2007

An assumption made in using semantic differential measures is that the adjective pairs used are truly bipolar; otherwise, statistical analyses may yield distorted findings. This article examines the 18 bipolar adjective pairs used in Fiedler's Least Preferred Coworker (LPC) instrument by using two scaling techniques and a sample of 113 respondents. To replicate and extend previous research, the 36 LPC adjectives were ranked according to their relative interpersonal favorability. The same sample also scaled the 36 adjectives using Stevens's magnitude estimation technique (MET). Both pair-comparison treatment of complete ranks scaling (under Thurstone's Case III) and the magnitude estimation procedure indicated that true bipolarity did not characterize most of the paired adjectives. Implications for future LPC and semantic differential research are discussed.
Burnout among Dutch Teachers: An Mbi-Validity Study
Authors: Schaufeli Wilmar B. , Daamen John , Van Mierlo Hanneke
Published: March 2007

The study investigates the internal consistency as well as the factorial and discriminant validity of the Maslach Burnout Inventory (MBI) in a sample of 326 Dutch secondary teachers. Compared to other teacher samples, the internal consistency of the three subscales (Emotional Exhaustion-EEX, Depersonalization-DEP, Reduced Personal Accomplishment-PAC) is relatively high. Using confirmatory maximum likelihood factor analysis with LISREL, it is shown that the three-factor oblique model fits relatively well compared to various alternative models. As in some other studies, one ambiguous item was identified ("I feel very energetic") that loads on two factors simultaneously (i.e., EEX and PAC). Moreover, burnout can be distinguished successfully from self-reported psychological strain as well as from somatic complaints. Nevertheless, EEX is substantially related to these more general symptoms. Finally, levels of EEX, psychological strain, and somatic complaints are significantly higher compared to Dutch reference groups, whereas levels of DEP and reduced PAC are significantly lower. It is concluded that the MBI is a valid and reliable self-report instrument to assess burnout in a non-English-speaking country like the Netherlands.
Measuring Women's Sport Interest in Response to Title IX
Authors: Greller Martin M. , Cochran Robert S. , Taylor Patricia A.
Published: March 2007

An approach is described whereby universities may respond to Title IX inquiries from the Office of Civil Rights regarding women's sport equity. This responds to that portion of the law that requires that institutions meet women's sport interest in equal measure to men's. The survey provides results useful for institutional decision making and helps address the specific needs and interests of the student body.
The Influence of Dimensionality on Estimation in the Partial Credit Model
Authors: De Ayala R. J.
Published: March 2007

Of the polytomous item response theory models, Masters's partial credit (PC) model has evoked a great deal of interest. Given some of the PC model's areas of application (e.g., assessing the clinical competence of physicians), it is reasonable to suspect some degree of multidimensionality in the data. This study was concerned with the effect of multidimensionality on PC parameter estimation. Both noncompensatory and compensatory data sets were generated. Within these two classes of data sets, the data differed from one another with respect to the interdimensional association between two abilities, θ1 and θ2. Analysis consisted of root mean square error (RMSE), bias, Pearson product-moment correlations, standardized root mean squared differences, standardized differences between means, and descriptive statistics. For the compensatory conditions, the RMSE and bias plots showed that the ability estimate more accurately estimated the average θ than either θ1 or θ2. With increasing interdimensional association, the differences in RMSE and in bias with respect to θ1, θ2, and the average θ diminished, although one ability appeared to be better estimated throughout the θ continuum than did the other ability. The RMSE plots for the noncompensatory data sets showed a pattern similar to that of the compensatory data. However, when the test was divided into its component dimensions, the RMSE with respect to one of the examinees' abilities was less than the RMSE with respect to average θ as well as the other ability; these differences between the RMSEs with respect to θ1, θ2, and average θ diminished with increasing interdimensional association. Results are encouraging for individuals interested in using the Rasch family of models.
Computing Pairwise Comparisons among Correlations with the SAS System
Authors: Williams Richard H. , LeBlanc William G.
Published: March 2007

A SAS program was written to compute pairwise multiple comparisons among a set of k independent product-moment correlation coefficients. The program can accommodate both equal and unequal sample sizes for up to k = 10 samples. Although the theoretical basis of the statistical technique is attributable to Tukey, the applicability of the method to correlation coefficients was made possible through a large-sample technique described by Levy.
Use of Empirical Estimates of Shrinkage in Multiple Regression: A Caution
Authors: Kromrey Jeffrey D. , Hines Constance V.
Published: March 2007

Empirical techniques to estimate the shrinkage of the sample R2 have been advocated as alternatives to analytical formulae. Although such techniques may be appropriate for estimating the coefficient of cross-validation, they do not provide accurate estimates of the population multiple correlation. The accuracy of four empirical techniques (simple cross-validation, multi-cross-validation, jackknife, and bootstrap) were investigated in a Monte Carlo study. Random samples of size 20 to 200 were drawn from a pseudopopulation of actual field data. Regression models were investigated with population coefficients of determination ranging from .04 to .50 and with numbers of regressors ranging from 2 to 10. Substantial statistical bias was evident when the shrunken R2 values were used to estimate the population squared multiple correlation. Researchers are advised to avoid the empirical techniques when the parameter of interest is the population coefficient of determination rather than the coefficient of cross-validation.
Personality Structure and the New Fifth Edition of the 16PF
Authors: Cattell Raymond B. , P. Cattell Heather E.
Published: March 2007

The purposes of the present article were to describe briefly the development of the new fifth edition of the Sixteen Personality Factor Questionnaire (16PF) and to present a check of the factor structure of this new edition. Since its initial publication in 1949, the 16PF has undergone four revisions (1956, 1962, 1968, and 1993). The latest revision (resulting in the 16PF fifth edition) was begun in 1988 with the goals of updating and improving item content, standardizing on a current population sample, and generally refining the test. Items were selected in a four-stage iterative process, beginning with an item pool containing the best items from all five current forms of the 16PF (Forms A, B, C, D, and CAQ Part 1). Specific item criteria are described. Factor analyses of the new items and scales are described and show strong support for the validity of the factor structure of the fifth edition and for its continuity with earlier versions.
Further Evidence of the Construct Validity and Reliability of a Portuguese Version of an Academic Self-Concept Scale
Authors: Villar Irene De Aquino , Michael William B. , Gribbons Barry
Published: March 2007

For a sample of 177 Portuguese students attending a private Catholic college in Sao Paulo, Brazil (74 females and 103 males), the twofold purpose of this study was to provide additional evidence regarding the internal consistency reliability and the construct validity of a Portuguese version of the Dimensions of Self-Concept, Form H. From both exploratory and confirmatory factor analyses, promising support was found for the construct validity for each of the five subscales (Level of Aspiration, Anxiety, Academic Interest and Satisfaction, Leadership and Initiative, and Identification vs. Alienation), the titles of which corresponded to the five hypothesized constructs. Internal consistency estimates of the reliability of all five 16-item subscales varied between .84 and .90.
Assessing Moderator Variables: Two Computer Simulation Studes
Authors: Mason Craig A. , Tu Shihfen , Cauce Ana Mari
Published: March 2007

The present article proposes a strategy for conceptualizing moderating relationships based on their type-strictly correlational and classical correlational-and form continuous, noncontinuous, logistic, and quantum. The results of two computer simulation studies comparing the relative power of three statistical approaches for assessing moderator variables are presented: moderated multiple regression, multiple regression with a dichotomized moderator, and correlational analysis. As predicted, moderated multiple regression was generally found to be equal or superior to these alternative approaches at detecting moderator relationships. Although the alternative approaches did potentially offer greater statistical power under limited circumstances, this was only true in more extreme cases and required fairly accurate estimates of specific characteristics of the joint distribution of the predictor, moderator, and outcome variables.
The Emperor's Clothes: Assessing the Validity of Scores on the Tennessee Self-Concept Scale
Authors: Bishop Sheryl L. , Walling David P. , Walker Betty A.
Published: March 2007

In 1985, Tzeng, Maxey, Fortier, and Landis conducted an extensive psychometric study of the Tennessee Self-Concept Scale (TSCS) and reported a systematic failure to validate the factor structure of either the eight clinical scales or the two global internal/external scales. Despite these findings, the TSCS has continued to be used in both clinical and research settings to investigate facets of the self-concept. One possible limitation of the Tzeng et al. study was the inherent heterogeneity in the three samples used, which could have masked factor structures. To investigate whether this was the case, the present study replicated the psychometric analyses in a homogeneous sample of female nursing and medical educators from a health science center and university in the Southwest. Results strongly mirrored the findings of Tzeng et al., challenging the proposed theoretical structure while supporting the reliable measurement of some, as yet unclear, dimension by the present instrument. Implications for the use of the TSCS as it now stands are discussed.
A FORTRAN 77 Program for Generating Sample Correlation Matrices
Authors: Rae Gordon
Published: March 2007

A FORTRAN 77 program for generating sample correlation matrices from a given population corTrelation matrix is described. Considerable savings in computing time are achieved by obtaining the random correlation matrices directly, rather than generating random scores from a multivariate normal distribution and computing the correlation coefficients in the usual manner.
The Religious Orientation Scale: Review and Meta-Analysis of Social Desirability Effects
Authors: Trimble Douglas E.
Published: March 2007

Reliability and validity of scores on the Religious Orientation Scale (ROS) are reviewed with respect to social desirability. ROS measures intrinsic religiousness (I; religion as an end unto itself) and extrinsic religiousness (E; religion as a means to some end, like friendship or solace). Development of the scale is briefly traced, including the modification of the E scale to include two subscales. Scores from the I scale have good internal consistency reliability (.83), but scores from E subscales (Social and Personal) have marginal internal consistency reliability (.63 and .64, respectively). I tends to correlate with desirable variables (mental health, altruism, religious commitment), and E correlates with that which is undesirable (prejudice, nonmarital sex). Meta-analysis revealed that I correlates .15 with social desirability but that E does not. Given the religious relevancy of social desirability measures, partialing out this variance is not recommended.
Development of a Shortened form of the Fennema-Sherman Mathematics Attitudes Scales
Authors: Mulhern Fiona , Rae Gordon
Published: March 2007

Data from 196 Irish school children were analyzed using principal components analysis with a varimax rotation to determine whether the underlying factor structure of the Fennema-Sherman Mathematics Attitudes Scales (FSMAS) fit the dimensions suggested by the position of the 108 items on nine subscales. Results indicated a factor structure virtually identical to a previous study that used a different sample, with the items being reduced to six separate components rather than nine as suggested by the scales' developers. Based on this factor structure, the authors attempted the development of a shortened form of the FSMAS. Internal consistency estimates of the reliability of scores on the whole scale and each subscale for both the original and the short form were favorable, with alpha coefficients ranging from .79 to .96.
Cultural and Developmental Comparisons of Landscape Perceptions and Preferences
Authors: Herzog Thomas R. , Herbert Eugene J. , Kaplan Rachel , Crooks C. L.
Published: March 2007

The authors compared several Australian subgroups and American college students on their preferences for Australian natural landscapes. Preference correlations across groups were generally high, with the correlations for Australian adults somewhat lower. Factor analysis yielded six perceptual categories: Vegetation, Open Smooth, Open Coarse, Rivers, Agrarian, and Structures. Both the Australian and American samples liked Rivers best and the Open categories least. Only the Australians included willow trees in the Agrarian category. The Australians liked the settings overall better than the Americans. Among the Australians, primary students liked the settings most, secondary students least; aboriginal college students liked the settings better than other college groups, but they disliked the Structures category; and DENR (Department of Environmental and Natural Resources) staff members liked the settings better than other Australian adults but, unlike other adults, did not like willows better than nonwillow settings. Cultural and evolutionary reasons for the complex pattern of results were explored.
Social Impact Studies
Authors: Shields Mark A.
Published: March 2007

is a doctoral candidate in sociology at Brown University. His major interests are social planning and environmental sociology and his dis sertation will explore the theoretical bases of social impact assessmen t
Attitudes and Conditions for Cooperation in a Paper Recycling Program
Authors: Humphrey Craig R. , Bord Richard J. , Hammond Margaret M. , Mann Stuart H.
Published: March 2007

Receptivity toward paper recycling was examined in relation to people's accuracy with wastepaper separation among: (1) personnel with two wastebaskets in offices, (2) personnel with divided wastebaskets, (3) personnel depositing nonsalvageable waste outside offices. A large university was used for the research, and half of each study group received encouragement to cooperate throughout this experiment. Findings indicated that receptivity and accuracy in wastepaper separation were related positively, but separation was better where the required effort was minimal, as in offices with two wastebaskets. People's accuracy with wastepaper separation deteriorated over time, but not enough to nullify the effect of asking people to participate in a paper recycling program. Encouragement did not have a statistically significant impact on accuracy with separation. Finally, no change in receptivity toward manual wastepaper separation was found among participants after the experiment. Therefore, the investigators concluded that office workers are willing and able to cooperate in paper recycling, though more needs to be known about improving people's accuracy in manual wastepaper separation.