bluuebunny/crossref_metadata_2025 huggingface dataset:
Elimination of BIAS in Test Scores: Effect on Reliability and Validity
Authors: Frary Robert B. , Zimmerman Donald W.
Published: March 2007

This paper demonstrates that correlation between bias components of test scores and unbiased observed scores is an effective predictor of changes in reliability and validity resulting from elimination of bias. Plausible assumptions about the value of this correlation and the sizes of related variance components yield the conclusion that reduction in reliability and validity is a possible outcome. This reduction could result in marginally valid or reliable tests being judged unsatisfactory in this regard after elimination of bias. Thus bias can have an effect beyond the unfairness of resulting scores, namely, perpetuation of the use of tests of poor quality.
Using Multivariate, Techniques to Analyze with in-Subject Effects in Univariate Anova Repeated Measures Designs
Authors: Shine Lester C.
Published: March 2007

The purpose of the present paper is to illustrate the use of multivariate techniques to analyze repeated measures ANOVA designs. As compared to a conventional repeated measures ANOVA, such techniques require less strict assumptions about population variances and covariances. A comprehensive illustrative example is given for the case of a three-way design with two factors repeated. Differences between the results for this multivariate analysis and those for a conventional analysis of the same data are discussed. General reasons for such differences are discussed.
The Internal Control Index: A Newly Developed Measure of Locus of Control
Authors: Duttweiler Patricia C.
Published: March 2007

This paper presents the development of a new measure of locus of control in adults, the Internal Control Index. Locus of control orientation has been found to be related to cognitive processing, motivation, conformity and autonomy, and self-reliance. Previously developed instruments measure external locus of control, have been criticized for format, response set, dimensionality, and low reliability. The study was conducted in four phases: pretesting item development, tryout testing (N = 548), field testing (N = 684), and a replication study with a sample (N = 133) of junior college students. The analyses of the field test and junior college administration indicated an estimated reliability for the ICI of .84, the presence of a strong principal component, two replicable factors, and evidence for convergent validity.
Approximating Probability Levels for Testing Null Hypotheses with Noncentral F Distributions
Authors: Fowler Robert L.
Published: March 2007

Laubscher (1960) offered two approximations for normalizing noncentral F distributions and concluded that a formula based on the square root of the chi-square distribution (SRA) gave values closer to the particular exact probabilities chosen than did a formula derived from a cube root of chi-square distribution (CRA). However, the range of values selected for degrees of freedom and A, the noncentrality parameter, are not representative of those in behavioral investigations. The present study compared the two approximations at six percentile points on the noncentral F distributions for numerator degrees of freedom in the range 1(1)6, 8, 12, 24, denominator degrees of freedom 6(2)30, 40, 60, 120, 240 and for Cohen's small, medium, and large effect sizes (f = .1, .25, .4) against exact values calculated by means of Tang's (1938) recurrence formula. It was found the CRA was clearly superior to the SRA and generally provided an excellent approximation for non-central F, particularly at levels of significance traditionally employed in psychology and education. Probability values for testing directional null hypotheses specifying a size of effect were typically correct to three decimals.
The Dental Hygiene Aptitude Tests and the American College Testing Program Tests as Predictors of Scores on the National Board Dental Hygiene Examination
Authors: Longenbecker Sueann , Wood Peter H.
Published: March 2007

Seventy-seven recent (1978 to 1981) graduates of the Dental Hygiene Program of Lima Technical College (Ohio) took the National Board Dental Hygiene Examination (NBDHE). These NBDHE scores served as the criterion variable in an attempt to compare the predictive validity of the Dental Hygiene Aptitude Tests (DHAT) and the tests of the ACT Assessment Program. The DHAT tests, singly and collectively, were more predictive of the Board scores than were the ACT Assessment tests. Two of the DHAT tests, the DHAT-Science and DHAT-Verbal tests, which both correlated moderately with the NBDHE score (r = .37) and with one another (r = .28), combined to produce the highest multiple-correlation with NBDHE scores (R = .46). The Composite score from the ACT Assessment Program and the Science test of the ACT Assessment Program produced correlations of .26 and .28, respectively, with NBDHE scores.
The Development and Validation of an Elementary School Substitute Teacher Questionnaire
Authors: Pascale Pietro J. , King James C. , Mastrian Lou
Published: March 2007

The development and validation of an instrument to assess the needs and concerns of elementary school substitutes are described. A review of the literature identified nine broad categories of needs for substitute teachers. Fifty-two items were constructed to represent the nine categories. Suggestions by a panel of four professional educators reduced the item pool to 50 items. A factor analysis of the responses to the 50 items for a sample of 312 elementary school substitutes corroborated the existence of nine underlying factors. A test-retest procedure estimated reliability at .91.
Instructional Sensitivity Expanded
Authors: Hanna Gerald S. , Bennett Judith A.
Published: March 2007

The presently viewed role and utility of measures of instructional sensitivity were summarized. A case was made that the rationale for the assessment of instructional sensitivity can be applied to all achievement tests and should not continue to be restricted to criterion-referenced mastery tests. Next, a line of research and theory concerning context dependence in tests containing interpretive exercises was outlined. The logic of this theory was integrated with the rationale of instructional sensitivity. Finally, practical interrelationships among content validity, reliability, instructional sensitivity, and related measures were discussed and illustrated by use of a varied sample of test items and data.
Reliability and Validity of the Cooperative Preschool Inventory for English- and Spanish-Speaking Hispanic Children
Authors: Powers Stephen , Medina Marcello
Published: March 2007

The internal consistency reliability, concurrent validity, and stability of the Cooperative Preschool Inventory in English and Spanish editions were examined for monolingual-English and monolingual-Spanish Hispanic preschool pupils. The findings supported the reliability, validity, and stability of both editions as well as the comparability of both editions.
A Simple Set of Salient Weights for the Major Dimensions of MMPI Scale Variation
Authors: Bernstein Ira H. , Garbin Calvin P.
Published: March 2007

The purpose of this paper is to demonstrate that the factor structure of the MMPI's 14 basic scales can be represented by quantities that are familiar to users. These are: (a) the equally weighted sum of Scales F, 1, 2, 3, 4, 6, 7, 8, and 0 (profile elevation), (b) the equally weighted sum of Scales L and K minus Scale F (test-taking attitudes or "faking good" vs. "faking bad"), (c) the equally weighted sum of Scales 2 and 0 vs. Scale 9 ("Optimism" vs. "Pessimism"), (d) Scale? alone, and (e) Scale 5 alone. Confirmatory factor analyses indicated that these weights reproduce MMPI scale intercorrelations well in two large, but rather different samples of 1000 protocols each, respectively derived from job applicants to positions requiring screening for emotional stability and inmates in the Federal Correctional System. Further replications were conducted using data from psychiatric outpatients and theology students.
Yeasaying and the Kirton Adaption-Innovation Inventory
Authors: Goldsmith Ronald E. , Matherly Timothy A. , Wheatley Walter J.
Published: March 2007

The Kirton Adaptation-Innovation Inventory (Kirton, 1976) has demonstrated utility for identifying stylistic differences in individual approaches to problem-solving. The present study examined the influence of acquiescent response style (Yeasaying) on this instrument among 89 American undergraduates and found little or no evidence that the KAI is affected by yeasaying.
A Model of Statistics Achievement Using Spatial Ability, Feminist Attitudes and Mathematics-Related Variables as Predictors
Authors: Elmore Patricia B. , Vasu Ellen Storey
Published: March 2007

Subjects for this study were graduate students enrolled in inferential statistics classes at a midwestern university. The study was conducted to determine the importance of spatial ability, attitudes toward mathematics, mathematical background, masculinity-femininity of interest pattern, attitudes toward feminist issues, student sex, and verbal and mathematical ability as predictors of achievement in applied statistics courses for male and female students.

Regression analyses were performed comparing full versus restricted models. The amount of variance in statistics achievement accounted for in the full model which included all the previously mentioned sets of predictor variables was .60. The most important predictor variable set was attitudes toward feminist issues (reduction in R2 = .1861). Sex-related differences were found on all variable sets except verbal and mathematical ability.
Aggregating Standard Scores or Raw Scores: Whither the Controversy?
Authors: Gardner Robert C. , Erdle Stephen
Published: March 2007

This article evaluated criticisms by Stevens and Aleamoni (1986) of an article by Gardner and Erdle (1984) on aggregation using either raw or standard scores. It was demonstrated that their criticisms were unfounded.
Construct Validity of the Myers-Briggs Type Indicator
Authors: Thompson Bruce , Borrello Gloria M.
Published: March 2007

The Myers-Briggs Type Indicator (MBTI) is widely recognized as an important measure of normal or non-pathological variations in personality. However, the construct validity of the measure has not been clearly established using factor analytic techniques. The present study investigated the structure and item performance of the instrument using data from 359 college students. Factor analysis was applied to the 95 scored MBTI items. Factor adequacy and invariance coefficients were computed, and the appropriateness of the recommended item weights was examined. The results strongly supported the instrument's construct validity.
Internal Consistency and Bias Considerations of the Goodenough-Harris Draw-a-Person Test
Authors: Strommen Erik F. , Smith Jeffrey K.
Published: March 2007

The present study reports the results of an internal consistency analysis of the Goodenough-Harris Draw A Person test (GHDAP). One hundred and fifty children ages 5, 6, 7, and 8 were given the test and scores were analyzed using the KR-20 formula. The results indicate that the 72-item full scales (Draw-A-Man or DAM and Draw-A-Woman or DAW) show good internal consistency at all ages, with no sex differences in mean score or internal consistency. In a secondary analysis, the 42 items common to both the DAM and DAW were examined to determine if a "short form" of the test might be constructed. The common item set showed sex effects, and internal consistency was notably lower for females than males at all age levels.
MARKOV Count: A Program for Computing the Learning Statistics of Two-Stage Markov Learning Experiments
Authors: Kingma Johannes , Reuvekamp Johan
Published: March 2007

This paper describes a PASCAL program that computes both different types of transitions and learning statistics suitable for learning experiments in which a two-stage Markov model is used. The frequency counts of the different transitions are used for estimating the parameters of the two-stage Markov model, where-as the learning statistics are employed for the goodness of fit tests of this model.
EIGEN: A Basic Program for Computing the Eigenvectors and Eigenvalues of a Real Symmetric Matrix
Authors: Powers Stephen
Published: March 2007

A computer program is described which computes the eigenvalues and eigenvectors of a real symmetric matrix. This program was written in BASIC for the TRS-80 microcomputer.
ROSS: A Microcomputer Program for Scoring the Ross Test of Higher Cognitive Processes
Authors: Pascale Pietro J. , Sundberg Vaughn N.
Published: March 2007

A computer program is described which generates the eightsubscale scores; analysis, synthesis, and evaluation scores; andtotal scores for the Ross Test of Higher Cognitive Processes. Thisprogram was written in BASIC for the Commodore 64 micro computer.
The Validation of the Scoring Criterion Problem in Multiplicative Two-Dimensional Classification Tasks
Authors: Kingma Johannes , Tenvergert Elisabeth M.
Published: March 2007

Three types of scoring for multiplicative two-dimensional classification tasks were distinguished: (1) The non-Genevan judgmentonly scoring criterion, (2) the Genevan scoring criterion of judgment-plus-explanation and (3) and the Genevan scoring criterion of counter suggestion. Two experiments are reported: one cross-sectional study (n = 487 age ranging from 4-year-olds to 11 -year-olds) and one longitudinal study (n=275, age ranging from 4-year-olds to 7-year-olds). The children in the cross-sectional study completed ten multiplicative classification tasks at one test administration, whereas in the longitudinal study the test was administered three times with four months interval. It was shown that all three scoring criteria produced a reliable test for multiplicative classification. Furthermore, the factor structures, which showed a very high degree of similarity for each of the scoring criteria, were invariant in the longitudinal study. It appears that the classification tasks for all these three scoring criteria refer to the same underlying concept. Although these three scoring criteria may be considered satisfactory from a psychometric point of view, one must be aware that the use of one of these criteria in research on the child's ability to understand and to carry out multiplicative classification tasks, needs to be based on an explanatory theoretical framework.
Environmental Assessment Index: Reliability, Stability, and Validity of the Long and Short Forms
Authors: Poresky Robert H.
Published: March 2007

The Environmental Assessment Index was developed to assess the educational/developmental quality of home environments of 3-year-old through 11-year-old children. The long form of Index is composed of 44 home observation and/or maternal interview items. The short form consists of 24 of the 44 items. The Index has been used to assess the quality of 62 rural children's homes in a three-year longitudinal study of ecological influences on rural children's mental and social development. The long form had a Cronbach alpha reliability of .74 and concurrent and predictive validity correlations with IQ estimates of +.66 and +.61 ( p <.01) for preschool children. The two-year test-retest correlation was .81 ( p <.001). The short form had a Cronbach alpha reliability of .82 and concurrent and predictive validity correlations with IQ estimates of +.64 and +.66 ( p <.01). The short form test-retest correlation was .86 ( p < .001). The scale items are included.
Alternative Methods for Combining Several Test Scores
Authors: Govindarajulu Z.
Published: March 2007

If a battery of tests is administered to the same individual, the question is how to combine the various resultant scores so as to obtain a composite score for prediction purposes. Even if preas-signed weights are used, they may not be the true weights, especially, when the test scores are intercorrelated. In the following the author briefly reviews the existing methods and proposes some new ones for obtaining weights that are best in some sense. Further, he illustrates the methods by using the data on certain city government employees.
Contemporary Measures of Attitudes toward Blacks
Authors: Byrnes Deborah A. , Kiger Gary
Published: March 2007

This paper reports the development of two scales to measure racial attitudes in contemporary society. Racial attitudes are difficult to assess in modern society since these negative attitudes are often masked by rationalizations that purportedly do not have to do with racial prejudice. The scales reported here are adapted from earlier racial attitude scales-specifically, the "Social Distance Scale" (Bogardus, 1933; Westie, 1953) and the "Social Situations Scale" (Kogan and Downey, 1956). Both were substantially revised and updated. Factor analyses, validity measures, and reliability coefficients are reported for the two scales and the subscales. The subjects were university teacher education students and students in general education courses in sociology ( N = 286).
The Effects of Ceiling Rules on the Internal Consistency Reliability of a Mathematics Achievement Test
Authors: Wilson Michael , Suriyawongse Somboon , Moore Alan
Published: March 2007

This study compared the estimates of reliability made using one, two, three, four, five, and unlimited consecutive failures as ceiling rules in scoring a mathematics achievement test. The total score for each individual became the sum of the correct responses prior to the point described by the ceiling rule. The results of this study indicated that the estimate of reliability using two, three, four, and five consecutive failures as the ceiling rules were an improvement over the methods using one and unlimited consecutive failures.
Group Matching: Is This a Research Technique to Be Avoided?
Authors: Ross Donald C. , Klein Donald F.
Published: March 2007

Systematic assignment procedures are sometimes advocated as contributing to experimental designs that will result in more nearly precise estimates of treatment effects than those with completely random assignment. Several maintain that this systematic assignment is counter-productive because it reduces the power of statistical tests relative to random assignment. To help resolve these positions, the variance of the sample difference and the power of the F test for mean differences were studied under group matching on covariates and also under random assignment. This procedure was followed for all combinations of (1) one or three covariates; (2) small, medium, or large error variance; and (3) simple analysis of variance (ANOVA) or analysis of covariance (ANOCOVA). ANOCOVA with group matching always resulted in the correct Type-I error, yielded the greatest power in 5 of 6 situations, and gave the smallest variance of sample differences in 5 of 6 situations. However, the superiority of ANOCOVA with group matching over ANOCOVA with random assignment was small. It is concluded that there is little to choose between these two methods when a model of linear regression obtains. If it does not, matched assignment is a judicious technique.
A Computer Program for Determining the Reliability of Dimensionally Scaled Data when the Numbers and Specific Sets of Examiners may Vary at Each Assessment
Authors: Ciccheti Domenic V. , Showalter Donald
Published: March 2007

Using a variant of the intraclass correlation coefficient (ICC), this program computes the reliability of dimensionally scaled variables when both the number and specific set of judges vary from one assessment to the next.
A Longitudinal Examination of the Dimensionality and Stability of the Organizational Commitment Questionnaire (OCQ)
Authors: Tetrick Lois E. , Farkas Arthur J.
Published: March 2007

Confirmatory factor analytic techniques were used to examine the dimensionality and stability of the Organizational Commitment Questionnaire (OCQ). Based on the item responses of a cohort of 440 Navy personnel at three time periods, the results suggest that the OCQ is composed of two separate, but highly correlated, dimensions. The dimensions of the OCQ were not stationary, but the results suggest that the value commitment dimension comprised of the nine positively worded items becomes more stable over time. Based on the pattern of factor loadings, squared multiple correlations of the items, and correlations among the factors it would appear that there would not be a loss in validity by using the short form of the OCQ, which consists of the items of value commitment dimension. These results also suggest that the OCQ may not be valid for individuals who have been with an organization for only a short time.
Validity and Reliability of the Original and Abridged Role Conflict and Ambiguity Scales
Authors: Murphy Christine A. , Gable Robert K.
Published: March 2007

Two studies were conducted to assess the validity and reliability of the original 29-item and the abridged 14-item role conflict and ambiguity scales developed by Rizzo, House, and Lirtzman (1970) for a sample of 362 university administrators. Although many reliability and validity studies have been conducted on managerial, technical, and clerical employees in several different types of organizations, few have been undertaken in academic settings and fewer still have examined both the original as well as the abridged scales. The results of Study I indicated that the abridged scales provide a conceptually meaningful, parsimonious, and reliable measure of the two role stress constructs. In addition, the results of Study II demonstrated that the role conflict scale could distinguish among administrators known to experience high levels of this form of role stress.
Measurements of Divergent and Complex Thinking
Authors: Kagan Dona M.
Published: March 2007

The purpose of this study was to examine (a) the degree to which tests of divergent production (DP) may be confounded by verbal ability and loquacity and (b) relationships among divergent thinking, social competency, and the syntactic complexity of prose written by subjects. Subjects were 61 fifth-and sixth-grade pupils who completed a battery of tests and wrote stories on an assigned topic. Their teachers evaluated them for social competency and for creative behavior. Even after controlling for verbal ability and loquacity, the DP tests appeared to measure a common, coherent set of abilities. Verbal rather than figural DP tests appeared to have relevance to social behavior. An association between complex thinking and the tendency to write in a relatively simple style suggested that complex thinkers may have (intuitively) appreciated the value of simplicity in facilitating communication.
Reading Grade Level of the London House Personnel Selection Inventory Series (PSI)
Authors: Werner Steven H. , Ash Philip
Published: March 2007

A series of readability analyses were conducted on the London House Personnel Selection Inventory, using the SMOG Index (McLaughlin, 1969) for the determination of reading grade level. The SMOG Index, a regression-derived formula, was calculated first by determining the number of polysyllabic words occurring in a subsample of 30 text passages. Then, the reading grade level required for comprehension of the entire text was determined. The results indicated that each of the nine versions of the London House Personnel Selection Inventory (PSI) is readable at the seventh grade educational level. In addition, each survey item of one version of the PSI was analyzed using a modified version of the SMOG Index. The results of this analysis also yielded the same seventh grade level of reading difficulty as the first SMOG analyses. It was concluded that the majority of those screened for employment with the survey typically exceed the reading comprehension levels of the average seventh grade student; and the jobs for which they are screened require at least that level of reading comprehension.
Development and Psychometric Properties of the Decision Conflict and Cooperation Questionnaire (DCCQ)
Authors: Dalton Dan R. , Cosier Richard A.
Published: March 2007

Research examining the positive effects of cognitive conflict and controversy has relied largely on laboratory protocol and case studies. This work develops a field-based instrument to assess decision conflict and cooperation. This study of 63 practicing managers indicates a robust three factor solution for the 10 item DCCQ instrument.
Life Styles Inventory: Its Applicability in the Canadian Context
Authors: Nediger William G. , Chelladurai P.
Published: March 2007

The purpose of the study was to assess the psychometric properties of Lafferty's (1973) Life Style Inventory in the Canadian context, and to evaluate the circumplexity of those life styles. A total of 581 Canadian subjects (males = 302; females = 274) responded to the 240-item inventory. The twelve subscales of the Life Style Inventory were found to be internally consistent. The item-to-total correlations yielded acceptable estimates of convergent and discriminant validity. The pattern of correlations among the life styles also indicated construct validity. However, a factor analysis of the twelve life styles defined three broader orientations instead of four as hypothesized by Lafferty. Also, the mapping of the factor loadings of the twelve life styles on a two-dimensional space did not produce a perfect circumplex, which could indicate that the twelve life styles constitute a linear, simplex model.
Group Embedded Figures Test (GEFT): Individual Differences, Performance, and Learning Effects
Authors: Mykytyn Peter P.
Published: March 2007

A laboratory study was conducted to investigate overall performance and learning effect differences with the Group Embedded Figures Test (GEFT) administered to 48 finance specialists. The study examined these differences based on the effects of several demographic characteristics: age, sex, total time employed with the current employer, total time employed in the current position, level of education, type of position held in the organization, and amount of academic and applied finance experience. Results indicated that total time employed in the organization tended to affect GEFT performance with those employed for fewer years manifesting greater field independence. An overall learning effect, as measured by the average difference score obtained between Parts II and III of the GEFT, was observed for those examinees who had been employed in the organization longer than the average.
Development of the Groupthink Assessment Inventory
Authors: Montanari John R. , Moorhead Gregory
Published: March 2007

This paper reports the development of the Groupthink Assessment Inventory (GAI)—a paper-and-pencil instrument that assesses the critical variables of Janis's groupthink hypothesis. The major tenets of the groupthink hypothesis are reviewed and discussed and the results of a preliminary study to test the validity of the GAI are reported.
The Anger Expression (AX) Scale: Correlations with the State-Trait Personality Inventory and Subscale Intercorrelations
Authors: Collins Steven W. , Hailey B. Jo
Published: March 2007

Undergraduate students (N = 502) completed the State-Trait Personality Inventory (STPI; Spielberger et al., 1979), and the Anger Expression Scale (AX; Spielberger et al., 1986), composed of three subscales, Anger Out (AX/Out), Anger In (AX/In), and Anger Control (AX/Con), and a total score of Anger Experienced (AX/EX). Correlations between each of the scales and subscales of the personality inventories were calculated and were compared with one another. As predicted, correlations between AX/EX and STPI subscales related to anger and anxiety were significantly higher than that between AX/EX and the STPI Curiosity subscale. Furthermore, the STPI Trait Anger Temperament subscale was more highly correlated with AX/Out than were any of the other personality subscales except STPI Trait Anger. Correlations between subscales of the AX were compared with those obtained by Spielberger et al. (1985) Whereas Spielberger et al. (1985) made a case for the independence of AX/Out and AX/In by presenting correlations of essentially zero for both male and female subjects, the present study showed a significant positive correlation between the two subscales for men, casting some doubt on the independence of the subscales.
On Using Regression Coefficients to Interpret Moderator Effects
Authors: Mossholder Kevin W. , Kemery Edward R. , Bedeian Arthur G.
Published: March 2007

In moderated multiple regression analysis, several researchers have relied totally or partially on the sign associated with the regression weight of the cross-product term xz to interpret a moderator effect. This study examined a common convention used in such interpretations. First through logical exposition, and then through the use of a Monte Carlo approach to simulate various moderator conditions, it was found that this convention may lead to incorrect inferences regarding interaction effects. Alternative procedures for interpreting moderator effects are recommended.
A Proposed Method to Combine Ranking and Graphic Rating in Performance Appraisal: The Quantitative Ranking Scale
Authors: Chiu Chi-Kwan , Alliger George M.
Published: March 2007

A method is proposed to combine a relative and an absolute approach to performance appraisal; specifically, graphic rating and ranking are combined. In two studies which examined this method, called the Quantitative Ranking Scale (QRS), less leniency generally was found in QRS than in graphic rating. The psychometric performance of the QRS was best when the distinction between the QRS and pure ranking was least. Nonetheless, the system would appear to hold promise as an alternative to graphic rating that could easily be adapted to other rating formats, such as behavioral anchoring or computerized rating.
The Use of Discriminant Analyses to Determine Subject Attrition Bias in Field Research
Authors: Zahrly Jan
Published: March 2007

Differences in subjects who remained with or dropped out of a research project were evaluated using discriminant analyses. Subjects were 79 factory employees who received ten different questionnaires measuring perceptions and attitudes during a 22 month research period. Attrition was not predicted by any of the eight personality variables. Situational variables significantly predicted attrition; subjects who completed all questionnaires were more likely to have been assigned to one set of sister teams, to have been socialized into the organization by group/formal methods, and to have been initially assigned to the night shift. Discriminant analysis is a statistical tool to determine some of the bias of longitudinal data.
Individual- and Group-Directed Leader Behavior Descriptions
Authors: Yammarino Francis J.
Published: March 2007

Relationships among individual- and group-directed measures of leader behavior descriptions and five variables were examined with an explicit consideration of multiple levels of analysis. In a sample of law enforcement personnel, results indicated that supervisor control and satisfaction with rewards were associated with individual- and group-directed measures of initiating structure based on differences between groups, but not within groups; role ambiguity and effort were associated with individual- and group-directed measures of consideration based on differences between groups, but not within groups; and satisfaction with supervisor was associated with individual- and group-directed measures of initiating structure and of consideration based on individual differences. Thus, different forms of measures (individual- or group-directed) of leader behavior descriptions were correlated with other variables based on different levels of analysis.
Maximized Reliability Estimates for Some Research Scales of The MMPI
Authors: Wagner Edwin E. , Adair Holiday E. , Foerstner Stacey
Published: March 2007

Distributions of all possible split-half correlations for the Harris and Lingoes, Wiggins, and Serkownek Scales of the MMPI that contained twelve items or fewer revealed significant negative skewness that resulted in spuriously lowered estimates of reliability. Corrections based on the optimized r11 increased the average Subscale split-half correlation from an alpha of .409 (or the average odd-even split of .411) to a maximized r11 of .604. Generally, reliability of scales, with the maximized r11 increased to levels acceptable for research purposes. It was concluded that research scales of the MMPI show split-half distributional anomalies which should dictate the use of maximized r11 to estimate internal consistency. It is suggested that these findings might be taken into consideration in the evaluation of the new MMPI.
Psychological and Personal Dimensions of Prospective Teachers' Reflective Abilities
Authors: Gipe Joan P. , Richards Janet C. , Levitov Justin , Speaker Richard
Published: March 2007

With an increasing concern that teachers develop reflective thinking abilities as part of their teacher training programs, there comes a need to know more about the reflector. This knowledge can guide teacher education programs in providing experiences that will enhance or encourage reflective ability. A Q-technique factor analysis was employed to examine a number of psychological and personal characteristics of prospective teachers in order to provide a description of those who have been classified as reflectors. The results indicate that both psychological and personal characteristics may be useful for describing reflectors and non-reflectors. Implications for teacher education programs are discussed.
Comparison between Continuous Bipolar and Unipolar Ratings of the Myers-Briggs Type Indicator
Authors: Tzeng Oliver C. S. , Ware Roger , Bharadwaj Naina
Published: March 2007

This study compared measurement properties of two response formats (bipolar and unipolar ratings) in personality assessment. Data used for empirical evaluation were responses of 135 volunteer college students on the Myers-Briggs Type Indicator (MBTI). The major results included: (a) high empirical factorial validity for both ratings on individual items with bipolar being superior; (b) higher validity in bipolar ratings than in unipolar ratings for the eight theoretical preference poles; (c) high alpha reliability coefficients for all eight preference poles in both ratings; and (d) evidence of high convergent, divergent, and discriminant validities for the eight preference poles across both ratings. It was concluded that while both ratings are reliable and valid, the bipolar method is more preferable for theoretical and practical purposes.
Validation of the Student Religiosity Questionnaire
Authors: Katz Yaacov J. , Schmida Mirjam
Published: March 2007

The aim of the present study was to confirm the validity of the Student Religiosity Questionnaire, an instrument compiled to measure religiosity of students at the high school level. The findings indicate that the SRQ is a valid and reliable measure of religious principles and religious practices for a representative sample of Israeli national-religious high school students.
Power and Reliability: The Case of Homogeneous True Score Regression Across Treatments
Authors: Fisicaro Sebastiano A. , Lautenschlager Gary J.
Published: March 2007

As part of their investigation of the relation between reliability of measures and statistical power, Nicewander and Price (1983) examined the situation in which true score regressions are homogeneous across treatments. They derived an equation indicating that the measure, X or Y, yielding the greater power depends on the reliabilities ( pXX'. and pYY', respectively) and the squared linear correlation between true scores for X and Y ( pT(X)T(Y)2). Typically, however, researchers cannot compute a direct estimate of pT(X)T(Y)2 The authors eliminate this problem by (a) pointing out situations in which the value of pT(X)T(Y)2 is either irrelevant or 1.0 and (b) demonstrating that their equation otherwise can be expressed in terms of pXX' and pXY only.
The Predictive Validity of the Asvab for Training Grades
Authors: Earles James A. , Ree Malcolm James
Published: March 2007

The validity of the ASVAB subtests and composites for grades in 150 military technical schools was investigated. Across all jobs and within the job categories of Mechanical, Administrative, General, and Electronics, after correction for range restriction, Arithmetic Reasoning was found to be the most valid subtest. Across all jobs and within the job categories, the Electronics composite or the General composite was the most valid composite.
Evaluating Undergraduate College Teaching: A Filipino Investigation
Authors: Watkins David , Gerong Andres
Published: March 2007

An investigation is reported which tests the applicability of two American instruments designed to assess tertiary students' evaluations of teaching effectiveness with 77 Filipino undergraduates. The scales were found to have generally high internal-consistency reliability coefficients, most of the items were seen to be appropriate, and every item was considered of importance by at least some of the students. In addition, all but the Workload/Difficulty items clearly differentiated between "good" and "poor" lecturers. Further analysis provided limited support for the convergent and discriminant validity of those scales hypothesized to measure similar or dissimilar components of effective teaching. However, this analysis did indicate more overlap between aspects of teaching skill and enthusiasm than evident in Western studies. Factor analysis confirmed this finding as a strong main factor of teaching effectiveness plus a minor factor referring to the workload of the course was obtained. Therefore this research questions the validity of these instruments and the underlying model of teaching effectiveness for Filipino students.
A Comparative Test of Magnitude Estimation and Pair-Comparison Treatment of Complete Ranks for Scaling a Small Number of Equalinterval Frequency Response Anchors
Authors: Schriesheim Chester A. , Gardiner Claudia C.
Published: March 2007

This study investigated whether previously-found differences in two sets of recommended five-point equal-interval response anchors could have been caused by scaling too many stimuli at one time. One set of recommended anchors, produced by magnitude estimation, was compared with a set produced by Thurstone Case III pair-comparison treatment of complete ranks. Subjects (N =110) completed magnitude estimations and rankings of 8 frequency expressions. Few of the scale values produced by magnitude estimation differed significantly from the means obtained in previous studies or from the "ideal" values expected of exactly equal-interval anchors. However, this outcome was not true of the Case III results (they were seriously discrepant). Implications for future research are discussed.
Meta-Rand: A Sas Macro Program for Randomly Generated Meta-Analysis
Authors: Koslowsky Meni , Sagie Abraham
Published: March 2007

META-RAND is a SAS Macro that generates random values according to certain parameters that are then used for calculating the correlations in a meta-analysis. The program uses some of the new approaches to meta-analysis that have been suggested by Hunter and Schmidt (1990) and Whitener (1990). Output consists of uncorrected and corrected mean and variance of r and several measures of the degree of homogeneity or heterogeneity in the data. The program runs on any environment that supports the SAS software package.
Reliability and Validity of the Revised California Psychological Inventory'S Vector 1 Scale
Authors: Zebb Barbara J. , Meyers Lawrence S.
Published: March 2007

This study examined the reliability and validity of the revised California Psychological Inventory's (CPI) Vector 1 (v.1) scale, a measure of introversion-extraversion. The v.1 and other psycho- logical scales were administered to 345 introductory psychology students. Coefficient alpha for v.1 was .82, and its test-retest reliability after a 5-week interval was .88. Subjects who were more introverted as measured by v.1 reported that they were less sociable, less assertive, more easily embarrassed, had greater social anxiety, and had a more external locus of control than subjects who were more extraverted. It was concluded that v.1 is a valid measure of Gough's introversion-extraversion construct.
Probability Distributions of Minkowski Distances between Discrete Random Variables
Authors: Schroger Erich , Rauh Reinhold , Schubo Werner
Published: March 2007

Minkowski distances are frequently used to indicate the similarity of two vectors in a n-dimensional space. This paper is about the probability distributions of Minkowski distances (e.g., City-block distances and Euclidean distances) between vectors in spaces spanned by n orthogonal, discrete valued axes. Formulas to compute the distributions of Minkowski distances are developed, critical values for tests of significance are tabled, and a normal approximation is examined. With the given information about the distributions of Minkowski distances a proper interpretation of empirical distance values should be facilitated.
The Problem of Negative Reliabilities
Authors: Krus David J. , Helmstadter Gerald C.
Published: March 2007

Negative coefficients of reliability, sometimes returned by the standard formulae for estimation of the internal-consistency reliability, are neither theoretically nor numerically correct. Alternate strategies for test development in this special case are suggested.
The Development and Validation of the Arts Self-Perception Inventory for Adolescents
Authors: Vispoel Walter P.
Published: March 2007

The Arts Self-Perception Inventory (ASPI) is a new instrument for junior high school and high school students designed to assess self-concept in four major arts-related domains: music, visual arts, dance, and dramatic arts. Two-hundred-and-five 7th-grade students completed this inventory, the Self Description Questionnaire II (SDQ II), and an investigator-designed questionnaire assessing interest, self-ratings of ability, grades, and noteworthy accomplishments in the arts and school subject areas. Conventional and confirmatory factor analyses clearly identified the four dimensions the ASPI is intended to measure. ASPI subscale scores were highly reliable (all as = .92) and, in general, had low correlations with each other and with the other dimensions of self-concept measured by the SDQ II. Correlations among self-concept dimensions and other indices formed a logically consistent pattern that strongly supported the construct validity of the ASPI scores.
Development and Validation of the Six-Factor Self-Concept Scale for Adults
Authors: Stake Jayne E.
Published: March 2007

The Six-Factor Self-Concept Scale is a multidimensional measure of adult self-concept that was designed to have broad applicability across life settings, roles, and activities. Developed through a series of exploratory factor analytic studies, the measure consists of six subscales: Likability, Morality, Task Accomplishment, Giftedness, Power, and Vulnerability. Confirmatory factor analysis revealed that the 36-item, six-factor structure provided a reasonably good fit for data derived from a sample of 365 noncollege adults. Factor structures of correlation matrixes for men and women and for undergraduates and noncollege adults were highly similar. The subscales were tested for distinctiveness, internal consistency, test-retest reliability, convergent validity, and divergent validity. Evidence for all five qualities is reported. The subscales differentially predicted childhood memories, recent behaviors and events, and ratings by knowledgeable observers.
Kolb'S Learning Style Theory Revisited
Authors: Cornwell John M. , Manfredo Pamela A.
Published: March 2007

The use of nominal-level analysis of four primary learning styles (PLS) (i.e., doing, thinking, watching, and feeling), based on the Learning Style Inventory demonstrated their discriminant/convergent validity but not the validity of Kolb's learning style types (LST) (i.e., accommodator, diverger, converger, and assimilator). The LST typology is derived from the difference of two sets of ipsatively scored variables-a circumstance that contributes to its lack of validity, whereas the PLS categories are based directly on the rank ordering given by subjects. The PLS category, thinking, was associated with having higher scores on a mental ability measure, whereas doing was associated with higher levels of learning and performance on an origami paper-folding task (i.e., an archetypical doing task).
A Comparison of Numerical Indexes for Measuring Attitude Ambivalence
Authors: Breckler Steven J.
Published: March 2007

Ambivalence is expressed when a person endorses both positive and negative attitudinal positions. Ambivalence is commonly measured by having respondents provide separate ratings of the positive and negative components of their attitudes. A number of different equations have been proposed for combining the two ratings into a numerical index of ambivalence. However, similarities and differences among the equations are not well understood. This article introduces a graphical method to help identify the important properties of an ambivalence index. Five ambivalence indexes were compared and contrasted by using this method, and only two were found to possess satisfactory properties. The same indexes were also computed from respondents' ratings of 26 attitude topics, and it was found that empirical differences among the indexes were relatively small.
Development and Validation of a Brief Measure of the Three Psychological Needs Underlying Intrinsic Motivation: The Afs Scales
Authors: Reeve Johnmarshall , Sickenius Brad
Published: March 2007

According to self-determination theory, intrinsic motivation arises from three psychological needs: self-determination, competence, and relatedness. In the present article, the authors describe the development of a brief, reliable, valid, and easy-to-administer measure of each of these psychological needs. (A fourth scale to measure tension is included.) Normative data, coefficient alphas, and evidence for factorial and external validity for each of the Activity-Feeling States (AFS) scales are provided. Further, predictive utility for the AFS scales is demonstrated by showing that each scale predicts both self-report and behavioral measures of intrinsic motivation.
Designing Measurement Studies Under Budget Constraints: Controlling Error of Measurement and Power
Authors: Marcoulides George A.
Published: March 2007

When designing measurement studies, one generally needs to consider two statistical issues: power and measurement error. The mean error variance-covariance component is introduced as an estimate that takes into account both of these statistical issues. This article presents a methodology for minimizing the mean error variance-covariance component in studies with resource constraints. The method is illustrated using a one-facet multivariate design, and extensions to other designs are discussed.
Estimation of Quantiles for the Sampling Distribution of the rWG within Group Agreement Index
Authors: Charnes John M. , Schriesheim Chester A.
Published: March 2007

The James, Demaree, and Wolf within-group agreement index (rwG) may be used to assess interrater agreement when two or more individuals ("judges") provide ratings on one or more items ("targets"). Although the James et al. index is increasingly being used to assess whether the aggregation of data is justified for higher levels of analysis, the sampling distribution of rWG has not been delineated, and therefore it has not been possible to conduct tests of the statistical significance of obtained results. As a consequence of this current deficiency in knowledge about rWG, a Monte Carlo simulation program (AGREESIM) was developed to estimate selected quantiles for the sampling distribution of rWG under any user-specified null distribution of judges' scores. The output is in the form of quantiles and their 95% confidence intervals (showing the precision of the quantile estimates).