bluuebunny/crossref_metadata_2025 huggingface dataset:
An Approximation of a Hierarchical Logistic Regression Model Used to Establish the Predictive Validity of Scores on a Nursing Licensure Exam
Authors: Schmidt Amy Elizabeth
Published: July 2003

A validity study was conducted to examine the degree to which Diagnostic Readiness Test (DRT) scores and Pre-Admissions Test scores could predict success or failure on the National Council Licensure Examination for Registered Nurses (NCLEX-RN). Data were obtained from 5,698 students in 135 schools of nursing on three measures: DRT scores, Pre-Admissions Test scores, and success or failure on the NCLEX-RN. An approximation of a hierarchical logistic regression model was used in the analysis. Results indicate that the DRT is the only significant predictor of NCLEX-RN performance and that the DRT is a stronger predictor for baccalaureate graduates than for nonbaccalaureate graduates. Directions for further research are suggested.
Graphing Cumulative Distribution Functions
Authors: Tanguma Jesus , Speed F. M.
Published: July 2003

This article presents a method for producing graphical displays of cumulative distribution functions. Step-by-step instructions on how to produce these graphs are provided using a concrete example. By following the step-by-step instructions, researchers will be able to produce the plots for themselves using SPSS. Thus, they will have an alternative way to analyze and report their data.
On Adding a Mean Structure to a Covariance Structure Model
Authors: Bentler Peter M. , Yuan Ke-Hai
Published: July 2003

The vast majority of structural equation models contains no mean structure, that is, the population means are estimated at the sample means and then eliminated from modeling consideration. Generalized least squares methods are proposed to estimate potential mean structure parameters and to evaluate whether the given model can be successfully augmented with a mean structure. A simulation evaluates the performance of some alternative tests. A method that takes variability due to the estimation of covariance structure parameters into account in the mean structure estimator, as well as in the weight matrix of the generalized least squares function, performs best. In small samples, the F test and Yuan-Bentler adjusted chi-square test perform best. For example, if there is interest in modeling whether arithmetic skills or vocabulary levels are increasing across time, as one would expect in school, an analysis of means is an essential modeling component.
Reviewing and Changing Answers on Computerized Fixed-Item Vocabulary Tests
Authors: Vispoel Walter P.
Published: July 2003

Results obtained from computerized vocabulary tests were compared under conditions in which item review was permitted and not permitted. Comparisons between the review and no-review conditions yielded no statistically significant differences in number correct scores, ability estimates, or measurement error, but examinees in both conditions strongly desired review opportunities. Comparisons of answers before and after review within the review condition showed that only a small percentage of answers was changed (3.63%), that more answers were changed from wrong to right than from right to wrong (by a ratio of 2.25 to 1), that a large proportion of examinees (45%) changed answers to at least some questions, and that most examinees who changed answers improved their performance by doing so (by a ratio of 2.44 to 1). The results revealed that performance gains after review were greater for examinees of higher ability and that review was desired more by examinees with higher test anxiety. The major drawback to allowing review was a 35% increase in testing time.
A Review of Some Individual- and Community-Level Effect Size Indices for the Study of Risk Factors for Child and Adolescent Development
Authors: Mason Craig A. , Scott Keith G. , Chapman Derek A. , Tu Shihfen
Published: July 2003

This article discusses the computation and application of various epidemiological measures of effect in educational and developmental research. Specifically, epidemiology provides a potentially important perspective for studies identifying risk factors for healthy child development. For example, it allows for the examination of both individual-level risk (the impact of risk factors on individuals experiencing them) and community-level risk (the impact of risk factors on the overall number of cases within a population). In terms of individual-level risk, issues related to the use and interpretation of the risk-ratio, the odds-ratio, and the logistic regression odds-ratio are reviewed. In addition, community-level measures of effect, such as the population-attributable fraction percentage, are examined. Implications of the design methodology (cohort study, case-control study, or representative study) on the choice and use of these measures of effect are discussed. Data from a large-scale ongoing project in developmental epidemiology are presented throughout the article for illustrative purposes.
Development and Validation of Scores on the Basic Technology Competencies for Educators Inventory
Authors: Flowers Claudia P. , Algozzine Robert F.
Published: July 2003

The purpose of this study was to develop a new instrument, the Basic Technology Competencies for Educators Inventory (BTCEI). Undergraduate and postbaccalaureate teacher education majors ( N = 437) participated in the development. Results support the theoretical structure of the BTCEI. Scores for the nine domains had high internal consistency reliability (alphas ranged from .87 to .96) and adequate stability reliability (ranged from .77 to .90).
Validatieon of Scores on the Psychological Empowerment Scale: A Measure of Empowerment for Parents of Children with a Disability
Authors: Akey Theresa M. , Marquis Janet G. , Ross Margaret E.
Published: July 2003

This article reports the results of several psychometric analyses that were conducted to provide evidence of construct validity for scores on a measure of psychological empowerment, the Psychological Empowerment Scale (PES), for parents of children with a disability. Confirmatory factor analyses were conducted to evaluate the internal structure of the PES and the reliability of its scores. The results of the confirmatory factor analyses provided evidence of convergent and discriminant validity for the scores from the four subscales underlying the PES: (a) attitudes of control and competence, (b) cognitive appraisals of critical skills and knowledge, (c) formal participation in organizations, and (d) informal participation in social systems and relationships. Reliability coefficients for the subscale scores and total scale score ranged from .90 to .97. In addition, the PES scores were correlated with other empowerment-related measures. The results of these correlational analyses and group discrimination analyses provided additional evidence of convergent and discriminant validity of the PES subscale and total scale scores.
Development and Validation of Scores on a Two-Dimensional Workplace Friendship Scale
Authors: Nielsen Ivy K. , Jex Steve M. , Adams Gary A.
Published: July 2003

Two studies were conducted to develop and provide evidence supporting the construct validity of scores on a scale to measure two aspects of workplace friendship: friendship prevalence and friendship opportunities. In the first study, data collected from 200 part-time graduate students supported the internal consistency and proposed dimensionality of scale scores. In the second study, data were collected from a total sample of 116, which consisted of part-time graduate students and employees of three organizations. Support was provided for convergent, discriminant, and nomological validity of scale scores.
Roy Table: A Program for Generating Tables of Critical Values for Roy’s Largest Root Criterion
Authors: Lutz J. Gary
Published: July 2003

Roy’s largest root criterion is one of several multivariate test statistics available to the data analyst. Although it has a number of desirable properties to recommend it, no transformation to a more commonly tabulated statistic (such as the F ratio) exists, and the published tables for Roy’s criterion are quite limited in terms of levels of statistical significance and values of the distribution parameters. This article describes a PC-based program that permits the user to generate tables of critical values for Roy’s criterion for any level of statistical significance and for any set of distribution parameters. Roy Table is useful for the researcher who needs a more detailed tabulation of critical values than currently available and for the textbook author who wants to customize the tables being made available to the reader.
Reliability Methods: A Note on the Frequency of Use of Various Types
Authors: Hogan Thomas P. , Benjamin Amy , Brezinski Kristen L.
Published: July 2003

This study examined the frequency of use of various types of reliability coefficients for a systematically drawn sample of 696 tests appearing in the APA-published Directory of Unpublished Experimental Mental Measures. Almost all articles included some type of reliability report for at least one test administration. Coefficient alpha was the over-whelming favorite among types of coefficients. Several measures treated almost universally in psychological-testing textbooks were rarely or never used. Problems encountered in the study included ambiguous designations of types of coefficients, reporting reliability based on a study other than the one cited, inadequate information about subscales, and simply incorrect recording of the information given in an original source.
Published Studies of Interrater Reliability Often Overestimate Reliability: Computing the Correct Coefficient
Authors: Fan Xitao , Chen Michael
Published: July 2003

It is erroneous to generalize the interrater reliability coefficient estimated from two or more raters rating only a (small) portion of the sample to the rest of the sample data for which only one rater is used for scoring, although such generalization is often made implicitly in practice. If the interrater reliability estimate from part of a sample is available, the score reliability for the rest of the sample data for which only one rater is used for scoring can be estimated both within the framework of classical reliability theory and that of generalizability theory. As intuitively expected, score reliability when only one rater is used for scoring is lower than the score reliability for which two raters are used. The authors provide a sample of published studies in different disciplines that inappropriately generalized reliability coefficients involving several raters to scores generated by a single rater.
Examination of Differential Item Functioning on a Standardized Achievement Battery with Limited English Proficient Students
Authors: Snetzler Suzi , Qualls Audrey L.
Published: July 2003

This study examines the incidence of differential item functioning (DIF) on three subtests of the Iowa Tests of Basic Skills. Test scores for 2,867 Alaskan students categorized as native Alaskan or White were available at two points in time: fourth and sixth grade or sixth and eighth grade. Analysis of language proficiency was conducted exclusively on native Alaskans classified according to one of three language proficiency categories: limited English, bilingual, or English proficient. Although a consistent decrease in effect-size change over time was observed in the comparison between bilinguals and English proficient students, the incidence of DIF tended to be sporadic in terms of which group was favored. Recognizing the inseparable link between language and cultural/ethnic background, an additional DIF analysis comparing Whites to native Alaskans of equal English proficiency was conducted to enhance understanding of the language comparison. Effect-size differences, favoring Whites, were much larger than those observed in the language comparisons.
The Validity of Scores on the Multidimensional Aptitude Battery
Authors: Carless Sally A.
Published: July 2003

The purpose of the present study was to examine the factor structure of the Multidimensional Aptitude Battery (MAB) and also the extent of overlap between the MAB and the Wechsler Adult Intelligence Scales–Revised (WAIS-R). The sample consisted of 55 men and 30 women who were administered the WAIS-R and the MAB. Factor analysis showed that the MAB assesses two distinct aspects of intelligence: verbal and performance abilities. The validity coefficients indicated there was substantial overlap between the WAIS-R and MAB Verbal, Performance, and Total scale scores. However, 4 of the 10 MAB subtests did not correlate with the WAIS-R subscales they were designed to represent. It was concluded that the MAB is a suitable alternative to the WAIS-R when an indication of verbal, performance, or general abilities is required; however, the MAB should not be used when detailed information is required on specific abilities.
A Test of Revised Scales for the Meyer and Allen (1991) Three-Component Commitment Construct
Authors: Culpepper Robert A.
Published: July 2003

Despite evidence that Allen and Meyer’s scales measure three-component commitment in a reliable and valid manner, the literature contains recurring criticism of several scale items. Criticisms refer to violations of content validity, poor reflection of the construct, and a measurement artifact in the form of a reverse-scoring method factor. This study surveyed five published sets of factor pattern coefficients from exploratory and confirmatory factor analyses, all of which corroborate the consistently weak performance of these items across study samples. Confirmatory factor analysis was employed with two samples, one new and one previously reported, to compare original and revised scales. Results showed that substantially improved construct measurement is achievable with relatively modest scale revisions.
The Reliability and Construct Validity of Scores on the Six-Factor Dosc (Dimensions of Self-Concept) Scale for College Students
Authors: Paik Chie Matsuzawa , Michael William B.
Published: July 2003

The Dimensions of Self-Concept (DOSC)-Form H purports to measure academic self-concept of college students. The current DOSC-Form H consists of five subscales representing five hypothesized factors of academic self-concept. In this study, a sixth factor was added. The twofold purpose was to (a) examine the reliability and construct validity of scores on the six-factor DOSC-Form H as administered to a sample of 350 midshipmen at the U.S. Naval Academy and (b) compare scores on the DOSC-Form H by the subjects’ years at the academy academic major, and gender. The reliability tests indicated satisfactory reliability for scores on each of the six subscales of the DOSC-Form H. The confirmatory factor analyses resulted in an oblique six-factor model that supported multidimensionality of the DOSC-Form H. Comparison of scores by demographic variables indicated statistically significant difference in scores on the Academic Interest and Satisfaction subscale between genders and across academic majors.
A Confirmatory Factor Analysis of Scores on a Chinese Version of an Academic Self-Concept Scale and its Invariance across Groups
Authors: Huang Chiungjung , Michael William B.
Published: July 2003

The purposes of this inquiry were twofold: (a) to examine the factor structure, convergent validity, and discriminant validity of scores on a Chinese version of an academic self-concept scale titled Dimensions of Self-Concept (DOSC), which provides an assessment of standing in five factor subscales: Level of Aspiration, Anxiety, Academic Interest and Satisfaction, Leadership and Initiative, and Identification Versus Alienation; and (b) to examine factorial invariance of scores across gender and age groups. A convenience sample of 877 seventh-, eighth-, and ninth-grade students participated in a suburban area of Changhua, Taiwan. The research findings provided promising support for the convergent and discriminant validity of scores on the subscales corresponding to five hypothesized constructs. From a practical standpoint, the findings reported in this investigation indicated that the factor coefficients, the factor variance/covariance, and various errors across age and gender groups were invariant across groups.
Factor Validity of Scores on a Social Support and Conflict Measure among Chinese Americans
Authors: Hwang Wei-Chin , Chun Chi-Ah , Kurasaki Karen , Mak Winnie , Takeuchi David T.
Published: July 2003

Data collected from the Chinese American Psychiatric Epidemiological Study (CAPES) were used to examine the factor validity of selected social support and conflict indices among 1,152 married Chinese Americans. Gender, age, and a 36-item social interaction scale consisting of six separate indices of social support and social conflict (spouse, family, and friend) were factor analyzed. As expected, cross-cultural validity of scores on all six social interaction indices was confirmed, lending empirical support to the notion that social support and conflict from different sources are distinct constructs in Chinese Americans.
Identifying General Factors of Intelligence: A Confirmatory Factor Analysis of the Ball Aptitude Battery
Authors: Neuman George A. , Bolin Aaron U. , Briggs Thomas E.
Published: July 2003

Research supports a hierarchical factor structure of intelligence that is consistent with the second-order factor model proposed by Gustafsson in which five first-order factors yield a single second-order factor of General Intelligence (g). Gustafsson’s model was tested with structural equation modeling via the Ball Aptitude Battery (BAB), a measure of aptitudes and vocational interests. This study focuses on the tests from the BAB that are believed to measure various aspects of intelligence: Numerical Computation, Numerical Reasoning, Inductive Reasoning, Analytical Reasoning, Paper Folding, Idea Fluency, Idea Generation, Vocabulary, Associative Memory, Auditory Memory, Clerical, and Writing Speed. Results indicate that the factor structure of the BAB is consistent with Gustafsson’s second-order factor model of intelligence. Implications of this finding are discussed.
A Reexamination of Schriesheim and Hinkin’s (1990) Measure of Upward Influence
Authors: Hochwarter Wayne A. , Pearson Allison W. , Ferris Gerald R. , Perrewe Pamela L. , Ralston David A.
Published: July 2003

Research examining the tactics used to influence others has served as a significant line of inquiry over the past two decades. Critical to this stream of work has been the development of measures used to assess the frequency of upward influence tactics. This article reexamines a taxonomy and instrumentation originally presented by Kipnis et al. and modified by Schriesheim and Hinkin. The authors of this article assessed the factor structure, convergent, and discriminant validity of the 18-item, six-factor (i.e., assertiveness, exchange, rationality, ingratiation, upward appeal, and coalition building) measure. Data relevant to the investigation of construct validity were gathered from four independent samples. Concerns regarding lower than acceptable reliability estimates and unexpected item-factor correlations surfaced suggesting the need to develop a more appropriate measure of upward influence tactics.
Assessing Differential Prediction Bias in the Developing Cognitive Abilities Test across Gender, Race/Ethnicity, and Socioeconomic Groups
Authors: Canivez Gary L. , Konold Timothy R.
Published: July 2003

This study investigated the differential predictive validity of the Developing Cognitive Abilities Test (DCAT) in a heterogeneous sample of 863 sixth-grade students. Bias was assessed across gender, race/ethnicity, and socioeconomic dimensions. Level H of the DCAT was administered during the students’ sixth-grade year, and selected subtests from the Iowa Tests of Basic Skills (ITBS) were administered 8 months later during their seventh-grade year. Overall, results indicated a general lack of bias in the DCAT in predicting ITBS scores across gender, race/ethnicity, and socioeconomic groups.
Memory and Reasoning Abilities Assessed by the Universal Nonverbal Intelligence Test: A Reliable Component Analysis (RCA) Study
Authors: Caruso John C. , Witkiewitz Katie
Published: July 2003

The Universal Nonverbal Intelligence Test (UNIT) is an important advancement in intelligence assessment, but the equal-weighting method used to compute scores for the memory and reasoning abilities results in some psychometric weaknesses. The equally weighted memory and reasoning scores are highly correlated, leading to a lack of discriminant validity, a potential lack of incremental validity, and poor reliability for their score differences. Reliable component analysis (RCA) was performed on the UNIT normative data to allow for the computation of reliable, uncorrelated memory and reasoning scores. The RCA scores were highly replicable across samples and ages, have good convergent validity, and have greater discriminant validity than the equally weighted scores. Furthermore, the difference between the memory and reasoning scores is much more reliable when using RCA. This results in narrower confidence intervals around difference scores and more powerful tests of the null hypothesis that there is no true difference between memory and reasoning abilities.
Do Different Response Formats Change the Latent Structure of Responses? an Empirical Investigation Using Taxometric Analysis
Authors: Arnau Randolph C. , Thompson Russel L. , Cook Colleen
Published: July 2003

Although Web-based surveys are increasing in popularity, very little research has been conducted on the psychometric implications of using different user interfaces for eliciting responses to survey items. The purpose of this study was to compare the latent structures of responses to two different user interface response formats in a Web-based survey. Two different coherent cut kinetics taxometric procedures—MAMBAC and L-mode factor analysis—were used to examine the latent structure of responses to a survey of library service quality using an unnumbered slider-bar user interface versus a radiobutton user interface. Strong evidence was found for a pure dimensional latent structure of responses from both user interfaces, which replicated across both taxometric procedures and across multiple survey items. It is concluded that the slider-bar and radiobutton user interfaces both yield similar latent structures of survey item responses. The implications of these findings for the construction of Web-based surveys are discussed.
Reliability Generalization: Exploring Variation of Reliability Coefficients of MMPI Clinical Scales Scores
Authors: Vacha-Haase Tammi , Kogan Lori R. , Tani Crystal R. , Woodall Renee A.
Published: July 2003

This study used reliability generalization to explore the variance of scores on the Minnesota Multiphasic Personality Inventory’s (MMPI’s) 10 clinical scales. Reliability generalization was implemented to identify (a) typical reliability of scores across studies, (b) the variability of clinical scale score reliability, and (c) measurement factors explaining or predicting variability in MMPI clinical score reliability. The reliability coefficients for scores on the 10 scales ranged from .00 to .96. Scale 5 (Mf) appeared to have the greatest variability ( SD = 0.20) and Scale 2 (D) the widest range of score reliabilities (.00 to .93). Average reliability coefficients ranged from .64 for Scale 6 (Pa) to .81 for Scale 0 (Si). Variations in MMPI clinical scale score reliabilities were best predicted by (a) MMPI form and (b) participant age groups.
Teachers’ Perceptions Structured through Facet Theory: Smallest Space Analysis versus Factor Analysis
Authors: Maslovaty Nava , Marshall Anne E. , Alkin Marvin C.
Published: July 2003

This article examines Guttman’s facet theory (FT) and compares it to factor analysis (FA) in the context of two research studies. FT is examined in terms of its advantages and disadvantages compared to FA for theory development and confirmation. Two studies provide insights into the utility of FT. The first describes ideal student traits as perceived by prospective teachers. Using FT and smallest space analysis (SSA) confirmed the theory by displaying the accord between the facets in the mapping sentence and the distribution of the items in a multidimensional space. The second describes teacher professionalism and teaching context as perceived by teachers who completed a version of the Talbert and McLaughlin questionnaire. FT and SSA confirmed the theory and identified the subscales and dynamic relationships between them. By using the definitional mapping sentence of FT and SSA, the multidimensional theory and structural validity of the findings in the two studies were confirmed.
A Factor Analytic Study of the Substance Abuse Subtle Screening Inventory (SASSI)
Authors: Gray B. Thomas
Published: July 2003

The Substance Abuse Subtle Screening Inventory (SASSI) is a widely used but little studied screening test for substance misuse. The present study was the first to examine the test’s factor structure and also provided an opportunity to compare direct and indirect assessment approaches. Two large samples ( n1 = 888, n2 = 580) of SASSI protocols were obtained. Reliability coefficients were generally good (> .8) for the direct scales and poor for the indirect scales. Confirmatory and exploratory factor analyses showed the data to be a poor fit to a model implicit in the SASSI. A two-factor model closely matching the direct scales was generated, replicated with the second sample, and found to be invariant across gender.
Further Validity and Reliability Evidence for Beck Hopelessness Scale Scores in a Nonclinical Sample
Authors: Steed Lyndall
Published: July 2003

The psychometric properties of the Beck Hopelessness Scale (BHS) were examined among 544 university students. Internal consistency of scores was satisfactory (Cronbach’s alpha = .88). A principal-axis factor analysis with oblique rotation suggested four factors that were largely uninterpretable. Removal of items and further analysis suggested a two-factor structure of questionable interpretability. Convergent validity was demonstrated by high correlations with the Hope Scale and the Life Orientation Test (LOT). A correlation of .57 between the BHS and perceived stress reduced to .24 when trait negative affect was controlled for, indicating a degree of discriminant utility. It is concluded that for normal populations, measures such as the LOT and Hope Scale are more appropriate.
Meta-Analysis of 2 × 2 Tables: Estimating a Common Risk Difference
Authors: Sánchez-Meca Julio , Marín-Martínez Fulgencio
Published: July 2003

Five procedures for estimating a common risk difference in a set of independent 2 × 2 tables were assessed via Monte Carlo simulation in terms of their bias, efficiency, confidence level adjustment, and statistical power. The maximum likelihood estimator showed the best performance, very closely followed by Cochran’s and Mantel-Haenszel’s procedures. The conditional weighted estimator, d CW, showed an irregular performace. The unweighted estimator, d U, showed less efficiency and statistical power than that of the other procedures. As a consequence, the use of the d CW and d U estimators is not recommended. The implications of the results in the practice of meta-analysis are discussed.
A Measure of Agreement for Interval or Nominal Multivariate Observations
Authors: Janson Harald , Olsson Ulf
Published: July 2003

This article addresses the problem of accounting overall chance-corrected interobserver agreement among the multivariate ratings of several judges. Modifying an approach by Berry and Mielke, a generalization of Cohen’s kappa coefficient is proposed. The generalized statistic accounts agreement for multivariate interval or nominal observations among several judges. The statistic’s metric is conventional, and in the univariate case it is equivalent to existing extensions of the kappa coefficient to several observers, as well as to a certain intraclass correlation coefficient. Application is exemplified using hypothetical and real-life data sets.
Investigating the Hierarchical Factor Structure of the Fifth Edition of the 16PF: an Application of the Schmid-Leiman Orthogonalization Procedure
Authors: Chernyshenko Oleksandr S. , Stark Stephen , Chan Kim Yin
Published: July 2003

Two issues regarding the factor structure of the Sixteen Personality Factor Questionnaire (16PF) Fifth Edition were investigated: (a) unidimensionality of the 16 noncognitive scales and (b) hierarchical factor structure of the inventory. The Schmid and Leiman orthogonalization procedure was applied to obtain a hierarchical factor solution in which multi-item composites were mapped directly onto first- and second-order orthogonal factors while simultaneously illustrating the relative positions of factors in the hierarchy. Unidimensionality was assessed using modified parallel analysis. The results indicated that the noncognitive multi-item composites could be factored into 16 first-order and 5 second-order orthogonal factors.
Development of the Child Evaluation Measure: An Assessment of Children’s Learning across Disciplines and in Multiple Contexts
Authors: Atkins Deborah Hammond , Kelly Katherine T. , Morrison George S.
Published: July 2003

The Child Evaluation Measure (CEM) for preschool children was developed to provide an inclusive assessment instrument that covers primary academic content areas (reading, literacy, mathematics, and science), domains of child development (social, emotional, and physical/motor skills), and other areas foundational for optimal development of the young child in today’s society (music and creative arts, health and wellness, character education, and technology applications). The present study investigated CEM score validity on the 12 subscales and the total measure using data for 301 children assessed on each of two occasions. Both score reliability and score validity analyses were conducted.
Measurement Error of Scores on the Mathematics Anxiety Rating Scale across Studies
Authors: Capraro Mary Margaret , Capraro Robert M. , Henson Robin K.
Published: July 2003

The Mathematics Anxiety Rating Scale (MARS) was submitted to a reliability generalization analysis (RG) to characterize the variability of measurement error in MARS scores across administrations and identify possible study characteristics that are predictive of score reliability variations. In general, the MARS and its variants yielded scores with strong internal consistency and test-retest reliability estimates, although variation was observed. Adult samples were related to lower score reliability compared to other age groupings. Inclusion of total score standard deviation in the regression models resulted in roughly 25% increases in R2 effects.
Modeling the Observation-to-Variable Ratio Necessary for Determining the Number of Factors by the Standard Error Scree Procedure Using Logistic Regression
Authors: Nasser Fadia , Wisenbaker Joseph
Published: July 2003

Logistic regression was used for modeling the observation-to-variable ( n/ v) ratio required for the standard error scree (SEscree) procedure to correctly identify the number of factors in simulated data. The correlation matrices were generated to possess known characteristics: number of factors ( f), number of variables ( v), sample size ( n), magnitude of pattern coefficients ( p), and degree of interfactor correlations ( r). The results indicated that under all conditions, the n/ v ratio required for the SEscree procedure to correctly identify the true number of factors with high probability exceeded the minimum of 5:1 recommended in some of the related literature. This study demonstrated the ability of the logistic regression to simplify summarizing and reporting findings from simulation studies that involve a large number of conditions.
Hierarchical Confirmatory Factor Analysis of the Revised Personal Style Inventory: Evidence for the Multidimensionality Problem of Perfectionism
Authors: Hong Sehee , Lee Min-Kyu
Published: July 2003

Autonomy and sociotropy, reflecting excessive concern about autonomous achievement and interpersonal relationships, respectively, have been proposed as the two personality dimensions that prompt vulnerability to depression. Accordingly, several self-report questionnaires have been developed to measure these two dimensions. The revised Personal Style Inventory (PSI) represents a significant improvement over existing measures in that it assesses entire domains of autonomy and sociotropy. However, the PSI’s usefulness has been undermined by its unclear factor structure. Using 574 college students in Korea, the present study examined the factor structure of the revised PSI using hierarchical confirmatory factor analysis. Several first-order and two two-factor hierarchical models were tested, with a hierarchical model specifying perfectionism as associated with both hierarchical factors (Autonomy and Sociotropy) deemed the best fitting.
The Factorial Validity of Scores on the Teacher Interpersonal Self-Efficacy Scale
Authors: Brouwers André , Tomic Welko
Published: July 2003

The present study examined the factorial validity of scores on the Teacher Interpersonal Self-Efficacy Scale across two samples of 416 teachers each. Following self-efficacy theory, which posits that self-efficacy beliefs are linked to specific activities, it was hypothesized that the three Teacher Interpersonal Self-Efficacy subscales comprised three different activities linked to teacher self-efficacy beliefs. Confirmatory factor analysis results from the two samples supported the hypothesis by showing an adequate fit of a three-factor oblique model. This model fits the data better than either a two-factor or one-factor alternate model. Scores from the three subscales yielded coefficient alphas in excess of .90.
Initial Development and Score Validation of the Adolescent Anger Rating Scale
Authors: Burney Deanna McKinnie , Kromrey Jeffrey
Published: July 2003

The Adolescent Anger Rating Scale (AARS) was designed to (a) measure two distinct types of anger: instrumental and reactive, and (b) assist researchers and practitioners in identifying specific types of anger in adolescents. The present study investigated the construct validity of AARS scores. Seven hundred ninety-two 12-to 19-year-old adolescents in Grades 7 through 12 participated in the study. Factor analysis yielded three factors: Instrumental Anger, Reactive Anger, and Anger Control. Moderate to moderately high Cronbach alphas and test-retest reliability coefficients indicated that scores from the AARS are internally consistent and stable when measuring anger subtypes. Discriminant validity evidence supported the AARS scores’ ability to measure specific types of anger different from constructs of anger measured by the Multidimensional Anger Inventory (MAI).
Exploratory Analysis of the Structure of Scores from the Multidimensional Scales of Perceived Self-Efficacy
Authors: Choi Namok , Fuqua Dale R. , Griffin Bryan W.
Published: July 2003

The purpose of the present study was to examine the internal structure of scores from Bandura’s Multidimensional Scales of Perceived Self-Efficacy (MSPSE). Data were obtained from college freshmen, a population previously untested with MSPSE. Results show that scores from nearly all items aligned almost exclusively with theoretically and empirically derived dimensions. Some differences in empirically derived dimensions occurred as a result of extraction procedures, although the differences observed still provided theoretically interpretable constructs. These results suggest that Bandura’s scales, with slight revisions, show promise for research on self-efficacy with undergraduate college students.
Score Reliability in Webor Internet-Based Surveys: Unnumbered Graphic Rating Scales versus Likert-Type Scales
Authors: Cook Colleen , Heath Fred , Thompson Russel L. , Thompson Bruce
Published: July 2003

Unnumbered graphic rating scales theoretically can lead to greater score variance and thus greater score reliability. The use of Web-based graphic sliders overcomes the practical problems of administering graphic scales on paper measures: the excessive costs of scoring and excessive scoring errors arising from the tediousness of scoring done by hand. The study investigated whether graphic scales realize theoretically expected improved score reliability and how coarseness in slider scoring affects reliability. A large sample size ( n = 4,407) and diverse respondent groups were employed so that more confidence could be invested in results.
Correct Confidence Intervals for Various Regression Effect Sizes and Parameters: The Importance of Noncentral Distributions in Computing Intervals
Authors: Smithson Michael
Published: July 2003

The advantages that confidence intervals have over null-hypothesis significance testing have been presented on many occasions to researchers in psychology. This article provides a practical introduction to methods of constructing confidence intervals for multiple and partial R2 and related parameters in multiple regression models based on “noncentral” F and χ2 distributions. Until recently, these techniques have not been widely available due to their neglect in popular statistical textbooks and software. These difficulties are addressed here via freely available SPSS scripts and software and illustrations of their use. The article concludes with discussions of implications for the interpretation of findings in terms of noncentral confidence intervals, alternative measures of effect size, the relationship between noncentral confidence intervals and power analysis, and the design of studies.
Sample Sizes for Confidence Intervals on the Increase in the Squared Multiple Correlation Coefficient
Authors: Algina James , Moulder Bradley C.
Published: July 2003

The increase in the squared multiple correlation coefficient (δ R2) associated with a variable in a regression equation is a commonly used measure of importance in regression analysis. The probability that an asymptotic confidence interval will include δρ2 was investigated. With sample sizes typically used in regression analyses, when δρ2 = 0.00 and the confidence level is .95 or greater, the probability will be at least .999. For δρ2≥ .01 and a confidence level of .95 or greater, the probability will be smaller than the nominal confidence level. For δρ2≥ .05 and a confidence level of .95, tables are provided for the sample size necessary for the probability to be at least .925 and to be at least .94.
Confidence Intervals, Power Calculation, and Sample Size Estimation for the Squared Multiple Correlation Coefficient under the Fixed and Random Regression Models: A Computer Program and Useful Standard Tables
Authors: Mendoza Jorge L. , Stafford Karen L.
Published: July 2003

In this article, the authors introduce a computer package written for Mathematica, the purpose of which is to perform a number of difficult iterative functions with respect to the squared multiple correlation coefficient under the fixed and random models. These functions include, among others, computation of confidence interval upper and lower bounds, power calculation, calculation of sample size required for a specified power level, and providing estimates of shrinkage in cross validating the squared multiple correlation under both the random and fixed models. Attention is given to some of the technical issues regarding the selection of, and working with, these two types of models as well as to issues concerning the construction of confidence intervals.
Reliability of Scores from the Eysenck Personality Questionnaire: A Reliability Generalization Study
Authors: Caruso John C. , Witkiewitz Katie , Belcourt-Dittloff Annie , Gottlieb Jennifer D.
Published: July 2003

A reliability generalization study was conducted on data from 69 samples found in 44 studies that employed the Psychoticism (P), Extraversion (E), Neuroticism (N), and Lie (L) scales of the Eysenck Personality Questionnaire (EPQ) or EPQ-Revised. The reliability of the scores varied considerably between scales, with P scores tending to have the lowest reliability. Hierarchical regression analyses revealed that a larger standard deviation of scores was associated with higher score reliability for all four EPQ scales. More variability in age was associated with higher score reliability for the P scale and the L scale. Samples composed of students provided scores with higher reliability than those composed of other types of individuals for the P scale. Several other potential predictors (form, language of administration, average score, average age, gender composition, and number of items per scale) were not significantly related to score reliability.
It is Time to Bury the Spearman-Brown “Prophecy” Formula for Some Common Applications
Authors: Charter Richard A.
Published: July 2003

The restrictive assumption of classical parallelism for the Spearman-Brown formulas makes them obsolete when the two-part alpha and coefficient alpha formulas can be used. The alpha coefficients require the less restrictive assumption of essential tau-equivalence. Even small reliability differences produced by the Spearman-Brown and alpha coefficient formulas on the same data can result in large applied differences.
A General Measure of Work Stress: The Stress in General Scale
Authors: Stanton Jeffrey M. , Balzer William K. , Smith Patricia C. , Parra Luis Fernando , Ironson Gail
Published: July 2003

The present study focused on the development and validation of scores on the Stress in General scale. Three diverse samples of workers ( n = 4,322, n = 574, n = 34) provided psychometric and validity evidence. All evidence converged on the existence of two distinct subscales, each of which measured a different aspect of general work stress. The studies also resulted in meaningful patterns of correlations with stressor measures, a physiological measure of chronic stress (blood-pressure reactivity), general job attitude measures, and intentions to quit.
Power Calculator: A Collection of Interactive Programs
Authors: Pittenger David J.
Published: July 2003

This package of computer programs provides statistical power estimates for a comprehensive range of commonly used inferential statistics. The package also has utilities for generating critical values for tests of statistical significance, sequences of random numbers, random sequences for assignment of participants to independent groups, and the generation of Latin squares. Finally, the package contains a program that allows one to conduct Monte Carlo simulations with single-factor, factorial, and mixed-model analyses of variance. The programs are suitable for research purposes and as a teaching tool for students enrolled in statistics and research methods courses.
Checking the Appropriateness of Item Response Theory Models by Predicting the Distribution of Observed Scores: The Program Eo-Fit
Authors: Ferrando Pere J. , Lorenzo-Seva Urbano
Published: July 2003

This article describes a Windows program for checking the suitability of unidimensional logistic item response models for binary and ordered polytomous responses with respect to a given set of data. The procedure on which the program is based consists of predicting the observed test score distributions from the item characteristic curves. The fit between the observed and predicted distributions is mainly assessed by using graphical displays, but an additional χ2-type statistic is also reported. The program allows the relative fit of different models to be compared and can also be used in the context of cross-validation assessment.
Effects of Sample Size on the Distribution of Selected Fit Indices: A Graphical Approach
Authors: Tanguma Jesus
Published: July 2003

The purpose of the present study was to investigate the effects of sample size on the cumulative distribution of selected fit indices. Two models (i.e., a reduced and a complete model) and six (20, 50, 100, 200, 500, 1,000) sample sizes were used to investigate the effect on the cumulative distribution of the fit indices as sample size was varied. Generally, the comparative fit index (CFI) exhibited very stable patterns and was less influenced by sample size or data types than were other fit indices. In addition, the normed fit index performed similarly to the CFI.
Confirmatory Analysis of Exploratively Obtained Factor Structures
Authors: van Prooijen Jan-Willem , van der Kloot Willem A.
Published: July 2003

Factor structures obtained by exploratory factor analysis (EFA) often turn out to fit poorly in confirmative follow-up studies. In the present study, the authors assessed the extent to which results obtained in EFA studies can be replicated by confirmatory factor analysis (CFA) in the same sample. More specifically, the authors used CFA to test three different factor models on several correlation matrices of exploratively obtained factor structures that were reported in the literature. The factor models varied with respect to the role of the smaller factor pattern coefficients. Results showed that confirmatory factor models in which all low EFA pattern coefficients were fixed to zero fitted especially poorly. The authors conclude that it may be justified to use a less constrained model when testing a factor model by allowing some correlation among the factors and some of the lower factor pattern coefficients to differ from zero.
Differential Item Functioning in the Wisc-III: Item Parameters for Boys and Girls in the National Standardization Sample
Authors: Maller Susan J.
Published: July 2003

The Wechsler Intelligence Scale for Children–Third Edition (WISC-III) is the most widely used test of intelligence in the world. However, the manual for the WISC-III provides insufficient detail regarding the detection of differential item functioning (DIF). The WISC-III national standardization sample ( N = 2,200) was used to investigate DIF in six WISC-III subtests. After fitting two parameter logistic and graded response models to the data, items were tested for DIF using the item response theory likelihood ratio DIF detection method. Of the 151 items studied, 52 were found to function differently across groups. The magnitude of the DIF was also considered by examining (a) parameter differences between groups and (b) root mean squared probability differences. Because the scores of boys and girls may be composed of different items systematically scored as correct, their IQs cannot be assumed to have the same meaning. Further investigations of item content bias are recommended.
The Kaufman Ability Battery for Children Mental Processing Scale: A Valid Measure of “Pure” Intelligence?
Authors: Cahan Sorel , Noyman Alon
Published: July 2003

The Kaufman Ability Battery for Children (K-ABC) is predicated on the distinction between intelligence (measured by the Mental Processing scale) and achievement (measured by the Achievement scale). This article questions the validity of this distinction and the interpretation of the K-ABC’s Mental Processing score as a measure of “pure” intelligence, uncontaminated by schooling. Schooling was found to affect raw scores on all Mental Processing subtests in the Israeli standardization sample of the K-ABC. More-over, for five of the eight subtests, the effect of schooling exceeded the effect of age. No difference was found between the Mental Processing and Achievement scales in the relative magnitude of the age and schooling effects.
An Investigation of the Validity of Scores on Locally Developed Performance Measures in a School Assessment Program
Authors: Crehan Kevin D.
Published: July 2003

A multitrait-multimethod approach was used to investigate the validity of scores on locally prepared performance assessments. The multiple traits were reading, language arts, and mathematics, and the multiple methods were the Comprehensive Test of Basic Skills/4, locally developed multiple-choice tests, and locally prepared performance assessments. The results offer very limited evidence of convergence and discrimination for scores on the performance assessments. A partial explanation for the lack of construct validity evidence for the performance assessment scores is the probable low reliability of scores on the performance measures due largely to their limited content sampling and relatively low objectivity of scoring.