Prereglog exmaple project
Creators: name: Kovacs, Marton
Publisher: name: Open Science Framework
Year: 2022
Subjects: subject: Social and Behavioral Sciences

description: Study Information Title Registered replication of Weissman et al. (2014): "Determinants of Congruency Sequence Effects Without Learning and Memory Confounds" Research Questions We aim to replicate the key findings of Experiments 1 and 2 reported in Weissman, D. H., Jiang, J., &amp; Egner, T. (2014). Determinants of congruency sequence effects without learning and memory confounds. Journal of Experimental Psychology: Human Perception and Performance, 40(5), 2022-2037. The main research question is: is the congruency sequence effect (i.e., the interaction of previous trial congruency with current trial congruency in conflict tasks) present once feature integration and contingency confounds are removed from 4 different conflict tasks? What is the size of the effect in these different paradigms? Hypotheses The specific findings we aim to replicate are: 1) the CSE is present in a prime-probe conflict task without learning and memory confounds, in an online sample. 2) even though the original study only detected the CSE in the online variant of the confound-free Simon task, and not the Stroop and the flanker, we expect to find the effect in the latter two tasks as well because power will be increased in our replication (by increasing sample size). We however expect that the asymmetry in the original study (CSE only in the prime-probe and Simon tasks, not in the other two) will be reflected in a difference in effect sizes across paradigms, i.e., the prime-probe and the Simon tasks will produce the largest effects, with the Stroop and the flanker leading to smaller CSEs. Sampling Plan Existing Data Registration prior to creation of data Explanation of existing data Data has not been collected yet. Data collection procedures Data will be collected online (i.e., participants will complete the task in their own homes, at their own convenience). Participants will be Hungarian undergraduate students from different departments (not just Psychology) who will receive course credit for participation. The only inclusion criterion will be that subjects be over the age of 18. Exclusion criteria will include color blindness and non-native status. As data collection will happen online, we expect to reach our target sample size fairly quickly, such as over the course of a week. We are also proposing this replication as a potential multi-lab study. If other labs were to join, they would be encouraged to run at least 50 participants per condition. No files selected Sample size Planned target sample size for each experiment and condition is at least 2.5 times the original target N reported by Weissman et al. For each experiment and each between-subject condition this was 50 in the original study, therefore we aim to collect data from 125 participants per condition. This means total N for Exp. 1 is 125, and total N for Exp. 2 is 375 (3 x 125). Total target N for the whole study is therefore 500. As mentioned above, this replication study is proposed as a potential multi-lab effort - other labs will be encouraged to set a target N of at least 50 per paradigm, matching the Ns of the original study. Sample size rationale Simonsohn (2015) suggests the "original N x 2.5" formula to calculate adequate sample sizes for replication projects. (Simonsohn, U. (2015). Small telescopes: Detectability and the evaluation of replication results. Psychological Science, 26(5), 559-569.) Stopping rule Data collection will be terminated when target N is reached. Variables Manipulated variables Current trial congruency: congruency of a given trial (Trial N) in the conflict tasks (prime-probe in Exp. 1, Stroop, flanker, Simon in Exp. 2). Levels: congruent (no conflict) and incongruent (conflicting). Previous trial congruency: congruency of the previous trial (Trial N-1) in the conflict tasks. Levels: congruent and incongruent. Task (between-subject): the conflict task participants complete. Levels: prime-probe, Stroop, flanker, or Simon. No files selected Measured variables Reaction time and accuracy will be measured in all of the tasks. No files selected Indices For each task, means will be calculated for four conditions (Previous Congruency x Current Congruency): congruent trials that were preceded by congruent trials (cC), incongruent trials that were preceded by congruent trials (cI), congruent trials preceded by incongruent trials (iC), and incongruent trials preceded by incongruent trials (iI). For mean RTs only trials that are correct and are preceded by an other correct trial will be used. For accuracy analyses, all trials (that remain after screening, see below) will be used. Two indices will also be calculated: a measure of the size of the congruency effect in RT by subtracting mean congruent trial RT from mean incongruent trial RT; and a measure of the size of the CSE in RT. This will be calculated the following way: (cI - cC) - (iI-iC), where the four components are mean RTs of the four different conditions described above. No files selected Design Plan Study type Experiment - A researcher randomly assigns treatments to study subjects, this includes field or lab experiments. This is also known as an intervention experiment and includes randomized controlled trials. Blinding For studies that involve human subjects, they will not know the treatment group to which they have been assigned. Study design Exp. 1: within-subject design with Previous Congruency and Current Congruency as factors. Participants will complete a single task with different conditions. Exp. 2: a mixed-design with Previous Congruency and Current Congruency as within-subject factors and task (with three levels: Flanker, Simon, Stroop) as a between-subject factor. (The two experiments, however, will be carried out simultaneously, thus our design can be thought of as a mixed design with the above mentioned within-subject factors and a between-subject factor with 4 levels: Prime-Probe, Flanker, Simon, Stroop). No files selected Randomization The trial sequence of the tasks will be randomized across participants. Analysis Plan Statistical models For both Exp. 1 and Exp. 2: two 2x2 repeated-measures ANOVAs will be run per task, one with the mean RT and one with mean accuracy as the dependent variables. In both cases, the two factors of the ANOVA will be Previous Congruency (congruent, incongruent) and Current Congruency (congruent, incongruent). The following cross-task analysis will also be conducted: a one-way between-subject ANOVA with task (levels: Prime-Probe, Flanker, Stroop, Simon) as the single factor, and the CSE index as the dependent variable will be run to examine if the size of the effect differs across tasks. If the Levene test indicates the violation of the assumption of homogeneity of variances, a Kruskal-Wallis H test will be run. To investigate whether the size of the CSE changes as a function of the magnitude of interference, correlations between the CSE and the congruency effect will be calculated, within each task. No files selected Transformations Previous and Current Congruency will be coded as follows: 0 = congruent, 1 = incongruent. Accuracy will be coded as follows: 0 = incorrect response, 1 = correct response. Follow-up analyses Following significant interactions, simple effects tests will be used to explore the pattern of the interactions. In the cross-task analyses, if the one-way ANOVA yields a significant result, Tukey's post-hoc test will be used to investigate pairwise differences. If instead of the one-way ANOVA a Kruskal-Wallis test is run, Dunn's test will be run to investigate pairwise comparisons. Inference criteria Bayes factors (BF) will be used to make inferences about the data. To ease interpretation of the results, we will use cut-offs suggested by Jeffreys (1961): a BF higher than 3 or lower than 1/3 will be taken to indicate support for the alternative or the null models, respectively. P-values will also be reported, but whenever the Bayesian and the frequentist analyses lead to different conclusions, BFs will be used to make decision. Priors for the different analyses will be determined the following way: 1) in within-task CSE analyses, a half-normal distribution will be used with a mean of 0 and a SD equal to the half of the congruency effect (in ms) for a particular task in the original data set by Weissman et al. (2014). To test the congruency main effect, the SD will be set to the congruency effect reported by Weissman et al. (2014) for that particular task. 2) for pairwise comparisons contrasting the magnitude of the CSE between tasks, a half-normal distribution will be used with a mean of 0 and SD equal to half of the greater congruency effect of the two in any given pair as reported by Weissman et al. (2014). 3) for the correlation between the CSE and the congruency effect, analyses will be conducted on the Fisher Z transformed r values, and a two-tailed normal distribution will be used as a prior, with a mean of 0 and a SD of 0.549 (corresponding to an r of 0.5). Data exclusion First, participants whose overall mean accuracy is below 70% or whose overall mean RT is more than 2.5 SDs away from the group mean will be excluded. Then, for each participant, trials more than 2.5 SDs away from the participants conditional means will be excluded as outliers. Trials immediately following outliers will also be excluded. (As mentioned above, for RT analyses, error trials and trials immediately following errors will also be removed.) Missing data Participants who do not complete the task will not be included in the analyses. Exploratory analysis NA