# Survey research and design in psychology/Assessment

Assessment

## Overview

* There are 9 online quizzes (5% each; total 45%), a data collection and entry exercise (10%) and a lab report (45%).
* All assessment is optional. Non-completed assessments will be awarded 0.
* A final overall mark of 50% or higher is required to Pass the unit. Partial final marks will be rounded up.
* Summary of assessment items:

## Quizzes

* Topics: There are 9 online quizzes, each worth 5% (total 45%), with the following topics:
** Survey research
** Survey design
** Descriptives and graphing
** Correlation
** Exploratory factor analysis
** Psychometrics
** MLR 1
** MLR 2
** Power and effect size
* Availability:
** Quizzes will be available until Mon 09:00 Week 14.
** UCLearn quizzes are only available to enrolled University of Canberra students.
* Late submissions: Not accepted
* Assessed knowledge: Quizzes assess knowledge of concepts covered in lectures, tutorials, and readings.
* Quiz content:
** Each quiz consists of 10 multiple choice questions drawn randomly from a larger test bank.
** The questions from each quiz correspond directly to a single lecture and its related readings.
** Some quizzes are harder than others (e.g., the lowest mean is typically for Quiz 05: Exploratory factor analysis).
* Question style: Some questions have more than one correct answer.
** In order to get full marks, all correct the answers must be selected and no incorrect answers must be selected. For example, if a question has 5 answer choices, 2 of which are correct (each correct answer would be worth 50%, adding to +100%) and 3 of which are incorrect (each incorrect answer would be worth -33% each, adding to -100%). The mark awarded is the total of the marks for each of the answer options selected. However, no negative total marks will be awarded for a question, so the lowest mark that can be awarded for a question is 0.
** The reason for including negative marks for incorrect answers for multiple response question types is that, otherwise, all answer options could be selected to achieve a full mark, even though some incorrect answers were selected. So, there needs to be some penalty for selecting incorrect options.
* Time limits: Quiz time limits vary between 10 and 20 minutes, depending on the complexity of the questions.
* Academic integrity: Quizzes are to be completed independently (i.e., without assistance of others), in your own time.
* Open book: Quizzes are open book - recommended resource materials include lecture, tutorial, and reading notes.
* Number of attempts: Each quiz can only be attempted once.
* Feedback: Answers to the quiz questions are shown immediately after quiz submission, but are no longer accessible once the feedback window is closed. Take any notes for study purposes prior to closing the feedback screen.
* Bonus marks: A bonus quiz mark is awarded for identifying an error or significant improvement to a quiz question - email details to the unit convener. For example, a student who got 7/10 on Quiz 1, emailed the unit convener to correctly point out a spelling error in that quiz, resulting in a bonus mark being added and the student's new Quiz 1 mark becoming 8/10.
* Practice quizzes: Some practice quizzes are available:
** Quiz 0 (a practice quiz) can be attempted as many times as you like. Use this quiz to test and make sure that you are familiar with how the quiz system works on the computer you are using.
** Several practice quizzes are available on Wikiversity, including:
*** Research types
*** Research purposes
*** Correlation
*** Exploratory factor analysis
*** Psychometric instrument development
*** Multiple linear regression
** Pearson - see External link sections on the lecture pages

## Data collection and entry

This assessment exercise provides hands-on involvement in real world survey data collection and data entry. It requires collecting data using a survey, entering data, submitting an electronic data file, and submitting the hard copy surveys in an accurate, timely fashion as part of a larger class project. The specific steps are to:
* Collect 5 cases of survey data by following the survey administration guidelines.
* Enter the survey data by following the data entry guidelines.
* Submit:
** Electronic data file via UCLearn by Monday 09:00 AM of Week 4 - no late submissions accepted
** Hard copy surveys as a single bundle with a coversheet by Monday 09:00 AM of Week 6 - no late submissions accepted - see hard copy survey guidelines
Important note: In order to earn any marks, it is necessary to submit both electronic and hard copy data on time. No marks will be provided if either the electronic or hard copy submissions are missing or late.

## Lab report
### Overview

* Present an independently-developed APA style lab report which examines:
** the psychometric properties of a multi-item, multi-factorial measure (either time management or time perspective) using exploratory factor analysis and reliability analysis (guided by a research question)
** an explanatory model involving at least three predictors and one dependent variable using multiple linear regression (guided by hypotheses - one per predictor).
* Use the class-aggregated data file from the data collection and entry assessment exercise, based on the Surveys about university student motivation, satisfaction, and time management

## Surveys

These surveys were designed for use by an undergraduate psychology class (Survey Research and Design in Psychology, 2005-2018):
* Time and Stress Questionnaire for University Students v.1 (TSQFUS1)
* The University Student Satisfaction and Time Management Questionnaire v.9 (TUSSTMQ9)
* The University Student Motivation & Satisfaction Questionnaire v.2 (TUSMSQ2)
Students used these surveys to collect data, entry data, and conduct analyses for a lab report.

## Using these surveys

These instruments and their items are free to use, adapt etcetera under a Creative Commons Attribution International 4.0 license.
However, be aware that the surveys in their current format are intentionally designed to not be "perfect" so that emerging scholars studying subjects such as "Survey research and design in psychology" can collect data and then practice exploratory factor analysis .
There is also intentionally no scoring key . Factor analysis is recommended to help determine the underlying factor structure and to identify which items to use to calculate composite scores. In other words, there is a latent structure, but you'll need to work it out. For example, for university student motivation, see these suggestions. Composite scores representing underlying constructs can then be used for descriptive statistics and hypothesis testing.

## Psychometrics

There are no reported psychometrics for newly developed items and scales in these survey instruments. Where intact, previously published measures were included, psychometrics may be available.
Users of these surveys should be prepared to conduct their own psychometric analyses (factor structure, reliability, and validity) based on their own samples.