Spreadsheet: 7424becb-aab9-431c-8521-d0608c0bd2e7
Sheet: 2. Assessments

 | Functional Requirements
 | All of the following functionality is in the Thinkgate base system or on their development roadmap. * Those items marked in column A with an asterisk are not applicable for Virtual LEAs and are not required for said virtual LEA. |  | LEA Selected IIS
 | Requirement Description | Mandatory or Preferred | Meets Requirement (Y/N)? | Tool Name | Level of Satisfaction (1, 2 or 3) | Comments
2.0 | Assessment and Growth
2.1  Assessment Items
Thinkgate Narrative: | The Elements Platform's robust repository allows for the support of multiple item types and statistics leading to a higher level of assessment rigor. The ability to increase rigor is directly related to the support of a myriad of assessment items from multiple choice to rubric based performance assessments, as well as, solid assessment creation process: field test items, anchor items and reviewer capability.  Items may be created and entered by the appropriate users as configured by the client.  Items may be self-created or copyrighted and secured in separate item banks.
2.1.1.a. | Supports state-approved items accessible to all users | Preferred
2.1.1.b. | Supports district, school, and teacher-created items accessible based on organizational level and apprioval level resulting from workflow (2.1.11) | Mandatory
2.1.2 | Provides a method for appropriate users to secure items for district or school based assessments | Preferred
2.1.3 | Provides a method for appropriate users to restrict individual users from adding items or modifying existing items based on school preference (administrator option) | Preferred
2.1.4 | Provides a method for appropriate users to lock an item to prohibit users from copying or editing the item | Preferred
2.1.5 | Provides a method for appropriate users to import  a variety of item types to include most or all of the following item types: constructed response, multiple choice, matching, close stems, short response, extended response, essay, interpretive exercises, performance assessment, and observational assessment | Preferred
2.1.6.a | Provides a method for users to create and edit a variety of item types to include most or all of the following item types: constructed response, multiple choice, matching, close stems, short, extended response, essay, interpretive exercises, performance assessment, and observational assessment, including associated rubrics, multi-media, anchor papers, and checklists | Mandatory
2.1.6.b. | Allows authors with no HTML knowledge to create/add items | Preferred
2.1.7 | Provides a method for an item author to share an item locally | Preferred
2.1.8 | Provides a method for users with the appropriate role to import item banks from other vendors and sources though QTI format | Preferred
2.1.9 | Provides a method to export items in QTI format | Preferred
2.1.11 | Provides an approval workflow for items prior to being incorporated into a shared item bank. | Mandatory
2.1.12 | Allows the use of externally created graphics, including but not limited to photos, graphics, charts and graphs | Mandatory
2.1.13 | Allows question text to be enhanced with underline, bold, italics, superscripts, subscripts, etc. | Preferred
2.1.14 | Allows for mathematical equations, graphics editors, and other equation editing capabilities | Mandatory
2.1.15 | Provides predetermined quality assurance criteria (such as at least 4 choices for MC items, correct spelling, rubric for performance-based item) when creating items | Preferred
2.1.16 | Maintains secure answer keys, scoring rubrics for constructed response items, and associated resources such as anchor papers, annotations, training sets, and qualifying sets | Mandatory
2.1.17 | Provides a method to store or link to audio files, video files (adheres to most current standards for presentation of video), and interactive objects | Preferred
2.1.18 | Provides links between assessment items and their associated graphics or passage | Mandatory
2.1.19 | Provides a method to keep all assessment items linked to passages or other common stimuli grouped together | Mandatory
2.1.20 | Provides a method to keep all assessment items linked to passages presented in a fixed order | Preferred
2.1.21 | Provides a method for users to link assessments and assessment items to one or more standard | Mandatory
2.1.22 | Provides a method for appropriate users to mark items as "anchor items" (e.g. common item, linking item - used for calculations) | Mandatory
2.1.23 | Provides a method for users to associate meta-data describing assessment items using most or all of the following:
 | [NAME]) assessed  (LRMI - Competencies) | Mandatory
 | [NAME] | Preferred
 | [NAME] (Y/N) | Mandatory
 | d. copyright date | Preferred
 | e. creation date  (LRMI - created) | Preferred
 | [NAME] (person who found and tagged the item)  (LRMI - creator) | Preferred
 | g. difficulty level | Preferred
 | h. grade level | Mandatory
 | [NAME] type (multiple choice, true-false, extended response, observation, performance, etc.) | Mandatory
 | [NAME]([NAME]) | Preferred
 | k. lexile | Preferred
 | l. license | Mandatory
 | m. organizational level (school, district, state) | Mandatory
 | [NAME]/host  (LRMI - publisher) | Preferred
 | o. quantile | Preferred
 | p. peer rating | Preferred
 | q. resource classification (assessment, instruction, etc.)  (LRMI - educationalUse) | Mandatory
 | r. skill | Preferred
 | [NAME]([NAME] 0 topic) | Mandatory
 | t. title  (LRMI - title) | Preferred
2.1.24 | Provides a method to maintain license information for assessment items by publisher and authorized users (schools, districts, state, etc.) and restrict access to published materials that require a specific license/right to use. | Mandatory
2.1.25 | Provides a method to include source, copyright designation, and permission documentation for assessment items and their prompts (passages, artwork graphics, etc.) | Mandatory
2.1.28 | Stores the following information for each item, where appropriate:
 | [NAME] description of the item | Mandatory
 | [NAME] item | Mandatory
 | [NAME] rules (answer key, points for each response option, points for item) | Mandatory
 | d. item answer incorrect responses (annotated responses) | Mandatory
 | e. item resources (resources needed to administer the items graphics, tools, passages, artwork, reference materials, etc.) | Mandatory
 | [NAME] or item discrimination | Preferred
 | [NAME] (probability) or item difficulty | Preferred
 | h. IRT Parameters (a, b, and c) | Preferred
 | i. Original item statistics if imported from other source (must be retained) | Preferred
2.1.29 | Calculates statistics for each item for each test administration:
 | a. frequency of each distracter | Mandatory
 | [NAME] item history usage statistics including frequency, grade, district, and date | Mandatory
 | [NAME] or item discrimination | Preferred
 | d. p-value (probability) or item difficulty p value only if from a vendor | Preferred
 | e. Response times (for computer-delivered items) | Preferred
2.1.30 | Provides a method for teachers to rate assessment items as they use them. | Preferred
2.2  Assessment Creation and Management
Thinkgate Narrative: | Due to Elements Platform functionality, assessments may be created, edited and distributed based upon custom control tables.  These assessments may be reviewed, shared or modified by those in the appropriate user based roles.  Different assessments types (formative, interim, summative, diagnostic, etc) can be created in multiple versions of the same assessment.  Ease of use was paramount in the creation of functionality to support the assessment creation.
2.2.1 | Supports state-created assessments accessible to all users | Preferred
 | Supports district, school, and teacher-created assessments  accessible based on organizational level and approval process resulting from workflow (2.2.30) | Mandatory
2.2.2 | Provides a method for appropriate users to import and modify assessments acquired from other sources based on appropriate licensing.  Provides a method to maintain license information for assessments by publisher and authorized users (schools, districts, state, etc.) and restrict access to published materials that require a specific license/right to use. | Preferred
2.2.3 | Allows authors to create, edit, and delete their own assessments | Mandatory
2.2.4 | Provides the method for an assessment author to share an assessment locally | Preferred
2.2.5 | Provides a method for a user who has appropriate security permissions to copy and modify assessments in the assessment bank | Mandatory
2.2.6 | Provides a method to create, manage, and score different versions of the same test | Preferred
2.2.7 | Provides a method to flag an assessment as formative, interim, summative, observational, performance, diagnositic | Mandatory
2.2.8 | Provides a method to create or import both holistic, quality based rubrics and trait or analytical quantity based rubrics to be attached to instructional components | Preferred
2.2.9 | Assessments may include sub-sections | Preferred
2.2.10 | Provides a method to include teacher notes to the test taker | Mandatory
2.2.11 | Provides a method to include internal teacher notes for sharing regarding the use/effectiveness of the assessment | Preferred
2.2.12 | Provides a method to include administration instructions | Preferred
2.2.13 | Provides a method to require proctor’s name and password before assessment is started | Preferred
2.2.14 | Provides a method to identify/display explicit criteria in a variety of formats, to include but not limited to: samples of student work (anchor papers) with connections to rubric or score expectations  (an example to use while scoring an assessment) | Mandatory
2.2.15 | Provides a method for users to assign point values to each item based either on assigned points or a percentage of the available points per sub-section or assessment total | Mandatory
2.2.16 | Supports inclusion of URL links as part of assessment instruction with consideration of security issues | Preferred
2.2.17 | Allows authors to create timed or un-timed tests | Preferred
2.2.18 | Provides a method for users to search and/or filter assessment items at a minimum by standard, grade level, subject area, item type, and author as well as one or more of the tagging items found in requirement 2.1.23 above while building an assessment | Mandatory
2.2.19 | Allows the user to require delivery of items in a specific order | Mandatory
2.2.20 | Displays teacher’s prior use of items during the current school year | Preferred
2.2.21 | Supports user control over layout/presentation, for example, “what-you-see is what-you-get" (WYSIWYG) entry of assessment questions and answers preserving fidelity of presentation on most devices | Preferred
2.2.22 | [NAME] display formatting for text (e.g., bold, italics, colored fonts, etc.), images, sound, videos (adheres to most current standards for presentation of video), and animation | Preferred
2.2.23 | Provides the option to shuffle choices in lists each time answer options are presented | Preferred
2.2.24 | Provides students taking the online assessment to easily see which items have and have not been responded to | Preferred
2.2.25 | Supports the ability for students taking the online assessment to randomly answer questions | Preferred
2.2.26 | Supports the ability and provides a method to require students taking the online assessment to answer a specific question before going to the next question | Preferred
2.2.27 | Allows for the option of a student comments box during assessment | Preferred
2.2.28 | Provides a method to associate meta-data describing assessments using most or all of the following:
 | [NAME]) assessed  (LRMI - Competencies) | Mandatory
 | 1. using CCSSO identifiers | Mandatory
 | 2. using industry-recognized curricular standard URLs, such as those provided by Achievement Standards Network or [NAME] | Mandatory
 | [NAME] | Preferred
 | [NAME] (Y/N) | Mandatory
 | d. copyright date | Preferred
 | e. creation date  (LRMI - created) | Preferred
 | [NAME] (person who found and tagged the item)  (LRMI - creator) | Preferred
 | g. grade level | Mandatory
 | h. language  ([NAME]) | Preferred
 | i. license | Mandatory
 | l. organizational level (school, district, state) | Mandatory
 | m. publisher/host  (LRMI - publisher) | Preferred
 | [NAME] rating | Preferred
 | o. resource classification (assessment, instruction, etc.)  (LRMI - educationalUse) | Mandatory
 | p. skill | Preferred
 | q. subject   ([NAME] 0 topic) | Mandatory
 | r. title  (LRMI - title) | Preferred
 | s. age appropriate criteria  (LRMI - typicalAgeRange) | Preferred
 | t. target audience (students, teachers, etc.)  (LRMI - intendedEndUserRole) | Mandatory
 | u. number of items | Mandatory
 | v. associated curriculum units | Preferred
 | w. location on one or more curriculum maps | Preferred
2.2.29 | Provides a method for users to search and/or filter assessments at a minimum by standard, grade level, subject area, and author as well as one or more of the tagging items found in requirement 2.2.28 above while building an assessment | Mandatory
2.2.30 | Provides an approval workflow for assessments prior to being incorporated into a shared assessment bank to incorporate multiple reviews, dates, item ratings, comments, authorship and source, with an audit trail of the vetting process. | Preferred
2.3  Assessment Assignment and Delivery
Thinkgate Narrative: | The Elements Platform supports the ability to secure, assign and deliever assessments in a variety of methods.  Through the Assessment Scheduler, assessments can be secured until a specified date and then released.  [NAME] assessments can be shared across schools or the district.  The assessments may be administered via online, plain paper or OMR scanning, web enabled tablets, handheld responders or entered manually by the teacher/proctor.  Online delivery is secured by locking screens and answer capture is protected from electrical outages.
2.3.1 | Provides a method for user to schedule and reschedule assessments | Mandatory
2.3.2 | Provides a method to assign assessments to a student or group of students (grade, class, or custom group) for whom the assessment author has security access | Mandatory
2.3.3 | Permits teachers to schedule either an assignment or assessment into their and their students’ individual calendars | Preferred
2.3.4 | Schedules assessments and tracks them via an online calendar | Preferred
2.3.5 | Allows assessment instructions to be customized for a test administration | Preferred
2.3.6 | Student and instructor users able to access checklist and/or a scoring rubric for each item | Preferred
2.3.7 | Provides a method for users to assign assessments to be administered by:
 | a. assessment name | Mandatory
 | b. course/section | Preferred
 | [NAME] | Preferred
 | d. grade level | Mandatory
 | e. administration start date | Mandatory
 | f. administration end date | Mandatory
 | [NAME] name or ID | Preferred
2.3.8* | Supports administration of assessments on multipage plain paper forms | Mandatory
2.3.9* | Supports administration of assessments on Optical [NAME] (OMR) forms | Preferred
2.3.10* | Printed answer forms must include a machine readable unique student identifier | Preferred
2.3.11 | Accommodates computer-based simulation assessments | Preferred
2.3.12 | Allows assessments to be administered using a variety of handheld web enabled devices, such as netbooks, tablets, smartphones | Preferred
2.3.13* | Allows assessments to be taken using handheld responders/clickers | Preferred
2.3.14 | Supports on-line assessment delivery to students | Mandatory
2.3.15 | Accommodates the administration of computer-based/online assessments that include multiple formats including:
 | a. matching | Mandatory
 | [NAME] | Mandatory
 | [NAME] choice | Mandatory
 | d. open ended | Mandatory
 | [NAME] | Mandatory
 | [NAME] | Mandatory
 | g. true/false | Mandatory
2.3.16 | Restricts the test-taker’s access to assessments and tools based upon parameters set by assessment administrator including some of the following: | Mandatory
 | a. number of times accessed (or until user defined proficiency threshold is obtained)
 | b. date and time of access
 | [NAME] time limit Min and [NAME]
 | d. use of calculators or other online tools such as spreadsheet formulas, protractors, rulers, highlighting etc.
 | e. based on a pre-determined access schedule (day, time, period, etc.)
 | f. by manual open/close by teacher or proctor
 | g. ability to change assessment responses prior to submission
 | h. restricted to browser assessment environment only (restricts access to other web applications)
 | i. restricted to a range of IP addresses
2.3.17 | Provides accessibility options to meet some or all of the following accommodations: | Preferred
 | a. ability to self-select print size or magnification
 | [NAME] provides graphics and text-based user interfaces
 | [NAME] scrolling difficulties
 | d. ability to vary screen size
 | e. minimize negative effects of magnification on graphics and tables
 | f. ability to self-select audio (screen reader), alternate language, or signed versions of instructions and test items, where appropriate
 | g. ability to have instructions repeated as often as student chooses up to a specified number of times
 | h. ability to vary audio speed and quality of audio presentation
 | i. ability to use screen reader that converts text into synthesized speech or Braille
 | j. ability to use alternative text or "alt tags" for images
 | k. ability to use color contrast for background and overlying text
 | l. ability to accommodate visually impaired students
2.3.18 | Allows for modifications of the assessment format such as font size, background color, and number of items on the page based on age, grade, and special needs of individual students | Preferred
2.3.19 | Supports electronic test-taker tools such as rulers, calculators, and protractors | Preferred
2.3.20 | Provides a method for user to edit administration settings | Preferred
2.3.22 | Provides a method to accept results if time limits are exceeded | Preferred
2.3.23 | Allows for un-timed question blocks (time out) to provide introductions/information | Preferred
2.3.24 | Provides a method for user to choose to display (or not display) time remaining on assessment | Preferred
2.3.25 | Provides a method for users to choose to warn (or not) the student when time is about to expire | Preferred
2.3.26 | Requests sufficient student identification as required by state/district to prove identity based on industry best practices | Preferred
2.3.27 | Supports the ability for students taking the online assessment to change answers for each section of the assessment before submitting the test | Mandatory
2.3.28 | Allows continuous and automatic saving of student responses during an assessment | Mandatory
2.3.29 | Provides the ability for test takers to view which items have/have not been responded to | Preferred
2.3.30 | Prevents “accidental” exiting from assessment by including a warning prompt | Preferred
2.3.31 | Prevents printing, screen captures,  saving to HTML, and viewing of HTML source during assessment session | Preferred
2.3.32 | Provides a method for appropriate users to lock down browser environment to prevent test takers from opening another web instance | Preferred
2.3.34 | Provides a method for the teacher to turn on and off test taker tools, including rulers, protractors, and calculators | Preferred
2.4  Assessment Scoring
Thinkgate Narrative: | Data from assessments is indicative of student growth.  The Elements Platform allows for ssessment scores to be collected via online, plain paper or OMR scanning, web enabled tablets, handheld responders or entered manually by the teacher/proctor.  Also supported are the import of state and national assessments.  Because all instructional resource material is tied to standards, the analysis of the collected information provides immediate and pertinent information to guide the educator in instructional student support.
2.4.1* | Supports scanning of student responses for off-line testing | Mandatory
2.4.2* | Provides a method for users to manually adjust or override scanned responses | Preferred
2.4.3 | Supports upload of student work associated with an assessment (e.g. presentation, report, video) maintaining a link to the assessment | Preferred
2.4.4* | Supports direct data entry of student responses for off-line testing when no scanner is available for multiple choice items | Mandatory
2.4.5 | Supports the upload of a specific MS Excel format, CSV needed for student answers | Preferred
2.4.6 | Supports on-line scoring of assessments | Preferred
2.4.7 | Allows for multiple educators to score a single assessment | Preferred
2.4.8 | Allows for both holistic and analytical rubric scoring of assessment items | Mandatory
2.4.9* | Supports direct data entry of student score for off-line testing | Mandatory
2.4.10 | Provides a method to import scores from other systems | Preferred
2.4.11 | Provides a method to export scores to other systems | Preferred
2.4.12 | Calculates score for overall assessment and by standard, standard domain, and standard cluster | Preferred
2.4.13 | System allows for weighting of each assignment/assessment category created towards final marking period grade calculation | Preferred
2.4.14 | Provides for seamless grade movement at the end of reporting period to district Student Information System for report card processing | Preferred
2.4.15 | Provides a method to access and/or import State assessment results such as MCAS, PARCC, OAA, OGT | Mandatory
2.4.16 | Provides a method to access and/or import other assessments results such as AP, ACT, SAT, PSAT, WIDA, DIBELS, etc. | Preferred
2.4.17 | Provides educator with a list of suggested resources (e.g. digital resources, curriculum resources including units and lesson plans, professional development resources targeted at teachers) or learning plan for individual students or student groups based on student outcomes on assessments. | Preferred