abisha_models

.gitattributes

@@ -50,10 +50,3 @@ ratio_proportion_change3_2223/sch_largest_100-coded/finetuning/fullTest/test.txt
 ratio_proportion_change3_2223/sch_largest_100-coded/finetuning/fullTest/highGRschool10_/test_info.txt filter=lfs diff=lfs merge=lfs -text
 ratio_proportion_change3_2223/sch_largest_100-coded/finetuning/fullTest/highGRschool10_/test.txt filter=lfs diff=lfs merge=lfs -text
 ratio_proportion_change3_2223/sch_largest_100-coded/finetuning/fullTest/test_BKT.txt filter=lfs diff=lfs merge=lfs -text
-ratio_proportion_change3_2223/sch_largest_100-coded/output/first10/bert_fine_tuned.model.first10%.wfaopttime.wttime.wttopttime.wttnoopttime.ep23 filter=lfs diff=lfs merge=lfs -text
-ratio_proportion_change3_2223/sch_largest_100-coded/output/first10/bert_fine_tuned.model.first10%.wskills.ep24 filter=lfs diff=lfs merge=lfs -text
-ratio_proportion_change3_2223/sch_largest_100-coded/output/first10/bert_fine_tuned.model.first10%.wskills.wfaopttime.wttime.wttopttime.wttnoopttime.ep40 filter=lfs diff=lfs merge=lfs -text
-ratio_proportion_change3_2223/sch_largest_100-coded/finetuning/overallTestData/test_info.txt filter=lfs diff=lfs merge=lfs -text
-ratio_proportion_change3_2223/sch_largest_100-coded/finetuning/overallTestData/test.txt filter=lfs diff=lfs merge=lfs -text
-ratio_proportion_change3_2223/sch_largest_100-coded/finetuning/fullData/train_info.txt filter=lfs diff=lfs merge=lfs -text
-ratio_proportion_change3_2223/sch_largest_100-coded/finetuning/fullData/train.txt filter=lfs diff=lfs merge=lfs -text

.gitignore

@@ -1,5 +1,5 @@
 train_info.txt
 train.txt
 train_label.txt
-ratio_proportion_change3_2223/sch_largest_100-coded/
-
+ratio_proportion_change3_2223/sch_largest_100-coded/logs/
+ratio_proportion_change3_2223/sch_largest_100-coded/finetuning/

Astra Project Description.md

@@ -1,92 +0,0 @@
-# ASTRA (AI for STRategy Analysis)
-
-[![License: MIT](https://img.shields.io/badge/License-MIT-yellow.svg)](https://opensource.org/licenses/MIT)
-[![Python 3.7+](https://img.shields.io/badge/python-3.7+-blue.svg)](https://www.python.org/downloads/)
-
-
-ASTRA is a collaborative research project between the University of Memphis and Carnegie Learning focused on leveraging AI to enhance our understanding of mathematical learning strategies.
-
-## Project Overview
-
-ASTRA utilizes a pre-trained model (based on a BERT-like architecture) to learn mathematics strategies from extensive data collected through Carnegie Learning's MATHia platform (formerly known as Cognitive Tutor). The data comes from hundreds of U.S. schools using this Intelligent Tutor as part of their core, blended math curriculum.
-
-## Current Focus
-
-The current demonstration focuses on:
-- Domain: Ratio and Proportions
-- Grade Level: 7th Grade
-- Objective: Predicting strategies that lead to correct vs. incorrect solutions
-
-## Available Models
-
-ASTRA offers three fine-tuned models:
-
-1. **ASTRA-FT-HGR**
-   - Fine-tuned with data from schools with high graduation rates
-   - Specialized for high-performing school environments
-
-2. **ASTRA-FT-LGR**
-   - Fine-tuned with data from schools with low graduation rates
-   - Focused on understanding challenges in struggling schools
-
-
-## Usage Instructions
-
-1. **Model Selection**
-   - Choose one of the three fine-tuned models based on your analysis needs
-   - Each model offers unique insights into student learning strategies
-
-2. **Data Scope Configuration**
-   - Select the percentage of schools to include in your analysis
-   - Note: Larger percentages may require longer processing times
-
-3. **Results Analysis**
-   - Access the dashboard to view model results
-   - Results are segregated by school graduation rates (high vs. low)
-   - Analyze strategy predictions and their effectiveness
-
-## Technical Details
-
-The system is built on:
-- A BERT-like architecture for the base model
-- Fine-tuning using real-world student data from MATHia
-- Specialized training sets based on school graduation rates
-
-## Partners
-
-- University of Memphis
-- Carnegie Learning (MATHia Platform)
-
-## Links
-
-- [🤗 Hugging Face Space](https://huggingface.co/spaces/suryadev1/astra)
-- [📄 Research Paper](https://drive.google.com/file/d/1lbEpg8Se1ugTtkjreD8eXIg7qrplhWan/view?pli=1)
-- [🤗 Github: Astra demo](https://github.com/Syudu41/ASTRA---Gates-Project)
-- [🤗 Project Page](https://sites.google.com/view/astra-research/home)
-- [🤗 Path Analysis Tool](https://path-analysis.vercel.app/)
-- [🤗 Github: Path Analysis Tool](https://github.com/CarnegieLearningWeb/PathAnalysis)
-
-
-
-## Note
-
-This is a demonstration version of the ASTRA system. The models are trained on specific mathematical domains and grade levels, with a current focus on ratio and proportions in 7th-grade mathematics.
-
-## 📦 Dependencies
-
-- Python 3.7+
-- Required machine learning libraries
-- Access to Hugging Face platform
-
-## ⚡ Quick Start
-
-1. Visit `suryadev1/astra` on Hugging Face
-2. Select your desired analysis type
-3. Adjust parameters as needed
-4. Generate instant visualizations
-
-
----
-
-Made with ❤️ by the ASTRA team
-

Astra Project Setup Instructions.md

@@ -112,45 +112,5 @@ python new_test_saved_finetuned_model.py \
     -b 1000
 ```
 Replace `<finetune_task>` with the actual fine-tuning task value.
-### Arguments
 
-**`-workspace_name`**  
-- Description: The folder/workspace name where the project, dataset, and model outputs are organized.  
-- Example: `"ratio_proportion_change3_2223/sch_largest_100-coded"`
-
-**`-finetune_task`**  
-- Description: Specifies which fine-tuning strategy was applied to the model.  
-- Options:  
-  - **ASTRA-FT-HGR** → Fine-tuned with 10% data from schools that have a **High Graduation Rate (HGR)**.  
-  - **ASTRA-FT-FIRST10-WSKILLS**  
-    - Checkpoint: `first10/bert_fine_tuned.model.first10%.wskills.ep24`  
-    - Description: Fine-tuned with 10% of initial problems from both **HGR + LGR schools**, with **Prior Skills encoded** using **Bayesian Knowledge Tracing (BKT)**.  
-
-  - **ASTRA-FT-FIRST10-WTIME**  
-    - Checkpoint: `first10/bert_fine_tuned.model.first10%.wfaopttime.wttime.wttopttime.wttnoopttime.ep23`  
-    - Description: Fine-tuned with 10% of initial problems from both **HGR + LGR schools**, using **temporal features** measuring student engagement in MATHia.  
-
-  - **ASTRA-FT-FIRST10-WSKILLS_WTIME**  
-    - Checkpoint: `first10/bert_fine_tuned.model.first10%.wskills.wfaopttime.wttime.wttopttime.wttnoopttime.ep40`  
-    - Description: Fine-tuned with 10% of initial problems from both **HGR + LGR schools**, combining **Prior Skills (BKT) + temporal features**.
-**`-test_dataset_path`**  
-- Description: Path to the test dataset file that you want to use for evaluation.  
-- Example: `"../../../../fileHandler/selected_rows.txt"`
-
-**`-finetuned_bert_classifier_checkpoint`**  
-- Description: The path to the saved fine-tuned BERT model checkpoint (specific `.model.epXX` file).  
-- Example:  
-  `"ratio_proportion_change3_2223/sch_largest_100-coded/output/highGRschool10/bert_fine_tuned.model.ep42"`  
-- Note: `ep42` means the checkpoint from **epoch 42** during training.  
-
-**`-e`**  
-- Description: Number of epochs to run during testing (or evaluation).  
-- Example: `-e 1` → run evaluation once.  
-
-**`-b`**  
-- Description: Batch size for testing — determines how many test samples are processed together in each forward pass.  
-- Example: `-b 1000` → each batch will contain **1000 examples**.  
-
----
-
-✅ Your Astra project should now be fully set up and ready to use!
+Your Astra project should now be fully set up and ready to use!

LICENSE

@@ -1,6 +1,6 @@
 MIT License
 
-Copyright (c) 2025 Astra
+Copyright (c) 2025 Sudarshan Balaji
 
 Permission is hereby granted, free of charge, to any person obtaining a copy
 of this software and associated documentation files (the "Software"), to deal

app.py

@@ -1,5 +1,5 @@
 import gradio as gr
-from huggingface_hub import hf_hub_download, HfApi
+from huggingface_hub import hf_hub_download
 import pickle
 from gradio import Progress
 import numpy as np
@@ -12,40 +12,9 @@ import plotly.graph_objects as go
 from sklearn.metrics import roc_auc_score
 from matplotlib.figure import Figure
 import csv
-import os
-from huggingface_hub import login
 # import os
 # Define the function to process the input file and model selection
 
-api = HfApi(token=os.getenv("HF_TOKEN"))
-
-DATASET_REPO = "suryadev1/generated-csvs" 
-def delete_files():
-    repo_files = api.list_repo_files(repo_id=DATASET_REPO, repo_type="dataset")
-
-    #  delete all CSV files
-    for f in repo_files:
-        if f.endswith(".csv"):
-            try:
-                api.delete_file(
-                    path_in_repo=f,
-                    repo_id=DATASET_REPO,
-                    repo_type="dataset"
-                )
-                print(f"Deleted old file: {f}")
-            except Exception as e:
-                print(f"Could not delete {f}: {e}")
-# upload files to the dataset
-def upload_to_dataset(filepath):
-
-    api.upload_file(
-        path_or_fileobj=filepath,
-        path_in_repo=os.path.basename(filepath),
-        repo_id=DATASET_REPO,
-        repo_type="dataset"
-    )
-
-
 def process_file(model_name,inc_slider,progress=Progress(track_tqdm=True)):
     # progress = gr.Progress(track_tqdm=True)
 
@@ -60,43 +29,25 @@ def process_file(model_name,inc_slider,progress=Progress(track_tqdm=True)):
     # shutil.copyfile(label.name, saved_test_label)
     # shutil.copyfile(info.name, saved_train_info)
     parent_location="ratio_proportion_change3_2223/sch_largest_100-coded/finetuning/"
-    test_info_location=parent_location+"overallTestData/test_info.txt"
-    test_location=parent_location+"overallTestData/test.txt"
-    label_location=parent_location+"overallTestData/test_label.txt"
-    # "ASTRA-FT-HGR-RANDOM10", "ASTRA-FT-FIRST10-WSKILLS", "ASTRA-FT-FIRST10-WTIME", "ASTRA-FT-FIRST10-WSKILLS_WTIME"
-    checkpoint = "ratio_proportion_change3_2223/sch_largest_100-coded/output/"
+    test_info_location=parent_location+"test_info.txt"
+    test_location=parent_location+"test.txt"
+    label_location=parent_location+"test_label.txt"
     if(model_name=="ASTRA-FT-HGR"):
         finetune_task="highGRschool10"
-        checkpoint += "highGRschool10/bert_fine_tuned.model.ep42"
-        model_task="ASTRA-FT-HGR-RANDOM10"
+        # test_info_location=parent_location+"fullTest/test_info.txt"
+        # test_location=parent_location+"fullTest/test.txt"
     elif(model_name== "ASTRA-FT-LGR" ):
         finetune_task="lowGRschoolAll"
-        model_task="ASTRA-FT-LGR"
+        # test_info_location=parent_location+"lowGRschoolAll/test_info.txt"
+        # test_location=parent_location+"lowGRschoolAll/test.txt"
     elif(model_name=="ASTRA-FT-FULL"):
+        # test_info_location=parent_location+"fullTest/test_info.txt"
+        # test_location=parent_location+"fullTest/test.txt"
         finetune_task="fullTest"
-        model_task="ASTRA-FT-FULL"
-    elif(model_name in ["ASTRA-FT-Skills", "ASTRA-FT-Temporal", "ASTRA-FT-Unified"]):
-        finetune_task="first10"
-        if model_name == "ASTRA-FT-Skills":
-            checkpoint += "first10/bert_fine_tuned.model.first10%.wskills.ep24"
-            model_task="ASTRA-FT-FIRST10-WSKILLS"
-        elif model_name == "ASTRA-FT-Temporal":
-            checkpoint += "first10/bert_fine_tuned.model.first10%.wfaopttime.wttime.wttopttime.wttnoopttime.ep23"
-            model_task="ASTRA-FT-FIRST10-WTIME"
-        elif model_name == "ASTRA-FT-Unified":
-            checkpoint += "first10/bert_fine_tuned.model.first10%.wskills.wfaopttime.wttime.wttopttime.wttnoopttime.ep40"
-            model_task="ASTRA-FT-FIRST10-WSKILLS_WTIME"
     else:
         finetune_task=None
     # Load the test_info file and the graduation rate file
     test_info = pd.read_csv(test_info_location, sep=',', header=None, engine='python')
-    def convert_etalon(x):
-        means_and_extremes = 1
-        if x.is_integer():
-            means_and_extremes = 0
-        return means_and_extremes
-
-    test_info[8] = test_info[7].apply(convert_etalon) # 7th column contains etalon of factor which decides the ER/ME problem type
     grad_rate_data = pd.DataFrame(pd.read_pickle('assests/school_grduation_rate.pkl'),columns=['school_number','grad_rate'])  # Load the grad_rate data
 
     # Step 1: Extract unique school numbers from test_info
@@ -106,15 +57,15 @@ def process_file(model_name,inc_slider,progress=Progress(track_tqdm=True)):
     schools = grad_rate_data[grad_rate_data['school_number'].isin(unique_schools)]
 
     # Define a threshold for high and low graduation rates (adjust as needed)
-    grad_rate_threshold = 0.8 #0.9  
+    grad_rate_threshold = 0.9  
 
     # Step 4: Divide schools into high and low graduation rate groups
     high_grad_schools = schools[schools['grad_rate'] >= grad_rate_threshold]['school_number'].unique()
     low_grad_schools = schools[schools['grad_rate'] < grad_rate_threshold]['school_number'].unique()
 
     # Step 5: Sample percentage of schools from each group
-    high_sample = pd.Series(high_grad_schools).sample(frac=inc_slider/100).tolist()
-    low_sample = pd.Series(low_grad_schools).sample(frac=inc_slider/100).tolist()
+    high_sample = pd.Series(high_grad_schools).sample(frac=inc_slider/100, random_state=1).tolist()
+    low_sample = pd.Series(low_grad_schools).sample(frac=inc_slider/100, random_state=1).tolist()
 
     # Step 6: Combine the sampled schools
     random_schools = high_sample + low_sample
@@ -162,19 +113,17 @@ def process_file(model_name,inc_slider,progress=Progress(track_tqdm=True)):
     'high' if idx in high_indices else 'low' for idx in selected_rows_df2.index
     ]
     # Group data by opt_task1 and opt_task2 based on test_info[6]
-    
-    opt_task_groups = ['opt_task1' if test_info.loc[idx, 8] == 0 else 'opt_task2' for idx in selected_rows_df2.index]
+    opt_task_groups = ['opt_task1' if test_info.loc[idx, 6] == 0 else 'opt_task2' for idx in selected_rows_df2.index]
     progress(0.2, desc="Running fine-tuned models...")
     print("finetuned task: ",finetune_task)
     subprocess.run([
         "python", "new_test_saved_finetuned_model.py",
         "-workspace_name", "ratio_proportion_change3_2223/sch_largest_100-coded",
-        "-model_name", model_task,
         "-finetune_task", finetune_task,
         "-test_dataset_path","../../../../fileHandler/selected_rows.txt",
         # "-test_label_path","../../../../train_label.txt",
-        "-finetuned_bert_classifier_checkpoint", checkpoint,
-        "-s",str(128),
+        "-finetuned_bert_classifier_checkpoint", 
+        "ratio_proportion_change3_2223/sch_largest_100-coded/output/highGRschool10/bert_fine_tuned.model.ep42",
         "-e",str(1),
         "-b",str(1000)
     ])
@@ -183,8 +132,6 @@ def process_file(model_name,inc_slider,progress=Progress(track_tqdm=True)):
     # Load tlb and plb
     with open("fileHandler/tlabels_plabels.pkl", "rb") as f:
         tlb, plb = pickle.load(f)
-        print("t==p = 0: ", sum([t==p for t,p in zip(tlb, plb) if t==0]))
-        print("t==p = 1: ", sum([t==p for t,p in zip(tlb, plb) if t==1]))
 
     # Define function to filter and write CSV
     def process_and_write_csv(filtered_data, filename):
@@ -205,105 +152,45 @@ def process_file(model_name,inc_slider,progress=Progress(track_tqdm=True)):
 
             row_num = 1
             for _, row in filtered_data.iterrows():
-                # school, class_id, student_id, status, problem, _, time_zone, duration, attempts = row[:9]
-                
-                # sch_NPHBD11809,17,stu_CRJBA61379,GRADUATED,ratio_proportion_change3-134,[strategygame],1,4.0,4.0,10,
-                # PercentChange-Attempt-1-0-OK-1667479255281	NumeratorQuantity1-Attempt-1-0-JIT-1667479268893	NumeratorQuantity1-Attempt-2-0-ERROR-1667479284199	NumeratorQuantity1-Attempt-3-0-OK-1667479294890	DenominatorQuantity1-Attempt-1-0-OK-1667479298749	NumeratorQuantity2-Attempt-1-0-OK-1667479301999	OptionalTask_1-Attempt-1-0-OK-1667479304886	DenominatorFactor-Attempt-1-0-OK-1667479314566	NumeratorFactor-Attempt-1-0-OK-1667479315579	EquationAnswer-Attempt-1-0-OK-1667479323750	FinalAnswerDirection-Attempt-1-0-OK-1667479333439	FinalAnswer-Attempt-1-0-OK-1667479338185,
-                # 1,
-                # 0	0.999767840033168	0	0	0.999996274310286	0	0.321529253998353	0.999722748307354	0.999840947031115,
-                # 0	-0.0002057730279919623	0	0	-3.302306839980673e-06	0	-0.41429892410820995	-0.00022392554103201068	-0.00012846367037400164,
-                # 0	0.999767840033168	0	0	0	0	0	0	0,
-                # 1667479255281	1667479294890	1667479298749	1667479301999	1667479304886	1667479314566	1667479315579	1667479323750	1667479333439	1667479338185,
-                # 0	39609	3859	3250	2887	9680	1013	8171	9689	4746,
-                # 2887	9680	1013	8171,0	39609	3859	3250	9689	4746,
-                # 14435,
-                # 82904
-                school, prob_solved, student_id, status, problem, prob_type, opt_type, _, _ = row[:9]
-                steps_data = row[10]
-                
-                # if row_num == 1:
-                #     print(row)
+                school, class_id, student_id, status, problem, _, time_zone, duration, attempts = row[:9]
+                steps_data = row[8] 
 
                 for step in steps_data.split('\t'):
                     step_parts = step.split('-')
-
                     step_name = step_parts[0]
-                    action = step_parts[1]
-                    attempt = step_parts[2]
-                    help_level = step_parts[3]
-                    outcome = step_parts[4]
-                    curr_time = step_parts[5]
+                    action = step_parts[1] if len(step_parts) > 1 else ""
+                    attempt = step_parts[2] if len(step_parts) > 2 else ""
+                    outcome = step_parts[-1] if len(step_parts) > 3 else ""
 
                     row_data = [
-                        row_num, "", "", student_id, "", curr_time, "", "", "", "", "", 
-                        "ratio_proportion_change3", problem, "", "", step_name, attempt, "", outcome, "", action, "", 
-                        "", "", help_level, "", "", "", "", "", "", "", 
-                        school, "", "", "", "", "", status, ""
+                        row_num, "", "", student_id, "", time_zone, duration, "", "", "", "", 
+                        problem, problem, "", "", step_name, attempt, "", outcome, "", action, "", "", "", "", "", "", "", "", "", "","", 
+                        school, class_id, "", "", "", "", "PROMOTED"
                     ]
                     writer.writerow(row_data)
                     row_num += 1
 
         print(f"CSV file '{filename}' created successfully.")
-        full_path = os.path.join("fileHandler", filename)
-        try:
-            upload_to_dataset(full_path)
-        except Exception as e:
-            print(f"Failed: Timeout or error occurred - {e}")
-        
-        
-    task_type_map = {0: "ER", 1: "ME"}
-    label_map = {0: "unsuccessful", 1: "successful"}
-
-    # -------------------------------
-    # 1. Where tlb == plb
-    # -------------------------------
-    # delete_files()
-    for label in [0, 1]:
-        # All strategies
-        matching_indices = [i for i in range(len(tlb)) if tlb[i] == plb[i] == label]
-        filtered_data = selected_test_info.iloc[matching_indices]
-        filename = f"allstrategies-match-{label_map[label]}.csv"
-        process_and_write_csv(filtered_data, filename)
-
-        # Per task type
-        for task_type in [0, 1]:
-            task_data = filtered_data[filtered_data[8] == task_type]
-            filename = f"{task_type_map[task_type]}-match-{label_map[label]}.csv"
-            process_and_write_csv(task_data, filename)
-
-    # -------------------------------
-    # 2. Where tlb only
-    # -------------------------------
-    for label in [0, 1]:
-        # All strategies
-        matching_indices = [i for i in range(len(tlb)) if tlb[i] == label]
-        filtered_data = selected_test_info.iloc[matching_indices]
-        filename = f"allstrategies-groundtruth-{label_map[label]}.csv"
-        process_and_write_csv(filtered_data, filename)
-
-        # Per task type
-        for task_type in [0, 1]:
-            task_data = filtered_data[filtered_data[8] == task_type]
-            filename = f"{task_type_map[task_type]}-groundtruth-{label_map[label]}.csv"
-            process_and_write_csv(task_data, filename)
-
-    # -------------------------------
-    # 3. All data by task type (no label filtering)
-    # -------------------------------
-    # ER
-    task_data = selected_test_info[selected_test_info[8] == 0]
-    filename = f"ER-all.csv"
-    process_and_write_csv(task_data, filename)
-
-    # ME
-    task_data = selected_test_info[selected_test_info[8] == 1]
-    filename = f"ME-all.csv"
-    process_and_write_csv(task_data, filename)
-
-    # All strategies
-    filename = "allstrategies-all.csv"
-    process_and_write_csv(selected_test_info, filename)
 
+    # Find indices where conditions match
+    for task_type in [0, 1]:  # test_info[6] = 1 or 2
+        for label in [0, 1]:  # tlb = plb = 0 or 1
+            matching_indices = [i for i in range(len(tlb)) if tlb[i] == plb[i] == label]
+
+            # Filter the data
+            filtered_data = selected_test_info.iloc[matching_indices]
+            filtered_data = filtered_data[filtered_data[6] == task_type]  # Ensure test_info[6] matches
+
+            # Define filename dynamically
+            task_type_map = {0: "ER", 1: "ME"}
+            label_map = {0: "unsuccessful", 1: "successful"}
+
+            filename = f"{task_type_map[task_type]}-{label_map[label]}-strategies.csv"
+
+
+            # Write to CSV
+            process_and_write_csv(filtered_data, filename)
+    
     with open("fileHandler/roc_data2.pkl", 'rb') as file:
         data = pickle.load(file)
     t_label=data[0]
@@ -404,11 +291,12 @@ def process_file(model_name,inc_slider,progress=Progress(track_tqdm=True)):
         data = file.readlines()
     selected_data = [data[i] for i in indices if i < len(data)]
     # Assuming test_info[7] is a list with ideal tasks for each instance
-    ideal_tasks = test_info[8]  # A list where each element is either 1 or 2
+    ideal_tasks = test_info[6]  # A list where each element is either 1 or 2
+
     # Initialize counters
     task_counts = {
-    1: {"ER": 0, "ME": 0, "both": 0},
-    2: {"ER": 0, "ME": 0, "both": 0}
+    1: {"ER": 0, "ME": 0, "both": 0,"none":0},
+    2: {"ER": 0, "ME": 0, "both": 0,"none":0}
     }
       # To store task completion counts per row
     # Analyze rows
@@ -456,7 +344,7 @@ def process_file(model_name,inc_slider,progress=Progress(track_tqdm=True)):
             elif opt1_done and opt2_done:
                 task_counts[1]["both"] += 1
             else:
-                print(i)
+                task_counts[1]["none"] +=1
         elif ideal_task == 1:
             if opt1_done and not opt2_done:
                 task_counts[2]["ER"] += 1
@@ -465,7 +353,7 @@ def process_file(model_name,inc_slider,progress=Progress(track_tqdm=True)):
             elif opt1_done and opt2_done:
                 task_counts[2]["both"] += 1
             else:
-                print(i)
+                task_counts[2]["none"] +=1
     # Print a summary of task completions
     # for summary in row_summary:
     #     print(f"\nRow {summary['row_index']}:")
@@ -609,8 +497,7 @@ def process_file(model_name,inc_slider,progress=Progress(track_tqdm=True)):
         textinfo='percent+label',
         textposition='auto',
         marker=dict(colors=colors),
-        sort=False,
-        hole=0.4
+        sort=False
        
     )])
 
@@ -648,8 +535,7 @@ def process_file(model_name,inc_slider,progress=Progress(track_tqdm=True)):
         textinfo='percent+label',
         textposition='auto',
         marker=dict(colors=colors),
-        sort=False,
-        hole=0.4
+        sort=False
         # pull=[0, 0.2, 0, 0] # for pulling part of pie chart out (depends on position)
         
     )])
@@ -778,7 +664,8 @@ def process_file(model_name,inc_slider,progress=Progress(track_tqdm=True)):
     ---------------------------
     Model: {model_name}
     ---------------------------\n
-    Number of schools sampled: {len(random_schools)} / {len(unique_schools)} 
+    Time Taken: {result['time_taken_from_start']:.2f} seconds
+    Number of schools sampled: {len(unique_schools)}
     Total number of instances from HGR schools : {len(high_indices)}
     Total number of instances from LGR schools: {len(low_indices)}
 
@@ -850,20 +737,18 @@ def process_file(model_name,inc_slider,progress=Progress(track_tqdm=True)):
 
 
     # return text_output,text_output_sampled_auc,fig,fig_task1,fig_task2,fig_hist1,fig_hist2
-    return text_output,fig,fig_task1,fig_task2,gr.update(visible=True)
+    return text_output,fig,fig_task1,fig_task2
 # List of models for the dropdown menu
 
 # models = ["ASTRA-FT-HGR", "ASTRA-FT-LGR", "ASTRA-FT-FULL"]
-# models = ["ASTRA-FT-HGR", "ASTRA-FT-FULL"]
-models = ["ASTRA-FT-HGR", "ASTRA-FT-Skills", "ASTRA-FT-Temporal", "ASTRA-FT-Unified"]
-
+models = ["ASTRA-FT-HGR", "ASTRA-FT-FULL"]
 content = """
 <h1 style="color: black;">A S T R A</h1>
 <h2 style="color: black;">An AI Model for Analyzing Math Strategies</h2>
 
 <h3 style="color: white; text-align: center">
     <a href="https://drive.google.com/file/d/1lbEpg8Se1ugTtkjreD8eXIg7qrplhWan/view" style="color: gr.themes.colors.red; text-decoration: none;">Link To Paper</a> | 
-    <a href="https://huggingface.co/spaces/suryadev1/astra/tree/main" style="color: #1E90FF; text-decoration: none;">Repo Link</a> | 
+    <a href="https://github.com/Syudu41/ASTRA---Gates-Project" style="color: #1E90FF; text-decoration: none;">GitHub</a> | 
     <a href="https://drive.google.com/file/d/1wussSAYV5WfRSgYNEDgxWNqMUNoiu65u/view" style="color: #1E90FF; text-decoration: none;">User Guide</a>
     
     
@@ -888,37 +773,26 @@ When the equivalent ratios are easy to compute (integral values), ER is much mor
 <p style="color: white;">To use the demo, please follow these steps:</p>
 
 <ol style="color: white;">
-<li style="color: white;">Select a percentage of schools to analyze (selecting a large percentage may take a long time). Note that the selected percentage is applied to both High Graduation Rate (HGR) schools and Low Graduation Rate (LGR schools).
-</li>
-    <li style="color: white;">Select a fine-tuned model:</li>
+    <li style="color: white;">Select a fine-tuned model:
         <ul style="color: white;">
-            <li style="color: white;">ASTRA-FT-HGR: Fine-tuned with 10 % data from schools that have a high graduation rate.</li>
-            <li style="color: white;">ASTRA-FT-Skills: Fine-tuned with 10% of initial problems from both HGR and LGR schools + Prior Skills encoded using Bayesian Knowledge Tracing</li>
-            <li style="color: white;">ASTRA-FT-Temporal: Fine-tuned with 10% of initial problems from both HGR and LGR schools + temporal features measuring student engagement with MATHia</li>
-            <li style="color: white;">ASTRA-FT-Unified: Fine-tuned with 10% of initial problems from both HGR and LGR schools + Prior Skills + temporal features</li>
+            <li style="color: white;">ASTRA-FT-HGR: Fine-tuned with a small sample of data from schools that have a high graduation rate.</li>
+            <li style="color: white;">ASTRA-FT-Full: Fine-tuned with a small sample of data from a mix of schools that have high/low graduation rates.</li>
         </ul>
-    
-    
- <li style="color: white;">
-  The results from the fine-tuned model are displayed in the dashboard:
-  <ul>
-    <li style="color: white;">The model accuracy is computed using the ROC-AUC metric.</li>
-    <li style="color: white;">The results are shown for HGR, LGR schools and for different problem types (ER/ME).</li>
-    <li style="color: white;">The distribution over how students utilized the optional tasks (whether they utilized ER/ME, used both of them or none of them) is shown for each problem type.</li>
-  </ul>
+    </li>
+    <li style="color: white;">Select a percentage of schools to analyze (selecting a large percentage may take a long time). Note that the selected percentage is applied to both High Graduation Rate (HGR) schools and Low Graduation Rate (LGR schools).
 </li>
-
-    
-<li style="color: white;">
-  Generate strategies from the AI model and visualize the strategies .csv files using the path analysis web-app. 
-  Refer to the 
-  <a href="https://drive.google.com/file/d/1wussSAYV5WfRSgYNEDgxWNqMUNoiu65u/view" 
-     style="color: #1E90FF; text-decoration: none;">
-     user guide
-  </a> 
-  for more details on how to interpret the strategy visualization.
+    <li style="color: white;">The results from the fine-tuned model are displayed in the dashboard:
+        <ul>
+            <li style="color: white;">The model accuracy is computed using the ROC-AUC metric.
 </li>
-
+            <li style="color: white;">The results are shown for HGR, LGR schools and  for different problem types (ER/ME). 
+</li>
+<li style="color: white;">The distribution over how students utilized the optional tasks (whether they utilized ER/ME, used both of them or none of them) is shown for each problem type. 
+</li>
+        </ul>
+    </li>
+        <li style="color: white;">Generate strategies from the AI model and visualize the strategies .csv files using the path analysis web-app. 
+        Refer to the <a href="https://drive.google.com/file/d/1wussSAYV5WfRSgYNEDgxWNqMUNoiu65u/view" style="color: #1E90FF; text-decoration: none;">user guide </a> for more details on how to interpret the strategy visualization.
 
 </ol>
 """
@@ -1222,90 +1096,43 @@ button, select, .slider-percentage {
     color: #1e293b !important;
     margin-bottom: 1rem !important;
     text-align: center !important;
-
-#file-box {
-        border: 1px solid #ccc;
-        border-radius: 6px;
-        padding: 10px;
-        margin-top: 12px;
-        background-color: #f9f9f9;
-    }
-
-.file-download {
-        margin-bottom: 5px !important;
-        padding: 4px !important;
-        height: 10px;
-    }
 }
 
-
 '''
-
 # Define the file directory
 FILE_DIR = "fileHandler"
 
 # Function to get list of files
 def list_files():
-    return ['Unsuccessful Strategies (ER)', 'Successful Strategies (ER)', 'Unsuccessful Strategies (ME)', 'Successful Strategies (ME)','Ground Truth Unsuccessful Strategies (ER)','Ground Truth Successful Strategies (ER)','Ground Truth Unsuccessful Strategies (ME)','Ground Truth Successful Strategies (ME)']
+    return ['Unsuccessful Strategies (ER)', 'Successful Strategies (ER)', 'Unsuccessful Strategies (ME)', 'Successful Strategies (ME)']
+    # return ['output_task0_label0.csv', 'output_task0_label1.csv', 'output_task1_label0.csv', 'output_task1_label1.csv']
+    # return [f for f in os.listdir(FILE_DIR) if os.path.isfile(os.path.join(FILE_DIR, f))]
 label_to_filename = {
-    # Predicted (tlb == plb)
-    'Predicted Successful Strategies (ER)': 'ER-match-successful.csv',
-    'Predicted Unsuccessful Strategies (ER)': 'ER-match-unsuccessful.csv',
-    'Predicted Successful Strategies (ME)': 'ME-match-successful.csv',
-    'Predicted Unsuccessful Strategies (ME)': 'ME-match-unsuccessful.csv',
-    'Predicted Successful Strategies (All)': 'allstrategies-match-successful.csv',
-    'Predicted Unsuccessful Strategies (All)': 'allstrategies-match-unsuccessful.csv',
-
-    # Ground Truth (tlb only)
-    'Ground Truth Successful Strategies (ER)': 'ER-groundtruth-successful.csv',
-    'Ground Truth Unsuccessful Strategies (ER)': 'ER-groundtruth-unsuccessful.csv',
-    'Ground Truth Successful Strategies (ME)': 'ME-groundtruth-successful.csv',
-    'Ground Truth Unsuccessful Strategies (ME)': 'ME-groundtruth-unsuccessful.csv',
-    'Ground Truth Successful Strategies (All)': 'allstrategies-groundtruth-successful.csv',
-    'Ground Truth Unsuccessful Strategies (All)': 'allstrategies-groundtruth-unsuccessful.csv',
-
-    # All data
-    'All Strategies (ER)': 'ER-all.csv',
-    'All Strategies (ME)': 'ME-all.csv',
-    'All Strategies (All)': 'allstrategies-all.csv'
+    'Unsuccessful Strategies (ER)': 'ER-unsuccessful-strategies.csv',
+    'Successful Strategies (ER)': 'ER-successful-strategies.csv',
+    'Unsuccessful Strategies (ME)': 'ME-unsuccessful-strategies.csv',
+    'Successful Strategies (ME)': 'ME-successful-strategies.csv'
 }
-
 # Function to provide the selected file path
-def provide_file_paths(task_type, source):
-    if not task_type or not source:
-        return None, None, gr.update(visible=False)
-
-    # Handle "All" case for combined strategies
-    if source == "All":
-        label_success = f"All Strategies ({task_type})"
-        label_unsuccess = f"All Strategies ({task_type})"
-    else:
-        label_success = f"{source} Successful Strategies ({task_type})"
-        label_unsuccess = f"{source} Unsuccessful Strategies ({task_type})"
-        label_all=f"All Strategies ({task_type})"
-
-    file_success = label_to_filename.get(label_success)
-    file_unsuccess = label_to_filename.get(label_unsuccess)
-    file_all=label_to_filename.get(label_all)
-
-    file_success_path = f"{FILE_DIR}/{file_success}" if file_success else None
-    file_unsuccess_path = f"{FILE_DIR}/{file_unsuccess}" if file_unsuccess else None
-    file_all_path = f"{FILE_DIR}/{file_all}" if file_all else None
-
-    dynamic_text = "🔍 [Visualize the strategies](https://path-analysis.vercel.app/)"
-    if file_success and file_unsuccess and file_all:
-        return file_success_path, file_unsuccess_path,file_all_path, gr.update(value=dynamic_text, visible=True)
-
-    return None, None,None, gr.update(visible=False)
-
-
+def provide_file_path(label_name):
+    file_name = label_to_filename.get(label_name, None)
+    if file_name:
+        file_path = f"{FILE_DIR}/{file_name}"
+        dynamic_text = "🔍 [Visualize the strategies](https://path-analysis.vercel.app/)"
+        return file_path, gr.update(value=dynamic_text, visible=True)
+    return None, gr.update(visible=False)
 
 
 with gr.Blocks(theme='gstaff/sketch', css=custom_css) as demo:
     
+    # gr.Markdown("<h1 id='title'>ASTRA</h1>", elem_id="title")
     gr.Markdown(content)
     
     with gr.Row():
+        # file_input = gr.File(label="Upload a test file", file_types=['.txt'], elem_classes="file-box")
+        # label_input = gr.File(label="Upload test labels", file_types=['.txt'], elem_classes="file-box")
+
+        # info_input = gr.File(label="Upload test info", file_types=['.txt'], elem_classes="file-box")
         model_dropdown = gr.Dropdown(
             choices=models,
             label="Select Fine-tuned Model",
@@ -1335,35 +1162,32 @@ with gr.Blocks(theme='gstaff/sketch', css=custom_css) as demo:
     with gr.Row():
         opt1_pie = gr.Plot(label="ER")
         opt2_pie = gr.Plot(label="ME")
-
-    
+        # output_summary = gr.Textbox(label="Summary")
+    # with gr.Row():
+    #     histo1 = gr.Plot(label="Hist")
+    #     histo2 = gr.Plot(label="Hist")
+    # with gr.Row():
+    #     output_text_sampled_auc = gr.Textbox(label="")
+  
+    with gr.Row():
+        file_dropdown = gr.Dropdown(choices=list_files(), label="Select a strategy from the dropdown")
+        download_button = gr.Button("Generate Strategies")
     with gr.Row():
-        with gr.Column():
-            redirect_button = gr.Button("Click to Visualize Strategies", visible=False)
-
-    redirect_button.click(
-        None,
-        inputs=[],
-        outputs=[],
-         js="""() => { 
-            window.open("https://path-analysis.vercel.app", "_blank"); 
-            return "ok";  // must return something
-        }"""
+        file_output = gr.File(label="Download File")
+        visualize_markdown = gr.Markdown(visible=False)
+    
+    download_button.click(
+        fn=provide_file_path,
+        inputs=[file_dropdown],
+        outputs=[file_output, visualize_markdown]
     )
 
 
+
     btn.click(
-        fn=lambda model, increment: (
-            *process_file(model, increment),  # Unpack all outputs from process_file
-            gr.update(value=None),     # update outcome_radio
-            gr.update(value=None), # Reset dropdown to first item
-            None,
-            None,
-            None,                                                           # Clear file output
-            gr.update(visible=False)           # Hide visualize markdown
-        ),
-        inputs=[model_dropdown, increment_slider],
-        outputs=[output_text, plot_output, opt1_pie, opt2_pie,redirect_button]
+        fn=process_file, 
+        inputs=[model_dropdown,increment_slider], 
+        outputs=[output_text,plot_output,opt1_pie,opt2_pie]
     )
 
 

fileHandler/result.txt

@@ -1,7 +1,7 @@
-avg_loss: 0.5818096399307251
-total_acc: 70.54714784633295
-precisions: 0.7205217318929581
-recalls: 0.7054714784633295
-f1_scores: 0.6956596700972714
-time_taken_from_start: 3.645707130432129
-auc_score: 0.7422687845544381
+avg_loss: 0.5737786740064621
+total_acc: 71.04486007593869
+precisions: 0.7412098113732791
+recalls: 0.7104486007593869
+f1_scores: 0.7047150367197683
+time_taken_from_start: 13.38778305053711
+auc_score: 0.7569549552207228

fileHandler/roc_data.pkl

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:de3b67c53ef11a9bfb50ceba34feddddf12c1a4284a6078bdd32acc72de0c1a0
-size 15989
+oid sha256:16b9d02104550e6a9350e03a5d8c99d0353cbd58740bf9ccfa0f0e86f603b551
+size 65333

fileHandler/roc_data2.pkl

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:1411da3bb230997d161e372a7308948ef783c504f10d7e1228238a92cdd266c3
-size 48215
+oid sha256:18c63a0757ddf4e98ab5b8ca7c1a903176991a2521194caa737fc07667730658
+size 199270

fileHandler/tlabels_plabels.pkl

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:627847d1d1054a96e7950df136ced227c494c428bc1e0875268071a412eb32bb
-size 65395
+oid sha256:1ead6d5d1eb2b3c7edb7b513bb3648b0878b7037a16205bef01e9f3198f4ab0c
+size 270389

new_test_saved_finetuned_model.py

@@ -6,7 +6,7 @@ from torch.optim import Adam
 from torch.utils.data import DataLoader
 import pickle
 print("here1",os.getcwd())
-from src.dataset import TokenizerDataset, TokenizerwSkillsDataset, TokenizerwTimeDataset, TokenizerwSkillsTimeDataset
+from src.dataset import TokenizerDataset, TokenizerDatasetForCalibration
 from src.vocab import Vocab
 print("here3",os.getcwd())
 from src.bert import BERT
@@ -19,7 +19,6 @@ import tqdm
 import sys
 import time
 import numpy as np
-from sklearn.preprocessing import QuantileTransformer
 
 from sklearn.metrics import precision_score, recall_score, f1_score, confusion_matrix, roc_curve, roc_auc_score
 import matplotlib.pyplot as plt
@@ -467,59 +466,12 @@ class BERTFineTuneCalibratedTrainer:
             sys.stdout = sys.__stdout__
         sys.stdout = sys.__stdout__
         
-def prepare_normalized_time_df():
-    faopt_time = []
-    total_time = []
-    nonopt_time = []
-    opt_time = []
-    school = []
-    student = []
-    progress = []
-    prob_id = []
-
-    with open("ratio_proportion_change3_2223/sch_largest_100-coded/finetuning/fullData/train_info.txt", "r") as f:
-        for line in f:
-            line = line.strip()
-            if line:
-                line = line.split(",")
-                sch = line[0]
-                school.append(sch)
-                stu = line[2]
-                student.append(stu)
-                status = line[3]
-                progress.append(status)
-                pid = line[4]
-                prob_id.append(pid)
-                total = float(line[-1])#/60000
-                faopt = float(line[-2])#/60000
-                nonopt = sum([float(i) for i in line[-3].split("\t")])
-                opt = sum([float(i) for i in line[-4].split("\t")])
-                faopt_time.append(faopt)
-                total_time.append(total)
-                nonopt_time.append(nonopt)
-                opt_time.append(opt)
-
-    df = pd.DataFrame({"school": school, "student": student, "progress": progress, "prob_id": prob_id, 
-                    "faopt_time": faopt_time, "total_time": total_time, 
-                    "nonopt_time": nonopt_time, "opt_time": opt_time})
-    for col in df.columns:
-        print(col, col.endswith('time'))
-        if col.endswith('time'): #col == "faopt_time" or col =="total_time":
-            num_df = df[col]
-            col_values = num_df.values.reshape(-1, 1)
-            nt = QuantileTransformer(output_distribution='normal')
-            col_values_norm = nt.fit_transform(col_values)
-            df[col] = col_values_norm
-            print(df[col].describe())
-    df.set_index(["school", "student", "progress", "prob_id"], inplace=True)
-    df.to_pickle("ratio_proportion_change3_2223/sch_largest_100-coded/time_info/full_data_normalized_time.pkl")
-    
+
     
 def train():
     parser = argparse.ArgumentParser()
 
     parser.add_argument('-workspace_name', type=str, default=None)
-    parser.add_argument('-model_name', type=str, default=None)
     parser.add_argument('-code', type=str, default=None, help="folder for pretraining outputs and logs")
     parser.add_argument('-finetune_task', type=str, default=None, help="folder inside finetuning")
     parser.add_argument("-attention", type=bool, default=False, help="analyse attention scores")
@@ -555,7 +507,7 @@ def train():
     parser.add_argument("-b", "--batch_size", type=int, default=500, help="number of batch_size") #64
     parser.add_argument("-e", "--epochs", type=int, default=1)#1501, help="number of epochs") #501
     # Use 50 for pretrain, and 10 for fine tune
-    parser.add_argument("-w", "--num_workers", type=int, default=7, help="dataloader worker size")
+    parser.add_argument("-w", "--num_workers", type=int, default=0, help="dataloader worker size")
 
     # Later run with cuda
     parser.add_argument("--with_cuda", type=bool, default=False, help="training with CUDA: true, or false")
@@ -607,19 +559,10 @@ def train():
     vocab_obj.load_vocab()
     print("Vocab Size: ", len(vocab_obj.vocab))
     
-    prepare_normalized_time_df()
+    
     print("Testing using finetuned model......")
-    print("Loading Test Dataset", args.test_dataset_path)
-    # "ASTRA-FT-HGR-RANDOM10", "ASTRA-FT-FIRST10-WSKILLS", "ASTRA-FT-FIRST10-WTIME", "ASTRA-FT-FIRST10-WSKILLS_WTIME"
-    # test_dataset = TokenizerDataset(args.test_dataset_path, args.test_label_path, vocab_obj, seq_len=args.seq_len)
-    if args.model_name == "ASTRA-FT-HGR-RANDOM10":            
-        test_dataset = TokenizerwSkillsDataset(args.test_dataset_path, args.test_label_path, vocab_obj, seq_len=args.seq_len)
-    elif args.model_name == "ASTRA-FT-FIRST10-WSKILLS":           
-        test_dataset = TokenizerwSkillsDataset(args.test_dataset_path, args.test_label_path, vocab_obj, seq_len=args.seq_len)
-    elif args.model_name == "ASTRA-FT-FIRST10-WTIME":            
-        test_dataset = TokenizerwTimeDataset(args.test_dataset_path, args.test_label_path, vocab_obj, seq_len=args.seq_len)
-    elif args.model_name == "ASTRA-FT-FIRST10-WSKILLS_WTIME":            
-        test_dataset = TokenizerwSkillsTimeDataset(args.test_dataset_path, args.test_label_path, vocab_obj, seq_len=args.seq_len)
+    print("Loading Test Dataset", args.test_dataset_path)            
+    test_dataset = TokenizerDataset(args.test_dataset_path, args.test_label_path, vocab_obj, seq_len=args.seq_len)
     # test_dataset = TokenizerDatasetForCalibration(args.test_dataset_path, args.test_label_path, vocab_obj, seq_len=args.seq_len)
 
     print("Creating Dataloader...")

ratio_proportion_change3_2223/sch_largest_100-coded/finetuning/first10/test.txt

@@ -1,339 +0,0 @@
-PercentChange-0 	NumeratorQuantity1-2 	DenominatorQuantity1-0 	NumeratorQuantity2-0 	OptionalTask_1 	DenominatorFactor 	NumeratorFactor 	EquationAnswer 	FinalAnswerDirection-0 	FinalAnswer-0
-PercentChange-0 	NumeratorQuantity2-0 	NumeratorQuantity1-0 	DenominatorQuantity1-0 	OptionalTask_1 	NumeratorFactor 	DenominatorFactor 	EquationAnswer 	FinalAnswer-2
-PercentChange-0 	NumeratorQuantity2-0 	NumeratorQuantity1-2 	DenominatorQuantity1-2 	OptionalTask_1 	DenominatorFactor 	NumeratorFactor 	EquationAnswer 	FinalAnswerDirection-0 	FinalAnswer-2
-PercentChange-0 	NumeratorQuantity2-0 	NumeratorQuantity1-0 	DenominatorQuantity1-0 	OptionalTask_1 	DenominatorFactor 	NumeratorFactor 	EquationAnswer 	FinalAnswerDirection-0 	FinalAnswer-0
-PercentChange-2 	NumeratorQuantity2-0 	NumeratorQuantity1-0 	DenominatorQuantity1-0 	OptionalTask_1 	DenominatorFactor 	NumeratorFactor 	EquationAnswer 	FinalAnswerDirection-2 	FinalAnswer-0
-PercentChange-0 	NumeratorQuantity2-0 	NumeratorQuantity1-0 	DenominatorQuantity1-0 	OptionalTask_1 	NumeratorFactor 	DenominatorFactor 	EquationAnswer 	FinalAnswer-0
-PercentChange-0 	NumeratorQuantity2-0 	NumeratorQuantity1-0 	DenominatorQuantity1-0 	OptionalTask_1 	NumeratorFactor 	DenominatorFactor 	EquationAnswer 	FinalAnswer-0
-PercentChange-0 	NumeratorQuantity2-0 	NumeratorQuantity1-2 	DenominatorQuantity1-0 	OptionalTask_1 	NumeratorFactor 	DenominatorFactor 	EquationAnswer 	FinalAnswer-2
-PercentChange-0 	NumeratorQuantity2-0 	NumeratorQuantity1-2 	DenominatorQuantity1-0 	OptionalTask_1 	NumeratorFactor 	DenominatorFactor 	EquationAnswer 	FinalAnswerDirection-2 	FinalAnswer-2
-PercentChange-0 	NumeratorQuantity2-0 	NumeratorQuantity1-0 	DenominatorQuantity1-0 	OptionalTask_1 	EquationAnswer 	DenominatorFactor 	NumeratorFactor 	EquationAnswer 	FinalAnswer-0 	FinalAnswerDirection-2
-PercentChange-0 	NumeratorQuantity2-0 	NumeratorQuantity1-0 	DenominatorQuantity1-0 	OptionalTask_1 	DenominatorFactor 	NumeratorFactor 	EquationAnswer 	FinalAnswerDirection-2 	FinalAnswer-2
-PercentChange-0 	NumeratorQuantity1-0 	DenominatorQuantity1-0 	NumeratorQuantity2-0 	OptionalTask_1 	EquationAnswer 	DenominatorFactor 	NumeratorFactor 	EquationAnswer 	FinalAnswer-0 	FinalAnswerDirection-0
-PercentChange-0 	NumeratorQuantity1-2 	NumeratorQuantity2-0 	NumeratorQuantity1-0 	DenominatorQuantity1-0 	OptionalTask_2 	FirstRow2:1 	FirstRow2:2 	FirstRow1:1 	FirstRow1:2 	SecondRow 	ThirdRow 	FinalAnswer-2
-PercentChange-0 	NumeratorQuantity1-2 	DenominatorQuantity1-2 	NumeratorQuantity2-0 	DenominatorQuantity1-2 	OptionalTask_2 	FirstRow1:2 	FirstRow1:1 	FirstRow2:1 	FirstRow2:2 	FirstRow1:1 	SecondRow 	FinalAnswer-2 	ThirdRow 	FinalAnswer-0 	FinalAnswerDirection-0
-PercentChange-0 	NumeratorQuantity1-0 	NumeratorQuantity2-0 	DenominatorQuantity1-0 	OptionalTask_2 	FirstRow2:1 	FirstRow2:2 	FirstRow1:1 	FirstRow1:2 	SecondRow 	ThirdRow 	FinalAnswer-0
-PercentChange-0 	NumeratorQuantity2-0 	DenominatorQuantity1-0 	NumeratorQuantity1-0 	OptionalTask_2 	FirstRow2:1 	FirstRow2:2 	FirstRow1:1 	FirstRow1:2 	SecondRow 	ThirdRow 	FinalAnswer-0
-PercentChange-0 	NumeratorQuantity2-2 	NumeratorQuantity1-2 	DenominatorQuantity1-0 	NumeratorQuantity1-2 	OptionalTask_2 	FirstRow1:2 	FirstRow1:1 	FirstRow2:2 	FirstRow1:1 	FirstRow2:1 	FirstRow1:1 	SecondRow 	ThirdRow 	FinalAnswer-2 	FinalAnswerDirection-0
-PercentChange-0 	NumeratorQuantity2-2 	NumeratorQuantity1-0 	DenominatorQuantity1-0 	NumeratorQuantity2-0 	OptionalTask_1 	EquationAnswer 	NumeratorFactor 	DenominatorFactor 	FinalAnswer-2 	FinalAnswerDirection-0
-PercentChange-0 	NumeratorQuantity2-0 	NumeratorQuantity1-0 	DenominatorQuantity1-0 	OptionalTask_2 	FirstRow2:1 	FirstRow2:2 	FirstRow1:1 	FirstRow1:2 	SecondRow 	ThirdRow 	FinalAnswer-2
-PercentChange-0 	NumeratorQuantity2-0 	NumeratorQuantity1-2 	DenominatorQuantity1-0 	NumeratorQuantity1-2 	OptionalTask_1 	NumeratorFactor 	DenominatorFactor 	NumeratorFactor 	DenominatorFactor 	EquationAnswer 	FinalAnswer-2
-PercentChange-0 	NumeratorQuantity2-2 	NumeratorQuantity1-2 	DenominatorQuantity1-0 	NumeratorQuantity1-2 	OptionalTask_1 	NumeratorFactor 	DenominatorFactor 	EquationAnswer 	FinalAnswer-0
-PercentChange-0 	NumeratorQuantity2-0 	NumeratorQuantity1-2 	DenominatorQuantity1-2 	NumeratorQuantity1-0 	DenominatorQuantity1-0 	OptionalTask_2 	FirstRow1:2 	FirstRow2:1 	FirstRow2:2 	FirstRow1:1 	SecondRow 	ThirdRow 	FinalAnswer-0 	FinalAnswerDirection-0
-PercentChange-0 	NumeratorQuantity2-0 	DenominatorQuantity1-0 	NumeratorQuantity1-0 	OptionalTask_1 	NumeratorFactor 	OptionalTask_2 	FirstRow2:1 	FirstRow2:2 	FirstRow1:1 	FirstRow1:2 	FirstRow1:1 	FirstRow1:2 	FirstRow1:1 	FirstRow1:2 	SecondRow 	ThirdRow 	FinalAnswer-2
-PercentChange-0 	NumeratorQuantity2-2 	NumeratorQuantity1-2 	DenominatorQuantity1-0 	OptionalTask_1 	DenominatorFactor 	NumeratorFactor 	EquationAnswer 	OptionalTask_2 	FirstRow1:1 	FirstRow1:2 	FirstRow2:2 	FirstRow2:1 	SecondRow 	ThirdRow 	FinalAnswer-2
-PercentChange-0 	NumeratorQuantity2-2 	NumeratorQuantity1-0 	DenominatorQuantity1-0 	OptionalTask_1 	NumeratorFactor 	DenominatorFactor 	EquationAnswer 	OptionalTask_2 	FirstRow1:1 	FirstRow1:2 	FirstRow2:2 	FirstRow2:1 	SecondRow 	ThirdRow 	FinalAnswer-1
-PercentChange-2 	NumeratorQuantity2-2 	NumeratorQuantity1-0 	DenominatorQuantity1-0 	OptionalTask_1 	DenominatorFactor 	NumeratorFactor 	EquationAnswer 	OptionalTask_2 	FirstRow1:1 	FirstRow1:2 	FirstRow2:1 	FirstRow2:2 	SecondRow 	ThirdRow 	FinalAnswer-2
-PercentChange-2 	NumeratorQuantity2-2 	NumeratorQuantity1-0 	DenominatorQuantity1-0 	OptionalTask_1 	NumeratorFactor 	DenominatorFactor 	NumeratorFactor 	EquationAnswer 	OptionalTask_2 	FirstRow1:1 	FirstRow1:2 	FirstRow2:2 	FirstRow2:1 	SecondRow 	ThirdRow 	FinalAnswer-1
-PercentChange-2 	NumeratorQuantity2-2 	NumeratorQuantity1-2 	DenominatorQuantity1-0 	OptionalTask_1 	NumeratorFactor 	DenominatorFactor 	NumeratorFactor 	EquationAnswer 	OptionalTask_2 	FirstRow1:1 	FirstRow1:2 	FirstRow2:1 	FirstRow2:2 	SecondRow 	ThirdRow 	FinalAnswer-1
-PercentChange-0 	NumeratorQuantity2-0 	NumeratorQuantity1-2 	DenominatorQuantity1-0 	OptionalTask_1 	EquationAnswer 	DenominatorFactor 	NumeratorFactor 	EquationAnswer 	OptionalTask_2 	FirstRow1:1 	FirstRow1:2 	FirstRow2:2 	FirstRow2:1 	SecondRow 	FinalAnswerDirection-0 	ThirdRow 	FinalAnswer-0
-PercentChange-0 	NumeratorQuantity2-2 	NumeratorQuantity1-0 	DenominatorQuantity1-0 	OptionalTask_1 	DenominatorFactor 	NumeratorFactor 	DenominatorFactor 	EquationAnswer 	OptionalTask_2 	FirstRow1:1 	FirstRow1:2 	FirstRow2:2 	FirstRow2:1 	SecondRow 	ThirdRow 	FinalAnswer-2
-PercentChange-2 	NumeratorQuantity2-2 	NumeratorQuantity1-0 	DenominatorQuantity1-0 	OptionalTask_1 	DenominatorFactor 	NumeratorFactor 	DenominatorFactor 	NumeratorFactor 	EquationAnswer 	OptionalTask_2 	FirstRow1:1 	FirstRow1:2 	FirstRow2:1 	FirstRow2:2 	SecondRow 	ThirdRow 	FinalAnswer-1
-PercentChange-2 	NumeratorQuantity2-0 	NumeratorQuantity1-0 	DenominatorQuantity1-0 	OptionalTask_1 	NumeratorFactor 	DenominatorFactor 	NumeratorFactor 	EquationAnswer 	OptionalTask_2 	FirstRow1:1 	FirstRow1:2 	FirstRow2:1 	FirstRow2:2 	SecondRow 	ThirdRow 	FinalAnswer-2
-PercentChange-0 	NumeratorQuantity2-2 	NumeratorQuantity1-2 	DenominatorQuantity1-1 	OptionalTask_1 	NumeratorFactor 	DenominatorFactor 	NumeratorFactor 	EquationAnswer 	OptionalTask_2 	FirstRow1:1 	FirstRow1:2 	FirstRow2:1 	FirstRow2:2 	SecondRow 	ThirdRow 	FinalAnswer-2
-PercentChange-2 	NumeratorQuantity2-2 	NumeratorQuantity1-0 	DenominatorQuantity1-1 	OptionalTask_1 	NumeratorFactor 	DenominatorFactor 	NumeratorFactor 	EquationAnswer 	OptionalTask_2 	FirstRow1:1 	FirstRow1:2 	FirstRow2:1 	FirstRow2:2 	SecondRow 	ThirdRow 	FinalAnswer-1
-PercentChange-0 	NumeratorQuantity2-2 	NumeratorQuantity1-2 	DenominatorQuantity1-0 	OptionalTask_1 	OptionalTask_2 	FirstRow1:1 	FirstRow1:2 	FirstRow2:1 	FirstRow2:2 	NumeratorFactor 	DenominatorFactor 	EquationAnswer 	SecondRow 	ThirdRow 	FinalAnswer-1
-PercentChange-0 	NumeratorQuantity2-0 	NumeratorQuantity1-0 	DenominatorQuantity1-0 	OptionalTask_1 	OptionalTask_2 	FirstRow1:1 	FirstRow2:1 	FirstRow2:2 	FirstRow1:1 	FirstRow1:2 	FirstRow1:1 	SecondRow 	ThirdRow 	EquationAnswer 	FinalAnswer-2
-PercentChange-0 	NumeratorQuantity2-0 	DenominatorQuantity1-0 	NumeratorQuantity1-0 	OptionalTask_1 	DenominatorFactor 	OptionalTask_2 	FirstRow2:1 	FirstRow2:2 	FirstRow1:2 	FirstRow1:1 	SecondRow 	ThirdRow 	EquationAnswer 	DenominatorFactor 	NumeratorFactor 	FinalAnswer-2
-PercentChange-0 	NumeratorQuantity2-0 	NumeratorQuantity1-0 	DenominatorQuantity1-0 	OptionalTask_1 	DenominatorFactor 	NumeratorFactor 	EquationAnswer 	FinalAnswer-0
-PercentChange-0 	NumeratorQuantity2-0 	NumeratorQuantity1-0 	DenominatorQuantity1-0 	OptionalTask_1 	NumeratorFactor 	DenominatorFactor 	EquationAnswer 	FinalAnswer-0
-PercentChange-0 	NumeratorQuantity2-0 	DenominatorQuantity1-0 	NumeratorQuantity1-0 	OptionalTask_2 	FirstRow2:1 	FirstRow2:2 	FirstRow1:2 	FirstRow1:1 	SecondRow 	ThirdRow 	OptionalTask_1 	EquationAnswer 	NumeratorFactor 	DenominatorFactor 	FinalAnswer-0
-PercentChange-0 	NumeratorQuantity2-0 	NumeratorQuantity1-0 	DenominatorQuantity1-0 	OptionalTask_1 	DenominatorFactor 	NumeratorFactor 	EquationAnswer 	FinalAnswer-0
-PercentChange-0 	NumeratorQuantity2-0 	DenominatorQuantity1-0 	NumeratorQuantity1-0 	OptionalTask_1 	OptionalTask_2 	FirstRow2:1 	FirstRow2:2 	FirstRow1:2 	FirstRow1:1 	SecondRow 	ThirdRow 	EquationAnswer 	FinalAnswer-2 	NumeratorFactor 	DenominatorFactor 	FinalAnswer-2
-PercentChange-0 	NumeratorQuantity2-0 	NumeratorQuantity1-0 	DenominatorQuantity1-0 	OptionalTask_2 	OptionalTask_1 	DenominatorFactor 	NumeratorFactor 	EquationAnswer 	FinalAnswer-0 	FinalAnswerDirection-0
-PercentChange-0 	NumeratorQuantity2-0 	NumeratorQuantity1-2 	DenominatorQuantity1-0 	FinalAnswer-2 	OptionalTask_1 	NumeratorFactor 	DenominatorFactor 	EquationAnswer 	OptionalTask_2 	FirstRow1:1 	FirstRow2:1 	FirstRow2:2 	FirstRow1:1 	FirstRow1:2 	SecondRow 	ThirdRow 	FinalAnswer-2
-PercentChange-0 	NumeratorQuantity2-0 	NumeratorQuantity1-0 	DenominatorQuantity1-0 	OptionalTask_2 	FirstRow1:2 	FirstRow1:1 	FirstRow2:2 	FirstRow2:1 	SecondRow 	ThirdRow 	FinalAnswer-0 	FinalAnswerDirection-0
-PercentChange-2 	NumeratorQuantity2-0 	NumeratorQuantity1-0 	DenominatorQuantity1-0 	OptionalTask_1 	DenominatorFactor 	NumeratorFactor 	EquationAnswer 	FinalAnswer-2 	FinalAnswerDirection-0 	FinalAnswer-0
-PercentChange-2 	NumeratorQuantity2-0 	NumeratorQuantity1-0 	DenominatorQuantity1-2 	OptionalTask_1 	DenominatorFactor 	NumeratorFactor 	EquationAnswer 	FinalAnswer-2 	FinalAnswerDirection-0 	FinalAnswer-0
-PercentChange-0 	NumeratorQuantity2-0 	NumeratorQuantity1-2 	DenominatorQuantity1-2 	OptionalTask_1 	DenominatorFactor 	NumeratorFactor 	EquationAnswer 	FinalAnswerDirection-2 	FinalAnswer-2
-PercentChange-0 	NumeratorQuantity2-0 	NumeratorQuantity1-2 	DenominatorQuantity1-0 	NumeratorQuantity1-0 	OptionalTask_1 	DenominatorFactor 	NumeratorFactor 	EquationAnswer 	FinalAnswer-0
-PercentChange-2 	NumeratorQuantity2-2 	NumeratorQuantity1-2 	DenominatorQuantity1-0 	NumeratorQuantity1-0 	OptionalTask_1 	NumeratorFactor 	DenominatorFactor 	EquationAnswer 	FinalAnswer-2
-PercentChange-0 	NumeratorQuantity2-0 	DenominatorQuantity1-0 	NumeratorQuantity1-0 	OptionalTask_1 	DenominatorFactor 	NumeratorFactor 	EquationAnswer 	FinalAnswer-0
-PercentChange-0 	NumeratorQuantity2-0 	DenominatorQuantity1-0 	NumeratorQuantity1-0 	OptionalTask_1 	DenominatorFactor 	NumeratorFactor 	EquationAnswer 	FinalAnswer-2
-PercentChange-2 	NumeratorQuantity2-0 	NumeratorQuantity1-0 	DenominatorQuantity1-0 	OptionalTask_1 	DenominatorFactor 	FinalAnswerDirection-2 	DenominatorFactor 	NumeratorFactor 	EquationAnswer 	FinalAnswer-2
-PercentChange-0 	NumeratorQuantity2-2 	NumeratorQuantity1-2 	DenominatorQuantity1-0 	OptionalTask_1 	DenominatorFactor 	NumeratorFactor 	EquationAnswer 	FinalAnswer-2
-PercentChange-2 	NumeratorQuantity1-2 	DenominatorQuantity1-0 	NumeratorQuantity2-0 	FinalAnswer-2 	OptionalTask_1 	DenominatorFactor 	NumeratorFactor 	EquationAnswer 	FinalAnswer-0 	FinalAnswerDirection-2
-PercentChange-0 	NumeratorQuantity2-0 	NumeratorQuantity1-0 	DenominatorQuantity1-0 	OptionalTask_1 	DenominatorFactor 	NumeratorFactor 	EquationAnswer 	FinalAnswerDirection-0 	FinalAnswer-2
-PercentChange-0 	NumeratorQuantity2-0 	DenominatorQuantity1-0 	NumeratorQuantity1-2 	FinalAnswer-2 	OptionalTask_1 	NumeratorFactor 	DenominatorFactor 	EquationAnswer 	OptionalTask_2 	FirstRow2:1 	FirstRow2:2 	FirstRow1:1 	FirstRow1:2 	FirstRow2:2 	SecondRow 	ThirdRow 	FinalAnswer-2
-PercentChange-0 	NumeratorQuantity2-2 	NumeratorQuantity1-0 	DenominatorQuantity1-0 	NumeratorQuantity2-0 	OptionalTask_2 	FirstRow2:1 	FirstRow2:2 	FirstRow1:1 	FirstRow1:2 	SecondRow 	ThirdRow 	FinalAnswer-0 	FinalAnswerDirection-0
-PercentChange-0 	NumeratorQuantity2-0 	DenominatorQuantity1-0 	NumeratorQuantity1-0 	OptionalTask_2 	FirstRow1:2 	FirstRow1:1 	FirstRow2:1 	FirstRow2:2 	SecondRow 	ThirdRow 	FinalAnswer-2
-PercentChange-0 	NumeratorQuantity2-0 	NumeratorQuantity1-2 	DenominatorQuantity1-0 	NumeratorQuantity1-0 	OptionalTask_2 	FirstRow2:2 	FirstRow2:1 	FirstRow1:1 	FirstRow1:2 	SecondRow 	ThirdRow 	FinalAnswer-0 	FinalAnswerDirection-0
-PercentChange-0 	NumeratorQuantity2-0 	NumeratorQuantity1-0 	DenominatorQuantity1-0 	OptionalTask_2 	FirstRow2:1 	FirstRow2:2 	FirstRow1:1 	FirstRow1:2 	SecondRow 	ThirdRow 	FinalAnswer-2 	FinalAnswerDirection-0
-PercentChange-0 	NumeratorQuantity2-0 	DenominatorQuantity1-0 	NumeratorQuantity1-2 	FinalAnswer-2 	OptionalTask_1 	DenominatorFactor 	NumeratorFactor 	EquationAnswer 	FinalAnswer-2 	OptionalTask_2 	FirstRow2:1 	FirstRow1:1 	FirstRow1:2 	FirstRow2:2 	FirstRow1:2 	SecondRow 	ThirdRow 	FinalAnswer-2
-PercentChange-0 	NumeratorQuantity2-0 	DenominatorQuantity1-0 	NumeratorQuantity1-0 	OptionalTask_2 	FirstRow1:2 	FirstRow1:1 	FirstRow2:1 	FirstRow2:2 	SecondRow 	ThirdRow 	FinalAnswer-0
-PercentChange-0 	NumeratorQuantity2-0 	NumeratorQuantity1-2 	DenominatorQuantity1-0 	NumeratorQuantity1-0 	OptionalTask_2 	FirstRow1:2 	FirstRow1:1 	FirstRow2:1 	FirstRow2:2 	SecondRow 	ThirdRow 	FinalAnswer-2
-PercentChange-0 	NumeratorQuantity2-0 	DenominatorQuantity1-0 	NumeratorQuantity1-0 	OptionalTask_1 	DenominatorFactor 	NumeratorFactor 	EquationAnswer 	FinalAnswer-2
-PercentChange-0 	NumeratorQuantity2-0 	DenominatorQuantity1-0 	NumeratorQuantity1-0 	OptionalTask_2 	FirstRow2:1 	FirstRow2:2 	FirstRow1:1 	FirstRow1:2 	SecondRow 	ThirdRow 	FinalAnswer-0
-PercentChange-0 	NumeratorQuantity2-0 	DenominatorQuantity1-0 	NumeratorQuantity1-0 	FinalAnswer-2 	OptionalTask_2 	FirstRow2:1 	FirstRow2:2 	FirstRow1:1 	FirstRow1:2 	SecondRow 	FinalAnswer-0
-PercentChange-2 	NumeratorQuantity2-0 	NumeratorQuantity1-0 	DenominatorQuantity1-0 	OptionalTask_1 	FinalAnswerDirection-2 	EquationAnswer 	NumeratorFactor 	DenominatorFactor 	NumeratorFactor 	EquationAnswer 	OptionalTask_2 	FirstRow1:1 	FirstRow1:2 	FirstRow2:1 	FirstRow2:2 	FirstRow2:1 	SecondRow 	ThirdRow 	FinalAnswer-0
-PercentChange-0 	NumeratorQuantity2-0 	NumeratorQuantity1-0 	DenominatorQuantity1-0 	OptionalTask_1 	NumeratorFactor 	DenominatorFactor 	OptionalTask_2 	FirstRow1:1 	FirstRow1:2 	FirstRow2:1 	FirstRow2:2 	SecondRow 	ThirdRow 	EquationAnswer 	FinalAnswer-0
-PercentChange-0 	NumeratorQuantity2-0 	NumeratorQuantity1-0 	DenominatorQuantity1-0 	OptionalTask_2 	FirstRow1:1 	FirstRow1:2 	FirstRow2:1 	FirstRow2:2 	SecondRow 	ThirdRow 	FinalAnswer-2 	OptionalTask_1 	DenominatorFactor 	NumeratorFactor 	EquationAnswer 	FinalAnswer-2
-PercentChange-0 	NumeratorQuantity2-0 	NumeratorQuantity1-0 	DenominatorQuantity1-0 	OptionalTask_2 	OptionalTask_1 	DenominatorFactor 	NumeratorFactor 	FirstRow1:1 	FirstRow1:2 	FirstRow2:1 	FirstRow2:2 	SecondRow 	ThirdRow 	EquationAnswer 	FinalAnswer-2
-PercentChange-2 	NumeratorQuantity2-0 	NumeratorQuantity1-0 	DenominatorQuantity1-0 	OptionalTask_2 	FirstRow1:1 	FirstRow1:2 	FirstRow2:1 	FirstRow2:2 	SecondRow 	ThirdRow 	OptionalTask_1 	DenominatorFactor 	NumeratorFactor 	EquationAnswer 	FinalAnswer-2
-PercentChange-0 	NumeratorQuantity2-0 	NumeratorQuantity1-0 	DenominatorQuantity1-0 	OptionalTask_1 	OptionalTask_2 	FirstRow1:1 	FirstRow1:2 	FirstRow2:1 	FirstRow2:2 	SecondRow 	ThirdRow 	DenominatorFactor 	FinalAnswer-2 	DenominatorFactor 	NumeratorFactor 	EquationAnswer 	FinalAnswer-2
-PercentChange-2 	NumeratorQuantity2-0 	NumeratorQuantity1-0 	DenominatorQuantity1-0 	OptionalTask_1 	OptionalTask_2 	FirstRow1:1 	FirstRow1:2 	FirstRow2:1 	FirstRow2:2 	DenominatorFactor 	NumeratorFactor 	EquationAnswer 	SecondRow 	FinalAnswer-0
-PercentChange-2 	NumeratorQuantity2-0 	NumeratorQuantity1-0 	DenominatorQuantity1-2 	OptionalTask_1 	DenominatorFactor 	NumeratorFactor 	OptionalTask_2 	FirstRow1:1 	FirstRow1:2 	FirstRow2:1 	FirstRow2:2 	SecondRow 	ThirdRow 	EquationAnswer 	FinalAnswer-0
-PercentChange-2 	NumeratorQuantity2-2 	NumeratorQuantity1-0 	DenominatorQuantity1-0 	OptionalTask_1 	OptionalTask_2 	EquationAnswer 	FirstRow1:1 	FirstRow1:2 	FirstRow2:1 	FirstRow2:2 	SecondRow 	ThirdRow 	DenominatorFactor 	NumeratorFactor 	EquationAnswer 	FinalAnswer-1
-PercentChange-0 	NumeratorQuantity2-0 	NumeratorQuantity1-2 	DenominatorQuantity1-0 	NumeratorQuantity1-0 	OptionalTask_1 	OptionalTask_2 	FirstRow1:1 	FirstRow1:2 	FirstRow2:1 	FirstRow2:2 	SecondRow 	ThirdRow 	EquationAnswer 	NumeratorFactor 	DenominatorFactor 	NumeratorFactor 	EquationAnswer 	FinalAnswer-0 	FinalAnswerDirection-2
-PercentChange-2 	NumeratorQuantity2-0 	NumeratorQuantity1-0 	DenominatorQuantity1-0 	OptionalTask_2 	OptionalTask_1 	NumeratorFactor 	FirstRow1:1 	NumeratorFactor 	DenominatorFactor 	NumeratorFactor 	EquationAnswer 	FirstRow1:2 	FirstRow2:1 	FirstRow2:2 	SecondRow 	ThirdRow 	FinalAnswer-0
-PercentChange-0 	NumeratorQuantity1-2 	NumeratorQuantity2-0 	DenominatorQuantity1-2 	NumeratorQuantity1-0 	DenominatorQuantity1-0 	OptionalTask_2 	FirstRow1:1 	FirstRow1:2 	FirstRow2:2 	FirstRow2:1 	SecondRow 	ThirdRow 	FinalAnswer-0
-PercentChange-0 	NumeratorQuantity2-0 	DenominatorQuantity1-2 	NumeratorQuantity1-0 	DenominatorQuantity1-0 	OptionalTask_2 	FirstRow1:1 	FirstRow1:2 	FirstRow2:1 	FirstRow2:2 	SecondRow 	ThirdRow 	FinalAnswer-0
-PercentChange-0 	NumeratorQuantity2-0 	NumeratorQuantity1-2 	DenominatorQuantity1-0 	NumeratorQuantity1-0 	OptionalTask_1 	DenominatorFactor 	NumeratorFactor 	EquationAnswer 	FinalAnswer-0 	FinalAnswerDirection-0
-PercentChange-2 	NumeratorQuantity2-0 	NumeratorQuantity1-2 	DenominatorQuantity1-0 	NumeratorQuantity1-0 	OptionalTask_1 	DenominatorFactor 	NumeratorFactor 	EquationAnswer 	FinalAnswer-0 	FinalAnswerDirection-0
-PercentChange-0 	NumeratorQuantity2-0 	NumeratorQuantity1-0 	DenominatorQuantity1-0 	OptionalTask_1 	DenominatorFactor 	NumeratorFactor 	EquationAnswer 	FinalAnswer-0 	FinalAnswerDirection-0
-PercentChange-0 	NumeratorQuantity2-0 	NumeratorQuantity1-2 	DenominatorQuantity1-0 	NumeratorQuantity1-2 	OptionalTask_1 	DenominatorFactor 	NumeratorFactor 	EquationAnswer 	FinalAnswer-0 	FinalAnswerDirection-0
-PercentChange-0 	NumeratorQuantity2-2 	NumeratorQuantity1-0 	DenominatorQuantity1-2 	OptionalTask_1 	NumeratorFactor 	DenominatorFactor 	EquationAnswer 	FinalAnswer-2
-PercentChange-0 	NumeratorQuantity2-0 	NumeratorQuantity1-0 	DenominatorQuantity1-0 	OptionalTask_2 	FirstRow1:1 	FirstRow1:2 	FirstRow2:1 	FirstRow2:2 	SecondRow 	ThirdRow 	FinalAnswer-0
-PercentChange-2 	NumeratorQuantity2-0 	DenominatorQuantity1-0 	NumeratorQuantity1-0 	OptionalTask_1 	DenominatorFactor 	NumeratorFactor 	EquationAnswer 	FinalAnswer-0 	FinalAnswerDirection-0
-PercentChange-2 	NumeratorQuantity2-0 	NumeratorQuantity1-0 	DenominatorQuantity1-0 	OptionalTask_1 	NumeratorFactor 	DenominatorFactor 	EquationAnswer 	FinalAnswer-2 	OptionalTask_2 	FirstRow1:1 	FirstRow2:2 	FirstRow2:1 	FirstRow1:2 	FirstRow1:1 	SecondRow 	ThirdRow 	FinalAnswer-2
-PercentChange-2 	NumeratorQuantity2-0 	NumeratorQuantity1-0 	DenominatorQuantity1-0 	OptionalTask_1 	EquationAnswer 	DenominatorFactor 	EquationAnswer 	DenominatorFactor 	EquationAnswer 	DenominatorFactor 	NumeratorFactor 	EquationAnswer 	OptionalTask_2 	FirstRow1:1 	FirstRow2:2 	FirstRow2:1 	FirstRow1:2 	FirstRow1:1 	SecondRow 	ThirdRow 	FinalAnswer-0 	FinalAnswerDirection-2
-PercentChange-2 	NumeratorQuantity2-2 	NumeratorQuantity1-0 	DenominatorQuantity1-0 	OptionalTask_1 	DenominatorFactor 	NumeratorFactor 	EquationAnswer 	FinalAnswer-0 	FinalAnswerDirection-2
-PercentChange-0 	NumeratorQuantity2-0 	DenominatorQuantity1-0 	NumeratorQuantity1-0 	OptionalTask_2 	FinalAnswer-2 	FirstRow2:1 	FirstRow2:2 	FirstRow1:1 	FirstRow1:2 	FinalAnswer-0
-PercentChange-0 	NumeratorQuantity2-0 	NumeratorQuantity1-0 	DenominatorQuantity1-0 	FinalAnswer-2 	OptionalTask_1 	EquationAnswer 	FinalAnswer-2 	EquationAnswer 	OptionalTask_2 	FirstRow2:1 	FirstRow2:2 	FirstRow1:1 	FirstRow1:2 	EquationAnswer 	SecondRow 	ThirdRow 	FinalAnswer-2 	ThirdRow 	FinalAnswer-2
-PercentChange-2 	NumeratorQuantity2-2 	NumeratorQuantity1-0 	DenominatorQuantity1-0 	NumeratorQuantity2-0 	OptionalTask_1 	NumeratorFactor 	EquationAnswer 	FinalAnswer-2 	FinalAnswerDirection-0
-PercentChange-0 	NumeratorQuantity2-0 	NumeratorQuantity1-0 	DenominatorQuantity1-0 	OptionalTask_2 	FirstRow2:1 	FirstRow2:2 	FirstRow1:2 	FirstRow1:1 	SecondRow 	ThirdRow 	FinalAnswer-2 	OptionalTask_1 	NumeratorFactor 	DenominatorFactor 	FinalAnswer-2
-PercentChange-0 	NumeratorQuantity2-0 	NumeratorQuantity1-2 	DenominatorQuantity1-2 	NumeratorQuantity1-0 	DenominatorQuantity1-2 	OptionalTask_1 	EquationAnswer 	NumeratorFactor 	OptionalTask_2 	FirstRow2:1 	FirstRow2:2 	FirstRow1:2 	FirstRow1:1 	SecondRow 	ThirdRow 	FinalAnswer-0 	FinalAnswerDirection-0
-PercentChange-0 	NumeratorQuantity2-0 	NumeratorQuantity1-0 	DenominatorQuantity1-0 	OptionalTask_2 	FirstRow2:1 	FirstRow2:2 	FirstRow1:1 	FirstRow1:2 	SecondRow 	FinalAnswer-2
-PercentChange-0 	NumeratorQuantity2-0 	NumeratorQuantity1-0 	DenominatorQuantity1-0 	OptionalTask_1 	DenominatorFactor 	NumeratorFactor 	EquationAnswer 	FinalAnswer-0 	FinalAnswerDirection-0
-PercentChange-0 	NumeratorQuantity2-0 	NumeratorQuantity1-0 	DenominatorQuantity1-0 	OptionalTask_2 	FirstRow2:1 	FirstRow2:2 	FirstRow1:1 	FirstRow1:2 	SecondRow 	ThirdRow 	FinalAnswer-0
-PercentChange-0 	NumeratorQuantity2-0 	NumeratorQuantity1-0 	DenominatorQuantity1-0 	OptionalTask_2 	FirstRow2:1 	FirstRow2:2 	FirstRow1:2 	FirstRow1:1 	SecondRow 	FinalAnswer-2
-PercentChange-0 	NumeratorQuantity2-0 	NumeratorQuantity1-2 	DenominatorQuantity1-0 	OptionalTask_2 	FirstRow2:1 	FirstRow2:2 	FirstRow1:1 	FirstRow1:2 	SecondRow 	ThirdRow 	FinalAnswer-2
-PercentChange-0 	NumeratorQuantity2-0 	NumeratorQuantity1-0 	DenominatorQuantity1-0 	OptionalTask_1 	DenominatorFactor 	NumeratorFactor 	EquationAnswer 	FinalAnswer-2
-PercentChange-0 	NumeratorQuantity2-0 	NumeratorQuantity1-2 	DenominatorQuantity1-0 	OptionalTask_2 	FirstRow2:1 	FirstRow2:2 	FirstRow1:1 	FirstRow1:2 	SecondRow 	ThirdRow 	FinalAnswer-2
-PercentChange-0 	NumeratorQuantity2-0 	NumeratorQuantity1-0 	DenominatorQuantity1-0 	OptionalTask_2 	FirstRow2:1 	FirstRow2:2 	FirstRow1:1 	FirstRow1:2 	SecondRow 	ThirdRow 	FinalAnswer-0
-PercentChange-0 	NumeratorQuantity2-0 	NumeratorQuantity1-0 	DenominatorQuantity1-0 	OptionalTask_2 	FirstRow2:1 	FirstRow2:2 	FirstRow1:1 	FirstRow1:2 	SecondRow 	ThirdRow 	FinalAnswer-0
-PercentChange-0 	NumeratorQuantity2-0 	NumeratorQuantity1-0 	DenominatorQuantity1-0 	OptionalTask_2 	FirstRow2:1 	FirstRow2:2 	FirstRow1:2 	FirstRow1:1 	FinalAnswer-2
-PercentChange-0 	NumeratorQuantity2-0 	NumeratorQuantity1-0 	DenominatorQuantity1-0 	OptionalTask_1 	DenominatorFactor 	NumeratorFactor 	EquationAnswer 	FinalAnswer-0
-PercentChange-0 	NumeratorQuantity2-0 	NumeratorQuantity1-0 	DenominatorQuantity1-0 	OptionalTask_1 	DenominatorFactor 	NumeratorFactor 	EquationAnswer 	FinalAnswer-2
-PercentChange-0 	NumeratorQuantity2-2 	NumeratorQuantity1-0 	DenominatorQuantity1-0 	OptionalTask_1 	EquationAnswer 	DenominatorFactor 	NumeratorFactor 	EquationAnswer 	OptionalTask_2 	FirstRow1:1 	FirstRow2:1 	FirstRow2:2 	FirstRow1:1 	FirstRow1:2 	FirstRow2:2 	FirstRow1:2 	SecondRow 	ThirdRow 	FinalAnswer-0 	FinalAnswerDirection-0
-PercentChange-0 	NumeratorQuantity2-0 	NumeratorQuantity1-0 	DenominatorQuantity1-0 	OptionalTask_1 	DenominatorFactor 	NumeratorFactor 	EquationAnswer 	OptionalTask_2 	FirstRow1:1 	FirstRow1:2 	FirstRow1:1 	FirstRow2:2 	FirstRow2:1 	SecondRow 	ThirdRow 	FinalAnswer-2
-PercentChange-0 	NumeratorQuantity2-0 	NumeratorQuantity1-0 	DenominatorQuantity1-2 	OptionalTask_1 	DenominatorFactor 	NumeratorFactor 	EquationAnswer 	FinalAnswer-2 	OptionalTask_2 	FirstRow2:2 	FirstRow2:1 	FirstRow1:1 	FirstRow1:2 	SecondRow 	ThirdRow 	FinalAnswer-2
-PercentChange-0 	NumeratorQuantity2-0 	NumeratorQuantity1-0 	DenominatorQuantity1-0 	OptionalTask_1 	EquationAnswer 	DenominatorFactor 	NumeratorFactor 	EquationAnswer 	OptionalTask_2 	FirstRow1:1 	FirstRow2:1 	FirstRow2:2 	FirstRow1:2 	FirstRow1:1 	SecondRow 	FinalAnswer-2 	ThirdRow 	FinalAnswer-0 	FinalAnswerDirection-0
-PercentChange-0 	NumeratorQuantity2-0 	NumeratorQuantity1-0 	DenominatorQuantity1-0 	OptionalTask_1 	DenominatorFactor 	NumeratorFactor 	EquationAnswer 	OptionalTask_2 	FirstRow2:1 	FirstRow2:2 	FirstRow1:1 	FirstRow1:2 	SecondRow 	ThirdRow 	FinalAnswer-0
-PercentChange-0 	NumeratorQuantity2-0 	NumeratorQuantity1-0 	DenominatorQuantity1-0 	OptionalTask_1 	NumeratorFactor 	DenominatorFactor 	NumeratorFactor 	EquationAnswer 	OptionalTask_2 	FirstRow2:1 	FirstRow2:2 	FirstRow1:1 	FirstRow1:2 	SecondRow 	ThirdRow 	FinalAnswer-2
-PercentChange-0 	NumeratorQuantity2-0 	NumeratorQuantity1-0 	DenominatorQuantity1-2 	OptionalTask_1 	DenominatorFactor 	NumeratorFactor 	EquationAnswer 	OptionalTask_2 	FirstRow1:1 	FirstRow1:2 	FirstRow2:1 	FirstRow2:2 	SecondRow 	ThirdRow 	FinalAnswer-2
-PercentChange-0 	NumeratorQuantity2-0 	NumeratorQuantity1-0 	DenominatorQuantity1-0 	OptionalTask_1 	DenominatorFactor 	NumeratorFactor 	EquationAnswer 	FinalAnswer-0
-PercentChange-2 	NumeratorQuantity2-2 	NumeratorQuantity1-2 	DenominatorQuantity1-0 	OptionalTask_1 	DenominatorFactor 	NumeratorFactor 	EquationAnswer 	OptionalTask_2 	FirstRow1:1 	FirstRow1:2 	FirstRow2:1 	FirstRow2:2 	SecondRow 	ThirdRow 	FinalAnswer-2
-PercentChange-0 	NumeratorQuantity2-0 	NumeratorQuantity1-2 	DenominatorQuantity1-2 	OptionalTask_1 	EquationAnswer 	DenominatorFactor 	NumeratorFactor 	EquationAnswer 	OptionalTask_2 	FirstRow1:1 	FirstRow1:2 	FirstRow2:1 	FirstRow2:2 	FinalAnswer-1 	SecondRow 	FinalAnswer-1 	ThirdRow 	FinalAnswer-0 	FinalAnswerDirection-2
-PercentChange-0 	NumeratorQuantity2-2 	NumeratorQuantity1-0 	NumeratorQuantity2-1 	DenominatorQuantity1-0 	OptionalTask_1 	DenominatorFactor 	NumeratorFactor 	EquationAnswer 	OptionalTask_2 	FirstRow1:1 	FirstRow1:2 	FirstRow2:1 	FirstRow2:2 	SecondRow 	ThirdRow 	FinalAnswer-2
-PercentChange-0 	NumeratorQuantity2-2 	NumeratorQuantity1-1 	DenominatorQuantity1-0 	OptionalTask_2 	OptionalTask_1 	NumeratorFactor 	DenominatorFactor 	NumeratorFactor 	EquationAnswer 	FirstRow1:1 	FirstRow1:2 	FirstRow2:1 	FirstRow2:2 	SecondRow 	ThirdRow 	FinalAnswer-1
-PercentChange-2 	NumeratorQuantity2-0 	NumeratorQuantity1-0 	DenominatorQuantity1-0 	OptionalTask_1 	DenominatorFactor 	NumeratorFactor 	EquationAnswer 	OptionalTask_2 	EquationAnswer 	FirstRow1:1 	FirstRow1:2 	FirstRow2:1 	FirstRow2:2 	FirstRow2:1 	SecondRow 	ThirdRow 	FinalAnswer-2
-PercentChange-0 	NumeratorQuantity2-2 	NumeratorQuantity1-0 	DenominatorQuantity1-0 	OptionalTask_1 	DenominatorFactor 	NumeratorFactor 	EquationAnswer 	OptionalTask_2 	FirstRow1:1 	FirstRow1:2 	FirstRow2:1 	FirstRow2:2 	FirstRow2:1 	SecondRow 	ThirdRow 	FinalAnswer-2
-PercentChange-0 	NumeratorQuantity2-2 	NumeratorQuantity1-0 	DenominatorQuantity1-0 	OptionalTask_2 	OptionalTask_1 	DenominatorFactor 	NumeratorFactor 	DenominatorFactor 	EquationAnswer 	FirstRow1:1 	FirstRow1:2 	FirstRow2:1 	FirstRow2:2 	SecondRow 	ThirdRow 	FinalAnswer-2
-PercentChange-2 	NumeratorQuantity2-0 	NumeratorQuantity1-0 	DenominatorQuantity1-0 	OptionalTask_1 	NumeratorFactor 	DenominatorFactor 	EquationAnswer 	OptionalTask_2 	EquationAnswer 	FirstRow1:1 	FirstRow1:2 	FirstRow2:2 	FirstRow2:1 	SecondRow 	ThirdRow 	FinalAnswer-1
-PercentChange-2 	NumeratorQuantity2-0 	NumeratorQuantity1-0 	DenominatorQuantity1-0 	OptionalTask_1 	NumeratorFactor 	DenominatorFactor 	NumeratorFactor 	EquationAnswer 	OptionalTask_2 	FirstRow1:1 	FirstRow1:2 	FirstRow2:2 	FirstRow2:1 	SecondRow 	ThirdRow 	FinalAnswer-2
-PercentChange-0 	NumeratorQuantity2-0 	NumeratorQuantity1-0 	DenominatorQuantity1-0 	OptionalTask_1 	DenominatorFactor 	NumeratorFactor 	EquationAnswer 	OptionalTask_2 	FirstRow1:1 	FirstRow1:2 	FirstRow2:2 	FirstRow2:1 	SecondRow 	ThirdRow 	FinalAnswer-0 	FinalAnswerDirection-0
-PercentChange-0 	NumeratorQuantity2-0 	NumeratorQuantity1-0 	DenominatorQuantity1-0 	OptionalTask_1 	DenominatorFactor 	NumeratorFactor 	EquationAnswer 	OptionalTask_2 	FirstRow1:1 	FirstRow1:2 	FirstRow2:1 	FirstRow2:2 	FirstRow2:1 	SecondRow 	ThirdRow 	FinalAnswer-1
-PercentChange-0 	NumeratorQuantity2-1 	NumeratorQuantity1-2 	DenominatorQuantity1-1 	OptionalTask_1 	DenominatorFactor 	NumeratorFactor 	EquationAnswer 	OptionalTask_2 	FirstRow1:1 	FirstRow1:2 	FirstRow2:1 	FirstRow2:2 	SecondRow 	ThirdRow 	FinalAnswer-1 	FinalAnswerDirection-0 	FinalAnswer-0
-PercentChange-0 	NumeratorQuantity2-0 	NumeratorQuantity1-0 	DenominatorQuantity1-0 	OptionalTask_1 	DenominatorFactor 	NumeratorFactor 	EquationAnswer 	OptionalTask_2 	FirstRow1:1 	FirstRow1:2 	FirstRow2:1 	FirstRow2:2 	FirstRow2:1 	SecondRow 	ThirdRow 	FinalAnswer-2
-PercentChange-0 	NumeratorQuantity2-2 	NumeratorQuantity1-0 	DenominatorQuantity1-0 	OptionalTask_1 	DenominatorFactor 	NumeratorFactor 	EquationAnswer 	OptionalTask_2 	FirstRow1:1 	FirstRow1:2 	FirstRow2:1 	FirstRow2:2 	SecondRow 	ThirdRow 	FinalAnswer-1
-PercentChange-2 	NumeratorQuantity2-0 	DenominatorQuantity1-0 	NumeratorQuantity1-0 	OptionalTask_1 	DenominatorFactor 	NumeratorFactor 	EquationAnswer 	OptionalTask_2 	FirstRow2:1 	FirstRow1:1 	FirstRow2:2 	FirstRow1:2 	SecondRow 	ThirdRow 	FinalAnswer-2
-PercentChange-0 	DenominatorQuantity1-2 	NumeratorQuantity2-0 	NumeratorQuantity1-2 	OptionalTask_1 	OptionalTask_2 	DenominatorFactor 	NumeratorFactor 	EquationAnswer 	FirstRow1:1 	FirstRow2:2 	FirstRow1:2 	FirstRow2:1 	FirstRow2:2 	FirstRow2:1 	SecondRow 	ThirdRow 	FinalAnswerDirection-0 	FinalAnswer-2
-PercentChange-2 	NumeratorQuantity2-2 	DenominatorQuantity1-0 	NumeratorQuantity1-0 	NumeratorQuantity2-0 	OptionalTask_1 	OptionalTask_2 	DenominatorFactor 	NumeratorFactor 	EquationAnswer 	FirstRow2:2 	FirstRow2:1 	FirstRow1:2 	FirstRow1:1 	FirstRow2:1 	FirstRow1:1 	FirstRow2:1 	SecondRow 	ThirdRow 	FinalAnswerDirection-0 	FinalAnswer-0
-PercentChange-0 	NumeratorQuantity2-0 	DenominatorQuantity1-2 	NumeratorQuantity1-0 	OptionalTask_1 	OptionalTask_2 	EquationAnswer 	NumeratorFactor 	DenominatorFactor 	NumeratorFactor 	EquationAnswer 	DenominatorFactor 	NumeratorFactor 	EquationAnswer 	FirstRow1:1 	FirstRow2:2 	FirstRow1:2 	FirstRow2:2 	FirstRow1:2 	FirstRow2:1 	SecondRow 	FinalAnswer-0 	FinalAnswerDirection-0
-PercentChange-0 	DenominatorQuantity1-0 	NumeratorQuantity2-0 	NumeratorQuantity1-0 	OptionalTask_1 	OptionalTask_2 	DenominatorFactor 	NumeratorFactor 	EquationAnswer 	FirstRow2:1 	FirstRow1:1 	FirstRow2:2 	FirstRow1:2 	SecondRow 	ThirdRow 	FinalAnswer-0
-PercentChange-0 	NumeratorQuantity2-0 	NumeratorQuantity1-0 	DenominatorQuantity1-0 	OptionalTask_1 	OptionalTask_2 	DenominatorFactor 	NumeratorFactor 	EquationAnswer 	FirstRow2:1 	FirstRow2:2 	FirstRow1:1 	FirstRow1:2 	SecondRow 	ThirdRow 	FinalAnswer-0
-PercentChange-0 	NumeratorQuantity2-0 	DenominatorQuantity1-2 	NumeratorQuantity1-0 	OptionalTask_1 	OptionalTask_2 	DenominatorFactor 	NumeratorFactor 	EquationAnswer 	FirstRow2:1 	FirstRow1:1 	FirstRow2:2 	FirstRow1:2 	SecondRow 	ThirdRow 	FinalAnswer-2
-PercentChange-0 	NumeratorQuantity2-0 	NumeratorQuantity1-0 	DenominatorQuantity1-0 	OptionalTask_1 	OptionalTask_2 	DenominatorFactor 	NumeratorFactor 	EquationAnswer 	FirstRow2:1 	FirstRow2:2 	FirstRow1:1 	FirstRow1:2 	SecondRow 	ThirdRow 	FinalAnswer-2
-PercentChange-0 	NumeratorQuantity2-0 	NumeratorQuantity1-0 	DenominatorQuantity1-0 	OptionalTask_1 	OptionalTask_2 	DenominatorFactor 	NumeratorFactor 	EquationAnswer 	FirstRow2:1 	FirstRow2:2 	FirstRow1:1 	FirstRow1:2 	SecondRow 	ThirdRow 	FinalAnswer-2
-PercentChange-0 	NumeratorQuantity2-0 	DenominatorQuantity1-0 	NumeratorQuantity1-2 	OptionalTask_1 	OptionalTask_2 	DenominatorFactor 	NumeratorFactor 	EquationAnswer 	FirstRow1:1 	FirstRow1:2 	FirstRow1:1 	FirstRow2:1 	FirstRow2:2 	FirstRow2:1 	SecondRow 	ThirdRow 	FinalAnswerDirection-0 	FinalAnswer-0
-PercentChange-0 	NumeratorQuantity2-0 	DenominatorQuantity1-0 	NumeratorQuantity1-0 	OptionalTask_1 	DenominatorFactor 	EquationAnswer 	NumeratorFactor 	EquationAnswer 	OptionalTask_2 	FirstRow1:1 	FirstRow2:1 	FirstRow2:2 	FirstRow1:1 	FirstRow2:2 	FirstRow1:1 	FirstRow2:2 	FirstRow1:1 	FirstRow1:2 	FirstRow2:2 	SecondRow 	ThirdRow 	FinalAnswer-2
-PercentChange-0 	NumeratorQuantity2-2 	NumeratorQuantity1-2 	DenominatorQuantity1-0 	OptionalTask_1 	NumeratorFactor 	DenominatorFactor 	EquationAnswer 	FinalAnswer-0
-PercentChange-0 	NumeratorQuantity2-2 	NumeratorQuantity1-2 	DenominatorQuantity1-0 	OptionalTask_1 	NumeratorFactor 	DenominatorFactor 	EquationAnswer 	FinalAnswer-2 	FinalAnswerDirection-2 	FinalAnswer-2
-PercentChange-2 	NumeratorQuantity2-2 	NumeratorQuantity1-2 	DenominatorQuantity1-0 	OptionalTask_1 	NumeratorFactor 	DenominatorFactor 	NumeratorFactor 	EquationAnswer 	FinalAnswer-0
-PercentChange-2 	NumeratorQuantity2-0 	NumeratorQuantity1-0 	DenominatorQuantity1-2 	OptionalTask_1 	DenominatorFactor 	NumeratorFactor 	EquationAnswer 	FinalAnswer-0 	FinalAnswerDirection-2
-PercentChange-0 	NumeratorQuantity2-2 	NumeratorQuantity1-2 	DenominatorQuantity1-0 	OptionalTask_1 	NumeratorFactor 	DenominatorFactor 	EquationAnswer 	FinalAnswer-0
-PercentChange-2 	NumeratorQuantity2-2 	NumeratorQuantity1-2 	DenominatorQuantity1-0 	OptionalTask_1 	NumeratorFactor 	DenominatorFactor 	NumeratorFactor 	EquationAnswer 	FinalAnswer-0
-PercentChange-2 	NumeratorQuantity2-0 	NumeratorQuantity1-0 	DenominatorQuantity1-0 	OptionalTask_1 	NumeratorFactor 	DenominatorFactor 	NumeratorFactor 	EquationAnswer 	FinalAnswer-0
-PercentChange-2 	NumeratorQuantity2-0 	NumeratorQuantity1-2 	DenominatorQuantity1-0 	OptionalTask_1 	NumeratorFactor 	DenominatorFactor 	EquationAnswer 	FinalAnswer-2
-PercentChange-0 	NumeratorQuantity2-2 	NumeratorQuantity1-0 	DenominatorQuantity1-0 	FinalAnswer-2 	OptionalTask_1 	DenominatorFactor 	NumeratorFactor 	EquationAnswer 	FinalAnswer-0
-PercentChange-2 	NumeratorQuantity2-0 	NumeratorQuantity1-2 	DenominatorQuantity1-0 	OptionalTask_1 	NumeratorFactor 	DenominatorFactor 	EquationAnswer 	FinalAnswer-2
-PercentChange-2 	NumeratorQuantity2-2 	NumeratorQuantity1-2 	DenominatorQuantity1-0 	OptionalTask_1 	NumeratorFactor 	DenominatorFactor 	EquationAnswer 	FinalAnswer-0
-PercentChange-0 	NumeratorQuantity2-2 	NumeratorQuantity1-0 	DenominatorQuantity1-0 	OptionalTask_1 	DenominatorFactor 	NumeratorFactor 	EquationAnswer 	FinalAnswer-2
-PercentChange-2 	NumeratorQuantity2-2 	NumeratorQuantity1-2 	DenominatorQuantity1-0 	OptionalTask_1 	NumeratorFactor 	DenominatorFactor 	NumeratorFactor 	EquationAnswer 	FinalAnswerDirection-0 	FinalAnswer-0
-PercentChange-0 	NumeratorQuantity2-0 	DenominatorQuantity1-0 	NumeratorQuantity1-0 	OptionalTask_2 	FirstRow2:1 	FirstRow2:2 	FirstRow1:1 	FirstRow1:2 	SecondRow 	ThirdRow 	FinalAnswer-0
-PercentChange-0 	NumeratorQuantity2-2 	NumeratorQuantity1-0 	DenominatorQuantity1-0 	NumeratorQuantity2-0 	OptionalTask_1 	EquationAnswer 	NumeratorFactor 	OptionalTask_2 	FirstRow1:2 	FirstRow1:1 	FirstRow2:2 	FirstRow2:1 	SecondRow 	ThirdRow 	FinalAnswerDirection-2 	FinalAnswer-1
-PercentChange-0 	NumeratorQuantity2-0 	DenominatorQuantity1-0 	NumeratorQuantity1-0 	OptionalTask_2 	FirstRow2:1 	FirstRow2:2 	FirstRow1:1 	FirstRow1:2 	SecondRow 	ThirdRow 	FinalAnswer-2
-PercentChange-2 	NumeratorQuantity2-0 	DenominatorQuantity1-0 	NumeratorQuantity1-0 	OptionalTask_2 	FirstRow2:1 	FirstRow2:2 	FirstRow1:1 	FirstRow1:2 	SecondRow 	ThirdRow 	FinalAnswer-0
-PercentChange-2 	NumeratorQuantity2-0 	DenominatorQuantity1-0 	NumeratorQuantity1-0 	OptionalTask_2 	FirstRow2:1 	FirstRow2:2 	FirstRow1:1 	FirstRow1:2 	SecondRow 	ThirdRow 	FinalAnswer-0
-PercentChange-2 	NumeratorQuantity2-0 	NumeratorQuantity1-2 	DenominatorQuantity1-0 	NumeratorQuantity1-0 	OptionalTask_2 	FirstRow2:1 	FirstRow2:2 	FirstRow1:1 	FirstRow1:2 	SecondRow 	ThirdRow 	FinalAnswer-2
-PercentChange-2 	NumeratorQuantity2-0 	DenominatorQuantity1-0 	NumeratorQuantity1-0 	OptionalTask_2 	FirstRow2:1 	FirstRow2:2 	FirstRow1:1 	FirstRow1:2 	SecondRow 	ThirdRow 	FinalAnswer-2
-PercentChange-2 	NumeratorQuantity2-0 	NumeratorQuantity1-2 	DenominatorQuantity1-0 	NumeratorQuantity1-0 	OptionalTask_2 	FirstRow2:1 	FirstRow2:2 	FirstRow1:1 	FirstRow1:2 	SecondRow 	ThirdRow 	FinalAnswer-2
-PercentChange-2 	NumeratorQuantity2-0 	NumeratorQuantity1-0 	DenominatorQuantity1-0 	OptionalTask_2 	FirstRow1:1 	FirstRow1:2 	FirstRow2:2 	FirstRow2:1 	SecondRow 	ThirdRow 	FinalAnswer-0 	FinalAnswerDirection-0
-PercentChange-0 	DenominatorQuantity1-2 	NumeratorQuantity1-2 	NumeratorQuantity2-2 	NumeratorQuantity1-0 	DenominatorQuantity1-2 	OptionalTask_2 	FirstRow1:1 	FirstRow1:2 	FirstRow2:1 	FirstRow1:2 	FirstRow2:2 	SecondRow 	ThirdRow 	FinalAnswer-0 	FinalAnswerDirection-0
-PercentChange-0 	DenominatorQuantity1-0 	NumeratorQuantity2-0 	NumeratorQuantity1-0 	OptionalTask_1 	DenominatorFactor 	NumeratorFactor 	OptionalTask_2 	FirstRow1:1 	FirstRow1:2 	FirstRow2:1 	FirstRow2:2 	SecondRow 	ThirdRow 	FinalAnswer-2 	EquationAnswer 	NumeratorFactor 	FinalAnswer-2
-PercentChange-0 	NumeratorQuantity2-0 	NumeratorQuantity1-2 	DenominatorQuantity1-2 	OptionalTask_1 	DenominatorFactor 	NumeratorFactor 	EquationAnswer 	FinalAnswer-0 	FinalAnswerDirection-0
-PercentChange-0 	NumeratorQuantity2-2 	NumeratorQuantity1-2 	DenominatorQuantity1-0 	NumeratorQuantity1-0 	OptionalTask_1 	EquationAnswer 	NumeratorFactor 	DenominatorFactor 	OptionalTask_2 	NumeratorFactor 	DenominatorFactor 	NumeratorFactor 	DenominatorFactor 	NumeratorFactor 	FinalAnswer-2
-PercentChange-2 	NumeratorQuantity2-0 	NumeratorQuantity1-2 	DenominatorQuantity1-0 	NumeratorQuantity1-0 	OptionalTask_2 	FirstRow1:1 	FirstRow1:2 	FirstRow2:2 	FirstRow2:1 	SecondRow 	ThirdRow 	FinalAnswer-0 	FinalAnswerDirection-0
-PercentChange-0 	NumeratorQuantity2-2 	NumeratorQuantity1-0 	DenominatorQuantity1-0 	OptionalTask_2 	FirstRow1:1 	FirstRow1:2 	FirstRow2:1 	FirstRow1:2 	FirstRow2:2 	SecondRow 	ThirdRow 	FinalAnswer-0 	FinalAnswerDirection-2
-PercentChange-0 	DenominatorQuantity1-0 	NumeratorQuantity2-0 	NumeratorQuantity1-2 	OptionalTask_1 	FinalAnswerDirection-0 	DenominatorFactor 	NumeratorFactor 	EquationAnswer 	FinalAnswer-0
-PercentChange-2 	NumeratorQuantity2-2 	NumeratorQuantity1-2 	DenominatorQuantity1-0 	NumeratorQuantity2-0 	NumeratorQuantity1-0 	OptionalTask_2 	FirstRow1:1 	FirstRow2:2 	FirstRow2:1 	FirstRow1:2 	SecondRow 	ThirdRow 	FinalAnswer-0 	FinalAnswerDirection-2
-PercentChange-0 	NumeratorQuantity2-0 	NumeratorQuantity1-0 	DenominatorQuantity1-0 	OptionalTask_1 	DenominatorFactor 	NumeratorFactor 	EquationAnswer 	FinalAnswer-2
-PercentChange-0 	NumeratorQuantity2-0 	NumeratorQuantity1-0 	DenominatorQuantity1-0 	OptionalTask_1 	DenominatorFactor 	NumeratorFactor 	EquationAnswer 	FinalAnswer-2
-PercentChange-0 	NumeratorQuantity2-0 	DenominatorQuantity1-0 	NumeratorQuantity1-0 	OptionalTask_1 	DenominatorFactor 	NumeratorFactor 	EquationAnswer 	FinalAnswer-2
-PercentChange-2 	DenominatorQuantity1-0 	NumeratorQuantity1-2 	NumeratorQuantity2-2 	NumeratorQuantity1-0 	NumeratorQuantity2-0 	OptionalTask_1 	NumeratorFactor 	DenominatorFactor 	NumeratorFactor 	EquationAnswer 	OptionalTask_2 	FirstRow1:1 	FirstRow2:1 	FirstRow1:2 	FirstRow2:1 	FirstRow2:2 	SecondRow 	ThirdRow 	FinalAnswer-2
-PercentChange-0 	NumeratorQuantity2-0 	NumeratorQuantity1-0 	DenominatorQuantity1-0 	OptionalTask_1 	DenominatorFactor 	NumeratorFactor 	EquationAnswer 	FinalAnswer-2
-PercentChange-0 	NumeratorQuantity2-0 	DenominatorQuantity1-0 	NumeratorQuantity1-0 	OptionalTask_1 	DenominatorFactor 	NumeratorFactor 	EquationAnswer 	FinalAnswer-2
-PercentChange-0 	NumeratorQuantity2-0 	DenominatorQuantity1-0 	NumeratorQuantity1-0 	OptionalTask_1 	DenominatorFactor 	NumeratorFactor 	EquationAnswer 	FinalAnswer-2
-PercentChange-0 	NumeratorQuantity2-0 	NumeratorQuantity1-2 	DenominatorQuantity1-0 	NumeratorQuantity1-0 	OptionalTask_1 	DenominatorFactor 	NumeratorFactor 	EquationAnswer 	OptionalTask_2 	FirstRow1:1 	FirstRow2:1 	FirstRow1:2 	FirstRow2:1 	FirstRow2:2 	SecondRow 	ThirdRow 	FinalAnswer-0
-PercentChange-0 	NumeratorQuantity2-0 	NumeratorQuantity1-2 	DenominatorQuantity1-0 	OptionalTask_2 	OptionalTask_1 	NumeratorFactor 	DenominatorFactor 	NumeratorFactor 	EquationAnswer 	FinalAnswer-2
-PercentChange-0 	NumeratorQuantity2-0 	NumeratorQuantity1-0 	DenominatorQuantity1-0 	OptionalTask_1 	DenominatorFactor 	NumeratorFactor 	EquationAnswer 	OptionalTask_2 	FirstRow1:2 	FirstRow1:1 	FirstRow2:1 	FirstRow2:2 	SecondRow 	ThirdRow 	FinalAnswer-0
-PercentChange-0 	NumeratorQuantity2-2 	NumeratorQuantity1-0 	DenominatorQuantity1-0 	OptionalTask_1 	FinalAnswer-1 	DenominatorFactor 	NumeratorFactor 	EquationAnswer 	OptionalTask_2 	FinalAnswer-1
-PercentChange-0 	NumeratorQuantity2-2 	NumeratorQuantity1-0 	DenominatorQuantity1-0 	OptionalTask_1 	DenominatorFactor 	NumeratorFactor 	EquationAnswer 	OptionalTask_2 	FirstRow1:2 	FirstRow1:1 	FirstRow2:1 	FirstRow2:2 	SecondRow 	ThirdRow 	FinalAnswer-2
-PercentChange-2 	NumeratorQuantity2-0 	NumeratorQuantity1-0 	DenominatorQuantity1-0 	OptionalTask_1 	DenominatorFactor 	NumeratorFactor 	EquationAnswer 	OptionalTask_2 	FirstRow1:2 	FirstRow1:1 	FirstRow2:1 	FirstRow2:2 	SecondRow 	ThirdRow 	FinalAnswer-2
-PercentChange-0 	NumeratorQuantity2-2 	NumeratorQuantity1-2 	DenominatorQuantity1-0 	OptionalTask_1 	DenominatorFactor 	NumeratorFactor 	EquationAnswer 	FinalAnswer-1
-PercentChange-0 	NumeratorQuantity2-2 	NumeratorQuantity1-2 	DenominatorQuantity1-0 	OptionalTask_1 	DenominatorFactor 	NumeratorFactor 	EquationAnswer 	OptionalTask_2 	FirstRow1:2 	FirstRow1:1 	FirstRow2:1 	FirstRow2:2 	SecondRow 	ThirdRow 	FinalAnswer-2
-PercentChange-0 	NumeratorQuantity2-0 	NumeratorQuantity1-0 	DenominatorQuantity1-0 	OptionalTask_1 	NumeratorFactor 	DenominatorFactor 	NumeratorFactor 	EquationAnswer 	OptionalTask_2 	FirstRow1:1 	FirstRow2:1 	FirstRow2:2 	FirstRow1:1 	FirstRow1:2 	SecondRow 	ThirdRow 	FinalAnswer-2
-PercentChange-2 	NumeratorQuantity2-0 	NumeratorQuantity1-0 	DenominatorQuantity1-0 	OptionalTask_1 	DenominatorFactor 	NumeratorFactor 	EquationAnswer 	OptionalTask_2 	FinalAnswer-1
-PercentChange-2 	NumeratorQuantity2-0 	NumeratorQuantity1-0 	DenominatorQuantity1-0 	OptionalTask_1 	DenominatorFactor 	NumeratorFactor 	EquationAnswer 	FinalAnswer-1
-PercentChange-2 	NumeratorQuantity2-0 	NumeratorQuantity1-0 	DenominatorQuantity1-0 	OptionalTask_1 	NumeratorFactor 	DenominatorFactor 	NumeratorFactor 	EquationAnswer 	FinalAnswer-1
-PercentChange-0 	NumeratorQuantity2-2 	NumeratorQuantity1-2 	DenominatorQuantity1-0 	OptionalTask_1 	EquationAnswer 	DenominatorFactor 	NumeratorFactor 	EquationAnswer 	OptionalTask_2 	FirstRow2:1 	FirstRow2:2 	FirstRow1:1 	FirstRow1:2 	FirstRow1:1 	SecondRow 	ThirdRow 	FinalAnswer-0 	FinalAnswerDirection-0
-PercentChange-0 	NumeratorQuantity2-0 	NumeratorQuantity1-0 	DenominatorQuantity1-0 	OptionalTask_1 	NumeratorFactor 	DenominatorFactor 	NumeratorFactor 	EquationAnswer 	OptionalTask_2 	FirstRow1:2 	FirstRow1:1 	FirstRow2:1 	FirstRow2:2 	SecondRow 	ThirdRow 	FinalAnswer-2
-PercentChange-2 	NumeratorQuantity2-2 	NumeratorQuantity1-0 	DenominatorQuantity1-0 	OptionalTask_1 	EquationAnswer 	DenominatorFactor 	NumeratorFactor 	EquationAnswer 	OptionalTask_2 	FirstRow1:1 	FirstRow1:2 	FirstRow2:1 	FirstRow2:2 	SecondRow 	FinalAnswerDirection-0 	ThirdRow 	FinalAnswer-0
-PercentChange-0 	NumeratorQuantity2-0 	NumeratorQuantity1-2 	DenominatorQuantity1-0 	OptionalTask_1 	EquationAnswer 	NumeratorFactor 	DenominatorFactor 	FinalAnswer-2 	FinalAnswerDirection-0
-PercentChange-0 	NumeratorQuantity2-0 	NumeratorQuantity1-0 	DenominatorQuantity1-2 	OptionalTask_1 	DenominatorFactor 	NumeratorFactor 	FinalAnswer-2
-PercentChange-2 	NumeratorQuantity2-0 	NumeratorQuantity1-0 	DenominatorQuantity1-0 	OptionalTask_1 	DenominatorFactor 	NumeratorFactor 	EquationAnswer 	FinalAnswer-0
-PercentChange-2 	NumeratorQuantity2-0 	NumeratorQuantity1-0 	DenominatorQuantity1-0 	OptionalTask_1 	OptionalTask_2 	DenominatorFactor 	NumeratorFactor 	EquationAnswer 	FirstRow1:2 	FirstRow1:1 	FirstRow2:2 	FirstRow2:1 	SecondRow 	ThirdRow 	FinalAnswerDirection-0 	FinalAnswer-0
-PercentChange-2 	NumeratorQuantity2-2 	NumeratorQuantity1-0 	NumeratorQuantity2-0 	DenominatorQuantity1-0 	FinalAnswer-2 	OptionalTask_1 	DenominatorFactor 	NumeratorFactor 	EquationAnswer 	FinalAnswer-1
-PercentChange-0 	NumeratorQuantity2-0 	NumeratorQuantity1-0 	DenominatorQuantity1-0 	OptionalTask_1 	NumeratorFactor 	DenominatorFactor 	EquationAnswer 	FinalAnswer-0
-PercentChange-2 	NumeratorQuantity2-2 	NumeratorQuantity1-0 	NumeratorQuantity2-2 	DenominatorQuantity1-0 	OptionalTask_1 	NumeratorFactor 	DenominatorFactor 	EquationAnswer 	OptionalTask_2 	FirstRow2:1 	FirstRow2:2 	FirstRow1:1 	FirstRow1:2 	SecondRow 	ThirdRow 	FinalAnswer-2
-PercentChange-0 	NumeratorQuantity2-0 	NumeratorQuantity1-0 	DenominatorQuantity1-0 	OptionalTask_1 	NumeratorFactor 	DenominatorFactor 	EquationAnswer 	FinalAnswer-2
-PercentChange-2 	NumeratorQuantity2-0 	NumeratorQuantity1-0 	DenominatorQuantity1-0 	OptionalTask_1 	OptionalTask_2 	DenominatorFactor 	NumeratorFactor 	EquationAnswer 	FirstRow2:1 	FirstRow2:2 	FirstRow1:1 	FirstRow1:2 	SecondRow 	ThirdRow 	FinalAnswer-2
-PercentChange-2 	NumeratorQuantity2-0 	NumeratorQuantity1-0 	DenominatorQuantity1-2 	OptionalTask_1 	OptionalTask_2 	EquationAnswer 	DenominatorFactor 	NumeratorFactor 	EquationAnswer 	FirstRow1:1 	FirstRow1:2 	FirstRow1:1 	FirstRow2:2 	FirstRow2:1 	SecondRow 	FinalAnswer-2 	FinalAnswerDirection-0
-PercentChange-0 	NumeratorQuantity2-2 	NumeratorQuantity1-2 	DenominatorQuantity1-2 	OptionalTask_1 	OptionalTask_2 	EquationAnswer 	DenominatorFactor 	NumeratorFactor 	EquationAnswer 	FirstRow1:1 	FirstRow1:2 	FirstRow1:1 	FirstRow2:2 	FirstRow2:1 	SecondRow 	ThirdRow 	FinalAnswerDirection-0 	FinalAnswer-0
-PercentChange-2 	NumeratorQuantity2-2 	NumeratorQuantity1-0 	DenominatorQuantity1-0 	OptionalTask_1 	OptionalTask_2 	EquationAnswer 	DenominatorFactor 	NumeratorFactor 	EquationAnswer 	FirstRow1:1 	FirstRow1:2 	FirstRow1:1 	FirstRow2:1 	FirstRow2:2 	SecondRow 	ThirdRow 	FinalAnswer-0 	FinalAnswerDirection-2
-PercentChange-0 	NumeratorQuantity2-0 	NumeratorQuantity1-0 	DenominatorQuantity1-0 	OptionalTask_1 	DenominatorFactor 	NumeratorFactor 	EquationAnswer 	OptionalTask_2 	FirstRow2:1 	FirstRow2:2 	FirstRow1:1 	FirstRow1:2 	SecondRow 	ThirdRow 	FinalAnswer-1
-PercentChange-2 	NumeratorQuantity2-0 	NumeratorQuantity1-0 	DenominatorQuantity1-0 	OptionalTask_1 	OptionalTask_2 	FirstRow2:1 	FirstRow1:1 	DenominatorFactor 	NumeratorFactor 	EquationAnswer 	FirstRow2:2 	FirstRow1:2 	SecondRow 	ThirdRow 	FinalAnswer-2
-PercentChange-2 	NumeratorQuantity2-0 	NumeratorQuantity1-0 	DenominatorQuantity1-0 	OptionalTask_1 	OptionalTask_2 	NumeratorFactor 	DenominatorFactor 	NumeratorFactor 	EquationAnswer 	FirstRow2:1 	FirstRow2:2 	FirstRow1:1 	FirstRow1:2 	SecondRow 	ThirdRow 	FinalAnswer-2
-PercentChange-2 	NumeratorQuantity2-0 	NumeratorQuantity1-0 	DenominatorQuantity1-0 	OptionalTask_1 	OptionalTask_2 	DenominatorFactor 	NumeratorFactor 	EquationAnswer 	FirstRow1:1 	FinalAnswer-0 	FinalAnswerDirection-0
-PercentChange-0 	NumeratorQuantity2-0 	NumeratorQuantity1-0 	DenominatorQuantity1-0 	OptionalTask_1 	OptionalTask_2 	DenominatorFactor 	NumeratorFactor 	EquationAnswer 	FirstRow2:1 	FirstRow2:2 	FirstRow1:1 	FirstRow1:2 	SecondRow 	ThirdRow 	FinalAnswer-2
-PercentChange-2 	NumeratorQuantity2-0 	NumeratorQuantity1-2 	DenominatorQuantity1-0 	NumeratorQuantity1-0 	OptionalTask_1 	OptionalTask_2 	NumeratorFactor 	DenominatorFactor 	NumeratorFactor 	EquationAnswer 	FirstRow2:1 	FirstRow2:2 	FirstRow1:1 	FirstRow1:2 	SecondRow 	ThirdRow 	FinalAnswer-2
-PercentChange-0 	NumeratorQuantity2-2 	NumeratorQuantity1-2 	DenominatorQuantity1-0 	OptionalTask_2 	FirstRow1:1 	FirstRow1:2 	FirstRow2:1 	FirstRow2:2 	SecondRow 	ThirdRow 	FinalAnswer-2
-PercentChange-0 	NumeratorQuantity2-0 	NumeratorQuantity1-0 	DenominatorQuantity1-0 	OptionalTask_2 	FirstRow1:1 	FirstRow1:2 	FirstRow2:2 	FirstRow2:1 	SecondRow 	ThirdRow 	FinalAnswer-2
-PercentChange-2 	NumeratorQuantity2-0 	NumeratorQuantity1-0 	DenominatorQuantity1-0 	OptionalTask_2 	FirstRow1:2 	FirstRow1:1 	FirstRow2:2 	FirstRow2:1 	SecondRow 	FinalAnswerDirection-0 	FinalAnswer-2
-PercentChange-0 	NumeratorQuantity2-0 	NumeratorQuantity1-0 	DenominatorQuantity1-0 	OptionalTask_2 	FirstRow1:1 	FirstRow1:2 	FirstRow2:2 	FirstRow2:1 	SecondRow 	ThirdRow 	FinalAnswer-0 	FinalAnswerDirection-0
-PercentChange-0 	NumeratorQuantity2-0 	NumeratorQuantity1-0 	DenominatorQuantity1-0 	OptionalTask_2 	FirstRow1:1 	FirstRow1:2 	FirstRow2:1 	FirstRow2:2 	SecondRow 	ThirdRow 	FinalAnswer-0
-PercentChange-0 	NumeratorQuantity2-2 	NumeratorQuantity1-2 	DenominatorQuantity1-2 	OptionalTask_2 	FirstRow2:1 	FirstRow2:2 	FirstRow1:1 	FirstRow1:2 	SecondRow 	ThirdRow 	FinalAnswer-2
-PercentChange-0 	NumeratorQuantity2-0 	NumeratorQuantity1-0 	DenominatorQuantity1-0 	OptionalTask_1 	DenominatorFactor 	NumeratorFactor 	EquationAnswer 	OptionalTask_2 	FirstRow2:1 	FirstRow2:2 	FirstRow1:1 	FirstRow1:2 	SecondRow 	ThirdRow 	FinalAnswer-0
-PercentChange-0 	NumeratorQuantity2-0 	NumeratorQuantity1-2 	DenominatorQuantity1-0 	OptionalTask_2 	FirstRow2:2 	FirstRow2:1 	FirstRow1:2 	FirstRow1:1 	SecondRow 	ThirdRow 	FinalAnswer-2
-PercentChange-0 	NumeratorQuantity2-0 	NumeratorQuantity1-2 	DenominatorQuantity1-0 	OptionalTask_2 	FirstRow2:2 	FirstRow2:1 	FirstRow1:1 	FirstRow1:2 	SecondRow 	ThirdRow 	FinalAnswer-0 	FinalAnswerDirection-0
-PercentChange-2 	NumeratorQuantity2-0 	NumeratorQuantity1-0 	DenominatorQuantity1-0 	OptionalTask_1 	DenominatorFactor 	NumeratorFactor 	EquationAnswer 	OptionalTask_2 	FirstRow2:1 	FirstRow2:2 	FirstRow1:1 	FirstRow1:2 	SecondRow 	ThirdRow 	FinalAnswer-2
-PercentChange-2 	NumeratorQuantity2-0 	NumeratorQuantity1-0 	DenominatorQuantity1-0 	OptionalTask_1 	NumeratorFactor 	DenominatorFactor 	EquationAnswer 	OptionalTask_2 	FirstRow2:1 	FirstRow2:2 	FirstRow1:1 	FirstRow1:2 	SecondRow 	ThirdRow 	FinalAnswer-2
-PercentChange-0 	NumeratorQuantity2-0 	NumeratorQuantity1-2 	DenominatorQuantity1-0 	OptionalTask_2 	FirstRow2:2 	FirstRow2:1 	FirstRow1:1 	FirstRow1:2 	SecondRow 	ThirdRow 	FinalAnswer-2
-PercentChange-0 	NumeratorQuantity2-0 	NumeratorQuantity1-2 	DenominatorQuantity1-0 	OptionalTask_2 	OptionalTask_1 	NumeratorFactor 	DenominatorFactor 	NumeratorFactor 	EquationAnswer 	FirstRow1:1 	FirstRow1:2 	FirstRow2:1 	FirstRow2:2 	SecondRow 	ThirdRow 	FinalAnswer-0
-PercentChange-2 	NumeratorQuantity2-0 	NumeratorQuantity1-0 	DenominatorQuantity1-0 	OptionalTask_1 	DenominatorFactor 	NumeratorFactor 	EquationAnswer 	OptionalTask_2 	FirstRow2:1 	FirstRow2:2 	FirstRow1:1 	FirstRow1:2 	SecondRow 	ThirdRow 	FinalAnswer-2
-PercentChange-2 	NumeratorQuantity2-0 	NumeratorQuantity1-2 	DenominatorQuantity1-2 	OptionalTask_2 	FirstRow2:1 	FirstRow2:2 	FirstRow1:1 	FirstRow1:2 	SecondRow 	ThirdRow 	FinalAnswer-0
-PercentChange-2 	NumeratorQuantity2-0 	NumeratorQuantity1-2 	DenominatorQuantity1-0 	OptionalTask_2 	FirstRow2:2 	FirstRow2:1 	FirstRow1:2 	FirstRow1:1 	SecondRow 	ThirdRow 	FinalAnswer-2
-PercentChange-0 	NumeratorQuantity2-0 	NumeratorQuantity1-2 	DenominatorQuantity1-0 	OptionalTask_1 	DenominatorFactor 	NumeratorFactor 	EquationAnswer 	OptionalTask_2 	FirstRow2:1 	FirstRow2:2 	FirstRow1:1 	FirstRow1:2 	SecondRow 	ThirdRow 	FinalAnswer-0
-PercentChange-0 	NumeratorQuantity2-0 	NumeratorQuantity1-2 	DenominatorQuantity1-0 	OptionalTask_2 	FirstRow2:1 	FirstRow2:2 	FirstRow1:1 	FirstRow1:2 	SecondRow 	ThirdRow 	FinalAnswer-2
-PercentChange-2 	NumeratorQuantity2-0 	NumeratorQuantity1-2 	DenominatorQuantity1-0 	OptionalTask_1 	DenominatorFactor 	NumeratorFactor 	EquationAnswer 	OptionalTask_2 	FirstRow2:1 	FirstRow2:2 	FirstRow1:1 	FirstRow1:2 	SecondRow 	ThirdRow 	FinalAnswer-0
-PercentChange-0 	NumeratorQuantity2-0 	NumeratorQuantity1-2 	DenominatorQuantity1-0 	OptionalTask_2 	FirstRow2:1 	FirstRow2:2 	FirstRow1:2 	FirstRow1:1 	FinalAnswer-2 	SecondRow 	ThirdRow 	FinalAnswer-2
-PercentChange-0 	NumeratorQuantity2-0 	NumeratorQuantity1-2 	DenominatorQuantity1-0 	OptionalTask_2 	FirstRow1:1 	FirstRow1:2 	FirstRow2:2 	FirstRow2:1 	SecondRow 	ThirdRow 	FinalAnswer-0 	FinalAnswerDirection-2
-PercentChange-2 	NumeratorQuantity2-0 	NumeratorQuantity1-0 	DenominatorQuantity1-0 	OptionalTask_2 	OptionalTask_1 	EquationAnswer 	DenominatorFactor 	NumeratorFactor 	EquationAnswer 	FirstRow1:1 	FirstRow1:2 	FirstRow2:2 	FirstRow2:1 	SecondRow 	ThirdRow 	FinalAnswer-0 	FinalAnswerDirection-0
-PercentChange-0 	NumeratorQuantity2-2 	NumeratorQuantity1-0 	DenominatorQuantity1-0 	OptionalTask_1 	EquationAnswer 	DenominatorFactor 	EquationAnswer 	DenominatorFactor 	NumeratorFactor 	EquationAnswer 	FinalAnswerDirection-0 	FinalAnswer-0
-PercentChange-0 	NumeratorQuantity1-0 	NumeratorQuantity2-0 	DenominatorQuantity1-0 	OptionalTask_2 	FirstRow1:1 	FirstRow1:2 	FirstRow2:1 	FirstRow2:2 	SecondRow 	ThirdRow 	FinalAnswer-0 	FinalAnswerDirection-0
-PercentChange-0 	NumeratorQuantity1-2 	NumeratorQuantity2-0 	NumeratorQuantity1-0 	DenominatorQuantity1-0 	OptionalTask_2 	FirstRow1:1 	FirstRow1:2 	FirstRow2:1 	FirstRow2:2 	SecondRow 	ThirdRow 	FinalAnswer-0
-PercentChange-0 	NumeratorQuantity2-0 	DenominatorQuantity1-0 	NumeratorQuantity1-0 	OptionalTask_2 	FirstRow1:1 	FirstRow1:2 	FirstRow2:1 	FirstRow2:2 	SecondRow 	ThirdRow 	FinalAnswer-2
-PercentChange-0 	NumeratorQuantity2-0 	NumeratorQuantity1-2 	DenominatorQuantity1-0 	OptionalTask_1 	NumeratorFactor 	OptionalTask_2 	FirstRow1:1 	FirstRow1:2 	FirstRow2:1 	FirstRow2:2 	FinalAnswer-2 	SecondRow 	ThirdRow 	FinalAnswer-2
-PercentChange-0 	NumeratorQuantity2-0 	DenominatorQuantity1-0 	NumeratorQuantity1-0 	OptionalTask_2 	FirstRow1:1 	FirstRow1:2 	FirstRow2:1 	FirstRow2:2 	SecondRow 	ThirdRow 	FinalAnswer-0
-PercentChange-0 	NumeratorQuantity2-0 	NumeratorQuantity1-2 	DenominatorQuantity1-0 	OptionalTask_1 	NumeratorFactor 	DenominatorFactor 	EquationAnswer 	FinalAnswer-2
-PercentChange-0 	NumeratorQuantity2-0 	DenominatorQuantity1-0 	NumeratorQuantity1-0 	OptionalTask_2 	FirstRow1:1 	FirstRow1:2 	FirstRow2:1 	FirstRow2:2 	SecondRow 	ThirdRow 	FinalAnswer-0
-PercentChange-0 	NumeratorQuantity2-0 	DenominatorQuantity1-0 	NumeratorQuantity1-2 	OptionalTask_1 	EquationAnswer 	DenominatorFactor 	NumeratorFactor 	EquationAnswer 	FinalAnswer-0 	FinalAnswerDirection-0
-PercentChange-0 	NumeratorQuantity2-0 	NumeratorQuantity1-0 	DenominatorQuantity1-0 	OptionalTask_1 	EquationAnswer 	DenominatorFactor 	NumeratorFactor 	EquationAnswer 	FinalAnswer-0 	FinalAnswerDirection-0
-PercentChange-0 	NumeratorQuantity2-0 	DenominatorQuantity1-0 	NumeratorQuantity1-0 	OptionalTask_1 	DenominatorFactor 	EquationAnswer 	OptionalTask_2 	FirstRow1:2 	FirstRow1:1 	FirstRow2:1 	FirstRow2:2 	SecondRow 	ThirdRow 	EquationAnswer 	NumeratorFactor 	FinalAnswer-0
-PercentChange-0 	NumeratorQuantity2-0 	NumeratorQuantity1-2 	DenominatorQuantity1-0 	NumeratorQuantity1-0 	OptionalTask_1 	DenominatorFactor 	NumeratorFactor 	EquationAnswer 	FinalAnswer-0
-PercentChange-0 	NumeratorQuantity2-0 	NumeratorQuantity1-0 	DenominatorQuantity1-0 	OptionalTask_1 	NumeratorFactor 	DenominatorFactor 	NumeratorFactor 	EquationAnswer 	FinalAnswer-0 	FinalAnswerDirection-0
-PercentChange-0 	NumeratorQuantity2-0 	DenominatorQuantity1-0 	NumeratorQuantity1-0 	OptionalTask_1 	NumeratorFactor 	DenominatorFactor 	EquationAnswer 	OptionalTask_2 	FirstRow1:1 	FirstRow2:1 	FirstRow2:2 	FirstRow1:1 	FirstRow1:2 	SecondRow 	ThirdRow 	FinalAnswer-2
-PercentChange-0 	NumeratorQuantity2-2 	DenominatorQuantity1-0 	NumeratorQuantity1-0 	OptionalTask_1 	DenominatorFactor 	NumeratorFactor 	EquationAnswer 	FinalAnswer-0
-PercentChange-0 	NumeratorQuantity2-0 	NumeratorQuantity1-2 	DenominatorQuantity1-0 	OptionalTask_1 	NumeratorFactor 	EquationAnswer 	DenominatorFactor 	NumeratorFactor 	EquationAnswer 	OptionalTask_2 	FirstRow2:1 	FirstRow2:2 	FirstRow1:2 	FirstRow1:1 	SecondRow 	ThirdRow 	FinalAnswer-0 	FinalAnswerDirection-0
-PercentChange-0 	NumeratorQuantity2-0 	NumeratorQuantity1-0 	DenominatorQuantity1-0 	OptionalTask_2 	FirstRow2:1 	FirstRow2:2 	FirstRow1:1 	FirstRow1:2 	SecondRow 	ThirdRow 	OptionalTask_1 	EquationAnswer 	NumeratorFactor 	DenominatorFactor 	FinalAnswer-0
-PercentChange-0 	NumeratorQuantity2-0 	NumeratorQuantity1-0 	DenominatorQuantity1-0 	OptionalTask_2 	FirstRow2:1 	FirstRow2:2 	FirstRow1:1 	FirstRow1:2 	SecondRow 	ThirdRow 	OptionalTask_1 	EquationAnswer 	NumeratorFactor 	DenominatorFactor 	FinalAnswer-0
-PercentChange-2 	NumeratorQuantity2-0 	NumeratorQuantity1-2 	DenominatorQuantity1-2 	OptionalTask_2 	FirstRow2:1 	FirstRow2:2 	FirstRow1:1 	FirstRow1:2 	SecondRow 	ThirdRow 	OptionalTask_1 	NumeratorFactor 	DenominatorFactor 	EquationAnswer 	ThirdRow 	FinalAnswer-0 	FinalAnswerDirection-0
-PercentChange-0 	NumeratorQuantity2-0 	NumeratorQuantity1-0 	DenominatorQuantity1-0 	OptionalTask_2 	FirstRow2:1 	FirstRow2:2 	FirstRow1:2 	FirstRow1:1 	SecondRow 	ThirdRow 	OptionalTask_1 	NumeratorFactor 	DenominatorFactor 	EquationAnswer 	FinalAnswer-0
-PercentChange-2 	NumeratorQuantity2-0 	NumeratorQuantity1-0 	DenominatorQuantity1-0 	OptionalTask_2 	FirstRow2:1 	FirstRow2:2 	FirstRow1:1 	FirstRow1:2 	OptionalTask_1 	SecondRow 	ThirdRow 	EquationAnswer 	NumeratorFactor 	DenominatorFactor 	FinalAnswer-2
-PercentChange-2 	NumeratorQuantity2-0 	DenominatorQuantity1-2 	NumeratorQuantity1-0 	OptionalTask_2 	FirstRow2:1 	FirstRow2:2 	FirstRow1:1 	FirstRow1:2 	SecondRow 	OptionalTask_1 	NumeratorFactor 	DenominatorFactor 	EquationAnswer 	ThirdRow 	FinalAnswer-0 	FinalAnswerDirection-0
-PercentChange-2 	NumeratorQuantity1-0 	NumeratorQuantity2-0 	DenominatorQuantity1-0 	OptionalTask_1 	DenominatorFactor 	NumeratorFactor 	EquationAnswer 	OptionalTask_2 	FirstRow1:2 	FirstRow2:2 	FirstRow2:1 	FirstRow1:1 	SecondRow 	ThirdRow 	FinalAnswer-0
-PercentChange-2 	DenominatorQuantity1-2 	NumeratorQuantity1-0 	NumeratorQuantity2-2 	DenominatorQuantity1-0 	NumeratorQuantity2-0 	OptionalTask_1 	NumeratorFactor 	OptionalTask_2 	FirstRow1:2 	FirstRow1:1 	FirstRow2:2 	FirstRow1:1 	FirstRow2:1 	SecondRow 	ThirdRow 	FinalAnswer-2 	DenominatorFactor 	NumeratorFactor 	EquationAnswer 	FinalAnswer-2
-PercentChange-0 	NumeratorQuantity2-0 	NumeratorQuantity1-2 	DenominatorQuantity1-0 	OptionalTask_1 	NumeratorFactor 	DenominatorFactor 	NumeratorFactor 	DenominatorFactor 	EquationAnswer 	OptionalTask_2 	FirstRow2:1 	FirstRow2:2 	FirstRow1:2 	FinalAnswerDirection-0 	FirstRow1:1 	SecondRow 	ThirdRow 	FinalAnswer-0
-PercentChange-2 	NumeratorQuantity2-2 	NumeratorQuantity1-0 	DenominatorQuantity1-0 	NumeratorQuantity2-0 	OptionalTask_2 	FirstRow1:2 	FirstRow1:1 	FirstRow2:2 	FirstRow2:1 	FirstRow1:1 	FirstRow2:1 	SecondRow 	ThirdRow 	FinalAnswer-2 	OptionalTask_1 	DenominatorFactor 	NumeratorFactor 	EquationAnswer 	FinalAnswer-2
-PercentChange-2 	NumeratorQuantity2-2 	NumeratorQuantity1-2 	DenominatorQuantity1-0 	NumeratorQuantity1-0 	NumeratorQuantity2-2 	OptionalTask_1 	OptionalTask_2 	FirstRow2:1 	FirstRow2:2 	FirstRow1:1 	FirstRow1:2 	SecondRow 	ThirdRow 	FinalAnswer-0 	FinalAnswerDirection-0
-PercentChange-2 	NumeratorQuantity1-0 	DenominatorQuantity1-0 	NumeratorQuantity2-0 	OptionalTask_1 	NumeratorFactor 	DenominatorFactor 	NumeratorFactor 	EquationAnswer 	OptionalTask_2 	FirstRow1:2 	FirstRow2:1 	FirstRow2:2 	FirstRow1:1 	FinalAnswer-0
-PercentChange-2 	NumeratorQuantity1-2 	NumeratorQuantity2-0 	DenominatorQuantity1-0 	NumeratorQuantity1-0 	OptionalTask_1 	DenominatorFactor 	NumeratorFactor 	EquationAnswer 	OptionalTask_2 	FirstRow2:1 	FirstRow2:2 	FirstRow1:1 	FirstRow1:2 	FirstRow2:2 	SecondRow 	ThirdRow 	FinalAnswer-0 	FinalAnswerDirection-0
-PercentChange-2 	NumeratorQuantity1-2 	NumeratorQuantity2-2 	DenominatorQuantity1-2 	NumeratorQuantity1-0 	NumeratorQuantity2-2 	OptionalTask_1 	DenominatorFactor 	NumeratorFactor 	EquationAnswer 	OptionalTask_2 	FirstRow2:1 	FirstRow1:2 	FirstRow1:1 	FirstRow2:2 	FirstRow1:2 	FinalAnswerDirection-0 	SecondRow 	ThirdRow 	FinalAnswer-0
-PercentChange-2 	DenominatorQuantity1-2 	NumeratorQuantity2-2 	NumeratorQuantity1-0 	DenominatorQuantity1-0 	NumeratorQuantity2-2 	OptionalTask_1 	DenominatorFactor 	NumeratorFactor 	EquationAnswer 	OptionalTask_2 	FirstRow1:2 	FirstRow1:1 	FirstRow2:2 	FirstRow1:1 	FirstRow2:1 	FirstRow1:1 	SecondRow 	ThirdRow 	FinalAnswer-2
-PercentChange-0 	NumeratorQuantity2-2 	DenominatorQuantity1-0 	NumeratorQuantity2-0 	NumeratorQuantity1-0 	OptionalTask_1 	DenominatorFactor 	OptionalTask_2 	FirstRow1:1 	FirstRow1:2 	FirstRow2:1 	FirstRow1:2 	FirstRow2:2 	FirstRow1:2 	SecondRow 	ThirdRow 	FinalAnswer-2 	NumeratorFactor 	EquationAnswer 	DenominatorFactor 	NumeratorFactor 	EquationAnswer 	FinalAnswer-2
-PercentChange-0 	NumeratorQuantity1-0 	NumeratorQuantity2-0 	DenominatorQuantity1-0 	OptionalTask_1 	DenominatorFactor 	NumeratorFactor 	EquationAnswer 	FinalAnswer-0
-PercentChange-2 	DenominatorQuantity1-2 	NumeratorQuantity1-2 	NumeratorQuantity2-0 	NumeratorQuantity1-2 	DenominatorQuantity1-0 	NumeratorQuantity1-2 	FinalAnswerDirection-0 	OptionalTask_1 	NumeratorFactor 	EquationAnswer 	DenominatorFactor 	NumeratorFactor 	OptionalTask_2 	FirstRow2:1 	FirstRow1:1 	FirstRow2:2 	FirstRow1:2 	SecondRow 	ThirdRow 	FinalAnswer-0
-PercentChange-0 	NumeratorQuantity1-0 	NumeratorQuantity2-0 	DenominatorQuantity1-0 	OptionalTask_1 	DenominatorFactor 	NumeratorFactor 	EquationAnswer 	OptionalTask_2 	FirstRow1:2 	FirstRow1:1 	FirstRow2:1 	FirstRow2:2 	SecondRow 	ThirdRow 	FinalAnswer-2
-PercentChange-0 	NumeratorQuantity1-2 	NumeratorQuantity2-0 	DenominatorQuantity1-2 	NumeratorQuantity1-0 	DenominatorQuantity1-0 	OptionalTask_1 	NumeratorFactor 	DenominatorFactor 	NumeratorFactor 	DenominatorFactor 	EquationAnswer 	OptionalTask_2 	FinalAnswerDirection-0 	FirstRow2:1 	FirstRow2:2 	FirstRow1:1 	FirstRow1:2 	FirstRow2:2 	SecondRow 	ThirdRow 	FinalAnswer-0
-PercentChange-0 	DenominatorQuantity1-2 	NumeratorQuantity1-0 	NumeratorQuantity2-2 	DenominatorQuantity1-0 	NumeratorQuantity2-0 	OptionalTask_1 	OptionalTask_2 	FirstRow1:2 	FirstRow2:2 	FirstRow2:1 	FirstRow1:1 	SecondRow 	ThirdRow 	FinalAnswer-2 	NumeratorFactor 	DenominatorFactor 	NumeratorFactor 	DenominatorFactor 	EquationAnswer 	FinalAnswer-2
-PercentChange-0 	NumeratorQuantity2-0 	NumeratorQuantity1-0 	DenominatorQuantity1-0 	OptionalTask_1 	OptionalTask_2 	DenominatorFactor 	NumeratorFactor 	EquationAnswer 	FirstRow2:1 	FirstRow2:2 	FirstRow1:2 	FirstRow1:1 	SecondRow 	ThirdRow 	FinalAnswer-2
-PercentChange-2 	NumeratorQuantity2-0 	NumeratorQuantity1-0 	DenominatorQuantity1-0 	OptionalTask_1 	OptionalTask_2 	DenominatorFactor 	NumeratorFactor 	EquationAnswer 	FirstRow1:1 	FirstRow1:2 	FirstRow2:2 	FirstRow2:1 	SecondRow 	ThirdRow 	FinalAnswer-0 	FinalAnswerDirection-0
-PercentChange-0 	NumeratorQuantity2-2 	NumeratorQuantity1-0 	DenominatorQuantity1-0 	OptionalTask_1 	OptionalTask_2 	FirstRow1:1 	FirstRow1:2 	FirstRow2:1 	FirstRow2:2 	SecondRow 	ThirdRow 	DenominatorFactor 	EquationAnswer 	DenominatorFactor 	NumeratorFactor 	FinalAnswer-2
-PercentChange-0 	NumeratorQuantity2-0 	NumeratorQuantity1-0 	DenominatorQuantity1-0 	OptionalTask_2 	OptionalTask_1 	FirstRow1:1 	FirstRow1:2 	FirstRow2:1 	FirstRow2:2 	SecondRow 	EquationAnswer 	FinalAnswer-0
-PercentChange-0 	NumeratorQuantity2-0 	NumeratorQuantity1-0 	DenominatorQuantity1-0 	OptionalTask_1 	OptionalTask_2 	FirstRow1:1 	FirstRow1:2 	FirstRow2:1 	FirstRow2:2 	SecondRow 	ThirdRow 	FinalAnswer-2 	EquationAnswer 	FinalAnswer-0
-PercentChange-0 	NumeratorQuantity2-0 	NumeratorQuantity1-0 	DenominatorQuantity1-0 	OptionalTask_1 	OptionalTask_2 	NumeratorFactor 	DenominatorFactor 	EquationAnswer 	FirstRow1:1 	FirstRow1:2 	FirstRow2:1 	FirstRow2:2 	SecondRow 	ThirdRow 	FinalAnswer-2
-PercentChange-0 	NumeratorQuantity2-0 	NumeratorQuantity1-0 	DenominatorQuantity1-0 	OptionalTask_1 	DenominatorFactor 	NumeratorFactor 	EquationAnswer 	FinalAnswer-0
-PercentChange-0 	NumeratorQuantity2-2 	NumeratorQuantity1-0 	DenominatorQuantity1-0 	OptionalTask_1 	DenominatorFactor 	NumeratorFactor 	EquationAnswer 	OptionalTask_2 	FirstRow1:1 	FirstRow2:2 	FirstRow2:1 	FirstRow1:1 	FirstRow1:2 	SecondRow 	ThirdRow 	FinalAnswer-2
-PercentChange-0 	NumeratorQuantity2-2 	NumeratorQuantity1-0 	DenominatorQuantity1-0 	OptionalTask_1 	OptionalTask_2 	DenominatorFactor 	EquationAnswer 	DenominatorFactor 	FirstRow1:1 	FirstRow1:2 	FirstRow2:2 	FirstRow2:1 	SecondRow 	ThirdRow 	EquationAnswer 	NumeratorFactor 	DenominatorFactor 	FinalAnswer-2 	FinalAnswerDirection-0
-PercentChange-0 	NumeratorQuantity2-0 	NumeratorQuantity1-0 	DenominatorQuantity1-0 	OptionalTask_1 	DenominatorFactor 	NumeratorFactor 	OptionalTask_2 	FirstRow1:1 	FirstRow1:2 	FirstRow2:1 	FirstRow2:2 	SecondRow 	FinalAnswer-0 	FinalAnswerDirection-0
-PercentChange-0 	NumeratorQuantity2-0 	NumeratorQuantity1-0 	DenominatorQuantity1-2 	OptionalTask_1 	DenominatorFactor 	NumeratorFactor 	EquationAnswer 	FinalAnswer-0 	FinalAnswerDirection-0
-PercentChange-0 	NumeratorQuantity2-0 	NumeratorQuantity1-0 	DenominatorQuantity1-0 	OptionalTask_1 	DenominatorFactor 	NumeratorFactor 	EquationAnswer 	FinalAnswer-0
-PercentChange-0 	NumeratorQuantity2-0 	NumeratorQuantity1-0 	DenominatorQuantity1-0 	OptionalTask_1 	DenominatorFactor 	NumeratorFactor 	EquationAnswer 	FinalAnswerDirection-0 	FinalAnswer-0
-PercentChange-0 	NumeratorQuantity2-0 	NumeratorQuantity1-0 	DenominatorQuantity1-0 	OptionalTask_2 	FirstRow2:1 	FirstRow2:2 	FirstRow1:1 	FirstRow1:2 	SecondRow 	ThirdRow 	FinalAnswer-2 	OptionalTask_1 	FinalAnswer-2
-PercentChange-0 	NumeratorQuantity2-2 	NumeratorQuantity1-0 	DenominatorQuantity1-0 	OptionalTask_1 	NumeratorFactor 	DenominatorFactor 	EquationAnswer 	FinalAnswer-2
-PercentChange-0 	NumeratorQuantity2-0 	NumeratorQuantity1-0 	DenominatorQuantity1-0 	OptionalTask_1 	DenominatorFactor 	NumeratorFactor 	EquationAnswer 	FinalAnswer-0
-PercentChange-0 	NumeratorQuantity2-0 	NumeratorQuantity1-0 	DenominatorQuantity1-2 	OptionalTask_1 	NumeratorFactor 	DenominatorFactor 	EquationAnswer 	FinalAnswer-2
-PercentChange-0 	NumeratorQuantity2-0 	NumeratorQuantity1-0 	DenominatorQuantity1-0 	OptionalTask_1 	DenominatorFactor 	NumeratorFactor 	EquationAnswer 	FinalAnswer-2
-PercentChange-0 	NumeratorQuantity2-0 	NumeratorQuantity1-0 	DenominatorQuantity1-0 	OptionalTask_1 	DenominatorFactor 	NumeratorFactor 	EquationAnswer 	FinalAnswer-0
-PercentChange-0 	NumeratorQuantity2-0 	NumeratorQuantity1-0 	DenominatorQuantity1-0 	OptionalTask_1 	DenominatorFactor 	NumeratorFactor 	EquationAnswer 	FinalAnswer-2
-PercentChange-0 	NumeratorQuantity2-0 	NumeratorQuantity1-2 	DenominatorQuantity1-0 	OptionalTask_1 	EquationAnswer 	DenominatorFactor 	NumeratorFactor 	EquationAnswer 	FinalAnswer-0 	FinalAnswerDirection-0
-PercentChange-0 	NumeratorQuantity2-0 	NumeratorQuantity1-0 	DenominatorQuantity1-0 	OptionalTask_1 	DenominatorFactor 	NumeratorFactor 	EquationAnswer 	FinalAnswer-2
-PercentChange-0 	NumeratorQuantity2-0 	NumeratorQuantity1-0 	DenominatorQuantity1-0 	OptionalTask_2 	FirstRow1:1 	FirstRow1:2 	FirstRow2:1 	FirstRow2:2 	SecondRow 	ThirdRow 	FinalAnswer-0
-PercentChange-2 	NumeratorQuantity2-0 	NumeratorQuantity1-0 	DenominatorQuantity1-0 	OptionalTask_2 	FirstRow1:1 	FirstRow1:2 	FirstRow2:1 	FirstRow2:2 	SecondRow 	ThirdRow 	FinalAnswer-0
-PercentChange-0 	NumeratorQuantity2-0 	NumeratorQuantity1-0 	DenominatorQuantity1-0 	OptionalTask_2 	FirstRow1:1 	FirstRow1:2 	FirstRow2:1 	FirstRow2:2 	SecondRow 	ThirdRow 	FinalAnswer-0
-PercentChange-0 	NumeratorQuantity2-2 	NumeratorQuantity1-0 	DenominatorQuantity1-0 	OptionalTask_2 	FirstRow1:1 	FirstRow1:2 	FirstRow2:2 	FirstRow2:1 	SecondRow 	ThirdRow 	FinalAnswer-0 	FinalAnswerDirection-0
-PercentChange-2 	NumeratorQuantity2-0 	NumeratorQuantity1-2 	DenominatorQuantity1-0 	NumeratorQuantity1-2 	OptionalTask_1 	NumeratorFactor 	DenominatorFactor 	NumeratorFactor 	EquationAnswer 	FinalAnswer-2
-PercentChange-0 	NumeratorQuantity2-0 	NumeratorQuantity1-0 	DenominatorQuantity1-0 	OptionalTask_2 	FirstRow1:1 	FirstRow1:2 	FirstRow2:2 	FirstRow2:1 	SecondRow 	ThirdRow 	FinalAnswer-2 	FinalAnswerDirection-0
-PercentChange-0 	NumeratorQuantity2-0 	NumeratorQuantity1-0 	DenominatorQuantity1-0 	OptionalTask_2 	FirstRow1:1 	FirstRow1:2 	FirstRow2:1 	FirstRow2:2 	SecondRow 	ThirdRow 	FinalAnswer-2
-PercentChange-0 	NumeratorQuantity2-0 	NumeratorQuantity1-0 	DenominatorQuantity1-0 	OptionalTask_2 	FirstRow1:1 	FirstRow1:2 	FirstRow2:1 	FirstRow2:2 	SecondRow 	ThirdRow 	FinalAnswer-2
-PercentChange-0 	NumeratorQuantity2-2 	NumeratorQuantity1-0 	DenominatorQuantity1-0 	OptionalTask_1 	NumeratorFactor 	DenominatorFactor 	EquationAnswer 	FinalAnswer-2
-PercentChange-0 	NumeratorQuantity2-0 	NumeratorQuantity1-0 	DenominatorQuantity1-0 	OptionalTask_2 	FirstRow1:1 	FirstRow1:2 	FirstRow2:1 	FirstRow2:2 	SecondRow 	ThirdRow 	FinalAnswer-0
-PercentChange-2 	NumeratorQuantity1-2 	DenominatorQuantity1-2 	NumeratorQuantity1-0 	DenominatorQuantity1-0 	NumeratorQuantity2-0 	OptionalTask_1 	NumeratorFactor 	DenominatorFactor 	EquationAnswer 	FinalAnswer-0 	FinalAnswerDirection-0
-PercentChange-2 	NumeratorQuantity2-2 	NumeratorQuantity1-2 	NumeratorQuantity2-0 	NumeratorQuantity1-2 	DenominatorQuantity1-0 	NumeratorQuantity1-0 	FinalAnswer-2 	OptionalTask_1 	NumeratorFactor 	DenominatorFactor 	EquationAnswer 	FinalAnswer-0
-PercentChange-0 	NumeratorQuantity2-2 	DenominatorQuantity1-0 	NumeratorQuantity1-0 	NumeratorQuantity2-0 	OptionalTask_1 	EquationAnswer 	NumeratorFactor 	FinalAnswerDirection-0 	NumeratorFactor 	OptionalTask_2 	EquationAnswer 	DenominatorFactor 	NumeratorFactor 	EquationAnswer 	FirstRow1:1 	FirstRow1:2 	FirstRow2:1 	FirstRow2:2 	SecondRow 	ThirdRow 	FinalAnswer-0
-PercentChange-0 	NumeratorQuantity2-2 	DenominatorQuantity1-0 	NumeratorQuantity1-2 	NumeratorQuantity2-2 	OptionalTask_1 	OptionalTask_2 	DenominatorFactor 	NumeratorFactor 	EquationAnswer 	FirstRow2:1 	FirstRow2:2 	FirstRow1:1 	FirstRow1:2 	SecondRow 	ThirdRow 	FinalAnswer-2
-PercentChange-0 	DenominatorQuantity1-0 	NumeratorQuantity2-2 	NumeratorQuantity1-0 	NumeratorQuantity2-2 	FinalAnswer-2 	OptionalTask_2 	OptionalTask_1 	EquationAnswer 	DenominatorFactor 	EquationAnswer 	DenominatorFactor 	FinalAnswerDirection-0 	NumeratorFactor 	EquationAnswer 	FirstRow1:1 	FirstRow1:2 	FirstRow2:2 	FirstRow2:1 	SecondRow 	ThirdRow 	FinalAnswer-0
-PercentChange-0 	NumeratorQuantity2-0 	NumeratorQuantity1-2 	DenominatorQuantity1-2 	NumeratorQuantity1-2 	OptionalTask_1 	OptionalTask_2 	FinalAnswerDirection-0 	EquationAnswer 	DenominatorFactor 	NumeratorFactor 	EquationAnswer 	FirstRow1:1 	FirstRow1:2 	FirstRow2:2 	FirstRow2:1 	SecondRow 	ThirdRow 	FinalAnswer-0
-PercentChange-2 	NumeratorQuantity2-2 	NumeratorQuantity1-0 	DenominatorQuantity1-0 	NumeratorQuantity2-0 	OptionalTask_1 	OptionalTask_2 	EquationAnswer 	DenominatorFactor 	NumeratorFactor 	EquationAnswer 	FirstRow1:1 	FirstRow1:2 	FirstRow2:2 	FirstRow2:1 	FinalAnswerDirection-2 	SecondRow 	ThirdRow 	FinalAnswer-2
-PercentChange-0 	NumeratorQuantity2-0 	DenominatorQuantity1-0 	NumeratorQuantity1-0 	OptionalTask_1 	OptionalTask_2 	NumeratorFactor 	DenominatorFactor 	NumeratorFactor 	EquationAnswer 	FirstRow2:2 	FirstRow2:1 	FirstRow1:1 	FirstRow1:2 	SecondRow 	ThirdRow 	FinalAnswer-2
-PercentChange-0 	NumeratorQuantity2-0 	NumeratorQuantity1-2 	DenominatorQuantity1-0 	NumeratorQuantity1-0 	OptionalTask_1 	OptionalTask_2 	NumeratorFactor 	DenominatorFactor 	NumeratorFactor 	DenominatorFactor 	NumeratorFactor 	EquationAnswer 	FirstRow1:1 	FirstRow1:2 	FirstRow2:1 	FirstRow2:2 	FirstRow2:1 	SecondRow 	ThirdRow 	FinalAnswer-2
-PercentChange-0 	DenominatorQuantity1-0 	NumeratorQuantity2-0 	NumeratorQuantity1-0 	OptionalTask_1 	OptionalTask_2 	EquationAnswer 	NumeratorFactor 	DenominatorFactor 	FirstRow2:1 	FirstRow2:2 	FirstRow1:1 	FirstRow1:2 	SecondRow 	ThirdRow 	FinalAnswer-0
-PercentChange-0 	DenominatorQuantity1-0 	NumeratorQuantity2-2 	NumeratorQuantity1-2 	NumeratorQuantity2-0 	OptionalTask_1 	OptionalTask_2 	FinalAnswerDirection-0 	FinalAnswer-2 	FirstRow2:1 	FirstRow1:1 	FirstRow2:2 	FirstRow1:2 	EquationAnswer 	NumeratorFactor 	DenominatorFactor 	SecondRow 	ThirdRow 	FinalAnswer-0
-PercentChange-2 	NumeratorQuantity2-2 	DenominatorQuantity1-0 	NumeratorQuantity1-0 	OptionalTask_1 	DenominatorFactor 	NumeratorFactor 	EquationAnswer 	OptionalTask_2 	FirstRow1:1 	FirstRow1:2 	FirstRow2:1 	FirstRow2:2 	SecondRow 	ThirdRow 	FinalAnswer-2
-PercentChange-0 	NumeratorQuantity2-0 	NumeratorQuantity1-0 	DenominatorQuantity1-0 	OptionalTask_1 	DenominatorFactor 	NumeratorFactor 	EquationAnswer 	FinalAnswer-0
-PercentChange-0 	NumeratorQuantity2-0 	NumeratorQuantity1-0 	DenominatorQuantity1-0 	FinalAnswer-2 	OptionalTask_1 	NumeratorFactor 	DenominatorFactor 	EquationAnswer 	FinalAnswer-2
-PercentChange-0 	NumeratorQuantity2-0 	NumeratorQuantity1-0 	DenominatorQuantity1-0 	OptionalTask_1 	DenominatorFactor 	NumeratorFactor 	EquationAnswer 	FinalAnswer-0 	FinalAnswerDirection-0
-PercentChange-0 	NumeratorQuantity2-0 	NumeratorQuantity1-2 	DenominatorQuantity1-0 	FinalAnswer-2 	OptionalTask_1 	DenominatorFactor 	NumeratorFactor 	EquationAnswer 	FinalAnswer-0 	FinalAnswerDirection-0
-PercentChange-0 	NumeratorQuantity2-2 	NumeratorQuantity1-0 	DenominatorQuantity1-0 	OptionalTask_1 	NumeratorFactor 	DenominatorFactor 	EquationAnswer 	FinalAnswer-2
-PercentChange-0 	NumeratorQuantity2-0 	NumeratorQuantity1-0 	DenominatorQuantity1-0 	OptionalTask_1 	NumeratorFactor 	DenominatorFactor 	NumeratorFactor 	EquationAnswer 	FinalAnswer-0
-PercentChange-0 	DenominatorQuantity1-0 	NumeratorQuantity1-0 	NumeratorQuantity2-0 	OptionalTask_1 	EquationAnswer 	NumeratorFactor 	DenominatorFactor 	OptionalTask_2 	FinalAnswer-2
-PercentChange-0 	NumeratorQuantity2-0 	NumeratorQuantity1-0 	DenominatorQuantity1-0 	OptionalTask_1 	NumeratorFactor 	DenominatorFactor 	EquationAnswer 	FinalAnswer-2
-PercentChange-0 	NumeratorQuantity2-0 	NumeratorQuantity1-0 	DenominatorQuantity1-0 	FinalAnswerDirection-0 	OptionalTask_1 	DenominatorFactor 	NumeratorFactor 	EquationAnswer 	FinalAnswer-0
-PercentChange-0 	NumeratorQuantity2-0 	DenominatorQuantity1-0 	NumeratorQuantity1-0 	OptionalTask_1 	DenominatorFactor 	NumeratorFactor 	EquationAnswer 	FinalAnswer-0 	FinalAnswerDirection-0
-PercentChange-0 	NumeratorQuantity2-0 	NumeratorQuantity1-0 	DenominatorQuantity1-0 	OptionalTask_1 	DenominatorFactor 	NumeratorFactor 	EquationAnswer 	FinalAnswer-2
-PercentChange-0 	NumeratorQuantity2-0 	DenominatorQuantity1-0 	NumeratorQuantity1-0 	OptionalTask_2 	FirstRow1:1 	FirstRow1:2 	FirstRow2:2 	FirstRow2:1 	SecondRow 	ThirdRow 	FinalAnswer-0
-PercentChange-0 	NumeratorQuantity2-2 	NumeratorQuantity1-2 	DenominatorQuantity1-0 	OptionalTask_1 	NumeratorFactor 	DenominatorFactor 	EquationAnswer 	FinalAnswer-2
-PercentChange-0 	NumeratorQuantity2-0 	NumeratorQuantity1-2 	DenominatorQuantity1-0 	OptionalTask_2 	FirstRow1:1 	FirstRow1:2 	FirstRow2:2 	FirstRow2:1 	SecondRow 	ThirdRow 	FinalAnswer-0
-PercentChange-0 	NumeratorQuantity2-0 	NumeratorQuantity1-2 	DenominatorQuantity1-0 	OptionalTask_1 	NumeratorFactor 	OptionalTask_2 	FirstRow1:1 	FirstRow1:2 	FirstRow2:1 	FirstRow2:2 	SecondRow 	ThirdRow 	FinalAnswer-2
-PercentChange-0 	NumeratorQuantity2-0 	NumeratorQuantity1-0 	DenominatorQuantity1-0 	OptionalTask_2 	FirstRow1:1 	FirstRow1:2 	FirstRow2:2 	FirstRow2:1 	SecondRow 	ThirdRow 	FinalAnswer-0
-PercentChange-0 	NumeratorQuantity2-0 	NumeratorQuantity1-2 	DenominatorQuantity1-0 	OptionalTask_2 	FirstRow1:1 	FirstRow1:2 	FirstRow2:2 	FirstRow2:1 	SecondRow 	ThirdRow 	FinalAnswer-2
-PercentChange-0 	NumeratorQuantity2-0 	DenominatorQuantity1-2 	NumeratorQuantity1-0 	DenominatorQuantity1-0 	OptionalTask_2 	FirstRow1:1 	FirstRow1:2 	FirstRow2:1 	FirstRow2:2 	SecondRow 	ThirdRow 	FinalAnswer-2
-PercentChange-0 	NumeratorQuantity2-0 	DenominatorQuantity1-0 	NumeratorQuantity1-0 	OptionalTask_2 	FirstRow1:1 	FirstRow1:2 	FirstRow2:1 	FirstRow2:2 	SecondRow 	ThirdRow 	FinalAnswer-0 	FinalAnswerDirection-0
-PercentChange-0 	NumeratorQuantity2-0 	NumeratorQuantity1-0 	DenominatorQuantity1-0 	OptionalTask_2 	FirstRow1:1 	FirstRow1:2 	FirstRow2:1 	FirstRow2:2 	OptionalTask_1 	NumeratorFactor 	DenominatorFactor 	NumeratorFactor 	DenominatorFactor 	EquationAnswer 	SecondRow 	ThirdRow 	FinalAnswer-2
-PercentChange-2 	NumeratorQuantity2-0 	NumeratorQuantity1-0 	DenominatorQuantity1-0 	FinalAnswer-2 	OptionalTask_1 	NumeratorFactor 	EquationAnswer 	NumeratorFactor 	DenominatorFactor 	NumeratorFactor 	FinalAnswer-2
-PercentChange-0 	NumeratorQuantity2-2 	NumeratorQuantity1-0 	NumeratorQuantity2-2 	DenominatorQuantity1-0 	FinalAnswer-2 	OptionalTask_1 	NumeratorFactor 	DenominatorFactor 	NumeratorFactor 	DenominatorFactor 	NumeratorFactor 	DenominatorFactor 	NumeratorFactor 	DenominatorFactor 	NumeratorFactor 	DenominatorFactor 	NumeratorFactor 	DenominatorFactor 	EquationAnswer 	FinalAnswer-2 	OptionalTask_2 	FirstRow1:1 	FirstRow2:2 	FirstRow2:1 	FirstRow1:1 	FirstRow1:2 	SecondRow 	ThirdRow 	FinalAnswer-2
-PercentChange-0 	NumeratorQuantity2-2 	NumeratorQuantity1-0 	DenominatorQuantity1-0 	OptionalTask_1 	NumeratorFactor 	DenominatorFactor 	NumeratorFactor 	EquationAnswer 	OptionalTask_2 	FirstRow1:1 	FirstRow1:2 	FirstRow2:1 	FirstRow2:2 	FirstRow2:1 	SecondRow 	ThirdRow 	FinalAnswer-1
-PercentChange-2 	DenominatorQuantity1-2 	NumeratorQuantity2-0 	NumeratorQuantity1-0 	DenominatorQuantity1-0 	OptionalTask_2 	FirstRow1:2 	FirstRow1:1 	FirstRow2:1 	FirstRow2:2 	FirstRow1:1 	FirstRow2:2 	SecondRow 	ThirdRow 	OptionalTask_1 	DenominatorFactor 	NumeratorFactor 	EquationAnswer 	FinalAnswer-2
-PercentChange-2 	NumeratorQuantity2-2 	NumeratorQuantity1-0 	DenominatorQuantity1-0 	NumeratorQuantity2-2 	OptionalTask_1 	EquationAnswer 	NumeratorFactor 	FinalAnswerDirection-0 	OptionalTask_2 	DenominatorFactor 	NumeratorFactor 	EquationAnswer 	FirstRow2:2 	FirstRow2:1 	FirstRow1:2 	FinalAnswer-1 	EquationAnswer 	FirstRow1:1 	SecondRow 	ThirdRow 	FinalAnswer-2
-PercentChange-0 	NumeratorQuantity2-2 	NumeratorQuantity1-2 	DenominatorQuantity1-0 	NumeratorQuantity1-0 	OptionalTask_1 	OptionalTask_2 	NumeratorFactor 	DenominatorFactor 	NumeratorFactor 	EquationAnswer 	NumeratorFactor 	DenominatorFactor 	FinalAnswer-2

ratio_proportion_change3_2223/sch_largest_100-coded/finetuning/first10/test_label.txt

@@ -1,339 +0,0 @@
-1
-0
-0
-1
-1
-1
-1
-0
-0
-1
-0
-1
-0
-0
-1
-1
-0
-0
-0
-0
-1
-1
-0
-0
-0
-0
-0
-0
-1
-0
-0
-0
-0
-0
-0
-0
-0
-1
-1
-1
-1
-0
-1
-0
-1
-0
-0
-0
-1
-0
-1
-0
-0
-0
-1
-0
-0
-1
-0
-1
-0
-0
-1
-0
-0
-1
-1
-1
-1
-0
-0
-0
-0
-1
-1
-0
-1
-1
-1
-1
-1
-1
-1
-1
-0
-1
-1
-0
-1
-1
-1
-0
-0
-0
-1
-0
-1
-1
-0
-0
-0
-0
-1
-1
-0
-1
-0
-1
-0
-0
-0
-1
-0
-0
-1
-0
-0
-0
-0
-0
-0
-0
-0
-0
-1
-0
-0
-0
-0
-0
-0
-1
-1
-1
-1
-0
-0
-0
-1
-0
-1
-0
-1
-1
-1
-1
-1
-0
-1
-0
-1
-0
-1
-1
-0
-0
-1
-1
-0
-0
-0
-1
-1
-0
-1
-0
-1
-1
-1
-1
-0
-0
-0
-0
-0
-0
-0
-1
-0
-1
-0
-0
-0
-0
-0
-0
-0
-0
-0
-1
-0
-1
-0
-0
-1
-1
-0
-1
-0
-0
-0
-0
-1
-1
-0
-0
-0
-1
-0
-0
-0
-0
-0
-1
-1
-0
-1
-0
-1
-0
-0
-0
-1
-0
-1
-0
-1
-0
-1
-0
-1
-1
-1
-1
-1
-0
-0
-1
-0
-1
-1
-1
-1
-1
-1
-0
-1
-1
-1
-1
-1
-1
-0
-1
-1
-0
-1
-0
-1
-1
-1
-1
-0
-0
-1
-1
-0
-1
-0
-0
-1
-0
-1
-0
-0
-1
-0
-0
-1
-1
-1
-1
-0
-0
-1
-0
-0
-1
-0
-1
-0
-1
-1
-1
-1
-0
-0
-0
-0
-0
-1
-1
-1
-1
-0
-1
-1
-0
-0
-0
-1
-1
-0
-1
-0
-1
-1
-0
-1
-0
-0
-1
-1
-0
-1
-0
-1
-0
-1
-0
-0
-1
-0
-0
-0
-0
-0
-0
-0

ratio_proportion_change3_2223/sch_largest_100-coded/finetuning/fullData/train.txt

@@ -1,3 +0,0 @@
-version https://git-lfs.github.com/spec/v1
-oid sha256:2ea646c2016cc3d12d46f91568c616b04957408fb85004cc7bf11058a859752d
-size 24283555

ratio_proportion_change3_2223/sch_largest_100-coded/finetuning/fullData/train_info.txt

@@ -1,3 +0,0 @@
-version https://git-lfs.github.com/spec/v1
-oid sha256:0c2b895dbf22e22fb0dcff62b96db220dc3bf8206812b444fef4672bd2f2eb4a
-size 189793031

ratio_proportion_change3_2223/sch_largest_100-coded/finetuning/highGRschool10/test_info.txt

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:0b19b36c6882ef1b6fc31b52627edc986a28852cb449b7f4bd4ff8f2e7140c6a
-size 2996165
+oid sha256:290e1dfc17f54b73f7e86c5981a5da584b5c5a8ad157beb1f8bd2fb698ffbfb6
+size 7581589

ratio_proportion_change3_2223/sch_largest_100-coded/finetuning/highGRschool10/test_label.txt

@@ -3,39 +3,32 @@
 1
 0
 1
-1
-1
-0
-1
 0
 1
 1
 1
-1
 0
 1
 0
-0
 1
 0
-1
 0
-1
 0
 0
 1
 1
 0
-0
-0
-0
-1
 1
 1
 1
 0
+1
+1
+1
 0
-0
+1
+1
+1
 0
 1
 1
@@ -45,51 +38,74 @@
 0
 0
 0
+0
+0
+0
 1
+0
+0
 1
 1
 0
 0
+1
 0
 1
 0
 0
 1
+0
 1
 1
 1
 1
 1
 0
-0
 1
 1
 1
 0
 1
+0
+0
 1
-1
+0
+0
+0
+0
+0
 0
 1
 1
 0
+0
+0
+1
 1
+0
 1
+0
 1
 1
 0
 1
 1
+0
 1
 1
+0
 1
 1
 1
+0
 1
 0
+1
 0
 1
 1
+0
+0
 1
 1
 0
@@ -99,52 +115,47 @@
 1
 1
 1
+0
 1
 1
 0
 0
-0
-0
-0
-0
-1
 1
+0
 1
 1
+0
 1
 1
 0
 1
 0
 0
-0
-0
-0
-0
 1
-1
-0
 0
 1
 1
 1
 1
-0
-0
 1
 0
-1
 0
 0
 1
 1
+1
+1
+1
+1
+1
 0
 0
 0
 0
 1
-1
 0
+1
+1
 0
 0
 0
@@ -153,11 +164,12 @@
 1
 0
 0
+1
 0
 0
+1
 0
-0
-0
+1
 0
 1
 1
@@ -165,33 +177,31 @@
 1
 0
 1
-1
 0
+1
 0
+1
 0
 1
 1
 0
 0
 1
-1
 0
 0
 1
 0
+1
 0
 0
 0
 0
 0
-1
-0
 0
 1
 1
 0
-1
-1
+0
 0
 1
 0
@@ -199,6 +209,7 @@
 0
 1
 0
+1
 0
 1
 1
@@ -207,6 +218,7 @@
 1
 1
 0
+1
 0
 0
 0
@@ -214,37 +226,22 @@
 1
 1
 1
+0
 1
 1
 1
-1
-1
-1
-1
-1
-1
-1
-1
-0
 0
 0
-1
 0
-1
 0
-1
-1
 0
 0
 1
-0
 1
 0
 0
 0
 0
-1
-0
 0
 0
 0
@@ -253,32 +250,26 @@
 0
 0
 1
-1
-1
-1
 0
 0
 0
 0
-1
 0
+1
 0
 0
-1
 0
-1
 0
 0
 0
-1
 0
-1
 0
 0
 0
-1
 0
 0
+1
+1
 0
 0
 0
@@ -288,29 +279,46 @@
 1
 1
 0
+0
+0
+1
 1
 1
 1
 1
+0
 1
 0
 0
+0
+1
+0
+1
+1
 1
 1
 1
 1
 1
 0
-0
+1
 1
 0
 0
 0
+1
+0
+1
+1
 0
 1
 1
 0
+0
+0
 1
+0
+0
 1
 0
 0
@@ -325,23 +333,31 @@
 0
 1
 1
+0
+0
 1
 0
 0
 1
 1
+1
+1
+0
+1
+1
+0
 0
 0
 0
 1
 1
+1
 0
 1
 1
 0
 1
-0
-0
+1
 1
 1
 1
@@ -350,32 +366,40 @@
 0
 1
 1
-0
+1
 0
 1
 1
 0
 0
-1
 0
 1
 1
 1
 1
 1
+0
 1
 0
+1
 0
 0
 0
 1
+1
+1
+1
+1
+1
 0
+1
 0
 0
+1
+1
 0
 0
 1
-0
 1
 1
 1
@@ -383,11 +407,17 @@
 0
 0
 0
+0
+0
 1
 1
 1
 0
 1
+1
+0
+0
+0
 0
 1
 1
@@ -395,20 +425,30 @@
 0
 0
 1
+0
+0
+0
 1
+0
 1
 0
 1
+0
 1
 0
+0
 1
 1
 0
 1
+1
+1
+0
 0
 0
 1
 0
+1
 0
 1
 1
@@ -420,19 +460,27 @@
 0
 1
 1
+1
+1
 0
 1
 1
 1
 0
 1
-0
 1
 0
+0
+0
+0
+0
+0
+0
 1
 0
 0
 0
+1
 0
 1
 0
@@ -440,11 +488,15 @@
 1
 0
 0
+0
+0
 1
 0
 0
 0
 0
+1
+1
 0
 0
 0
@@ -452,16 +504,26 @@
 0
 0
 0
+1
+1
+1
 0
 0
 0
 1
 1
+1
 0
+1
+1
+1
+1
+1
 0
+1
+1
 0
 0
-1
 0
 0
 1
@@ -475,10 +537,15 @@
 1
 1
 0
+0
+0
+0
+1
 1
 0
 0
 1
+1
 0
 0
 0
@@ -486,48 +553,63 @@
 1
 1
 1
-1
-1
 0
+1
 0
+1
 0
 0
+1
+1
+1
 0
+1
 0
+1
 0
 0
 0
 0
+1
 0
 0
 0
 1
-1
 0
 0
 1
 1
 1
+0
 1
 1
 1
 0
 1
-1
-1
+0
 1
 1
 0
 0
+1
+1
 0
 1
+0
 1
+0
 1
+0
+0
 1
 0
 0
 1
 1
+0
+0
+0
+0
 1
 0
 0
@@ -537,18 +619,20 @@
 0
 0
 0
+1
+0
 0
 1
 1
+0
 1
 0
 0
+1
 0
 0
 1
 1
-1
-1
 0
 0
 0
@@ -559,19 +643,23 @@
 1
 1
 0
-0
+1
 1
 0
 0
+0
+1
+1
 1
 1
 1
 0
 0
 1
-0
 1
 1
+0
+0
 1
 1
 0
@@ -580,29 +668,26 @@
 0
 1
 0
+0
 1
 1
 0
 1
 0
-1
 0
 1
 1
 1
 0
 0
-1
-0
 0
+1
 0
 0
 1
-0
 1
 1
-0
-0
+1
 0
 0
 1
@@ -611,37 +696,30 @@
 1
 0
 1
-1
 0
 1
 1
 1
-1
 0
+1
 0
 1
 1
 1
-0
-0
-0
-0
 1
 0
 0
 1
 1
 0
-0
-1
 1
 1
 0
 1
 0
-0
-0
-0
+1
+1
+1
 0
 0
 0
@@ -649,49 +727,89 @@
 0
 1
 0
+1
+1
 0
 0
+1
 0
 1
 1
-0
-0
+1
+1
 1
 0
 1
+1
+1
+1
 0
 0
 1
 0
 0
-0
+1
+1
+1
+1
+1
 1
 0
 0
 1
+1
+1
+1
+1
+1
+1
+1
+1
 0
 0
 0
+1
 0
 0
 0
+1
+1
+1
+1
 0
 0
-0
+1
+1
+1
+1
 1
 0
+1
+1
 0
+1
+1
 0
 0
 0
+1
 0
 0
 0
+1
+1
 0
+1
+1
+1
 0
 0
+1
+1
 0
 0
+1
+1
 0
 0
 0
@@ -701,127 +819,124 @@
 1
 1
 0
+1
 0
+1
+1
+1
 0
 0
 0
 0
-0
-1
-1
-1
-1
 1
 0
 0
 0
 1
 1
-1
+0
+0
 1
 1
 0
 0
 0
-1
 0
 0
-1
-1
 0
 1
 1
 0
 0
+0
 1
+0
 1
 0
 0
 1
 1
+0
 1
 0
 0
 0
 0
 0
-1
+0
 0
 1
 0
 0
 1
 0
+1
 0
 1
 1
 1
+0
+1
 1
 0
 0
 0
-1
-1
-1
-1
+0
+0
 1
 0
 0
 0
 0
-1
-1
-1
-1
-1
 0
 0
 0
 0
-1
+0
 1
 1
 0
 0
+0
+0
 1
 1
-0
 1
 1
 0
 0
 0
 1
+1
 0
 0
 0
 1
 1
 0
+1
 0
 1
 0
 1
+1
 0
+1
 0
 1
 0
 1
 1
+1
 0
 0
 0
-1
-0
 0
 1
 1
 1
-1
 0
-1
-1
-1
+0
 1
 0
 0
@@ -829,18 +944,18 @@
 1
 1
 1
-0
-0
 1
+0
 1
+0
 1
 1
 1
 0
 0
-1
 0
 1
+1
 0
 0
 0
@@ -848,43 +963,46 @@
 0
 0
 0
-1
-0
 0
 0
 0
 0
+1
 0
 1
 0
+0
 1
 1
 1
 0
 0
-0
+1
 1
 0
 0
 0
-1
-1
-1
-1
 0
 0
 0
-1
 0
 1
 0
+0
 1
+0
 1
+0
+0
+0
+0
+0
 1
 1
 1
 0
-1
+0
+0
 0
 1
 0
@@ -893,31 +1011,37 @@
 0
 0
 1
-1
 0
 0
 0
 1
-1
 0
-1
+0
 0
 1
 1
 1
 1
 0
+1
 0
+1
 0
 0
 0
+1
 0
 0
 1
 1
+0
+0
 1
 1
 0
+1
+1
+1
 0
 0
 0
@@ -928,13 +1052,14 @@
 0
 0
 0
+1
 0
+1
 0
 0
 0
 0
 0
-1
 0
 1
 0
@@ -944,113 +1069,124 @@
 1
 0
 0
-0
-0
-0
 1
-0
 1
-0
-0
 1
 1
 0
 1
 1
-0
 1
+0
+0
 1
+0
 1
 0
 0
 0
 0
+1
+1
+1
+1
 0
 0
+1
+1
 0
+1
 0
 0
 0
 0
+1
 0
 0
+1
+1
+1
+1
+1
+1
 0
 0
+1
 0
 0
 0
+1
+1
 0
 0
+1
+1
 0
 0
 0
 0
 1
-1
+0
 0
 1
+0
 1
 0
 1
 1
 0
-0
+1
 0
 0
 1
 1
 1
 1
-0
 1
+0
 1
 0
 0
 1
 0
-1
 0
 0
 1
 0
 1
-0
 1
 1
 0
 1
 1
-0
-0
-0
 1
 1
 1
+0
 1
 1
+0
 1
 0
 0
-1
-1
-1
+0
 0
 1
 0
 0
-1
 0
 1
-0
 1
 0
 0
+1
 0
 0
+1
 0
 0
 0
-0
+1
 1
 0
 1
@@ -1059,11 +1195,9 @@
 0
 0
 1
-1
 0
 0
 0
-1
 0
 0
 0
@@ -1071,43 +1205,57 @@
 0
 1
 0
-0
+1
 0
 0
 1
 1
 0
-1
-0
-0
 0
 1
 0
+1
 0
 0
 0
 0
+1
 0
 0
+1
 0
 0
+1
+1
 0
 0
+1
 0
+1
 0
 0
 0
+1
+1
+1
 0
+1
 0
 0
 1
+0
 1
 0
 1
 1
+0
+0
+1
+0
 1
 0
 0
+1
 0
 0
 0
@@ -1115,30 +1263,23 @@
 1
 1
 0
+0
 1
 1
-1
-1
+0
 1
 1
 0
 0
 0
 0
+0
 1
 0
 0
-1
-1
-1
 0
-1
-1
-1
-1
 0
 0
-1
 0
 0
 1
@@ -1146,35 +1287,37 @@
 0
 1
 1
-1
-1
+0
 0
 1
+0
 1
 1
 1
 0
 1
 1
+0
+0
 1
-1
-1
+0
 0
 0
 1
-1
-1
-1
+0
 1
 0
 0
 0
 0
+0
+0
 1
 1
-0
 1
 0
+1
+1
 0
 1
 1
@@ -1186,6 +1329,17 @@
 0
 1
 0
+0
+1
+0
+0
+0
+0
+0
+0
+0
+0
+0
 1
 0
 1
@@ -1204,30 +1358,46 @@
 0
 0
 0
+1
+1
 0
+1
 0
 1
+1
+1
+0
 0
 0
 1
 1
+1
+1
 0
 0
 0
+1
+1
 0
 0
 1
+1
+1
+1
+1
+1
 0
 0
 0
-1
-0
-1
 0
 0
 0
 0
 0
+1
+1
+1
+1
 0
 1
 0
@@ -1236,19 +1406,27 @@
 0
 0
 1
-0
 1
 0
-1
 0
 1
 0
+0
 1
 1
-1
+0
+0
+0
+0
+0
+0
+0
+0
 1
 1
 0
+1
+1
 0
 1
 0
@@ -1259,32 +1437,51 @@
 1
 1
 1
-0
 1
 1
 1
-0
+1
+1
+1
 1
 0
 1
 0
+0
+1
+1
 1
 1
+0
 1
 1
 0
 1
 1
+1
+1
+1
 0
 0
 0
 0
 1
+1
+1
+0
+1
 0
 0
+0
+1
+1
+1
 1
+1
+0
 0
 1
+1
 0
 0
 0
@@ -1295,53 +1492,66 @@
 0
 0
 1
+0
+0
 1
 1
 1
 0
 0
+0
 1
 0
 0
 0
+1
 0
 0
 0
-1
 0
 1
 1
 1
+0
+0
+0
+0
+1
 1
+0
 1
+0
+0
 1
 1
 1
 0
 1
 1
-0
+1
 0
 0
 1
 1
 1
+0
 1
 1
 0
 0
-1
-1
+0
+0
+0
+0
 0
 1
-1
+0
 1
 1
 1
 0
 1
-1
-1
+0
 1
 1
 1
@@ -1349,12 +1559,21 @@
 1
 1
 0
-1
 0
+1
+1
 0
 0
+1
 0
 0
+1
+1
+1
+1
+1
+1
+1
 0
 1
 0
@@ -1363,20 +1582,29 @@
 1
 0
 0
+0
 1
 1
 0
+1
 0
+1
+1
 0
 0
 0
+1
+1
+1
 0
 0
 1
-0
 1
 1
 1
+1
+1
+0
 0
 1
 1
@@ -1385,19 +1613,33 @@
 0
 1
 0
+1
 0
 0
 1
+1
+1
+0
+0
+0
+0
+0
 0
 1
 0
+0
 1
 1
 1
 1
 0
 0
+0
+0
 1
+0
+0
+0
 1
 0
 1
@@ -1406,42 +1648,51 @@
 1
 0
 1
+1
 0
 0
 1
+1
 0
 0
 1
 1
-0
 1
 1
 1
 0
+0
 1
 1
 1
 0
+1
+1
+1
 0
 0
+1
 0
 0
 0
 0
 0
 1
-1
 0
 0
 0
 0
 1
+0
+1
+0
+1
 1
 1
 1
 0
-0
 1
+0
 1
 1
 1
@@ -1449,25 +1700,33 @@
 0
 0
 0
-0
-0
-0
 1
 1
+0
 1
 1
 0
 1
 1
+0
 1
 1
+0
+0
 1
+0
 1
+0
 1
 0
 0
+0
+0
 1
+1
+0
 0
+1
 0
 1
 1
@@ -1476,12 +1735,15 @@
 0
 1
 1
-0
 1
 1
 1
 0
 1
+0
+0
+0
+0
 1
 1
 1
@@ -1489,68 +1751,73 @@
 1
 0
 0
+0
+1
+0
+1
 1
 1
 1
 0
+1
+1
 0
 0
 1
 0
+1
 0
 0
+1
 0
 1
+1
 0
+1
 0
 0
 1
 1
+1
 0
 0
 0
 0
 1
 1
-1
-1
 0
 1
 0
+0
 1
 1
 1
+0
 1
 0
+1
+1
 0
 0
 0
 0
 1
-1
-1
 0
-1
-1
-1
 0
 0
 1
 1
 1
-0
-0
-0
 1
 1
 1
 0
 1
 1
+1
 0
 1
 1
-0
 1
 0
 1
@@ -1558,61 +1825,45 @@
 1
 1
 1
-0
 1
 1
 1
 1
 0
 0
-1
-1
 0
 1
-0
 1
 0
-1
 0
-1
 0
 0
 0
 1
-1
+0
 0
 1
 0
 0
-1
-1
 0
-1
-1
 0
 0
 0
 1
 1
-0
 1
 0
-1
-1
 0
 1
 0
 0
-1
-1
 0
 0
-1
+0
 1
 1
 0
 1
-0
 1
 0
 0
@@ -1622,24 +1873,32 @@
 1
 0
 0
+0
+0
 1
 1
 0
 0
 1
+0
+1
 1
 0
+0
+0
+1
 1
 0
+1
 0
 1
+1
+1
 0
 0
 0
 1
 0
-1
-1
 0
 0
 0
@@ -1648,38 +1907,33 @@
 0
 0
 0
-1
 0
-1
-1
 0
 0
 0
-1
 0
 1
 1
 0
 0
-1
-1
 0
 1
 1
 0
 1
 1
+1
 0
+1
 0
 1
 1
-0
 1
 1
 0
 0
-0
 1
+0
 1
 1
 1
@@ -1697,22 +1951,5161 @@
 0
 0
 0
+1
+1
+1
+1
 0
 0
 0
 0
 0
 0
+1
+1
+1
+1
+0
+1
+1
+0
+1
+0
+0
+1
+1
+0
+0
+0
+1
+0
+1
+1
+1
+0
+1
+1
+1
+0
+1
+1
+1
+1
+1
+0
+0
+1
+1
+0
+0
+1
+0
+1
+0
+1
+0
+0
+1
+1
+1
+0
+1
+1
+0
+0
+0
+0
+1
+1
+0
+0
+0
+1
+0
+1
+1
+1
+0
+0
+0
+1
+1
+0
+0
+0
+0
+1
+1
+1
+0
+0
+0
+0
+0
+0
+0
+0
+1
+0
+0
+0
+0
+1
+0
+1
+1
+1
+0
+1
+0
+0
+1
+0
+1
+1
+1
+0
+0
+1
+1
+0
+1
+0
+0
+1
+1
+1
+1
+1
+0
+0
+1
+0
+1
+1
+1
+1
+0
+0
+0
+0
+0
+0
+0
+1
+0
+1
+0
+0
+1
+1
+1
+1
+1
+1
+1
+1
+1
+1
+0
+0
+0
+1
+1
+1
+1
+1
+1
+1
+0
+1
+0
+1
+1
+0
+1
+0
+1
+1
+0
+0
+0
+0
+0
+1
+1
+0
+1
+1
+0
+0
+1
+1
+1
+0
+1
+1
+1
+0
+1
+1
+1
+1
+1
+0
+0
+1
+0
+1
+0
+0
+1
+1
+0
+1
+0
+0
+0
+0
+0
+1
+1
+0
+1
+1
+0
+0
+0
+0
+1
+0
+1
+1
+1
+1
+1
+0
+0
+1
+1
+1
+1
+1
+1
+1
+0
+1
+1
+1
+1
+1
+1
+1
+1
+1
+1
+1
+1
+0
+0
+1
+1
+1
+1
+1
+1
+0
+0
+1
+0
+0
+1
+1
+1
+1
+1
+0
+1
+1
+0
+1
+0
+0
+1
+0
+1
+1
+1
+0
+0
+1
+1
+0
+1
+0
+0
+1
+1
+1
+1
+0
+1
+1
+0
+1
+1
+0
+0
+0
+1
+0
+1
+1
+1
+1
+1
+0
+0
+1
+0
+0
+0
+1
+0
+0
+1
+1
+0
+1
+1
+0
+1
+1
+0
+1
+0
+0
+1
+0
+0
+1
+0
+1
+0
+0
+0
+0
+0
+0
+0
+0
+0
+1
+0
+0
+1
+1
+0
+0
+0
+1
+0
+1
+0
+0
+1
+1
+1
+0
+1
+1
+1
+1
+0
+1
+0
+0
+0
+1
+0
+1
+1
+0
+1
+0
+0
+1
+0
+1
+1
+0
+1
+1
+1
+0
+1
+1
+1
+1
+0
+1
+0
+1
+0
+1
+0
+1
+0
+1
+1
+0
+0
+0
+1
+1
+0
+0
+0
+0
+0
+0
+0
+1
+1
+1
+0
+0
+0
+0
+0
+0
+1
+0
+0
+0
+1
+0
+1
+1
+1
+0
+0
+0
+1
+1
+0
+0
+0
+1
+0
+0
+0
+0
+0
+0
+1
+0
+1
+1
+1
+1
+1
+0
+1
+0
+0
+0
+0
+1
+0
+1
+1
+1
+1
+1
+1
+1
+1
+0
+1
+0
+1
+0
+0
+0
+0
+1
+0
+0
+1
+1
+0
+1
+1
+0
+0
+1
+0
+1
+1
+1
+1
+0
+0
+1
+0
+1
+0
+1
+1
+1
+0
+0
+0
+1
+0
+1
+0
+0
+1
+0
+1
+1
+1
+1
+1
+1
+1
+0
+0
+0
+1
+1
+0
+1
+1
+1
+1
+0
+0
+0
+0
+1
+1
+0
+1
+0
+1
+0
+0
+1
+0
+0
+0
+1
+0
+0
+0
+0
+1
+0
+1
+1
+1
+0
+0
+0
+0
+0
+1
+0
+0
+1
+0
+0
+0
+0
+1
+1
+1
+1
+1
+0
+1
+0
+0
+1
+0
+1
+1
+1
+1
+1
+1
+1
+1
+0
+0
+0
+1
+0
+1
+0
+0
+0
+1
+1
+1
+1
+1
+1
+1
+0
+1
+1
+1
+1
+0
+0
+1
+1
+1
+1
+1
+0
+0
+0
+0
+0
+0
+1
+1
+1
+0
+0
+0
+1
+1
+1
+1
+1
+0
+1
+1
+1
+0
+1
+0
+1
+0
+1
+1
+1
+1
+0
+0
+1
+1
+0
+1
+1
+1
+1
+0
+0
+1
+1
+1
+1
+0
+0
+1
+0
+1
+1
+1
+1
+0
+0
+0
+0
+1
+0
+0
+0
+0
+1
+1
+1
+1
+0
+1
+0
+0
+1
+0
+1
+1
+0
+1
+0
+1
+0
+1
+0
+1
+0
+1
+1
+0
+1
+1
+1
+0
+0
+1
+1
+0
+1
+0
+0
+0
+1
+0
+1
+0
+0
+1
+1
+0
+1
+0
+0
+0
+1
+1
+1
+0
+1
+1
+0
+1
+0
+0
+1
+1
+1
+0
+0
+0
+1
+0
+0
+0
+1
+1
+0
+1
+1
+1
+1
+1
+1
+0
+0
+0
+0
+0
+1
+1
+1
+1
+0
+0
+1
+1
+1
+1
+1
+1
+0
+1
+1
+1
+0
+1
+0
+1
+0
+0
+1
+1
+1
+0
+1
+0
+0
+1
+0
+0
+0
+1
+0
+0
+1
+0
+0
+1
+1
+1
+0
+0
+1
+1
+0
+1
+0
+0
+1
+1
+1
+0
+0
+1
+1
+0
+1
+0
+1
+1
+1
+1
+1
+1
+1
+1
+1
+0
+1
+1
+1
+1
+0
+0
+0
+0
+0
+1
+0
+1
+0
+1
+1
+1
+0
+1
+1
+0
+0
+0
+0
+1
+1
+1
+1
+1
+1
+1
+1
+0
+0
+1
+0
+0
+0
+0
+0
+0
+0
+0
+0
+0
+1
+1
+1
+0
+1
+1
+0
+1
+1
+0
+1
+1
+0
+0
+0
+0
+1
+0
+0
+0
+0
+0
+1
+1
+1
+0
+1
+0
+1
+1
+1
+1
+1
+1
+1
+1
+0
+1
+1
+0
+1
+1
+1
+0
+0
+0
+1
+1
+0
+0
+1
+1
+1
+0
+1
+0
+1
+0
+0
+0
+0
+1
+1
+1
+0
+1
+1
+1
+0
+0
+0
+0
+0
+0
+1
+1
+0
+0
+0
+0
+0
+0
+0
+0
+0
+1
+1
+1
+1
+1
+0
+0
+0
+0
+0
+0
+0
+1
+1
+0
+0
+0
+0
+0
+0
+0
+1
+0
+1
+0
+1
+0
+1
+0
+1
+0
+1
+1
+0
+1
+1
+0
+1
+1
+1
+1
+1
+1
+0
+0
+0
+1
+0
+0
+0
+0
+0
+0
+0
+1
+1
+1
+1
+0
+0
+1
+0
+0
+0
+0
+0
+1
+0
+0
+0
+1
+0
+0
+0
+1
+1
+1
+1
+1
+0
+1
+1
+1
+1
+0
+0
+0
+0
+0
+1
+0
+0
+0
+0
+1
+1
+0
+0
+1
+1
+1
+1
+1
+0
+1
+0
+0
+1
+0
+1
+1
+0
+1
+1
+1
+1
+1
+1
+1
+0
+0
+0
+0
+1
+1
+1
+1
+1
+0
+1
+1
+1
+1
+1
+0
+1
+0
+1
+1
+1
+0
+1
+1
+0
+1
+0
+1
+1
+0
+0
+1
+1
+0
+0
+1
+0
+0
+1
+0
+1
+0
+1
+1
+1
+1
+1
+0
+1
+1
+0
+0
+0
+1
+1
+0
+1
+0
+1
+1
+1
+0
+0
+1
+0
+1
+1
+0
+1
+1
+1
+1
+0
+0
+1
+0
+0
+1
+0
+0
+0
+1
+1
+1
+0
+0
+0
+1
+0
+0
+0
+1
+0
+1
+1
+1
+0
+0
+1
+1
+0
+1
+1
+1
+1
+1
+0
+1
+1
+1
+1
+1
+0
+1
+1
+0
+1
+1
+1
+1
+0
+0
+0
+1
+0
+0
+1
+1
+0
+1
+1
+1
+0
+1
+0
+0
+1
+0
+0
+1
+0
+1
+1
+1
+0
+1
+0
+1
+0
+0
+1
+1
+1
+1
+0
+1
+0
+0
+1
+0
+1
+1
+0
+0
+1
+0
+0
+0
+0
+1
+0
+1
+1
+1
+0
+1
+0
+0
+1
+0
+0
+0
+1
+0
+0
+1
+1
+1
+0
+1
+1
+0
+0
+0
+0
+0
+0
+0
+1
+1
+1
+1
+0
+0
+0
+0
+0
+0
+0
+0
+1
+0
+0
+0
+1
+1
+1
+1
+1
+0
+0
+0
+0
+1
+1
+1
+0
+1
+0
+0
+1
+1
+1
+0
+1
+0
+1
+1
+1
+0
+1
+1
+1
+0
+0
+1
+1
+0
+1
+1
+0
+1
+1
+1
+1
+1
+0
+0
+1
+1
+1
+1
+1
+0
+1
+0
+0
+1
+1
+0
+0
+0
+0
+1
+0
+1
+1
+1
+1
+1
+1
+1
+1
+0
+1
+1
+1
+1
+0
+0
+0
+1
+0
+1
+1
+1
+1
+1
+1
+0
+1
+1
+1
+1
+0
+1
+0
+0
+0
+0
+1
+1
+1
+1
+0
+0
+0
+0
+1
+0
+0
+0
+1
+1
+1
+1
+1
+0
+1
+1
+1
+1
+1
+1
+1
+0
+1
+0
+0
+1
+0
+1
+1
+0
+0
+1
+1
+1
+1
+0
+0
+1
+1
+0
+1
+0
+1
+0
+0
+0
+1
+1
+1
+1
+1
+1
+1
+1
+0
+0
+1
+1
+0
+1
+0
+1
+1
+0
+1
+1
+0
+0
+0
+1
+0
+0
+1
+1
+1
+1
+1
+0
+1
+1
+1
+1
+1
+0
+0
+0
+0
+1
+0
+0
+0
+0
+1
+1
+0
+1
+1
+1
+0
+0
+0
+1
+1
+1
+1
+1
+0
+1
+0
+1
+1
+1
+0
+1
+1
+1
+0
+0
+0
+0
+0
+1
+0
+0
+0
+0
+0
+0
+1
+0
+1
+0
+0
+1
+0
+1
+1
+1
+1
+1
+1
+1
+0
+1
+1
+0
+1
+1
+1
+1
+0
+0
+0
+1
+0
+0
+0
+1
+0
+0
+0
+0
+1
+0
+0
+0
+1
+0
+0
+1
+1
+1
+0
+1
+1
+1
+1
+0
+1
+0
+0
+0
+1
+1
+0
+1
+0
+1
+1
+0
+0
+0
+1
+0
+0
+0
+0
+0
+0
+0
+0
+0
+0
+1
+1
+0
+0
+1
+1
+1
+0
+0
+0
+0
+1
+0
+1
+1
+1
+0
+1
+1
+0
+1
+0
+1
+1
+0
+1
+1
+0
+1
+0
+0
+1
+1
+1
+0
+0
+1
+1
+0
+1
+1
+0
+0
+0
+1
+1
+0
+1
+0
+1
+1
+1
+0
+1
+0
+1
+0
+0
+1
+1
+1
+0
+0
+0
+1
+1
+1
+0
+1
+1
+0
+0
+1
+0
+0
+1
+1
+0
+0
+0
+1
+0
+0
+0
+0
+1
+0
+0
+0
+0
+0
+0
+0
+1
+0
+1
+0
+0
+0
+0
+0
+1
+1
+0
+1
+1
+0
+1
+0
+0
+1
+1
+0
+0
+1
+1
+1
+1
+1
+1
+0
+0
+1
+0
+1
+0
+0
+1
+1
+1
+0
+0
+1
+0
+1
+1
+1
+1
+1
+1
+1
+1
+0
+0
+1
+1
+1
+0
+0
+0
+1
+0
+0
+0
+0
+0
+0
+0
+1
+1
+0
+0
+0
+1
+1
+1
+1
+0
+1
+0
+1
+0
+0
+0
+0
+0
+1
+1
+1
+0
+0
+1
+1
+0
+1
+0
+1
+1
+1
+1
+0
+0
+0
+0
+1
+0
+0
+1
+0
+0
+1
+1
+1
+0
+1
+1
+0
+1
+0
+1
+0
+0
+0
+0
+1
+0
+0
+0
+0
+0
+0
+0
+0
+0
+0
+1
+0
+1
+0
+1
+1
+0
+1
+0
+1
+1
+0
+0
+0
+1
+1
+1
+1
+0
+0
+0
+0
+1
+0
+1
+0
+0
+1
+1
+1
+0
+1
+1
+1
+0
+1
+1
+0
+1
+0
+0
+0
+1
+0
+1
+1
+0
+0
+0
+0
+1
+1
+1
+0
+0
+0
+0
+0
+0
+0
+1
+1
+0
+1
+0
+0
+1
+0
+0
+0
+0
+0
+1
+1
+1
+0
+0
+1
+1
+1
+1
+1
+1
+1
+1
+1
+0
+1
+0
+0
+0
+1
+0
+1
+1
+1
+1
+0
+0
+0
+1
+1
+1
+1
+0
+0
+1
+1
+1
+1
+1
+1
+1
+1
+1
+0
+0
+1
+0
+1
+0
+1
+0
+1
+0
+1
+0
+1
+1
+1
+0
+0
+1
+0
+0
+0
+0
+0
+1
+0
+1
+0
+1
+0
+0
+1
+0
+0
+1
+0
+1
+1
+0
+0
+1
+0
+0
+0
+1
+1
+1
+1
+1
+0
+1
+0
+0
+0
+0
+1
+1
+1
+1
+0
+0
+0
+1
+0
+1
+1
+1
+1
+1
+1
+1
+1
+0
+1
+1
+1
+1
+0
+0
+1
+0
+0
+1
+1
+1
+1
+0
+1
+0
+0
+0
+1
+1
+1
+1
+1
+0
+0
+0
+0
+1
+1
+1
+0
+1
+0
+1
+0
+1
+1
+0
+0
+1
+1
+1
+1
+0
+1
+1
+1
+1
+1
+1
+0
+0
+0
+1
+1
+0
+1
+1
+1
+0
+1
+1
+1
+0
+0
+0
+0
+1
+1
+1
+1
+0
+1
+1
+1
+0
+0
+1
+1
+1
+1
+0
+0
+0
+0
+1
+1
+0
+1
+1
+0
+1
+0
+0
+1
+1
+0
+1
+1
+0
+1
+0
+1
+1
+1
+1
+0
+1
+0
+1
+0
+0
+1
+1
+1
+1
+1
+1
+1
+1
+1
+1
+1
+1
+1
+1
+1
+1
+0
+0
+0
+1
+0
+0
+1
+1
+0
+1
+0
+0
+1
+1
+0
+1
+0
+1
+0
+1
+0
+1
+0
+1
+1
+1
+0
+1
+0
+1
+1
+1
+0
+1
+1
+0
+1
+1
+0
+0
+1
+1
+0
+0
+0
+1
+1
+1
+1
+1
+1
+1
+1
+0
+0
+1
+1
+1
+1
+1
+1
+0
+0
+0
+0
+1
+0
+1
+1
+1
+0
+0
+0
+1
+1
+1
+1
+1
+0
+1
+1
+0
+1
+1
+1
+1
+1
+0
+1
+0
+0
+0
+1
+1
+1
+0
+0
+0
+0
+0
+0
+1
+0
+1
+0
+0
+1
+0
+1
+1
+1
+0
+1
+1
+0
+0
+0
+1
+0
+1
+1
+1
+1
+0
+0
+1
+1
+1
+0
+0
+1
+1
+1
+1
+1
+1
+1
+0
+1
+0
+1
+1
+0
+1
+1
+1
+1
+1
+0
+0
+0
+1
+1
+0
+1
+1
+0
+1
+1
+1
+0
+1
+1
+1
+0
+1
+1
+1
+1
+0
+0
+1
+1
+0
+0
+1
+1
+1
+1
+0
+0
+1
+1
+1
+0
+1
+1
+1
+1
+0
+0
+1
+0
+0
+1
+1
+1
+0
+0
+0
+0
+0
+0
+0
+0
+0
+0
+0
+1
+1
+1
+1
+1
+1
+1
+0
+1
+0
+0
+0
+1
+1
+1
+0
+0
+0
+1
+1
+0
+1
+1
+1
+1
+0
+0
+0
+0
+0
+1
+0
+1
+1
+0
+1
+0
+0
+0
+0
+1
+1
+1
+1
+1
+1
+1
+1
+1
+1
+1
+1
+0
+0
+1
+1
+0
+1
+1
+0
+1
+1
+0
+1
+0
+1
+0
+1
+0
+1
+1
+1
+1
+1
+1
+1
+0
+0
+0
+0
+1
+1
+0
+0
+1
+1
+1
+1
+1
+0
+0
+1
+1
+0
+1
+1
+1
+0
+1
+0
+0
+0
+1
+1
+0
+1
+1
+0
+1
+1
+0
+1
+0
+1
+0
+1
+0
+0
+0
+1
+0
+0
+1
+0
+0
+0
+1
+0
+1
+1
+0
+1
+1
+1
+1
+0
+0
+1
+1
+0
+0
+0
+1
+0
+0
+1
+0
+0
+0
+1
+1
+1
+1
+1
+1
+1
+1
+1
+1
+0
+1
+0
+0
+1
+0
+1
+1
+1
+0
+0
+1
+0
+0
+0
+0
+0
+1
+0
+1
+1
+0
+1
+1
+1
+1
+0
+0
+1
+1
+1
+1
+1
+0
+1
+0
+1
+0
+0
+1
+0
+1
+0
+0
+0
+1
+1
+1
+1
+1
+0
+1
+0
+1
+1
+1
+0
+1
+0
+1
+0
+0
+1
+0
+0
+1
+0
+0
+0
+0
+1
+0
+1
+1
+1
+1
+1
+0
+0
+1
+1
+0
+1
+1
+1
+0
+1
+1
+0
+0
+1
+0
+0
+1
+0
+0
+0
+0
+1
+1
+1
+1
+0
+1
+0
+1
+0
+1
+1
+0
+0
+0
+0
+1
+1
+1
+1
+0
+1
+1
+1
+0
+1
+0
+1
+1
+0
+0
+1
+1
+0
+0
+1
+0
+1
+1
+1
+0
+1
+0
+0
+1
+0
+0
+0
+0
+1
+0
+0
+1
+1
+1
+0
+0
+0
+1
+1
+0
+1
+0
+1
+1
+0
+1
+0
+0
+0
+1
+0
+1
+1
+1
+1
+1
+0
+1
+1
+0
+1
+0
+0
+1
+0
+1
+1
+1
+1
+1
+0
+1
+0
+1
+1
+0
+1
+1
+0
+1
+1
+1
+1
+1
+1
+1
+1
+0
+0
+1
+1
+1
+1
+1
+1
+1
+0
+0
+0
+1
+1
+0
+1
+1
+0
+1
+0
+0
+1
+0
+1
+1
+1
+0
+1
+0
+1
+0
+1
+0
+0
+1
+0
+0
+0
+1
+1
+1
+1
+0
+1
+1
+1
+1
+1
+0
+0
+0
+0
+1
+1
+0
+1
+0
+0
+0
+1
+0
+1
+1
+0
+0
+0
+0
+1
+0
+0
+0
+0
+1
+1
+1
+1
+1
+1
+1
+0
+0
+0
+0
+0
+1
+1
+1
+1
+1
+1
+1
+1
+0
+0
+0
+0
+1
+1
+0
+0
+0
+1
+1
+1
+1
+1
+1
+1
+0
+1
+0
+0
+1
+1
+1
+1
+0
+1
+1
+1
+1
+1
+1
+1
+1
+0
+1
+0
+0
+0
+1
+1
+1
+0
+0
+1
+1
+1
+0
+0
+0
+0
+0
+1
+1
+1
+1
+1
+0
+0
+0
+0
+0
+0
+0
+0
+0
+1
+0
+0
+1
+1
+1
+0
+1
+1
+0
+1
+1
+1
+0
+1
+1
+1
+1
+0
+1
+1
+0
+1
+1
+1
+1
+0
+0
+0
+1
+1
+1
+1
+0
+1
+0
+0
+1
+0
+1
+1
+0
+0
+0
+1
+1
+0
+1
+0
+0
+1
+1
+1
+0
+1
+0
+1
+1
+0
+1
+1
+1
+1
+1
+0
+0
+1
+1
+0
+1
+0
+0
+0
+1
+0
+1
+1
+0
+1
+1
+1
+1
+1
+1
+1
+0
+1
+1
+1
+0
+1
+1
+0
+0
+0
+0
+0
+0
+1
+0
+0
+0
+1
+0
+0
+0
+1
+1
+1
+1
+1
+1
+0
+1
+1
+1
+1
+0
+0
+0
+1
+0
+1
+0
+1
+1
+1
+1
+0
+0
+1
+1
+0
+1
+1
+0
+1
+0
+1
+0
+0
+1
+1
+0
+1
+1
+0
+1
+0
+1
+1
+1
+0
+1
+1
+1
+0
+0
+0
+1
+0
+1
+1
+0
+0
+0
+0
+0
+0
+0
+0
+0
+1
+0
+1
+0
+1
+0
+0
+0
+1
+1
+1
+0
+0
+0
+1
+1
+1
+0
+0
+1
+0
+1
+1
+0
+0
+0
+0
+0
+1
+1
+0
+1
+1
+1
+1
+0
+0
+1
+0
+0
+0
+1
+1
+1
+0
+0
+0
+0
+1
+1
+0
+1
+1
+1
+1
+1
+1
+1
+1
+0
+1
+0
+1
+0
+0
+0
+1
+0
+1
+0
+1
+0
+0
+0
+0
+0
+0
+1
+0
+0
+0
+0
+0
+1
+1
+1
+1
+1
+1
+0
+1
+0
+1
+0
+0
+1
+0
+1
+0
+0
+1
+0
+1
+1
+0
+0
+1
+0
+1
+0
+0
+0
+0
+1
+0
+0
+1
+1
+0
+0
+0
+1
+1
+0
+1
+1
+0
+0
+1
+1
+0
+0
+0
+0
+0
+1
+0
+0
+0
+0
+1
+0
+0
+1
+0
+1
+1
+1
+1
+0
+1
+1
+0
+0
+1
+1
+1
+0
+0
+0
+0
+1
+0
+1
+0
+0
+1
+0
+0
+1
+0
+1
+1
+0
+1
+0
+0
+1
+1
+0
+0
+1
+1
+0
+1
+1
+1
+1
+1
+0
+1
+1
+1
+0
+1
+1
+1
+1
+1
+0
+0
+1
+1
+1
+1
+0
+1
+0
+1
+0
+0
+1
+1
+1
+1
+0
+0
+1
+0
+1
+0
+0
+1
+0
+1
+1
+1
+1
+0
+0
+1
+0
+1
+1
+1
+1
+1
+1
+0
+1
+1
+1
+0
+1
+1
+0
+1
+1
+1
+1
+1
+1
+0
+0
+0
+0
+0
+0
+1
+0
+1
+0
+0
+0
+0
+1
+1
+0
+1
+1
+1
+0
+1
+0
+1
+0
+0
+0
+1
+1
+0
+1
+1
+1
+1
+0
+0
+1
+1
+0
+0
+1
+1
+1
+1
+0
+0
+1
+1
+0
+1
+1
+0
+0
+0
+0
+0
+0
+0
+1
+0
+1
+1
+1
+1
+1
+1
+1
+1
+0
+1
+0
+1
+0
+0
+1
+1
+0
+0
+1
+0
+0
+0
+1
+1
+0
+1
+1
+1
+1
+1
+1
+0
+1
+1
+0
+1
+1
+0
+0
+0
+0
+1
+1
+0
+1
+0
+1
+1
+1
+1
+1
+1
+1
+1
+1
+1
+1
+1
+1
+0
+1
+1
+1
+0
+0
+1
+0
+1
+1
+1
+0
+0
+0
+1
+0
+1
+1
+0
+1
+0
+0
+1
+1
+1
+1
+1
+0
+1
+1
+0
+0
+1
+1
+1
+0
+0
+0
+0
+0
+1
+0
+0
+0
+0
+0
+0
+0
+1
+0
+0
+0
+0
+1
+0
+1
+1
+0
+1
+0
+0
+0
+0
+1
+0
+0
+1
+0
+1
+0
+1
+0
+1
+1
+0
+0
+0
+0
+1
+1
+1
+1
+0
+0
+1
+1
+0
+0
+1
+1
+0
+1
+0
+0
+1
+1
+1
+0
+0
+0
+0
+0
+1
+1
+1
+0
+0
+0
+1
+1
+1
+0
+0
+1
+1
+0
+1
+1
+1
+1
+1
+1
+1
+1
+1
+1
+1
+0
+1
+1
+0
+1
+1
+1
+1
+1
+0
+0
+1
+1
+0
+0
+1
+1
+0
+1
+0
+1
+0
+0
+1
+1
+0
+0
+0
+0
+1
+1
+0
+0
+1
+1
+1
+1
+1
+0
+0
+0
+0
+0
+0
+0
+0
+0
+0
+1
+0
+1
+1
+0
+1
+0
+1
+1
+1
+0
+0
+1
+0
+0
+1
+0
+1
+0
+1
+1
+1
+0
+1
+0
+0
+0
+0
+1
+1
+0
+0
+1
+0
+1
+0
+0
+1
+0
+1
+1
+1
+1
+1
+0
+0
+1
+1
+1
+1
+1
+1
+1
+0
+1
+0
+1
+0
+0
+1
+1
+1
+0
+1
+0
+0
+0
+1
+1
+1
+1
+1
+0
+1
+0
+1
+1
+1
+0
+1
+0
+0
+1
+0
+1
+0
+1
+1
+1
+1
+0
+0
+0
+1
+0
+0
+1
+1
+1
+0
+1
+1
+0
+0
+1
+1
+1
+0
+1
+1
+0
+1
+1
+0
+1
+1
+0
+1
+0
+0
+1
+1
+0
+0
+1
+0
+1
+0
+0
+1
+0
+1
+1
+1
+0
+0
+0
+1
+0
+1
+1
+1
+1
+0
+0
+1
+1
+1
+1
+1
+1
+1
+0
+1
+1
+1
+0
+0
+0
+1
+1
+0
+0
+1
+1
+1
+0
+0
+0
+0
+1
+0
+0
+1
+1
+1
+1
+1
+0
+1
+0
+0
+0
+0
+0
+0
+1
+0
+1
+1
+1
+0
+1
+0
+0
+0
+1
+1
+1
+1
+1
+1
+0
+1
+1
+1
+0
+1
+1
+1
+1
+1
+1
+1
+1
+0
+1
+0
+1
+0
+1
+0
+1
+1
+1
+0
+1
+0
+1
+1
+1
+1
+1
+1
+0
+0
+1
+0
+0
+0
+0
+0
+0
+1
+0
+1
+0
+1
+0
+1
+1
+0
+0
+1
+0
+0
+1
+0
+1
+0
+1
+1
+0
+0
+1
+0
+0
+0
+1
+1
+0
+1
+1
+0
+1
+1
+1
+0
+1
+0
+0
+1
+0
+0
+1
+1
+1
+1
+1
+1
+0
+0
+0
+0
+1
+0
+1
+0
+1
+0
+0
+0
+1
+1
+1
+1
+1
+1
+1
+1
+0
+0
+0
+0
+1
+0
+0
+0
+0
+0
+1
+0
+1
+0
+0
+1
+0
+1
+1
+0
+1
+1
+0
+1
+0
+0
+0
+0
+0
+1
+1
+0
+0
+1
+1
+1
+1
+0
+0
+0
+0
+1
+1
+0
+0
+1
+0
+0
+0
+0
+1
+1
+1
+0
+1
+1
+1
+0
+1
+1
+0
+0
+1
+1
+0
+1
+0
+0
+0
+1
+0
+0
+1
+1
+1
+0
+0
+0
+1
+1
+0
+1
+1
+0
+1
+1
+1
+1
+1
+0
+0
+0
+0
+0
+0
+0
+1
+1
+1
+0
+0
+1
+1
+1
+1
+0
+0
+1
+1
+0
+0
+1
+0
+1
+0
+1
+1
+1
+0
+0
+0
+0
+0
+1
+0
+0
+0
+1
+1
+0
+1
+0
+1
+0
+1
+1
+0
+1
+1
+1
+1
+0
+0
+1
+1
+0
+1
+1
+0
+1
+1
+0
+1
+0
+1
+0
+0
+1
+0
+1
+1
+0
+0
+0
+1
+0
+1
+1
+0
+1
+1
+0
+0
+0
+0
+1
+1
+1
+1
+1
+1
+1
+0
+1
+1
+1
+1
+1
+1
+1
+1
+0
+0
+1
+0
+1
+0
+0
+0
+0
+0
+0
+0
+0
+1
+0
+0
+1
+1
+0
+1
+1
+1
+1
+1
+0
+0
+1
+1
+0
+0
+1
+0
+0
+0
+0
+1
+0
+1
+1
+1
+0
+0
+1
+0
+0
+1
+0
+0
+0
+0
+1
+1
+1
+1
+1
+0
+1
+0
+0
+0
+1
+1
+1
+1
+0
+1
+1
+1
+0
+1
+1
+1
+0
+1
+1
+0
+1
+1
+0
+1
+0
+1
+1
+1
+1
+1
+1
+1
+1
+1
+1
+1
+1
+1
+0
+1
+1
+1
+0
+1
+1
+1
+1
+0
+1
+1
+0
+0
+0
+0
+1
+1
+1
+0
+0
+1
+1
+1
+1
+0
+1
+0
+1
+1
+1
+0
+0
+0
+1
+0
+1
+0
+1
+1
+0
+0
+1
+0
+1
+0
+1
+1
+1
+1
+1
+0
+1
+1
+1
+1
+0
+1
+0
+1
+1
+0
+1
+1
+1
+0
+1
+0
+1
+1
+1
+0
+1
+0
+1
+1
+1
+1
+1
+0
+1
+1
+1
+0
+1
+1
+1
+0
+1
+0
+0
+0
+0
+1
+0
+0
+1
+1
+0
+1
+0
+1
+0
+1
+0
+0
+1
+1
+1
+0
+1
+1
+1
+0
+1
+1
+1
+1
+0
+1
+0
+0
+1
+0
+1
+1
+1
+0
+1
+0
+0
+0
+0
+0
+0
+0
+0
+0
+0
+0
+0
+0
+0
+0
+0
+0
+0
+0
+0
+0
+0
+1
+0
+0
+1
+1
+1
+1
+0
+0
+1
+0
+0
+0
+0
+0
+0
+0
+0
+1
+1
+1
+1
+0
+1
+0
+0
+1
+1
+1
+0
+1
+0
+0
+0
+0
+1
+0
+0
+1
+0
+0
+0
+0
+0
+0
+1
+0
+1
+1
+1
+1
+1
+0
+1
+1
+1
+0
+0
+1
+1
+0
+1
+1
+1
+1
+1
+0
+1
+1
+1
+1
+1
+0
+0
+0
+1
+1
+0
+1
+1
+1
+1
+1
+1
+1
+0
+1
+1
+1
+0
+1
+1
+0
+1
+1
+1
+1
+0
+1
+1
+1
+0
+0
+1
+1
+0
+0
+0
+1
+1
+0
+1
+1
+1
+0
+1
+1
+0
+0
+0
+1
+1
+1
+1
+0
+0
+0
+1
+1
+0
+0
+1
+1
+1
+1
+1
+1
+0
+1
+1
+0
+0
+1
+0
+0
+0
+0
+0
+1
+0
+1
+0
+1
+0
+1
+1
+1
+1
+1
+1
+1
+1
+1
+0
+0
+0
+1
+1
+1
+1
+1
+1
+1
+0
+1
+0
+1
+1
+1
+0
+0
+1
+1
+1
+1
+1
+0
+1
+0
+1
+1
+0
+0
+0
+0
+0
+0
+1
+1
+1
+0
+0
+1
+1
+0
+0
+1
+1
+0
+1
+0
+0
+0
+0
+0
+1
+0
+1
+0
+0
+0
+0
+1
+1
+1
+1
+1
+0
+1
+0
+1
+0
+1
+1
+1
+0
+1
+1
+0
+1
+0
+0
+1
+0
+1
+1
+1
+0
+0
+0
+1
+1
+0
+1
+0
+1
+0
+1
+0
+1
+1
+0
+0
+0
+0
+0
+1
+0
+0
+1
+0
+1
+1
+0
+1
+1
+0
+1
+1
+1
+0
+1
+1
+1
+0
+1
+1
+0
+1
+0
+1
+1
+1
+1
+0
+0
+1
+1
+0
+1
+1
+0
+0
+1
+0
+0
+1
+1
+1
+1
+1
+0
+0
+1
+0
+1
+1
+0
+0
+1
+1
+1
+1
+1
+1
+1
+0
+0
+0
+1
+0
+1
+1
+1
+1
+0
+1
+1
+0
+1
+0
+1
+1
+0
+1
+1
+1
+1
+0
+0
+0
+1
+1
+1
+1
+1
+0
+1
+0
+1
+1
+1
+1
+0
+1
+0
+0
+0
+1
+0
+0
+0
+1
+0
+1
+0
+0
+0
+1
+1
+1
+0
+1
+1
+0
+1
+0
+1
+0
+0
+1
+1
+1
+1
+0
+1
+1
+0
+1
+0
+0
+1
+1
+1
+1
+0
+1
+1
+1
+0
+0
+0
+0
+1
+1
+1
+1
+0
+1
+0
+0
+0
+1
+0
+1
+1
+0
+0
+1
+1
+0
+0
+0
+1
+0
+1
+1
+1
+1
+1
+1
+1
+0
+1
+0
+0
+1
+1
+1
+0
+0
+0
+1
+0
+1
+0
+0
+0
+0
+1
+1
+0
+1
+0
+0
+1
+0
+0
+1
+1
+1
+0
+0
+0
+1
+0
+1
+1
+0
+1
+1
+0
+1
+0
+1
+1
+1
+0
+0
+1
+0
+1
+1
+1
+1
+1
+1
+0
+0
+1
+0
+1
+1
+1
+0
+1
+1
+0
+0
+0
+0
+0
+1
+1
+1
+0
+1
+0
+0
+0
+0
+0
+1
+0
+0
+0
+1
+1
+0
+0
+1
+0
+1
+1
+1
+1
+0
+0
+0
+1
+1
+1
+1
+1
+1
+0
+0
+1
+1
+0
+0
+0
+0
+0
+1
+0
+0
+0
+0
+1
+0
+0
+0
+0
+1
+1
+0
+1
+1
+0
+0
+1
+0
+1
+0
+0
+0
+0
+0
+1
+1
+1
+0
+0
+1
+0
+0
+0
+1
+0
+0
+0
+0
+1
+1
+0
+0
+1
+1
+1
+0
+0
+1
+0
+1
+0
+0
+1
+1
+0
+0
+0
+0
+1
+1
+0
+1
+1
+1
+0
+0
+0
+0
+0
+0
+1
+1
+1
+1
+1
+0
+1
+1
+1
+1
+1
+1
+0
+1
+1
+1
+0
+0
+1
+1
+0
+1
+1
+0
+1
+1
+1
+1
+0
+1
+1
+0
+0
+0
+0
+0
+0
+0
+0
+0
+0
+1
+0
+1
+0
+0
+0
+0
+0
+1
+0
+1
+0
+0
+1
+1
+1
+1
+1
+1
 0
 0
 0
+1
+1
+0
+1
+1
+0
+0
+0
+0
+1
+0
+1
+1
+1
+0
+0
+0
+1
+1
+1
+1
+1
+0
+0
+1
+1
+0
+0
+0
+0
+0
+0
+1
+1
+1
+1
+0
+0
+1
+1
+1
+1
+0
+1
+1
+0
+1
+1
+1
+1
+0
+1
+1
+1
+0
+1
+0
+1
+1
+1
+0
+0
+1
+1
+1
+0
+0
+0
+1
+1
+0
+0
+0
+0
+0
+1
+0
+0
+0
+0
+1
+0
+0
+1
+0
+1
+1
+1
+1
+1
+1
+0
+1
+0
+1
+0
+1
+1
+1
+1
+0
+1
+0
+1
 0
+1
 0
+1
+1
+1
 0
 0
 0
+1
 0
+1
+1
+1
+1
+1
 0
+1
+1
+1
+1
+1
+1
 0
+1
+1
+1
+1
 0
+1
 0
+1
+1
+1

ratio_proportion_change3_2223/sch_largest_100-coded/finetuning/overallTestData/test.txt

@@ -1,3 +0,0 @@
-version https://git-lfs.github.com/spec/v1
-oid sha256:e16cfaea0c20e82ae9a6267b68542a2bc569b757c0c6a3162312207b15cd66e3
-size 20628909

ratio_proportion_change3_2223/sch_largest_100-coded/finetuning/overallTestData/test_info.txt

@@ -1,3 +0,0 @@
-version https://git-lfs.github.com/spec/v1
-oid sha256:b9f25a40d85e36d9971bb645550a3a503316265630637c04ccc997b18a68b31b
-size 161328625

ratio_proportion_change3_2223/sch_largest_100-coded/finetuning/test.txt

@@ -1,3 +0,0 @@
-version https://git-lfs.github.com/spec/v1
-oid sha256:35569d6f81ef85e6353f36912c1cb79bfb723fe7d2476e10afcb745c170c5130
-size 24672844

ratio_proportion_change3_2223/sch_largest_100-coded/finetuning/test_info.txt

@@ -1,3 +0,0 @@
-version https://git-lfs.github.com/spec/v1
-oid sha256:a6aadba0002bfdfde835b8837b3ff36cd84c64c3e23b6589ec1d002b4b62c2f4
-size 122629427

ratio_proportion_change3_2223/sch_largest_100-coded/output/first10/bert_fine_tuned.model.first10%.wfaopttime.wttime.wttopttime.wttnoopttime.ep23

@@ -1,3 +0,0 @@
-version https://git-lfs.github.com/spec/v1
-oid sha256:2575410884e07a564e39c2777ba88896a56623a546db4b7901d793618a89cb8f
-size 68489814

ratio_proportion_change3_2223/sch_largest_100-coded/output/first10/bert_fine_tuned.model.first10%.wskills.ep24

@@ -1,3 +0,0 @@
-version https://git-lfs.github.com/spec/v1
-oid sha256:8af416689089c3c243d3abe58369a4725dbcfa446da951ccc49ed63961da9a1f
-size 68474774

ratio_proportion_change3_2223/sch_largest_100-coded/output/first10/bert_fine_tuned.model.first10%.wskills.wfaopttime.wttime.wttopttime.wttnoopttime.ep40

@@ -1,3 +0,0 @@
-version https://git-lfs.github.com/spec/v1
-oid sha256:02df4b9e62fc3ee0728ce0cf26b903958f3dca7a949d83c39b24d4d679f64cba
-size 68491670

ratio_proportion_change3_2223/sch_largest_100-coded/output/highGRschool10/bert_fine_tuned.model.ep42

@@ -1,3 +0,0 @@
-version https://git-lfs.github.com/spec/v1
-oid sha256:fe0a59447b0f642ee78b8b577471b08d823b6702db653674cbbae153d5b249c9
-size 7294550

ratio_proportion_change3_2223/sch_largest_100-coded/time_info/full_data_normalized_time.pkl

@@ -1,3 +0,0 @@
-version https://git-lfs.github.com/spec/v1
-oid sha256:197f28e0b0836572fd12eb3c9d13f9f8557b1fb39cd368a535f216caa3a37a75
-size 4660819

src/dataset.py

@@ -7,18 +7,208 @@ import random
 from .vocab import Vocab
 import pickle
 import copy
-import os
+# from sklearn.preprocessing import OneHotEncoder
 
+class PretrainerDataset(Dataset):
+    """
+        Class name: PretrainDataset
+        
+    """
+    def __init__(self, dataset_path, vocab, seq_len=30, max_mask=0.15):
+        self.dataset_path = dataset_path
+        self.vocab = vocab # Vocab object
+        
+        # Related to input dataset file
+        self.lines = []
+        self.index_documents = {}
+
+        seq_len_list = []
+        with open(self.dataset_path, "r") as reader:
+            i = 0
+            index = 0
+            self.index_documents[i] = []
+            for line in tqdm.tqdm(reader.readlines()):
+                if line:
+                    line = line.strip()
+                    if not line:
+                        i+=1
+                        self.index_documents[i] = []
+                    else:
+                        self.index_documents[i].append(index)
+                        self.lines.append(line.split("\t"))
+                        len_line = len(line.split("\t"))
+                        seq_len_list.append(len_line)
+                        index+=1
+            reader.close()
+        print("Sequence Stats: len: %s, min: %s, max: %s, average: %s"% (len(seq_len_list),
+              min(seq_len_list), max(seq_len_list), sum(seq_len_list)/len(seq_len_list)))
+        print("Unique Sequences: ", len({tuple(ll) for ll in self.lines}))
+        self.index_documents = {k:v for k,v in self.index_documents.items() if v}
+        print(len(self.index_documents))
+        self.seq_len = seq_len
+        print("Sequence length set at: ", self.seq_len)
+        self.max_mask = max_mask
+        print("% of input tokens selected for masking : ",self.max_mask)
+
+    
+    def __len__(self):
+        return len(self.lines)
+    
+    def __getitem__(self, item):
+        token_a = self.lines[item]
+        # sa_masked = None
+        # sa_masked_label = None
+        # token_b = None
+        # is_same_student = None
+        # sb_masked = None
+        # sb_masked_label = None
+        
+        # if self.select_next_seq:
+        #     is_same_student, token_b = self.get_token_b(item)
+        #     is_same_student = 1 if is_same_student else 0
+        #     token_a1, token_b1 = self.truncate_to_max_seq(token_a, token_b)
+        #     sa_masked, sa_masked_label = self.random_mask_seq(token_a1)
+        #     sb_masked, sb_masked_label = self.random_mask_seq(token_b1)
+        # else:
+        token_a = token_a[:self.seq_len-2]
+        sa_masked, sa_masked_label, sa_masked_pos = self.random_mask_seq(token_a)
+
+        s1 = ([self.vocab.vocab['[CLS]']] + sa_masked + [self.vocab.vocab['[SEP]']])
+        s1_label = ([self.vocab.vocab['[PAD]']] + sa_masked_label + [self.vocab.vocab['[PAD]']])
+        segment_label = [1 for _ in range(len(s1))]
+        masked_pos = ([0] + sa_masked_pos + [0])
+        
+        # if self.select_next_seq:
+        #     s1 = s1 + sb_masked + [self.vocab.vocab['[SEP]']]
+        #     s1_label = s1_label + sb_masked_label + [self.vocab.vocab['[PAD]']]
+        #     segment_label = segment_label + [2 for _ in range(len(sb_masked)+1)]
+        
+        padding = [self.vocab.vocab['[PAD]'] for _ in range(self.seq_len - len(s1))]
+        s1.extend(padding)
+        s1_label.extend(padding)
+        segment_label.extend(padding)
+        masked_pos.extend(padding)
+ 
+        output = {'bert_input': s1,
+                 'bert_label': s1_label,
+                 'segment_label': segment_label,
+                 'masked_pos': masked_pos}
+        # print(f"tokenA: {token_a}")
+        # print(f"output: {output}")
+        
+        # if self.select_next_seq:
+        #     output['is_same_student'] = is_same_student
+        
+        # print(item, len(s1), len(s1_label), len(segment_label))
+        # print(f"{item}.")
+        return {key: torch.tensor(value) for key, value in output.items()}
+    
+    def random_mask_seq(self, tokens):
+        """
+        Input: original token seq
+        Output: masked token seq, output label
+        """
+        
+        masked_pos = []
+        output_labels = []
+        output_tokens = copy.deepcopy(tokens)
+        opt_step = False
+        for i, token in enumerate(tokens):
+            if token in ['OptionalTask_1', 'EquationAnswer', 'NumeratorFactor', 'DenominatorFactor', 'OptionalTask_2', 'FirstRow1:1', 'FirstRow1:2', 'FirstRow2:1', 'FirstRow2:2', 'SecondRow', 'ThirdRow']:
+                opt_step = True
+            # if opt_step:
+            #     prob = random.random()
+            #     if prob < self.max_mask:
+            #         output_tokens[i] = random.choice([3,7,8,9,11,12,13,14,15,16,22,23,24,25,26,27,30,31,32])
+            #         masked_pos.append(1)
+            #     else:
+            #         output_tokens[i] = self.vocab.vocab.get(token, self.vocab.vocab['[UNK]'])
+            #         masked_pos.append(0)
+            #     output_labels.append(self.vocab.vocab.get(token, self.vocab.vocab['[UNK]']))
+            #     opt_step = False
+            # else:    
+            prob = random.random()
+            if prob < self.max_mask:
+             # chooses 15% of token positions at random
+                # prob /= 0.15
+                prob = random.random()
+                if prob < 0.8: #[MASK] token 80% of the time
+                    output_tokens[i] = self.vocab.vocab['[MASK]']
+                    masked_pos.append(1)
+                elif prob < 0.9: # a random token 10% of the time 
+                    # print(".......0.8-0.9......")
+                    if opt_step:
+                        output_tokens[i] = random.choice([7,8,9,11,12,13,14,15,16,22,23,24,25,26,27,30,31,32])
+                        opt_step = False
+                    else:
+                        output_tokens[i] = random.randint(1, len(self.vocab.vocab)-1)
+                    masked_pos.append(1)
+                else: # the unchanged i-th token 10% of the time
+                    # print(".......unchanged......")
+                    output_tokens[i] = self.vocab.vocab.get(token, self.vocab.vocab['[UNK]'])
+                    masked_pos.append(0)
+                # True Label
+                output_labels.append(self.vocab.vocab.get(token, self.vocab.vocab['[UNK]']))
+                # masked_pos_label[i] = self.vocab.vocab.get(token, self.vocab.vocab['[UNK]'])
+            else:
+                # i-th token with original value
+                output_tokens[i] = self.vocab.vocab.get(token, self.vocab.vocab['[UNK]'])
+                # Padded label
+                output_labels.append(self.vocab.vocab['[PAD]'])
+                masked_pos.append(0)
+        # label_position = []
+        # label_tokens = []
+        # for k, v in masked_pos_label.items():
+        #     label_position.append(k)
+        #     label_tokens.append(v)
+        return  output_tokens, output_labels, masked_pos
+    
+#     def get_token_b(self, item):
+#         document_id = [k for k,v in self.index_documents.items() if item in v][0]
+#         random_document_id = document_id
+        
+#         if random.random() < 0.5:
+#             document_ids = [k for k in self.index_documents.keys() if k != document_id]
+#             random_document_id = random.choice(document_ids) 
+
+#         same_student = (random_document_id == document_id)
+        
+#         nex_seq_list = self.index_documents.get(random_document_id)
+
+#         if same_student:
+#             if len(nex_seq_list) != 1:
+#                 nex_seq_list = [v for v in nex_seq_list if v !=item]
+
+#         next_seq = random.choice(nex_seq_list)
+#         tokens = self.lines[next_seq]
+#         # print(f"item = {item}, tokens: {tokens}")
+#         # print(f"item={item}, next={next_seq}, same_student = {same_student}, {document_id} == {random_document_id}, b. {tokens}")
+#         return same_student, tokens
+
+#     def truncate_to_max_seq(self, s1, s2):
+#         sa = copy.deepcopy(s1)
+#         sb = copy.deepcopy(s1)
+#         total_allowed_seq = self.seq_len - 3
+        
+#         while((len(sa)+len(sb)) > total_allowed_seq):
+#             if random.random() < 0.5:
+#                 sa.pop()
+#             else:
+#                 sb.pop()
+#         return sa, sb
+            
+                
 class TokenizerDataset(Dataset):
     """
         Class name: TokenizerDataset
         Tokenize the data in the dataset
-        Feat length: 17 
+        
     """
     def __init__(self, dataset_path, label_path, vocab, seq_len=30):
         self.dataset_path = dataset_path
         self.label_path = label_path
         self.vocab = vocab # Vocab object
+        # self.encoder = OneHotEncoder(sparse=False)
         
         # Related to input dataset file
         self.lines = []
@@ -52,14 +242,39 @@ class TokenizerDataset(Dataset):
                         feat2 = [float(i) for i in line.split(",")[-2].split("\t")]
                         feat_vec.extend(feat2[1:])
                         
+                        # # highGRschool_w_prior_w_p_diffskill_wo_fa
+                        # feat_vec = [float(i) for i in line.split(",")[-3].split("\t")]
+                        # feat2 = [-float(i) for i in line.split(",")[-2].split("\t")]
+                        # feat_vec.extend(feat2[1:])
+                        
+#                         # highGRschool_w_prior_w_diffskill_0fa_skill
+#                         feat_vec = [float(i) for i in line.split(",")[-3].split("\t")]
+#                         feat2 = [float(i) for i in line.split(",")[-2].split("\t")]
+#                         fa_feat_vec = [float(i) for i in line.split(",")[-1].split("\t")]
+                        
+#                         diff_skill = [f2 if f1==0 else 0 for f2, f1 in zip(feat2, fa_feat_vec)]
+#                         feat_vec.extend(diff_skill)
+                         
                         if j == 0:
                             print(len(feat_vec))
                             j+=1
-                    
+                        
+                        # feat_vec.extend(feat2[1:])
+                        # feat_vec.extend(feat2)
+                        # feat_vec = [float(i) for i in line.split(",")[-2].split("\t")]
+                        # feat_vec = feat_vec[1:]
+                        # feat_vec = [float(line.split(",")[-1])]
+                        # feat_vec = [float(i) for i in line.split(",")[-1].split("\t")]
+                        # feat_vec = [ft-f1 for ft, f1 in zip(feat_vec, fa_feat_vec)]
+
                         self.feats.append(feat_vec)
                 dataset_info_file.close()
             except Exception as e:
                 print(e)
+            # labeler = np.array([0, 1]) #np.unique(self.labels)
+            # print(f"Labeler {labeler}")
+            # self.encoder.fit(labeler.reshape(-1,1))
+            # self.labels = self.encoder.transform(np.array(self.labels).reshape(-1,1))
 
         self.file = open(self.dataset_path, "r")
         for line in self.file:
@@ -102,315 +317,95 @@ class TokenizerDataset(Dataset):
                  'segment_label': segment_label}
         return {key: torch.tensor(value) for key, value in output.items()}
         
-class TokenizerwSkillsDataset(Dataset):
-    """
-        Feature length: 17
-
-    """
-    def __init__(self, dataset_path, label_path, vocab, seq_len=30):
-        print(f"dataset_path: {dataset_path}")
-        print(f"label_path: {label_path}")
-
-        self.dataset_path = dataset_path
-        self.label_path = label_path
-        self.vocab = vocab # Vocab object
-        self.seq_len = seq_len
-
-        # Related to input dataset file
-        self.lines = []
-        self.labels = []
-        self.feats = []
-        selected_lines = []
-
-        print("TokenizerwSkillsDataset...............................")
-
-        if self.label_path:
-            # Comment this section if you are not using feat attribute
-            dataset_info_file = open(self.label_path.replace("label", "info"), "r").readlines()
-            print(">>>>>>>>>>>>>>>>>", len(dataset_info_file))
-            j = 0
-            for idex, line in enumerate(dataset_info_file):
-                try:
-                    if line:
-                        line = line.strip()
-                        if not line:
-                            continue
-
-                        feat_vec = [float(i) for i in line.split(",")[-9].split("\t")]
-                        feat2 = [float(i) for i in line.split(",")[-8].split("\t")]
-                        feat_vec.extend(feat2[1:])
-
-                        if j == 0:
-                            print(";;;;", len(feat_vec), feat_vec)
-                            j+=1
-                        self.feats.append(feat_vec)
-                        selected_lines.append(idex)
-                except Exception as e:
-                    print("................>")
-                    print(e)
-                    print("Error at index: ", idex)
-
-            self.label_file = open(self.label_path, "r")
-            for idex, line in enumerate(self.label_file):
-                if line:
-                    line = line.strip()
-                    if not line:
-                        continue
-                    if idex in selected_lines:
-                        self.labels.append(int(line))
-                    # self.labels.append(int(line))
-            self.label_file.close()
-
-        self.file = open(self.dataset_path, "r")
-        for idex, line in enumerate(self.file):
-            if line:
-                line = line.strip()
-                if line:
-                    if idex in selected_lines:
-                        self.lines.append(line)
-                    # self.lines.append(line)
-        self.file.close()
-        self.len = len(self.lines)
-        print("Sequence length set at ", self.seq_len, len(self.lines), len(self.labels) if self.label_path else 0)
-
-    def __len__(self):
-        return self.len
-
-    def __getitem__(self, item):
-        org_line = self.lines[item].split("\t")
-        dup_line = []
-        opt = False
-        for l in org_line:
-            if l in ["OptionalTask_1", "EquationAnswer", "NumeratorFactor", "DenominatorFactor", "OptionalTask_2", "FirstRow1:1", "FirstRow1:2", "FirstRow2:1", "FirstRow2:2", "SecondRow", "ThirdRow"]:
-                opt = True
-            if opt and 'FinalAnswer-' in l:
-                dup_line.append('[UNK]')
-            else:
-                dup_line.append(l)
-        dup_line = "\t".join(dup_line)
-        # print(dup_line)
-        s1 = self.vocab.to_seq(dup_line, self.seq_len) # This is like tokenizer and adds [CLS] and [SEP].
-        s1_label = self.labels[item] if self.label_path else 0
-        segment_label = [1 for _ in range(len(s1))]
-        s1_feat = self.feats[item] if len(self.feats)>0 else 0
-        padding = [self.vocab.vocab['[PAD]'] for _ in range(self.seq_len - len(s1))]
-        s1.extend(padding), segment_label.extend(padding)
-        # print(s1_feat)
-
-        output = {'input': s1,
-                 'label': s1_label,
-                  'feat': s1_feat,
-                 'segment_label': segment_label}
-        return {key: torch.tensor(value) for key, value in output.items()}
-
-
-class TokenizerwTimeDataset(Dataset):
+        
+class TokenizerDatasetForCalibration(Dataset):
     """
-        Feature length: 4
-
+        Class name: TokenizerDataset
+        Tokenize the data in the dataset
+        
     """
     def __init__(self, dataset_path, label_path, vocab, seq_len=30):
-        print(f"dataset_path: {dataset_path}")
-        print(f"label_path: {label_path}")
-
         self.dataset_path = dataset_path
         self.label_path = label_path
         self.vocab = vocab # Vocab object
-        self.seq_len = seq_len
-
+        # self.encoder = OneHotEncoder(sparse=False)
+        
         # Related to input dataset file
         self.lines = []
         self.labels = []
         self.feats = []
-        selected_lines = []
-
-        print("TokenizerwTimeDataset...............................")
-        time_df = pickle.load(open("ratio_proportion_change3_2223/sch_largest_100-coded/time_info/full_data_normalized_time.pkl", "rb"))
-        print("time: ?? ", time_df.shape)
-
         if self.label_path:
-            # Comment this section if you are not using feat attribute
-            dataset_info_file = open(self.label_path.replace("label", "info"), "r").readlines()
-            print(">>>>>>>>>>>>>>>>>", len(dataset_info_file))
-            j = 0
-            for idex, line in enumerate(dataset_info_file):
-                try:
-                    if line:
-                        line = line.strip()
-                        if not line:
-                            continue
-
-                        feat_vec = []
-
-                        sch = line.split(",")[0]
-                        stu = line.split(",")[2]
-                        progress = line.split(",")[3]
-                        prob_id = line.split(",")[4]
-
-                        total_time = time_df.loc[(sch, stu, progress, prob_id)]['total_time'].item()
-                        faopt_time = time_df.loc[(sch, stu, progress, prob_id)]['faopt_time'].item()
-                        opt_time = time_df.loc[(sch, stu, progress, prob_id)]['opt_time'].item()
-                        nonopt_time = time_df.loc[(sch, stu, progress, prob_id)]['nonopt_time'].item()
-
-                        feat_vec.append(faopt_time)
-                        feat_vec.append(total_time)
-                        feat_vec.append(opt_time)
-                        feat_vec.append(nonopt_time)
-
-                        if j == 0:
-                            print(";;;;", len(feat_vec), feat_vec)
-                            j+=1
-                        self.feats.append(feat_vec)
-                        selected_lines.append(idex)
-                except Exception as e:
-                    print("................>")
-                    print(e)
-                    print("Error at index: ", idex)
-
             self.label_file = open(self.label_path, "r")
-            for idex, line in enumerate(self.label_file):
+            for line in self.label_file:
                 if line:
                     line = line.strip()
                     if not line:
                         continue
-                    if idex in selected_lines:
-                        self.labels.append(int(line))
-                    # self.labels.append(int(line))
+                    self.labels.append(int(line))
             self.label_file.close()
-
-        self.file = open(self.dataset_path, "r")
-        for idex, line in enumerate(self.file):
-            if line:
-                line = line.strip()
-                if line:
-                    if idex in selected_lines:
-                        self.lines.append(line)
-                    # self.lines.append(line)
-        self.file.close()
-        self.len = len(self.lines)
-        print("Sequence length set at ", self.seq_len, len(self.lines), len(self.labels) if self.label_path else 0)
-
-    def __len__(self):
-        return self.len
-
-    def __getitem__(self, item):
-        org_line = self.lines[item].split("\t")
-        dup_line = []
-        opt = False
-        for l in org_line:
-            if l in ["OptionalTask_1", "EquationAnswer", "NumeratorFactor", "DenominatorFactor", "OptionalTask_2", "FirstRow1:1", "FirstRow1:2", "FirstRow2:1", "FirstRow2:2", "SecondRow", "ThirdRow"]:
-                opt = True
-            if opt and 'FinalAnswer-' in l:
-                dup_line.append('[UNK]')
-            else:
-                dup_line.append(l)
-        dup_line = "\t".join(dup_line)
-        # print(dup_line)
-        s1 = self.vocab.to_seq(dup_line, self.seq_len) # This is like tokenizer and adds [CLS] and [SEP].
-        s1_label = self.labels[item] if self.label_path else 0
-        segment_label = [1 for _ in range(len(s1))]
-        s1_feat = self.feats[item] if len(self.feats)>0 else 0
-        padding = [self.vocab.vocab['[PAD]'] for _ in range(self.seq_len - len(s1))]
-        s1.extend(padding), segment_label.extend(padding)
-        # print(s1_feat)
-
-        output = {'input': s1,
-                 'label': s1_label,
-                  'feat': s1_feat,
-                 'segment_label': segment_label}
-        return {key: torch.tensor(value) for key, value in output.items()}
-        
-class TokenizerwSkillsTimeDataset(Dataset):
-    """
-        Feature length: 17+4 = 21
-
-    """
-    def __init__(self, dataset_path, label_path, vocab, seq_len=30):
-        print(f"dataset_path: {dataset_path}")
-        print(f"label_path: {label_path}")
-
-        self.dataset_path = dataset_path
-        self.label_path = label_path
-        self.vocab = vocab # Vocab object
-        self.seq_len = seq_len
-
-        # Related to input dataset file
-        self.lines = []
-        self.labels = []
-        self.feats = []
-        selected_lines = []
-
-        print("TokenizerwSkillsTimeDataset...............................")
-        time_df = pickle.load(open("ratio_proportion_change3_2223/sch_largest_100-coded/time_info/full_data_normalized_time.pkl", "rb"))
-        print("time: ", time_df.shape)
-
-        if self.label_path:
+            
             # Comment this section if you are not using feat attribute
-            dataset_info_file = open(self.label_path.replace("label", "info"), "r").readlines()
-            print(">>>>>>>>>>>>>>>>>", len(dataset_info_file))
-            j = 0
-            for idex, line in enumerate(dataset_info_file):
-                try:
+            try:
+                j = 0
+                dataset_info_file = open(self.label_path.replace("label", "info"), "r")
+                for line in dataset_info_file:
                     if line:
                         line = line.strip()
                         if not line:
                             continue
-
-                        feat_vec = [float(i) for i in line.split(",")[-9].split("\t")]
-                        feat2 = [float(i) for i in line.split(",")[-8].split("\t")]
+                      
+                        # # highGRschool_w_prior
+                        # feat_vec = [float(i) for i in line.split(",")[-3].split("\t")]
+                        
+                        # highGRschool_w_prior_w_diffskill_wo_fa
+                        feat_vec = [float(i) for i in line.split(",")[-3].split("\t")]
+                        feat2 = [float(i) for i in line.split(",")[-2].split("\t")]
                         feat_vec.extend(feat2[1:])
-
-                        sch = line.split(",")[0]
-                        stu = line.split(",")[2]
-                        progress = line.split(",")[3]
-                        prob_id = line.split(",")[4]
-
-                        total_time = time_df.loc[(sch, stu, progress, prob_id)]['total_time'].item()
-                        faopt_time = time_df.loc[(sch, stu, progress, prob_id)]['faopt_time'].item()
-                        opt_time = time_df.loc[(sch, stu, progress, prob_id)]['opt_time'].item()
-                        nonopt_time = time_df.loc[(sch, stu, progress, prob_id)]['nonopt_time'].item()
-
-                        feat_vec.append(faopt_time)
-                        feat_vec.append(total_time)
-                        feat_vec.append(opt_time)
-                        feat_vec.append(nonopt_time)
-
+                        
+#                         # highGRschool_w_prior_w_diffskill_0fa_skill
+#                         feat_vec = [float(i) for i in line.split(",")[-3].split("\t")]
+#                         feat2 = [float(i) for i in line.split(",")[-2].split("\t")]
+#                         fa_feat_vec = [float(i) for i in line.split(",")[-1].split("\t")]
+                        
+#                         diff_skill = [f2 if f1==0 else 0 for f2, f1 in zip(feat2, fa_feat_vec)]
+#                         feat_vec.extend(diff_skill)
+                         
                         if j == 0:
-                            print(";;;;", len(feat_vec), feat_vec)
+                            print(len(feat_vec))
                             j+=1
-                        self.feats.append(feat_vec)
-                        selected_lines.append(idex)
-                except Exception as e:
-                    print("................>")
-                    print(e)
-                    print("Error at index: ", idex)
+                        
+                        # feat_vec.extend(feat2[1:])
+                        # feat_vec.extend(feat2)
+                        # feat_vec = [float(i) for i in line.split(",")[-2].split("\t")]
+                        # feat_vec = feat_vec[1:]
+                        # feat_vec = [float(line.split(",")[-1])]
+                        # feat_vec = [float(i) for i in line.split(",")[-1].split("\t")]
+                        # feat_vec = [ft-f1 for ft, f1 in zip(feat_vec, fa_feat_vec)]
 
-            self.label_file = open(self.label_path, "r")
-            for idex, line in enumerate(self.label_file):
-                if line:
-                    line = line.strip()
-                    if not line:
-                        continue
-                    if idex in selected_lines:
-                        self.labels.append(int(line))
-                    # self.labels.append(int(line))
-            self.label_file.close()
+                        self.feats.append(feat_vec)
+                dataset_info_file.close()
+            except Exception as e:
+                print(e)
+            # labeler = np.array([0, 1]) #np.unique(self.labels)
+            # print(f"Labeler {labeler}")
+            # self.encoder.fit(labeler.reshape(-1,1))
+            # self.labels = self.encoder.transform(np.array(self.labels).reshape(-1,1))
 
         self.file = open(self.dataset_path, "r")
-        for idex, line in enumerate(self.file):
+        for line in self.file:
             if line:
                 line = line.strip()
                 if line:
-                    if idex in selected_lines:
-                        self.lines.append(line)
-                    # self.lines.append(line)
-        self.file.close()
+                    self.lines.append(line)
+        self.file.close()             
+        
         self.len = len(self.lines)
+        self.seq_len = seq_len
         print("Sequence length set at ", self.seq_len, len(self.lines), len(self.labels) if self.label_path else 0)
-
+        
     def __len__(self):
         return self.len
-
+    
     def __getitem__(self, item):
         org_line = self.lines[item].split("\t")
         dup_line = []
@@ -418,7 +413,7 @@ class TokenizerwSkillsTimeDataset(Dataset):
         for l in org_line:
             if l in ["OptionalTask_1", "EquationAnswer", "NumeratorFactor", "DenominatorFactor", "OptionalTask_2", "FirstRow1:1", "FirstRow1:2", "FirstRow2:1", "FirstRow2:2", "SecondRow", "ThirdRow"]:
                 opt = True
-            if opt and 'FinalAnswer-' in l:
+            if opt and 'FinalAnswer-' in l: 
                 dup_line.append('[UNK]')
             else:
                 dup_line.append(l)
@@ -430,10 +425,35 @@ class TokenizerwSkillsTimeDataset(Dataset):
         s1_feat = self.feats[item] if len(self.feats)>0 else 0
         padding = [self.vocab.vocab['[PAD]'] for _ in range(self.seq_len - len(s1))]
         s1.extend(padding), segment_label.extend(padding)
-        # print(s1_feat)
-
+        
         output = {'input': s1,
                  'label': s1_label,
                   'feat': s1_feat,
                  'segment_label': segment_label}
-        return {key: torch.tensor(value) for key, value in output.items()}
+        return ({key: torch.tensor(value) for key, value in output.items()}, s1_label)
+        
+        
+        
+        # if __name__ == "__main__":
+#     # import pickle
+#     # k = pickle.load(open("dataset/CL4999_1920/unique_steps_list.pkl","rb"))
+#     # print(k)
+#     vocab_obj = Vocab("pretraining/vocab.txt")
+#     vocab_obj.load_vocab()
+#     datasetTrain = PretrainerDataset("pretraining/pretrain.txt", vocab_obj)
+    
+#     print(datasetTrain, len(datasetTrain))#, datasetTrain.documents_index)
+#     print(datasetTrain[len(datasetTrain)-1])
+#     for i, d in enumerate(datasetTrain):
+#         print(d.items())
+#         break
+        
+#     fine_tune = TokenizerDataset("finetuning/finetune.txt", "finetuning/finetune_label.txt", vocab_obj)
+#     print(fine_tune)
+#     print(fine_tune[len(fine_tune)-1])
+#     print(fine_tune[random.randint(0, len(fine_tune))])
+#     for i, d in enumerate(fine_tune):
+#         print(d.items())
+#         break
+        
+