Baseline HarvardX-Tools
Modify to support all EdX Data formats

Supports EdX Old Cumulative (static prod servers), Old modified
cumulative (virtual private cloud dynamic servers) and daily new log
formats (No dynamic server directory structure)
Modify moveRawLogs to support new AllLogs format
Set course name to unknown (if host/date unk)

Fix to prevent course name from being added to dictionary until all
relevant fields are valid. Instead, add to Unknown log file
Update processLogData script, class output update

remove unneeded steps in processLogData script (due to going to Daily
format), include directory name in class output
Added org_id to raw log filename

To maintain consistency with legacy file format, add org_id to filename
format (i.e.: 2014-08-20_HarvardX.log). Added known_host_names and
known_org_ids for checking valid hosts and schools for use in directory
names, respectively.
Allow optional start and end dates for processing

If start and end date are specified, then script will log for log files
>= start date and log files <= end date (inclusive). If none specified,
process all log files it finds
Do not process all logs if start/end wrong format

Fixed bug where all logs are processed if start date are in proper date
format (i.e: YYYY-MM-DD)
Extract delta times from log file

Script needed to extract the delta events from a given log file using a
list of time hacks as the deltas
Check time ordered log file

Script to check time ordered events for a given log file. testTime is a
shell script to check the logs of a given directory. Console print is
the output
Update processLogData to take start date/end date

Optionally take start date/end date (inclusive) for processing Log
files. Then automatically create the weekly logs files
Clarify notes in processLogData

Clarify output of the script in processLogData
Code cleanup and test verification scripts

Update code base with latest test scripts for comparing Legacy vs.
Daily Log event logs. Test scripts compare time hacks within 2 log
files, and also generates a delta log file containing the delta time
hacks. Also performed code cleanup in separateClassLogs.
Merge latest changes from remote Github repository
Update killList

Added ‘1-Test’
Update notes for delta time event script

Remove from “checkData” dir and add to “logs” directory, since this is
more appropriate, as it deals with generating a new delta log from a
list of specified time hacks