Added code to support processing multiple directories:
    - added multiple checks to make sure the entire data can be parsed
Removed all lms files from the data directory:
   - also added comments on how to process data