code separated into compilation and cleanup. cleanup still a work in progress. need to convert most of the char fields to numeric using lookup tables. final data size still more than 5 MB