reorg methods; add abstract methods
compress test indices
Mirror: refresh_index implemented
add todo notes
refactor path generation and add HackPack code