before high performance
adding new .py
before selecting whole partitions
iterators for modularity
optimized with use of sets and removing unnecessary dict lookups
dedicated data dir