Desired functionality is implemented at the lowest level, instead of
polishing will move to command line in order to run quickly on large
data