Cleaning up build organization

Ideally it would probably want to use dub, long-term, but this should at least make the current build system a little nicer