Simplify build process

@cap @stephentu 
It might be nice if RelWithDebInfo had at least `-g`, and maybe even `-fno-omit-frame-pointer`. These both make debugging much easier