Reduce memory footprint in Travis
Don't fork compiler

This speeds up compiling by ~25% and helps prevent Travis from running
out of memory