Build in build directory, not source directory.

Also, don't kill the object directory if it's the source directory.