Remove all binaries to see if we really recompile