Actually removing binaries