Properly kill the provider process