Yes, you can permanently stop syncing with OneDrive by unlinking your account from the service. You can do this by going to the Account tab in the Settings of the OneDrive app and clicking on the Unlink account button.