Remove now takes ownership into consideration

Also, remove always uses hash.
Always remove file from local storage.