Method to delete a file

As a user who just accidentally uploaded a file with an incorrect name, I'd really like to be able to delete it.
Struggling to justify this to myself as well. It's probably not necessary especially as we have metrics and logging for this kind of information. Will drop in a different PR unless @peterbourgon has convincing arguments.