That's what I thought too, but indeed it does not.  storage.delete() has to be run to physically remove the picture file.  Just double-check verified.