This doesn't recursively remove any subdirectories. Not sure if that'll cause errors.