Don't leave read only dir around, fails clean