Raise FileDoesNotExistError when we can't write
Fully expand KeysFile path
Don't leave blank lines when deleting keys