Only delete existing tmp key stores (bug 986641)

Maybe one of these named temp files is getting deleted on close()?