Drop prompt lines from config, discard changes on exit