Use ssh_agent when pub+priv key are None, not based on the class