I suppose we cannot depend on paramiko and extend their logic rather than copy/pasting/modifying