Use actual remote fingerprint rather than cached one

fixes #1546