Turn on logging from jsch to see if it helps tracking down some intermittent test failures.
Use a KeyPairProvider in SFTPServer that provides a valid, on the spot generated key pair.