Fix public key default leaking in tests.

again >:(