Revamp dummy cert generation.

We no longer use on-disk storage - we just keep the certs in memory.