Also create Java KeyStores for certificate authority key pair