GlassFish requires certificates and keys to be in PEM encoded format. The private key should also be in unencrypted PKCS#8 format.