Embedded JWK keys are public keys, not private

https://tools.ietf.org/html/draft-ietf-jose-json-web-signature-36#section-4.1.3
says:

 The "jwk" (JSON Web Key) Header Parameter is the _public key_ ...

(emphasis mine)

It wouldn't make sense to attach the private key in the header of
a JWS.