How keystone is suppose to work behind the balancer when there is different certs on each of them with cn set to their fqdn?
This is issue of ssl support in keystone and should be fixed when someone will prepare keystone to work on HA, and not LB or swift issue.