[#51136581] Use HTTPS for all URLs

In preparation for turning off HTTP on backend-lb. I don't think there's a
good reason for inconsistent HTTP and HTTPS URLs in this file.

/cc @JordanHatch @alext