[SPARK-3286] - Cannot view ApplicationMaster UI when Yarn’s url scheme i...

...s https
I'll defer to @tgravescs on Hadoop branch trivia; I see the point of having different logic for stable and alpha, although I'm ok with the current approach too.