To mitigate the bitterness in beer cheese soup, use a low hops beer like a light ale or lager. A hoppy beer (like an IPA) can make the soup taste bitter.