Carlson's show regularly drew better than 3 million viewers nightly, often ranking as the most watched primetime show on cable.