Noll blir sett på som en del av Sid Gillmans trenertre. Han beskrev senere Gilmman som "one of the game's prime researchers and offensive specialists. In six years, I had more exposure to football than I normally would have received in 12 years." I Nolls seks år med Chargers var han defensive line coach, defensive backfield coach og defensive coordinator. Laget nådde fem AFL Championships i perioden. Gillman sa at Noll "had a great way with players," spesifikt "If a guy didn't do the job expected, Chuck could climb on his back."} Defensive tackle Ernie Ladd sa at Noll var en "fiery guy", men også at han var"the best teacher I ever played under." "He and I were always fighting, always squabbling, but he had a great way of teaching. I take my hat off to Chuck. He was one of the main reasons for our success."} Forsvarsrekken under Noll ble kjent som "Fearsome Foursome", og i 1961 ble defensive end Earl Faison utpekt til AFL Rookie of the Year.