Brown was named one of the Wisden Cricketers of the Year in 1933, but his career declined thereafter until he was made captain of Northamptonshire and England in 1949. Brown was an England selector from 1951 to 1953 and Chairman of Selectors in 1953 when England regained the Ashes. Subsequently, he was involved in cricket administration including tour management. He was elected President of Marylebone Cricket Club (MCC) in 1971–72 and Chairman of the Cricket Council in 1977. He was awarded the MBE in 1942 for his gallantry in the evacuation of the British Army from Crete and the CBE in 1980 for services to cricket.