A decade later , the brothers became estranged when Bryan quietly quit the Republican Party -- because of opposition to the Bush administration -- in the middle of Steve 's losing primary campaign for New Jersey governor .