He was later removed from the case after an appeals court ruled that the powers he had been granted were broader than those allowed by the rules governing special masters , and he was asked instead to file a brief as a " friend of the court . "