Not having secondary sexual characters amounts to deficiency of sex hormones and a condition called as hypogonadism. Sometimes facial hair may not be developed but other changes like pubic hair, penile size, erectile function might be normal and then it may not be hypogonadism. What your brothers needs is a good clinical examination from a physician/endocrinologist to know the status.