The referee is part of the field. A ball that hits the ref plays on as if nothing happened. If it hits the ref and then bounces into the goal it counts as a goal. So if you are reffing be sure not to place yourself in a position so that a goal is scored from a rebound off of you. Move around the perimeter of the play.
Nothing looks as bad as a referee who tries to call the whole game from the center circle.
The league is paying you to be in the correct position to make the call and that position should be no more than ten feet from where the ball is in U6 or U8 and no more than 20 feet in U10. Smile and be helpful. Do not intimidate the players. Do not yell at the players or coaches. If confronted by an upset coach move away from the coach and call the game from the opposite side of the field.