In many ways it is more challenging than photographing the Dodgers or the A's. At a major league park I can't roam around. I even make a dollar or two at it from time to time. So, if you like sports, figure out how to shoot it. Your challenge is no different now than fifty years ago.
Sports photography is as well.
We have all seen the photographer nailed by the linebacker or running back who doesn't stop on the sideline. As for wildlife photographers, some get killed by bears. Others get rift valley fever, etc. In the office I have gotten paper cuts-dangerous stuff here. All in all, if you want to take photos, you will.