The umpire's role in baseball mainly revolves around making split-second decisions. Just by itself alone, the fast-paced game can be difficult to manage.
There is no single toughest call all umpires are subject to. However, close-call situations can be tricky, no matter the situation.