While some might suggest Arabic or Cantonese, I would suggest that Hungarian (or Magyar, as the natives sometimes refer to it) is hands-down the most difficult language for an English speaker to learn.