English is widely spoken throughout Israel, and even more so in Jerusalem (and Tel Aviv as well). Hebrew is the principal language in West Jerusalem, while Arabic is commonly spoken in East Jerusalem, the Palestinian side of town.
English is particularly common in the Old City. Even if the only Hebrew word you know is “shalom,” you’ll get along just fine.