Budgeting is the most important aspect to consider when traveling to New York City to avoid overspending.