Economic downturns, travel disruptions, and competition from alternative accommodations can all negatively impact hotel stocks.