Greetings can be late, however, so it makes much more sense to say late happy birthday, which is why belated happy birthday is the correct formulation. When you write the greeting correctly, belated modifies the phrase happy birthday. When you write it incorrectly, happy modifies the phrase belated birthday.