Question: is it grammatically correct to say yesterday night?
Answer: You should say last night OR last evening according to the time you are referring. You cannot say yesterday night because the night is also part of today. You can, however use both last evening or yesterday evening, because the evening is part of yesterday, as would be yesterday morning and yesterday afternoon.