Question: what is considered the late afternoon?
Answer: The terms late or early or mid apply to all times in the day. So Late Afternoon or evening is correct. Evening starts from 5 pm. But remember that late afternoon is also used to represent early evening.