In my opinion, There isn’t a best time, though milk does contain tryptophan, which can help promote sleep if you have it in the evening.  However, if you are lactose intolerant or have a milk allergy, it's best to avoid drinking milk altogether.