Early mornings and late afternoons are perfect to avoid the heat and larger crowds, especially at popular spots like St Kilda Beach.