It is worth remembering that summer dress is not a business casual attire. However, in some work environments it Is acceptable. Make sure your summer dress is a knee length one and isn’t too bright.
You can also layer a turtleneck under your dress and wear high boots in a cooler weather.