Rosemary has donned a summer frock in red and white polka dots topped by a white linen jacket