Not using retraction can lead to stringing and other print defects. Without the extruder being pulled back, the molten filament will continue to ooze out from the nozzle as it moves across non-contiguous sections of your design.  It can result in poor layer adhesion and weak and poorly defined prints.