One of the most common causes of a wobbly drill press is the quill. A loose quill will allow the chuck to wobble when the drill press is operating. Another possible cause is the drill press being misaligned. This is usually a result of the gearbox and motor not lining up correctly. You should also check that the drill bit is inserted in the chuck correctly.