This is a grey area. Historically, Desert and Chukka boots would never have been worn with a suit (even after their migration into Western fashion). But some of the newer designs with a thinner sole could potentially work. Generally speaking, thick soles and rugged stitching should stay with casualwear.