You should definitely remove the egg quickly, but try not to disturb the area as there may also be additional organisms present that are beneficial to your garden.