Yes, it's recommended to remove the gills from soft shell crabs as they can affect the taste and texture.