So it turns out the depth map is affected by non uniform density and measurement error
Pretty normals