fix rtgeom routine, add pixel equality macro to core test