test to run in EMR to see if not writing to the rejected output would make the problem go away