DRILL-1504: Enabling fragment memory limit causes out of memory