Yelp/mrjob — Issue #289: input record length limit on Windows
Author: davidmarin
Created: 2011-11-28 18:50:31+00:00
State: open
Labels: Feature

Windows sort apparently uses a fixed record size with a default of 4096 bytes. If you feed it lines longer than that, you get an error like:

```
Input record exceeds maximum length. Specify larger maximum.
```

You *can* specify a larger maximum length with the `/rec` switch; the highest record size it'll support is 65535.

We could add something to sort invocation in `local` and `inline` modes that retries sorting with `/rec 65535` if we encounter this error message.