the high level preprocessing can now accept full file length