added an option for user to specify changeover threshold between short-text and long-text processing