made tabular writer obey the len parameter of process_token