getNextToken now retrieves tokens line by line instead of token by token