the truncate function is now online
sentiment statistics is now implemented. Also, senteces with fewer tokens than X are excluded from the tokanization. Hence, they don't get stored.