modify for better support of truncationTokenOffset and more accurate hittest for tuncation