Stop supporting term vectors only on long fields

We'll add this back in another pull request.