VariantField: Remove unused template specializations

 (for now, Tim suggested that we ressurect it)