Use empty BytesRef if we read from <= 1.4.0