oh I think I got it - this is since we preserve seperators during indexing and otherwise the queries don't work. This is very essential actually otherwise this entire thing doesn't work. Can you please make an in-line comment about this?