Be more conservative when recognizing dates

Only in the inference, if AsDateTime is called explicitely on a JsonValue, still allow the cast
Minimizes the weirdness of #49