ENH: optimization on possibily_convert_datetime to only try conversion in certain cases