ENH: Have inferred_freq set offset