ENH: Guard against 1 observation 1d exog