Fix scaling bug after refreshing in unscaled state