Only skip refresh if the width hasn't changed

For #2825. @peterflynn, could you look at this one?