Start from the default format when applying formats (Fixes #1230)