VecFusion: Vector Font Generation with Diffusion
Authors: name: Vikas Thamizharasan; name: Difan Liu; name: Shantanu Agarwal; name: Matthew Fisher; name: Michael Gharbi; name: Oliver Wang; name: Alec Jacobson; name: Evangelos Kalogerakis
Published: 2023-12-16 20:49:00

Abstract: We present VecFusion, a new neural architecture that can generate vector
fonts with varying topological structures and precise control point positions.
Our approach is a cascaded diffusion model which consists of a raster diffusion
model followed by a vector diffusion model. The raster model generates
low-resolution, rasterized fonts with auxiliary control point information,
capturing the global style and shape of the font, while the vector model
synthesizes vector fonts conditioned on the low-resolution raster fonts from
the first stage. To synthesize long and complex curves, our vector diffusion
model uses a transformer architecture and a novel vector representation that
enables the modeling of diverse vector geometry and the precise prediction of
control points. Our experiments show that, in contrast to previous generative
models for vector graphics, our new cascaded vector diffusion model generates
higher quality vector fonts, with complex structures and diverse styles.