Keep resizing until we are sure we got the font in place or we time out.