Fix memory leaks, by refcounting XFFont

Change-Id: Iecfddf21f19313f46ee2544fad9c4df1e399e0f5