Defer call to FcPatternDestroy(). (fixes Issue #16)

I hit this issue too on Linux (debian/testing). Moving the destroy call fixes it for me.