GTK3Agg backend: Only convert the cairo context to a cairocffi context o...

This fixes https://github.com/matplotlib/matplotlib/issues/2810