Since we already have a non-weak ref to `Q`, could we not just remove this and below (in remove), do `Q.ax.figure.callbacks` instead?  (Haven't tried, just seems like the simpler solution that also doesn't create any extra strong references.)