Invalidate font manager when rcParam family lists change.

A possible fix for #3074 and related issues.