WIP: Fix matplotlib, etc. errors

I would like the deprecation warning to show the actual error message. It might also make sense to replace the error again with the original one if the fallback failed as well.
If this occurs, there would be a bug elsewhere. But I am not sure if such a bug could not be even outside numpy, so I suppose we should do the sanity check...