Skip numpy/matplotlib since we're just linting