Correctly remove from the matrix incompatible django / python versions.
Don't double install django-filter.