Don't depend on polymorphic any more

Only django-filer needs it, and it already has it as a dependency