Restrict to django 1.4 and 1.5

Tests are broken when running with django 1.6, need to investigate