Handle swappable User model

Foreign key to User model through an import is not a good practice and it does not allow the usage of swappable user model.