i still think this should be done while importing and once in the database. imo the code should assume that the data in the database is clean.