Before removing the M2M table and field, I'd make sure the tables are usable -- that is, save an instance and play with it a little.
This is mostly motivated by past m2m problems on Oracle, where South created tables but they had the wrong name (Oracle backend is a little insane there).