Remove the column from the appropriate table