upload process now adds in some new columns