updated to handle combingin files from single commodities