add start of script to check for incomplete datasets. also, further cleaning of ami data files