a number of changes including awk to make unique reads