data gathering now in threading
merge