use rbindlist to merge dataframes. huuuge speedup.