edit middle point and tolerance level

bring the processing and data to RAM instead at HD,
correct the middle point and its tolerance level for embedding
add ngram and log for entropy

extensive change in code structure for more efficient and add logging
data
-mean
-min
-max
-variance and standard deviation