handle empty files
use ratio of variance and mean to clag "bad" data