added new functionfor the new refined data set