ENG-6380 add warmup and reduce the number of tests

Gonna merge it into master according to Phil's instruction