Bug 1075227 - Implement chunking logic for faster tests runs on CI

Is this on purpose?