Lower test worker count

The worker count was high due to some overly complicated tests that have
since been re-written

Change-Id: Id7ccc4ab2c9f6c917c151c2fc217a68fd88c806f