Increase duration timeout task manager

Sometimes, Jenkins or Travis is slow, and can't hit that 1 second
timeout. This increases to 5 seconds to account for local slowness.
Land #2688, TaskManager spec timeout increase