Special fix for travis CI failures

Travis is not seeing garbage collection of the bogus pointers. Increase
the threshold!