Remove pessimistic version constraint

It only needs to be >= 3.2.0, putting .x makes it also be < 4.