Performance improvements to `inflate`

* Release the GIL only once in inflate
* inflate is pretty fast, so only release the GIL if it's a large object

Depends on GH-122