Retry unmapping when we switched buffers.

Fixes #229.