Don't clear 'refill_buffers' unconditionally for pattern fill

If we have asked for a specific buffer compression, then we need
the refill option (if set).

Signed-off-by: Jens Axboe <axboe@fb.com>