Add support to block/unblock new requests, while not touching on
existing and running requests