agnosticbin: Do not block input data while negotiating

It is a bad idea to block streaming thread

Change-Id: I2c31f9f6a83a0717f8c5a0a910a24d94ef34d302