Early return instead of remove on a blockingdeque
Revert previous change
Fix issue #64