Fix Busy Waiting in Worker

@dpandiar please check