Add set_master impl to manage who should be invoking notify/gc_work