We could reuse notify_mutex here