worker_thread.cc now correctly maintains the neighbors vector