remove the semaphore