Handle directory remove requests