Remove Reference directory from tracking