Remove unused directory color configuration