Remove special cases in build-time dep audit