Allow specifying optional dependencies to ignore