Fix build directories in subdirs not being ignored