Ignore only binaries, not directories