I'd like to talk concretely here. The compiler-rt library is tiny and very easy to build. It has one function per object, so the linker strips out everything you don't use.

Without a conrete reason as to why, I don't see why the compiler should stop linking to compiler-rt.