Fix compile-time error

This fixes an error caused by boostorg/type_traits@d5c5988d92871f5474646dc4e9a6cb9d6809f460, where the broken_compiler_spec header was removed. It doesn't seem to actually be used, so I just removed that line.