Don't build with -Werror

This fixes building with mingw, where the visibility attributes
aren't supported.