I haven't tried compiling without it - I'm not sure whether the id3 tagging support is available through libmad as well