fixup an include

This unordered_map thing was totally unnecessary and this header
is included everywhere. From the logs it looks like the boost
unordered_map is a fairly expensive include.