Remove unnecessary default template argument values

Not supported by MSC16 and not needed in the current codebase, so they can
go.