Remove virtual structs

Closes #17861.
Glad to see this gone.