Ah, I thought this was because, for example, even though a node in the "teaser" view mode needs to have links, you don't want those links to be rendered when embedded in an entity.

You're right that links should be configurable in entity view displays though.