Query installed requirements for extras

Slight cleanup of #1886 with the commits collapsed and an entry added to changelog.

Closes #1886