Make sure Active Support configurations are applied correctly

Before this patch configuration set using config.active_support
would not be set.

Closes #15364