If new pane is created, make it the active pane

This is for #9255 

cc @JeffryBooher