If new pane is created, make it the active pane

This is for #9255 

cc @JeffryBooher 
we should change the name of this to `newPane` then since it's only valid when a pane is created.