If new pane is created, make it the active pane

This is for #9255 

cc @JeffryBooher 
Note that new pane is not created when switching between vertical/horizontal, and we don't want to switch focus in that case.