Finally narrowed down the issue with tmux panes getting renamed.