Plugins: create after_merge invocation stage

After merging, we want to remove certain labels... this makes that possible
Is this a debug leftover?