Avoid notification spam when the build palette is left-clicked

fixes #2361