Configuring notifications to avoid bothering everybody