Fixes #48

Besides actually fixing the issue, it also adds displaying the setting window as a secondary action to the menu button (i.e. ctrl-clicking the menu button calls that windows)
Are we missing something here? If we are not, maybe it will be wise to add something like "Do nothing" instead of "..." ?