Use inline toolbars in the preferences dialog.

https://wiki.gnome.org/Design/HIG/InlineToolbars