You can get rid of a Safari extension by deleting that from the App Library on your device. You can also disable the extension temporarily from Settings > Extensions > Safari menu.