To do this, you will need to create your own prompts.
Make sure to Save prompt for future use, like this:
Then, you can go into Settings > Preferences > Appearance > Drafts and select/deselect all the OpenAI quick actions ...