Yes, you can block or remove a bot by going to the chat settings and selecting the option to block or delete the bot.