Yes, you can. Helpie FAQ plugin gives you hundreds of toggle icon options that you can use to customize you FAQ section.