Yes, you can. If you play without it, just add in one more gold coin so you still have one coin per person. Or if you don't want to use prizes but still want to do the lucky coin, you could give that person a "get out of jail free pass" of sorts where they don't get eliminated if they get the unlucky coin in say the next 2-3 rounds.