You can if you want to, but I don’t recommend omitting the lemon extract. If you do, it’ll have much less lemon flavor.