Yes, if the music is in the public domain, you can perform it publicly. You can make copies of it, remix it, use it in a film, or whatever you want to do with it. The only thing that you need to establish is that sheet music is public domain. However, every music sheet comes with their own legal terms. Make sure to go through them thoroughly and then pick them up.