One option is to contact the manufacturer and inquire about replacement pieces. Some companies will send you replacements at no cost, whereas others will charge you for the pieces plus shipping. Another option is to use a different set of magnets. You could use any magnet set you like, though there are sets geared toward educational use that may work especially well.