Toss the cherries with a bit of flour before folding them in the cake batter. The flour will help the cherries "stick" to the batter, so they won't sink to the bottom of the cake pan.