Sometimes when baking with fruits or other add-ins, they sink to the bottom. Tossing them with flour can help, although the main issue is that whole cherries are heavy and it is tough to win against gravity. You can cut the cherries in half or in quarters if you'd like. More juices will seep out into your batter but that is ok.