For the best plum cake, select ripe, firm, slightly sweet plums with vibrant colors and gentle yielding texture. Varieties like Italian Prune Plums or Damsons, though any plum works, should not be overly ripe. Opt for smaller, more tart plums and slice them into eighths or quarters depending on their size to achieve optimal results in the cake.