Baby eggplant is not bitter, however, if you do not like the taste of baby eggplant, you can cut it, sprinkly salt over it and leave it for an hour so that the moisture drains out. This will help reduce the bitter-taste if any.