Usually bitter kaya taste is caused by overcooking the caramel, causing the syrup to be burnt and taste bitter. Make sure not to overcook the sugar syrup when making caramel. Once the syrup turns golden brown, remove pan from heat.