The passion fruit bars are done baking when the edges turn golden brown and the filling is set with a slight jiggle in the center. It's essential not to overbake them to maintain a soft and gooey texture.