Yes, tap water in Ljubljana is clean and potable. Even the water from the many drinking fountains around the city is safe to drink, too.
If you have trust issues and you must drink bottled water, purchase big bottles from the grocery or supermarket instead of buying small ones at restaurants. It’s cheaper that way.