Yes, apricots taste like oranges. They have the same sweet yet tart flavors. However, you may say that oranges are definitely more sour than apricots.