Seoul has expressed deep regrets over Abe's remarks made earlier this month.