Japanese Prime Minister Shinzo Abe on Tuesday vowed never to budge on the issue of North Korea's abductions of Japanese citizens, as the two countries prepared for talks on normalising ties in Hanoi.