Japanese officials say Mr. Toledo told the Japanese leader that former Peruvian President Alberto Fujimori 's recent return to South America should not affect the two nations ' relationship .