Critics say Yasukuni represents Japan 's past military aggression , but Mr. Koizumi says his visits are to pray for peace .