The criticism from Seoul Monday came in response to Japanese Foreign Minister Taro Aso 's comments Saturday about visits to a controversial war shrine in Tokyo .