Nope. The travel agencies are only there to collect and check your documents. However, it is possible that the Embassy of Japan will request that you visit them for an interview after they receive your documents — but I've never heard of such a case when applying for a tourist visa only.