If your tattoo is large, possibly, but it all depends on the airport and the individual members of staff working there. Tattoos are not yet illegal in Japan, and many Japanese airport security employees accept foreign tourists with tattoos.