If you are successful in removing that portion, you may lose your tattoo. However, it is also affected by age. As your skin cells repair, a fresh tattoo will lose a lot of pigment. If it's a little scrape that heals without leaving scars, you may not need to touch it up, but there's always the chance of color loss. For permanent tattoos, please consult with a dermatologist before taking any action on your tattoo.