To put it simply, you can’t really determine a character’s ethnicity unless the creators of the anime specifically say so. Without this information, we have only their skin color to rely on.  It’s also important to point out that tan characters are not black characters. Therefore, we can only assume characters are persons of color if their skin color doesn’t turn darker because of sunlight.