Question: are distant stars still there?
Answer: -- there are a total of just over 9,000 stars that the human eye can discern. Every single one of them is contained within our own galaxy, though, so none of these are millions of light years away. There are some that are thousands of light years distant, though.