Yes, stars are made up of a combination of hydrogen and helium. This is the same as our Sun, and it's the same as the gas planets too. Stars can also be made up of lots of different elements like iron and carbon too, which can have an effect on the stars color.