This is a question that you should already know the answer to, but one that is not a bad question, all things considered. With touchscreens in general, it is safe for you to access them with your fingers touching the screen (hence the name). Outside of dealing with fingerprints, this will not damage your screen (unless you scratch it with your fingernail).
Thus, it is not much different with a glove on your hand. There are a lot of factors that you should be paying attention to, but you will never have to worry about gloves damaging your screen. Granted, that they are touchscreen gloves and not a pair of rubber gloves.