Yes, Reims is worth a visit. However, the city is by far not as beautiful as the other villages in the Champagne region. I suggest planning a morning in Reims and spending the rest of the time visiting Epernay and the other beautiful villages of the Champagne.