A red, orange or yellow flame on a gas stove is usually indicative of a problem. The problem usually stems from incomplete combustion which can serve as a health risk to anyone in the house. Use a carbon monoxide detector to detect unsafe levels of CO, and hire a technician to remediate the issue if normal cleaning of the orifices doesn’t help.