You should be worried about petechiae if they appear suddenly and are accompanied by other symptoms such as fever, fatigue, or bruising. It is important to seek medical attention to rule out underlying health issues.