Yes, electric baseboard heaters can potentially ignite curtains if the curtains come into direct contact with the heaters. It's crucial to ensure that flammable materials are kept at a safe distance from the heaters to prevent fire hazards.