Yes, you can use Rustoleum on baseboard heaters. Ensure it is a high-heat variant.