MAINT: Only reset color when color has been set

Reviewed-by: Scott Parlane <scott.parlane@alliedtelesis.co.nz>

Signed-off-by: Andrew Campbell <andrew.campbell@alliedtelesis.co.nz>