Remove unnecessary conditional branch

I removed a conditional branch in Material that was made unnecessary by your change to Color's set method.