Make sure loglevels don't get touched when not needed. refs #2660