lr adjustment for hybrid p/t with relu units for comparison