rezero (pypi): ReZero networks
Keywords: deep-neural-networks|language-modeling|pytroch|resnet|transformer