Ahmad, W. U., Chakraborty, S., Ray, B., and Chang, K.-W. Unified pre-training for program understanding and generation. ArXiv, abs/2103.06333, 2021.
Bender, G., Liu, H., Chen, B., Chu, G., Cheng, S., Kindermans, P.-J., and Le, Q. V. Can weight sharing outperform random architecture search? an investigation with tunas. 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 14311-14320, 2020.
BigScience Workshop, Scao, T. L., Fan, A., Akiki, C., Pavlick, E., Ilic, S., Hesslow, D., Castagne, R., Luccioni, A. S., Yvon, F., Galle, M., Tow, J., Rush, A. M., Biderman, S., Webson, A., Ammanamanchi, P. S., Wang, T., Sagot, B., Muennighoff, N., del Moral, A. V., Ruwase, O., Bawden, R., Bekman, S., McMillan-Major, A., Beltagy, I., Nguyen, H., Saulnier, L., Tan, S., Suarez, P. O., Sanh, V., Laurencon, H., Jernite, Y., Launay, J., Mitchell, M., Raffel, C., Gokaslan, A., Simhi, A., Soroa, A., Aji, A. F., Alfassy, A., Rogers, A., Nitzav, A. K., Xu, C., Mou, C., Emezue, C., Klamm, C., Leong, C., van Strien, D., Adelani, D. I., Radev, D., Ponferrada, E. G., Levkovizh, E., Kim, E., Natan, E. B., De Toni, F., Dupont, G., Kruszewski, G., Pistilli, G., Elsahar, H., Benyamina, H., Tran, H., Yu, I., Abdulmumin, I., Johnson, I., Gonzalez-Dios, I., de la Rosa, J., Chim, J., Dodge, J., Zhu, J., Chang, J., Frohberg, J., Tobing, J., Bhattacharjee, J., Almubarak, K., Chen, K., Lo, K., Von Werra, L., Weber, L., Phan, L., allal, L. B., Tanguy, L., Dey, M., Munoz, M. R., Masoud, M., Grandury, M., Šaško, M., Huang, M., Coavoux, M., Singh, M., Jiang, M. T.-J., Vu, M. C., Jauhar, M. A., Ghaleb, M., Subramani, N., Kassner, N., Khamis, N., Nguyen, O., Espejel, O., de Gibert, O., Villegas, P., Henderson, P., Colombo, P.,amuok, P., Lhoest, Q. Harliman, R., Bommasani, R., López, R. L., Ribeiro, R., Osei, S., Pyysalo, S., Nagel, S., Bose, S. Muhammad, S. H. Sharma, S. Longpre, S. Nikpoor, S. Silberberg, S. Pai, S. Zink, S. Torrent T. T. Schick T. Thrush T. Danchev V. Nikoulinea V. Laippala V. Lepercq V. Prabhu V. Alyafeai Z. Talat Z. Raja A. Heinzerling B.SiC.TasarD.E.SaleskyE.MielkeS.J. LeeW.Y.SharmaA.SantilliA.ChaffinA.StieglerA.DattaD.SzczechlaE.Chhablani G.WangH.Pandey H.Strobelt H.Fries J.A.Rozen J.GaoL.SutawikaL.BariM.S. Al-shaibani M.S.Manica M.Nayak N.Teehan R.Albanie S.ShenS.Ben-David S. BachS.H.KimT.BersT.Fevry T.Neeraj T.Thakker U.RaunakV.TangX.Yong Z-X.SunZ.BrodyS.UriY.Tojarieh H.RobertsA.ChungH.W.TaeJ.PhangJ. PressO.LiC.NarayananD.Bourfoune H.CasperJ.RasleyJ.RyabininM.Mishra M.ZhangM.ShoyebiM.PeyrounetteM.PatryN.TaziN.SansevieroO.von Platen P.CornetteP.LavalléeP.F.LacroixR.RajbhandariS.GandhiS.SmithS.RequenaS. PatilS.DettmersT.BaruwaA.SinghA.ChevelevaA.LigozatA-L.SubramonianA. Nével,A.Lovering C.Garrette D.Tunuguntla D.ReiterE.TaktashevaE.VoloshinaE. Bogdanov,E.WinataG.I.SchoelkopfH.KaloJ.-C.NovikovaJ.FordeJ.Z.CliveJ. KasaiJ.KawamuraK.HazanL.CarpuatM.ClinciuM.KimN.ChengN.SerikovO. Antverg O.vander Wal O.Zhang R.Zhang R.Gehrmann S.MirkinS.PaisS.Shavrina T.ScialomT.YunT.Limisiewicz T.RieserV.ProtasovV.MikhailovV.PruksachatkunY BelinkovY.BambergerZ.KasnerZ.RuedaA.PestanaA.FeizpourA.KhanA.Faranak A.SantosA.HeviaA.UnldreajA.AghagolA.AbdollahiA.TammourA.Haji Hosseini A.BehroozziB.AjibadeB.SaxenaB.FerrandisC.M.ContractorD.LanskyD.David D. KielaD.NguyenD.A.TanE.BaylorE.OzoaniE.MirzaF.OnoniwuF.Rezanejad H JonesH.BhattacharyaI.SolaimanI.SedenkoI.Nejadgholi I.PassmoreJ.SeltzerJ.Sanz J.B.DutraL.SamagaioM.ElbadriM.MieskesM.GerchickM.AkinloluM.McKenna M.QiuM.GhauriM.BurynokM.AbrarN.RajaniN.ElkottN.FahmyN.Samuel O AnR.KromannR.HaoR.AlizadehS.ShubberS.WangS.RoyS.ViguierS.LeT. OyebadeT.Le,T.YangY.NguyenZ.KashyapA.R.PalascianoA.CallahanA.Shukla A.Miranda-EscaladaA.SinghA.BeilharzB.WangB.BritoC.ZhouC.JainC.XuC