{{위키데이터 속성 추적}}
[[파일:Google PaLM Logo.svg|섬네일|PaLM의 로고]]
'''PaLM'''(Pathways Language Model)은 [[Google AI]]에서 개발한 5400억 개의 파라미터 변환기 기반 대규모 언어 모델이다.<ref name="blog">{{웹 인용|last1=Narang |first1=Sharan |last2=Chowdhery |first2=Aakanksha |title=Pathways Language Model (PaLM): Scaling to 540 Billion Parameters for Breakthrough Performance |url=https://ai.googleblog.com/2022/04/pathways-language-model-palm-scaling-to.html |website=ai.googleblog.com |access-date=17 March 2023 |language=en}}</ref> 연구원들은 또한 모델 규모의 효과를 테스트하기 위해 더 작은 버전의 PaLM, 80억 및 620억 파라미터 모델을 훈련했다.<ref name="paper">{{ArXiv 인용|last1=Chowdhery |first1=Aakanksha |last2=Narang |first2=Sharan |last3=Devlin |first3=Jacob |last4=Bosma |first4=Maarten |last5=Mishra |first5=Gaurav |last6=Roberts |first6=Adam |last7=Barham |first7=Paul |last8=Chung |first8=Hyung Won |last9=Sutton |first9=Charles |last10=Gehrmann |first10=Sebastian |last11=Schuh |first11=Parker |last12=Shi |first12=Kensen |last13=Tsvyashchenko |first13=Sasha |last14=Maynez |first14=Joshua |last15=Rao |first15=Abhishek |last16=Barnes |first16=Parker |last17=Tay |first17=Yi |last18=Shazeer |first18=Noam |last19=Prabhakaran |first19=Vinodkumar |last20=Reif |first20=Emily |last21=Du |first21=Nan |last22=Hutchinson |first22=Ben |last23=Pope |first23=Reiner |last24=Bradbury |first24=James |last25=Austin |first25=Jacob |last26=Isard |first26=Michael |last27=Gur-Ari |first27=Guy |last28=Yin |first28=Pengcheng |last29=Duke |first29=Toju |last30=Levskaya |first30=Anselm |last31=Ghemawat |first31=Sanjay |last32=Dev |first32=Sunipa |last33=Michalewski |first33=Henryk |last34=Garcia |first34=Xavier |last35=Misra |first35=Vedant |last36=Robinson |first36=Kevin |last37=Fedus |first37=Liam |last38=Zhou |first38=Denny |last39=Ippolito |first39=Daphne |last40=Luan |first40=David |last41=Lim |first41=Hyeontaek |last42=Zoph |first42=Barret |last43=Spiridonov |first43=Alexander |last44=Sepassi |first44=Ryan |last45=Dohan |first45=David |last46=Agrawal |first46=Shivani |last47=Omernick |first47=Mark |last48=Dai |first48=Andrew M. |last49=Pillai |first49=Thanumalayan Sankaranarayana |last50=Pellat |first50=Marie |last51=Lewkowycz |first51=Aitor |last52=Moreira |first52=Erica |last53=Child |first53=Rewon |last54=Polozov |first54=Oleksandr |last55=Lee |first55=Katherine |last56=Zhou |first56=Zongwei |last57=Wang |first57=Xuezhi |last58=Saeta |first58=Brennan |last59=Diaz |first59=Mark |last60=Firat |first60=Orhan |last61=Catasta |first61=Michele |last62=Wei |first62=Jason |last63=Meier-Hellstern |first63=Kathy |last64=Eck |first64=Douglas |last65=Dean |first65=Jeff |last66=Petrov |first66=Slav |last67=Fiedel |first67=Noah |title=PaLM: Scaling Language Modeling with Pathways |date=2022 |class=cs.CL |eprint=2204.02311 |display-authors=3}}</ref>

PaLM은 상식 추론, 산술 추론, 농담 설명, 코드 생성 및 번역을 포함한 광범위한 작업을 수행할 수 있다.<ref name="paper"/><ref name="venturebeat"/><ref>{{웹 인용|last1=Bastian |first1=Matthias |date=5 April 2022 |title=Google PaLM: Giant language AI can explain jokes |url=https://the-decoder.com/google-palm-giant-language-ai-can-explain-jokes/ |access-date=17 March 2023 |website=the decoder}}</ref><ref>{{웹 인용|date=12 December 2022 |title=Google: Why Is No One Talking About PaLM |url=https://seekingalpha.com/article/4563975-google-why-is-no-one-talking-about-palm |access-date=17 March 2023 |website=seekingalpha.com |language=en}}</ref> 생각 사슬 프롬프트와 결합했을 때 PaLM은 단어 문제 및 논리 기반 질문과 같은 여러 단계의 추론이 필요한 데이터 세트에서 훨씬 더 나은 성능을 달성했다.<ref name="blog"/><ref name="paper"/>

이 모델은 2022년 4월에 처음 발표되었으며 구글이 PaLM 및 기타 여러 기술용 API를 출시한 2023년 3월까지 비공개로 유지되었다.<ref>{{웹 인용|last1=Vincent |first1=James |title=Google opens up its AI language model PaLM to challenge OpenAI and GPT-3 |url=https://www.theverge.com/2023/3/14/23639313/google-ai-language-model-palm-api-challenge-openai |website=The Verge |access-date=17 March 2023 |date=14 March 2023}}</ref> API는 대중에게 공개되기 전에 대기자 명단에 등록한 제한된 수의 개발자가 먼저 사용할 수 있다.<ref>{{웹 인용|last1=Huffman |first1=Scott |last2=Woodward |first2=Josh |title=PaLM API & MakerSuite: an approachable way to start prototyping and building generative AI applications |url=https://developers.googleblog.com/2023/03/announcing-palm-api-and-makersuite.html |access-date=17 March 2023 |language=en}}</ref>

구글과 딥마인드는 의료 데이터에 대해 미세 조정되고 의료 질문 응답 벤치마크에서 이전 모델을 능가하는 Med-PaLM이라는 PaLM 540B 버전을 개발했다.<ref>{{ArXiv 인용|last1=Singhal |first1=Karan |last2=Azizi |first2=Shekoofeh |last3=Tu |first3=Tao |last4=Mahdavi |first4=S. Sara |last5=Wei |first5=Jason |last6=Chung |first6=Hyung Won |last7=Scales |first7=Nathan |last8=Tanwani |first8=Ajay |last9=Cole-Lewis |first9=Heather |last10=Pfohl |first10=Stephen |last11=Payne |first11=Perry |last12=Seneviratne |first12=Martin |last13=Gamble |first13=Paul |last14=Kelly |first14=Chris |last15=Scharli |first15=Nathaneal |last16=Chowdhery |first16=Aakanksha |last17=Mansfield |first17=Philip |last18=Arcas |first18=Blaise Aguera y |last19=Webster |first19=Dale |last20=Corrado |first20=Greg S. |last21=Matias |first21=Yossi |last22=Chou |first22=Katherine |last23=Gottweis |first23=Juraj |last24=Tomasev |first24=Nenad |last25=Liu |first25=Yun |last26=Rajkomar |first26=Alvin |last27=Barral |first27=Joelle |last28=Semturs |first28=Christopher |last29=Karthikesalingam |first29=Alan |last30=Natarajan |first30=Vivek |title=Large Language Models Encode Clinical Knowledge |date=2022 |class=cs.CL |eprint=2212.13138 |display-authors=3}}</ref><ref>{{웹 인용|title=MedPaLM: New Chatbots Will Soon Be Better Than Waiting For A Doctor |url=https://medicalfuturist.com/medpalm-new-ai-medical-chatbots-will-soon-be-better-than-waiting-for-a-doctor/ |website=The Medical Futurist |access-date=17 March 2023 |date=17 January 2023}}</ref> Med-PaLM은 미국 의료 면허 문제에서 처음으로 합격 점수를 얻었으며 객관식 및 개방형 질문에 모두 정확하게 답하는 것 외에도 추론을 제공하고 자체 응답을 평가할 수 있다.<ref>{{웹 인용|last1=Matias |first1=Yossi |last2=Corrado |first2=Greg |title=Our latest health AI research updates |url=https://blog.google/technology/health/ai-llm-medpalm-research-thecheckup/ |website=Google |access-date=17 March 2023 |language=en-us |date=14 March 2023}}</ref>

구글은 또한 비전 변환기를 사용하여 PaLM을 확장하여 로봇 조작에 사용할 수 있는 최첨단 비전 언어 모델인 PaLM-E를 만들었다.<ref>{{ArXiv 인용|last1=Driess |first1=Danny |last2=Xia |first2=Fei |last3=Sajjadi |first3=Mehdi S. M. |last4=Lynch |first4=Corey |last5=Chowdhery |first5=Aakanksha |last6=Ichter |first6=Brian |last7=Wahid |first7=Ayzaan |last8=Tompson |first8=Jonathan |last9=Vuong |first9=Quan |last10=Yu |first10=Tianhe |last11=Huang |first11=Wenlong |last12=Chebotar |first12=Yevgen |last13=Sermanet |first13=Pierre |last14=Duckworth |first14=Daniel |last15=Levine |first15=Sergey |last16=Vanhoucke |first16=Vincent |last17=Hausman |first17=Karol |last18=Toussaint |first18=Marc |last19=Greff |first19=Klaus |last20=Zeng |first20=Andy |last21=Mordatch |first21=Igor |last22=Florence |first22=Pete |title=PaLM-E: An Embodied Multimodal Language Model |date=2023 |class=cs.LG |eprint=2303.03378 |display-authors=3 }}</ref><ref>{{웹 인용|last1=Driess |first1=Danny |last2=Florence |first2=Pete |title=PaLM-E: An embodied multimodal language model |url=https://ai.googleblog.com/2023/03/palm-e-embodied-multimodal-language.html |website=ai.googleblog.com |access-date=17 March 2023 |language=en}}</ref> 이 모델은 재교육이나 미세 조정 없이 경쟁적으로 로봇 작업을 수행할 수 있다.<ref>{{웹 인용|last1=Edwards |first1=Benj |title=Google's PaLM-E is a generalist robot brain that takes commands |url=https://arstechnica.com/information-technology/2023/03/embodied-ai-googles-palm-e-allows-robot-control-with-natural-commands/ |website=Ars Technica |access-date=17 March 2023 |language=en-us |date=7 March 2023}}</ref>

2023년 5월 구글은 연례 구글 I/O 기조연설에서 PaLM 2를 발표했다.<ref>{{웹 인용|last=Lardinois |first=Frederic |date=May 10, 2023 |title=Google launches PaLM 2, its next-gen large language model |url=https://techcrunch.com/2023/05/10/google-launches-palm-2-its-next-gen-large-language-model/ |url-status=live |archive-url=https://web.archive.org/web/20230510172453/https://techcrunch.com/2023/05/10/google-launches-palm-2-its-next-gen-large-language-model/ |archive-date=May 10, 2023 |access-date=May 10, 2023 |website=[[TechCrunch]]}}</ref> PaLM 2는 3조 6천억 개의 토큰으로 학습된 3,400억 개의 파라미터 모델로 보고되었다.<ref name="cnbc-20230516">{{웹 인용|last=Elias |first=Jennifer |url=https://www.cnbc.com/2023/05/16/googles-palm-2-uses-nearly-five-times-more-text-data-than-predecessor.html |title=Google's newest A.I. model uses nearly five times more text data for training than its predecessor |work=[[CNBC]] |date=16 May 2023 |access-date=18 May 2023}}</ref>

== 같이 보기 ==
* [[LaMDA]]
* [[제미니 (언어 모델)]]

== 각주 ==
<references />

{{구글}}
{{자연어 처리}}

[[분류:구글의 소프트웨어]]
[[분류:대형 언어 모델]]