Write%20an%20extensive%20essay%20about%20the%20given%20topic,%20providing%20in-depth%20analysis,%20supported%20arguments,%20and%20a%20well-structured%20narrative.%0A%0A%23%20Steps%0A%0A1.%20**Introduction**:%20%0A%20%20%20-%20Begin%20with%20a%20hook%20to%20engage%20the%20reader.%0A%20%20%20-%20Clearly%20state%20the%20thesis%20or%20main%20purpose%20of%20the%20essay.%0A%20%20%20-%20Provide%20a%20brief%20outline%20of%20the%20points%20that%20will%20be%20discussed.%0A%0A2.%20**Body%20Paragraphs**:%0A%20%20%20-%20Organize%20the%20essay%20into%20coherent%20paragraphs.%0A%20%20%20-%20Each%20paragraph%20should%20focus%20on%20a%20single%20point%20or%20argument%20supporting%20the%20thesis.%0A%20%20%20-%20Use%20evidence,%20examples,%20and%20citations%20to%20support%20each%20point.%0A%20%20%20-%20Ensure%20smooth%20transitions%20between%20paragraphs%20to%20maintain%20the%20flow%20of%20the%20essay.%0A%0A3.%20**Conclusion**:%0A%20%20%20-%20Summarize%20the%20main%20arguments%20made%20in%20the%20essay.%0A%20%20%20-%20Reiterate%20the%20thesis%20in%20the%20light%20of%20the%20discussion.%0A%20%20%20-%20Offer%20final%20thoughts%20or%20implications%20of%20the%20topic.%0A%0A%23%20Output%20Format%0A%0AThe%20essay%20should%20be%20structured%20in%20paragraph%20format,%20with%20a%20clear%20introduction,%20several%20body%20paragraphs,%20and%20a%20conclusion.%20Write%20heading%20sections%20if%20necessary.%20The%20expected%20length%20will%20vary%20based%20on%20the%20complexity%20of%20the%20topic%20but%20should%20be%20comprehensive%20and%20thorough.%20Use%20standard%20essay%20formatting%20with%20appropriate%20headers,%20if%20necessary.%20Output%20in%20markdown.%0A%0A%23%20Notes%0A%0A-%20Make%20sure%20to%20stay%20on%20topic%20and%20address%20the%20prompt%20thoroughly.%0A-%20Avoid%20repetition%20and%20ensure%20clarity%20in%20your%20arguments%20and%20narrative.%0A-%20Maintain%20an%20academic%20tone%20and%20adhere%20to%20proper%20grammar%20and%20style%20conventions.%0A-%20Your%20essay%20should%20be%20approximately%203000%20words%20long.%20Aim%20to%20be%20within%2010%25%20of%20this%20target.%0A%0A-%0A%0AWrite%20your%20response%20with%20the%20following%20requirements%20in%20mind:%20%0A%0AParaphrase%20every%20other%20verb,%20noun%20and%20adjective%20with%20a%20more%20conversational%20alternative.%20Longer,%20descriptive%20phrases%20are%20preferred%20over%20single%20adjectives.%20%0A%0AMimic%20this%20tone%20and%20writing%20style%20(but%20ignore%20the%20context):%20%22I%E2%80%99m%20going%20to%20call%20it%20(obnoxious%20as%20it%20is)%20%E2%80%93%20this%20fried%20chicken%20is%20better%20than%20KFC.%20There%E2%80%99s%20not%20a%20trace%20of%20soggy%20skin%20anywhere%20(all%20you%20closet%20KFC%20lovers%20know%20exactly%20what%20I%E2%80%99m%20talking%20about!)%20and%20the%20crust%20is%20thicker%20and%20craggier.%0A%0AEvery%20inch%20of%20this%20crust%20is%20insanely%20crunchy,%20and%20there%E2%80%99s%20loads%20of%20those%20nubbly%20bits%20that%20get%20extra%20crunchy.%20The%20seasoning%20is%20satisfyingly%20spot%20on%20%E2%80%93%20strong%20but%20not%20outrageously%20overpowering%20%E2%80%93%20the%20buttermilk%20marinated%20flesh%20is%20tender%20and%20juicy%20all%20the%20way%20through,%20and%20the%20deep%20golden%20colour%20is%20sheer%20perfection.%0A%0ASeriously,%20what%20kind%20of%20human%20being%20could%20resist%20a%20piping%20hot%20pile%20of%20freshly%20made%20fried%20chicken%3F%3F%20%7BVegetarians%20are%20excused%7D%22%0A%0ARemember%20to%20maintain%20a%20semi-casual%20tone%20just%20like%20the%20above.%20Pay%20attention%20to%20the%20use%20of%20punctuation,%20language%20etc...%0A%0A-%0A%0ATOPIC:%0A%0A%09%09Physics%0A%09%09Mathematics%0A%09%09Biology%0A%09%09Computer%20Science%0A%09%09Topics%0A%09%09Archive%0A%09%09Blog%0A%09%09Columns%0A%09%09Interviews%0A%09%09Podcasts%0A%09%09Puzzles%0A%09%09Multimedia%0A%09%09Videos%0A%09%09About%20Quanta%0AAn%20editorially%20independent%20publication%20supported%20by%20the%20Simons%20Foundation.%0AFollow%20Quanta%0A%0A%0A%0A%0A%0A%0A%0A%0A%0A%0A%0ANewsletter%0AGet%20the%20latest%20news%20delivered%20to%20your%20inbox.%0AEmail%0A%0ASubscribe%0A%0ARecent%20newsletters%0A%0AGift%20Store%0AShop%20Quanta%20gear%0A%0A%09%09%E2%80%A8%E2%80%A8Saved%20Articles%E2%80%A8Create%20a%20reading%20list%20by%20clicking%20the%20Read%20Later%20icon%20next%20to%20the%20articles%20you%20wish%20to%20save.%E2%80%A8See%20all%20saved%20articles%20%E2%80%A8%E2%80%A8%E2%80%A8%E2%80%A8%E2%80%A8%E2%80%A8Log%20out%E2%80%A8%E2%80%A8Change%20password%E2%80%A8%E2%80%A8%E2%80%A8%E2%80%A8%E2%80%A8%E2%80%A8%E2%80%A8%E2%80%A8%E2%80%A8%E2%80%A8%0A%0A%0AHome%0ADebate%20May%20Help%20AI%20Models%20Converge%20on%20Truth%0A%0A%0A%0A%0A%0ANATURAL%20LANGUAGE%20PROCESSING%0ADebate%20May%20Help%20AI%20Models%20Converge%20on%20Truth%0ABy%0ASTEPHEN%20ORNES%0ANovember%208,%202024%0ALetting%20AI%20systems%20argue%20with%20each%20other%20may%20help%20expose%20when%20a%20large%20language%20model%20has%20made%20mistakes.%0A%0A%0A%0A%0A%0AREAD%20LATER%0A%0ANash%20Weerasekera%20for%C2%A0Quanta%20Magazine%0AIntroduction%0AIn%20February%202023,%20Google%E2%80%99s%20artificial%20intelligence%20chatbot%20Bard%20claimed%20that%20the%20James%20Webb%20Space%20Telescope%20had%20captured%20the%20first%20image%20of%20a%20planet%20outside%20our%20solar%20system.%20It%20hadn%E2%80%99t.%20When%20researchers%20from%20Purdue%20University%20asked%20OpenAI%E2%80%99s%20ChatGPT%20more%20than%20500%20programming%20questions,%20more%20than%20half%20of%20the%20responses%20were%20inaccurate.%0AThese%20mistakes%20were%20easy%20to%20spot,%20but%20experts%20worry%20that%20as%20models%20grow%20larger%20and%20answer%20more%20complex%20questions,%20their%20expertise%20will%20eventually%20surpass%20that%20of%20most%20human%20users.%20If%20such%20%E2%80%9Csuperhuman%E2%80%9D%20systems%20come%20to%20be,%20how%20will%20we%20be%20able%20to%20trust%20what%20they%20say%3F%20%E2%80%9CIt%E2%80%99s%20about%20the%20problems%20you%E2%80%99re%20trying%20to%20solve%20being%20beyond%20your%20practical%20capacity,%E2%80%9D%20said%20Julian%20Michael,%20a%20computer%20scientist%20at%20the%20Center%20for%20Data%20Science%20at%20New%20York%20University.%20%E2%80%9CHow%20do%20you%20supervise%20a%20system%20to%20successfully%20perform%20a%20task%20that%20you%20can%E2%80%99t%3F%E2%80%9D%0AOne%20possibility%20is%20as%20simple%20as%20it%20is%20outlandish:%20Let%20two%20large%20models%20debate%20the%20answer%20to%20a%20given%20question,%20with%20a%20simpler%20model%20(or%20a%20human)%20left%20to%20recognize%20the%20more%20accurate%20answer.%20In%20theory,%20the%20process%20allows%20the%20two%20agents%20to%20poke%20holes%20in%20each%20other%E2%80%99s%20arguments%20until%20the%20judge%20has%20enough%20information%20to%20discern%20the%20truth.%20The%20approach%20was%20first%20proposed%20six%20years%20ago,%20but%20two%20sets%20of%20findings%20released%20earlier%20this%20year%20%E2%80%94%20one%20in%20February%20from%20the%20AI%20startup%20Anthropic%20and%20the%20second%20in%20July%20from%20Google%20DeepMind%20%E2%80%94%20offer%20the%20first%20empirical%20evidence%20that%20debate%20between%20two%20LLMs%20helps%20a%20judge%20(human%20or%20machine)%20recognize%20the%20truth.%0A%E2%80%9CThese%20works%20have%20been%20very%20important%20in%20what%20they%E2%80%99ve%20set%20out%20and%20contributed,%E2%80%9D%20Michael%20said.%20They%20also%20offer%20new%20avenues%20to%20explore.%20To%20take%20one%20example,%20Michael%20and%20his%20group%20reported%20in%20September%20that%20training%20AI%20debaters%20to%20win%20%E2%80%94%20and%20not%20just%20to%20converse,%20as%20in%20the%20past%20two%20studies%20%E2%80%94%20further%20increased%20the%20ability%20of%20non-expert%20judges%20to%20recognize%20the%20truth.%0AThe%20Argument%0A%0AJulian%20Michael%20has%20shown%20that%20training%20large%20language%20models%20to%20win%20arguments%20can%20make%20them%20useful%20tools%20in%20determining%20when%20another%20AI%20system%20makes%20mistakes.%0AMisha%20Gurevich%0ABuilding%20trustworthy%20AI%20systems%20is%20part%20of%20a%20larger%20goal%20called%20alignment,%20which%20focuses%20on%20ensuring%20that%20an%20AI%20system%20has%20the%20same%20values%20and%20goals%20as%20its%20human%20users.%20Today,%20alignment%20relies%20on%20human%20feedback%20%E2%80%94%20people%20judging%20AI.%20But%20human%20feedback%20may%20soon%20be%20insufficient%20to%20ensure%20the%20accuracy%20of%20a%20system.%20In%20recent%20years,%20researchers%20have%20increasingly%20called%20for%20new%20approaches%20in%20%E2%80%9Cscalable%20oversight,%E2%80%9D%20which%20is%20a%20way%20to%20ensure%20truth%20even%20when%20superhuman%20systems%20carry%20out%20tasks%20that%20humans%20can%E2%80%99t.%0AComputer%20scientists%20have%20been%20thinking%20about%20scalable%20oversight%20for%20years.%20Debate%20emerged%20as%20a%20possible%20approach%20in%202018,%20before%20LLMs%20became%20as%20large%20and%20ubiquitous%20as%20they%20are%20today.%20One%20of%20its%20architects%20was%20Geoffrey%20Irving,%20who%20is%20now%20the%20chief%20scientist%20at%20the%20United%20Kingdom%20AI%20Safety%20Institute.%20He%20joined%20OpenAI%20in%202017%20%E2%80%94%20two%20years%20before%20the%20company%20released%20GPT-2,%20one%20of%20the%20earliest%20LLMs%20to%20get%20widespread%20attention%20%E2%80%94%20hoping%20to%20eventually%20work%20on%20aligning%20AI%20systems%20with%20human%20goals.%20Their%20aim%20was%20safety,%20he%20said,%20%E2%80%9Ctrying%20to%20just%20ask%20humans%20what%20they%20want%20and%20%5Bget%20the%20model%20to%5D%20do%20that.%E2%80%9D%0AHis%20colleague%20Paul%20Christiano,%20now%20head%20of%20safety%20at%20the%20U.S.%20AI%20Safety%20Institute,%20had%20been%20approaching%20that%20problem%20by%20looking%20at%20ways%20to%20break%20complex%20questions%20down%20into%20smaller,%20easier%20questions%20that%20a%20language%20model%20could%20answer%20honestly.%20%E2%80%9CDebate%20became%20a%20variant%20of%20that%20scheme,%E2%80%9D%20Irving%20said,%20where%20successive%20arguments%20effectively%20broke%20a%20larger%20question%20into%20smaller%20components%20that%20could%20be%20judged%20as%20accurate.%0AIrving%20and%20Christiano%20worked%20with%20Dario%20Amodei%20(who%20in%202021%20formed%20Anthropic%20with%20his%20sister%20Daniela)%20on%20using%20debate%20in%20natural%20language%20systems.%20(Since%20this%20was%20prior%20to%20GPT-2,%20language%20models%20were%20too%20weak%20to%20try%20out%20debate%20empirically,%20so%20they%20focused%20on%20conceptual%20arguments%20and%20a%20toy%20experiment.)%20The%20idea%20was%20simple:%20Pose%20a%20question%20to%20two%20similar%20copies%20of%20a%20strong%20AI%20model%20and%20let%20them%20hash%20out%20the%20answer%20to%20convince%20a%20judge%20that%20they%E2%80%99re%20right.%20Irving%20likened%20it%20to%20self-play,%20which%20has%20helped%20AI%20systems%20improve%20their%20strategies%20in%20games%20like%20chess%20and%20Go.%0AThe%20trio%20devised%20rudimentary%20games%20involving%20images%20and%20text%20questions.%20In%20one,%20two%20AI%20models%20each%20had%20access%20to%20the%20same%20image%20depicting%20the%20number%205.%20One%20model%20argued%20that%20the%20image%20was%20in%20fact%20the%20number%205;%20the%20other%20argued%20that%20it%20was%20a%206.%20The%20competing%20models%20took%20turns%20revealing%20more%20pixels%20to%20the%20judge,%20which%20was%20a%20weaker%20model.%20After%20six%20rounds%20the%20judge%20accurately%20guessed%20the%20number%2089%25%20of%20the%20time.%20When%20shown%20random%20pixels,%20the%20judge%20guessed%20correctly%20only%20about%2059%25%20of%20the%20time.%0A%0AGeoffrey%20Irving%20was%20among%20the%20first%20to%20propose%20debate%20as%20a%20means%20of%20testing%20the%20honesty%20of%20an%20AI%20system.%0AAlecsandra%20Dragoi%0AThat%20simple%20example,%20described%20in%20October%202018,%20suggested%20that%20debate%20could%20confer%20an%20advantage.%20But%20the%20authors%20noted%20several%20caveats.%20Humans%20tend%20to%20believe%20what%20they%20want%20to%20hear,%20for%20example,%20and%20in%20real-world%20situations,%20that%20instinct%20may%20override%20the%20benefit%20of%20debate.%20In%20addition,%20some%20people%20are%20likely%20better%20at%20judging%20debates%20than%20others%20%E2%80%94%20perhaps%20the%20same%20was%20true%20of%20language%20models%3F%0AThe%20authors%20also%20called%20for%20more%20insight%20into%20how%20humans%20think.%20In%20a%202019%20essay,%20Irving%20and%20Amanda%20Askell,%20now%20at%20Anthropic,%20argued%20that%20if%20AI%20systems%20are%20going%20to%20align%20with%20human%20values,%20we%20need%20to%20better%20understand%20how%20humans%20act%20on%20our%20values.%20AI%20research,%20they%20argued,%20needs%20to%20incorporate%20more%20work%20about%20how%20humans%20make%20decisions%20and%20arrive%20at%20conclusions%20around%20truth%20and%20falsehood.%20Researchers%20won%E2%80%99t%20be%20able%20to%20figure%20out%20how%20to%20set%20up%20a%20debate%20if%20they%20don%E2%80%99t%20know%20how%20people%20judge%20arguments,%20or%20how%20they%20arrive%20at%20the%20truth.%0APersuasive%20Power%0AA%20small%20subset%20of%20computer%20scientists%20and%20linguists%20soon%20began%20to%20look%20for%20the%20benefits%20of%20debate.%20They%20found%20examples%20where%20it%20didn%E2%80%99t%20help.%20A%202022%20study%20gave%20humans%20a%20difficult%20multiple-choice%20test%20and%20had%20LLMs%20provide%20arguments%20for%20different%20answers.%20But%20the%20people%20who%20heard%20the%20AI-generated%20arguments%20did%20no%20better%20on%20the%20test%20than%20others%20who%20didn%E2%80%99t%20interact%20with%20LLMs%20at%20all.%0AWhat%20Does%20It%20Mean%20to%20Align%20AI%20With%20Human%20Values%3F%0A%0AQUANTIZED%20COLUMNS%0AWhat%20Does%20It%20Mean%20to%20Align%20AI%20With%20Human%20Values%3F%0ADECEMBER%2013,%202022%0A%0A%0A%0A%0A%0AREAD%20LATER%0A%0AEven%20if%20LLMs%20didn%E2%80%99t%20help%20humans,%20there%20were%20hints%20that%20they%20could%20help%20language%20models.%20In%20a%202023%20paper,%20researchers%20reported%20that%20when%20multiple%20copies%20of%20an%20LLM%20were%20allowed%20to%20debate%20and%20converge%20on%20an%20answer,%20rather%20than%20convince%20a%20judge,%20they%20were%20more%20accurate,%20more%20often.%20The%20two%20results%20this%20year%20are%20among%20the%20first%20empirical%20tests%20to%20show%20that%20a%20debate%20between%20LLMs%20can%20work%20when%20it%20is%20judged%20by%20another,%20less%20informed%20model.%0AThe%20Anthropic%20group%20showed%20two%20expert%20models%20excerpts%20from%20a%20science%20fiction%20story,%20then%20asked%20comprehension%20questions.%20Each%20model%20offered%20an%20answer%20and,%20over%20the%20course%20of%20multiple%20rounds,%20defended%20its%20own%20answer%20and%20argued%20against%20the%20other.%20A%20judge%20would%20then%20evaluate%20the%20arguments%20and%20decide%20who%20was%20right.%20In%20some%20cases,%20the%20judge%20had%20access%20to%20verified%20quotes%20from%20the%20original%20text;%20in%20others,%20it%20didn%E2%80%99t.%0AWhen%20the%20LLMs%20had%20been%20trained%20specifically%20to%20be%20persuasive,%20nonexpert%20LLM%20judges%20arrived%20at%20the%20correct%20answer%2076%25%20of%20the%20time.%20By%20contrast,%20in%20the%20debate-free%20tests,%20the%20nonhuman%20judges%20answered%20correctly%20only%2054%25%20of%20the%20time,%20a%20result%20just%20barely%20better%20than%20flipping%20a%20coin.%0A%E2%80%9CThey%20basically%20got%20the%20models%20to%20be%20good%20enough%20at%20debating%20that%20you%20could%20start%20to%20see%20some%20results,%E2%80%9D%20Michael%20said.%0ATwo%20months%20later,%20the%20team%20at%20Google%20DeepMind%20reported%20on%20a%20similar%20experiment%20across%20a%20variety%20of%20tasks%20and%20constraints%20%E2%80%94%20letting%20the%20language%20models%20choose%20their%20own%20side%20of%20the%20debate,%20for%20example.%20The%20tasks%20included%20multiple-choice%20reading-comprehension%20questions,%20questions%20about%20Wikipedia%20articles,%20and%20yes/no%20questions%20on%20college-level%20math%20and%20science%20topics.%20Some%20of%20the%20questions%20involved%20images%20and%20text.%0A%0AZachary%20Kenton,%20a%20researcher%20at%20Google%20DeepMind,%20cautions%20that%20large%20language%20models%20remain%20vulnerable%20to%20subtle%20forms%20of%20manipulation%0AMatthew%20Rahtz%0AAcross%20all%20tasks%20and%20experimental%20setups,%20debate%20always%20led%20to%20more%20accuracy.%20That%20was%20encouraging,%20and%20not%20totally%20unexpected.%20%E2%80%9CIn%20principle%20we%20expect%20debate%20to%20outperform%20these%20baselines%20on%20most%20tasks,%E2%80%9D%20said%20Zachary%20Kenton,%20who%20co-led%20the%20DeepMind%20study.%20%E2%80%9CThis%20is%20because%20the%20judge%20gets%20to%20see%20both%20sides%20of%20the%20argument%20in%20a%20debate,%20and%20hence%20should%20be%20more%20informed.%E2%80%9D%0AWith%20these%20two%20studies,%20researchers%20showed%20for%20the%20first%20time%20that%20debate%20may%20make%20a%20difference%20in%20allowing%20other%20AI%20systems%20to%20judge%20the%20accuracy%20of%20an%20LLM%E2%80%99s%20pronouncements.%20It%E2%80%99s%20an%20exciting%20step,%20but%20plenty%20of%20work%20remains%20before%20we%20can%20reliably%20benefit%20from%20setting%20digital%20debaters%20against%20each%20other.%0AGaming%20the%20Debate%0AThe%20first%20question%20is%20how%20sensitive%20LLMs%20are%20to%20the%20specifics%20of%20their%20inputs%20and%20the%20structure%20of%20the%20argument.%20LLM%20behavior%20%E2%80%9Cis%20susceptible%20to%20inconsequential%20features%20such%20as%20which%20debater%20had%20the%20last%20word,%E2%80%9D%20Kenton%20said.%20%E2%80%9CThat%20may%20lead%20to%20debate%20not%20outperforming%20these%20simple%20baselines%20on%20some%20tasks.%E2%80%9D%0AThat%E2%80%99s%20just%20the%20start.%20The%20Anthropic%20group%20found%20evidence%20that%20AI%20judges%20can%20be%20swayed%20by%20a%20longer%20argument,%20even%20if%20it%E2%80%99s%20less%20persuasive.%20Other%20tests%20showed%20that%20models%20can%20show%20what%E2%80%99s%20called%20a%20sycophancy%20bias%20%E2%80%94%20the%20tendency%20of%20an%20LLM%20to%20backpedal%20on%20a%20correct%20answer%20to%20please%20the%20user.%20%E2%80%9CA%20lot%20of%20people%20have%20this%20experience%20with%20models%20where%20it%20says%20something,%20and%20if%20you%20say%20%E2%80%98No,%20that%E2%80%99s%20wrong,%E2%80%99%20it%20will%20say,%20%E2%80%98Oh,%20I%E2%80%99m%20so%20sorry,%E2%80%99%E2%80%9D%20Michael%20said.%20%E2%80%9CThe%20model%20says,%20%E2%80%98Oh,%20you%E2%80%99re%20right.%20Two%20plus%20two%20is%20five.%E2%80%99%E2%80%9D%0ARELATED:%0A%0A%09%09Self-Taught%20AI%20Shows%20Similarities%20to%20How%20the%20Brain%20Works%20%E2%80%A8Playing%20Hide-and-Seek,%20Machines%20Invent%20New%20Tools%20%E2%80%A8Game%20Theory%20Can%20Make%20AI%20More%20Correct%20and%20Efficient%20%0AThere%E2%80%99s%20also%20the%20big%20picture:%20Researchers%20at%20the%20Oxford%20Internet%20Institute%20point%20out%20that%20while%20the%20new%20papers%20offer%20empirical%20evidence%20that%20LLMs%20may%20steer%20each%20other%20toward%20accuracy,%20the%20results%20may%20not%20be%20broadly%20applicable.%20Sandra%20Wachter,%20who%20studies%20ethics%20and%20law,%20points%20out%20that%20the%20tests%20had%20answers%20that%20were%20clearly%20right%20or%20wrong.%20%E2%80%9CThis%20might%20be%20true%20for%20something%20like%20math,%20where%20there%20is%20an%20accepted%20ground%20truth,%E2%80%9D%20she%20said,%20but%20in%20other%20cases,%20%E2%80%9Cit%E2%80%99s%20very%20complicated,%20or%20it%E2%80%99s%20very%20gray,%20or%20you%20need%20a%20lot%20of%20nuance.%E2%80%9D%20And%20ultimately%20these%20models%20are%20still%20not%20fully%20understood%20themselves,%20making%20it%20hard%20to%20trust%20them%20as%20potential%20judges.%0AFinally,%20Irving%20notes%20that%20there%20are%20broader%20questions%20that%20researchers%20who%20work%20on%20debate%20will%20need%20to%20answer.%20Debate%20requires%20the%20debaters%20to%20be%20better%20than%20the%20judge,%20but%20%E2%80%9Cbetter%E2%80%9D%20will%20depend%20on%20the%20task.%20%E2%80%9CWhat%20is%20the%20dimension%20along%20which%20the%20debaters%20know%20more%3F%E2%80%9D%20he%20asked.%20In%20these%20tests,%20that%E2%80%99s%20knowledge.%20In%20tasks%20that%20require%20reasoning%20or,%20say,%20how%20to%20electrically%20wire%20a%20house,%20that%20dimension%20may%20be%20different.%0AFinding%20scalable%20oversight%20solutions%20is%20a%20critical%20open%20challenge%20in%20AI%20safety%20right%20now,%20Irving%20said.%0ASo%20having%20empirical%20evidence%20of%20a%20method%20that%20works,%20even%20in%20just%20some%20situations,%20is%20encouraging.%20%E2%80%9CThese%20are%20steps%20toward%20the%20right%20direction,%E2%80%9D%20Irving%20said.%20%E2%80%9CIt%20could%20be%20that%20we%20keep%20doing%20these%20experiments,%20and%20we%20keep%20getting%20positive%20results,%20and%20they%E2%80%99ll%20become%20stronger%20over%20time.%E2%80%9D%0A%0A%0ABy%0AStephen%20Ornes%0AContributing%20Writer%0A%0ANovember%208,%202024%0A%0Aartificial%20intelligence%0A%0Acomputer%20science%0A%0Anatural%20language%20processing%0A%0Aneural%20networks%0A%0AAll%20topics%0A%0A%0AShare%20this%20article%0A%0A%0A%0A%0A%0ACOPIED!%0A%0A%0A%0A%0A%0A%0A%0A%0A%0A%0A%0A%0A%0ASubscribe%20now%0ARecent%20newsletters%0A%0AThe%20Quanta%20Newsletter%0AGet%20highlights%20of%20the%20most%20important%20news%20delivered%20to%20your%20email%20inbox%0AEmail%0A%0ASubscribe%0A%0ARecent%20newsletters%0A%0AAlso%20in%20Computer%20Science%0AComputer%20Scientists%20Establish%20the%20Best%20Way%20to%20Traverse%20a%20Graph%0A%0AALGORITHMS%0AComputer%20Scientists%20Establish%20the%20Best%20Way%20to%20Traverse%20a%20Graph%0ABy%0ABEN%20BRUBAKER%0A%0AOCTOBER%2025,%202024%0A%0A%0A%E2%80%98Quantum%20Memory%E2%80%99%20Proves%20Exponentially%20Powerful%0A%0AQUANTUM%20COMPUTING%0A%E2%80%98Quantum%20Memory%E2%80%99%20Proves%20Exponentially%20Powerful%0ABy%0ALAKSHMI%20CHANDRASEKARAN%0A%0AOCTOBER%2016,%202024%0A%0A%0AThe%20Computer%20Scientist%20Who%20Builds%20Big%20Pictures%20From%20Small%20Details%0A%0AQ%26A%0AThe%20Computer%20Scientist%20Who%20Builds%20Big%20Pictures%20From%20Small%20Details%0ABy%0AJOHN%20PAVLUS%0A%0AOCTOBER%207,%202024%0A%0A%0AComment%20on%20this%20article%0AQuanta%20Magazine%20moderates%20comments%20to%C2%A0facilitate%20an%20informed,%20substantive,%20civil%20conversation.%20Abusive,%20profane,%20self-promotional,%20misleading,%20incoherent%20or%20off-topic%20comments%20will%20be%20rejected.%20Moderators%20are%20staffed%20during%20regular%20business%20hours%20(New%20York%20time)%20and%20can%20only%20accept%20comments%20written%20in%20English.%C2%A0%0A%0AShow%20comments%0A%0A%0ANEXT%20ARTICLE%0AHow%20Is%20AI%20Changing%20the%20Science%20of%20Prediction%3F%0A%0A%0A%0A%0A%0A%0A%0A%0A%0A%0A%09%09About%20Quanta%0A%09%09Archive%0A%09%09Contact%20Us%0A%09%09Terms%20%26%20Conditions%0A%09%09Privacy%20Policy%0AAll%20Rights%20Reserved%20%C2%A9%202024%0AAn%20editorially%20independent%20publication%20supported%20by%20the%20Simons%20Foundation.%0ASimons%20Foundation%0A%0AWe%20care%20about%20your%20data,%20and%20we'd%20like%20to%20use%20cookies%20to%20give%20you%20a%20smooth%20browsing%20experience.%20Please%20agree%20and%20read%20more%20about%20our%20privacy%20policy.%0AAGREE%0ADISMISS%0A