Repository: stanford-crfm/helm
Issue: J1-jumbo assigns unreasonably low logprobs to 2048-token prompts
Root cause: External Dependency Breakage

J1-jumbo assigns a much lower logprob to token prompts that contain 2048 tokens than their prefices. See example below.

[Prompt with 2047 tokens](https://crfm-models.stanford.edu/static/index.html?prompt=%22Previously%20on%20%22Wayward%20Pines%22...%22%20%22This%20fake%20little%20town%20is%20all%20that%27s%20left.%22%20%22There%27s%20a%20faction.%22%20%22They%27re%20gonna%20take%20down%20the%20fence.%22%20%22Surrender%20your%20arms%20and%20explosives%20by%20tomorrow%20morning%20and%20everything%20stays%20between%20us.%22%20%22Wayward%20Pines%20needs%20a%20new%20generation.%22%20%22You%20and%20Ben%20look%20so%20nice%20together.%22%20%22How%20is%20that%20working%20out%3F%22%20%22It%27s%20great%2C%20actually.%22%20%22You%20were%20right.%22%20%22They%20got%20to%20Ethan.%22%20%22We%20execute%20tonight.%22%20%22%20All%20right.%22%20%22Who%27s%20that%3F%22%20%22%20Ted%20Laufer.%22%20%22He%20drives%20the%20delivery%20truck.%22%20%22He%27s%20always%20right%20on%20time%2C%20right%20at%208%3A00.%22%20%22Okay%2C%20let%27s%20go.%22%20%22Help!%22%20%22I%20need%20a%20doctor!%22%20%22Help!%22%20%22Come%20here.%22%20%22Come%20here.%22%20%22%20I%20need%20a%20doctor.%22%20%22%20Sir%2C%20we%20can%20help.%22%20%22You%27re%20okay.%22%20%22Come%20with%20us%2C%20please.%22%20%22%20What%20happened%3F%22%20%22%20Truck%20exploded.%22%20%22Prep%20radiology%2C%20now!%22%20%22Oh%2C%20my%20God!%22%20%22Wait%20a%20minute.%22%20%22Is%20this%20guy%20a%20real%20doctor%3F%22%20%22%20Of%20course%20he%20is.%22%20%22%20We%20need%20to%20move!%22%20%22Ben%20will%20receive%20the%20best%20possible%20care.%22%20%22You%20know%20the%20children%20are%20our%20most%20precious%20resource.%22%20%22Pam%20to%20ICU%2C%20please.%22%20%22Try%20to%20remain%20calm.%22%20%22Go%20ahead%20and%20look.%22%20%22There%20you%20go.%22%20%22%20Hey.%22%20%22%20Oh%2C%20my%20God.%22%20%22Ah%2C%20here%27s%20Dr.%20Carol.%22%20%22So%20far%2C%20I%20see%20no%20significant%20injury%20to%20his%20brain%2C%20but%20we%20won%27t%20know%20exactly%20where%20we%20stand%20until%20he%20regains%20consciousness.%22%20%22But%20he%27s%20gonna%20be%20okay.%22%20%22If%20he%20comes%20to%20in%20the%20next%2024%20hours%2C%20the%20odds%20of%20a%20full%20recovery%20are%20very%20good.%22%20%22It%20could%20be%20a%20long%20night.%22%20%22Try%20to%20get%20some%20rest.%22%20%22What%20kind%20of%20person%20sets%20off%20a%20bomb%20in%20the%20middle%20of%20town%3F%22%20%22%20I%20told%20him%20to%20stay%20home.%22%20%22%20Hey.%22%20%22%20I%20did.%22%20%22%20It%27s%20not%20your%20fault.%22%20%22He%27s%20just%20a%20kid.%22%20%22He%27s%2014.%22%20%22Remember%20what%20you%20were%20like%3F%22%20%22Do%20you%20think%20he%27s%20involved%20with%20any%20of%20this%3F%22%20%22No.%22%20%22If%20you%20need%20anything%20at%20all%2C%22%20%22%20you%20just%20press%20this%20buzzer%2C%20all%20right%3F%22%20%22%20Thank%20you.%22%20%22Oh%2C%20Dr.%20Jenkins!%22%20%22How%20are%20the%20children%3F%22%20%22Amy%20Breslow%27s%20gonna%20be%20all%20right%2C%20all%20things%20considered.%22%20%22Ben%20Burke%20is%20still%20unconscious.%22%20%22But%20not%20to%20worry...%22%20%22Dr.%20Carol%20is%20with%20him.%22%20%22He%27s%20absolutely%20going%20to%20pull%20through.%22%20%22How%20have%20they%20been%20able%20to%20do%20this%3F%22%20%22!%22%20%22Settle%20yourself%20down%2C%20now.%22%20%22Remember%20where%20you%20are%20for%20God%27s%20sake%2C%20David.%22%20%22W-We%27ll%20put%20out%20an%20issue%20of%20the%20Chronicle.%22%20%22We%20explain%20this%20is%20a...%20it%27s%20a...%20an%20explosion.%22%20%22It%27s%20a%20gas%20leak.%22%20%22Yes.%22%20%22It%27s%20a%20fine%20idea.%22%20%22I%20just%20hope%20they%20buy%20it.%22%20%22I%27m%20worried%20about%20the%20townsfolk.%22%20%22And%20people%20have%20already%20started%20talking.%22%20%22I%20think%20we%20should%20do%20something%20for%20them%2C%20something%20very%2C%20very%20special%2C%20for%20the%20entire%20community.%22%20%22A%20celebration%3F%22%20%22Yes.%22%20%22Yes%2C%20a%20celebration%20of%20life%20in%20Wayward%20Pines.%22%20%22Remind%20everybody%20exactly%20how%20blessed%20we%20actually%20are.%22%20%22Hmm%3F%22%20%22This%20is%20internal%20bleeding.%22%20%22It%27s%20bad.%22%20%22We%20should%20keep%20moving.%22%20%22No.%22%20%22No.%22%20%22No%2C%20we%20have%20to%20stay%20here%20and%20wait%20for%20the%20others.%22%20%22%20No%20one%27s%20coming%2C%20Harold.%22%20%22%20We%20don%27t%20know%20that.%22%20%22And%20he%20is%20not%20gonna%20survive%20another%20move.%22%20%22Here%20they%20come.%22%20%22Thank%20God.%22%20%22I%20got%20some%20food%2C%20water%2C%20and%20first%20aid%20in%20there.%22%20%22Wait.%22%20%22What%27s%20Ruby%20doing%3F%22%20%22She%20had%20to%20go%20back.%22%20%22She%20can%27t%20risk%20showing%20up%20late%20for%20work.%22%20%22What%20happened%20to%20Eric%3F%22%20%22He%20got%20pinned%20between%20the%20truck%20and%20the%20dumpster.%22%20%22Well%2C%20we%20should%20take%20him%20down%20to%20the%20hospital.%22%20%22So%20they%20can%20execute%20him%3F%22%20%22What%20happened%20at%20the%20fence%3F%22%20%22Two%20got%20away%2C%20four%20got%20taken%2C%20and%20Kate%27s%20in%20jail.%22%20%22%20Oh%2C%20my%20God.%22%20%22%20Look.%22%20%22I%20really%20want%20to%20help%20you%20guys%2C%20but%20I%20can%27t%20stay.%22%20%22Sorry.%22%20%22I%20want%20to%20get%20out%20of%20this%20town!%22%20%22Why%3F%22%20%22Because%20none%20of%20it%27s%20real.%22%20%22It%27s%20a...%22%20%22it%27s%20a%20Potemkin%20village.%22%20%22They%20have%20them%20in...%20in%20Syria%2C%20North%20Korea.%22%20%22They%27re%20fake%20cities%20built%20to%20impress.%22%20%22Who%27s%20behind%20it%3F%22%20%22CIA%3F%22%20%22Is%20it%20social%20or...%22%20%22or%20medical%3F%22%20%22What%3F%22%20%22This%20government%20experiment.%22%20%22Is%20it%20social%20or%20medical%3F%22%20%22It%27s%20just%20a%20town.%22%20%22Just%20a%20town.%22%20%22With%20an%20electrified%20fence%3F%22%20%22W-W-W-With%20a%20microchip%20in%20my%20leg%3F%22%20%22!%22%20%22You%20have%20to%20write%20that%20down%2C%20huh%3F%22%20%22I%27m%20just%20noting%20your%20progress.%22%20%22I%27m%20not%20making%20any%20progress.%22%20%22I%20don%27t%20want%20to%20make%20any%20progress.%22%20%22I%20want%20to%20talk%20to%20someone%20in%20charge%20now!%22%20%22It%27s%20been%20two%20months!%22%20%22I...%22%20%22I%20am%20sorry.%22%20%22Oh%2C%20poor%20Katie.%22%20%22Not%20feeling%20so%20well%2C%20eh%3F%22%20%22Don%27t%20worry.%22%20%22We%27ll%20get%20you%20all%20fixed%20up.%22%20%22That%27s%20a%20good%20girl.%22%20%22Oh%2C%20shh%2C%20shh%2C%20shh%2C%20shh%2C%20shh%2C%20shh%2C%20shh%2C%20shh.%22%20%22Ruby%27s%20here%2C%20you%20guys.%22%20%22Heard%20the%20driver%20and%20two%20kids%20are%20still%20in%20the%20hospital.%22%20%22If%20that%20was%20the%20gas%20line%2C%20then%20how%20come%20the%20asphalt%20wasn%27t%20damaged%3F%22%20%22Only%20thing%20exploded%20was%20the%20truck.%22%20%22Had%20to%20be%20a%20bomb.%22%20%22What%20do%20you%20think%2C%20Dr.%20Jenkins%3F%22%20%22Well...%20when%20a%20disaster%20like%20this%20occurs%20in%20a%20town%20as%20beautiful%20as%20ours%2C%20it%27s%20natural%20for%20folks%20to%20ask%20questions.%22%20%22But...%20we%20should%20be%20careful%20not%20to%20spread%20rumors.%22%20%22Hello%3F%22%20%22Who%20is%20it%2C%20Ruby%3F%22%20%22A%20fellowship%20gathering%2C%20mandatory%20attendance.%22%20%22Give%20me%20a%20reading%20on%20Ruby%27s%20chip.%22%20%22She%20was%20late%20to%20work.%22%20%22Pine%20needles%20in%20her%20hair.%22%20%22She%27s%20at%20home%20in%20bed.%22%20%22Let%20me%20see.%22%20%22She%20must%20have%20taken%20her%20chip%20out%20last%20night%20and%20left%20it%20in%20her%20room.%22%20%22I%20wonder%20how%20many%20more%20people%20are%20home%20in%20bed.%22%20%22All%20right%2C%20where%20are%20they%2C%20Kate%3F%22%20%22Five%20of%20your%20people%20are%20off%20the%20grid%20right%20now%2C%20including%20Harold.%22%20%22You%20think%20I%20want%20to%20help%20you%20find%20my%20husband%3F%22%20%22Your%20husband%20blew%20up%20a%20truck%20last%20night%20on%20Main%20Street.%22%20%22He%20nearly%20killed%20my%20son.%22%20%22Ben%3F%22%20%22W-What%20are%20you%20talking%20about%3F%22%20%22I-Is%20he%20gonna%20be%20okay%3F%22%20%22Don%27t%20even%20say%20his%20name.%22%20%22%20Just%20tell%20me%20where%20they%20are.%22%20%22%20I%20am%20so%20sorry%2C%20Ethan.%22%20%22Something%20must%20have%20gone%20wrong%20with%20the%20timer.%22%20%22It%20was...%20it%20was%20meant%20to%20go%20off%20at...%20at%20the%20fence.%22%20%22Well%2C%20that%27s%20the%20last%20thing%20that%20we%20need%20to%20have%20happen.%22%20%22You%20know%20what%20the%20difference%20is%20between%20you%20and%20me%3F%22%20%22I%20believe%20what%20I%20know%20in%20my%20heart.%22%20%22You%20believe%20what%20they%20tell%20you.%22%20%22Look%2C%20I%20know%20you%20don%27t%20get%20it.%22%20%22I%20know%20you%20think%20they%20got%20to%20me.%22%20%22But%20I%20know%20what%27s%20out%20there%20and%20it%27s%20not%20Boise.%22%20%22You%20ever%20think%20about%20why%20they%20picked%20you%20to%20be%20Sheriff%3F%22%20%22%27Cause%20I%20have.%22%20%22You%20know%2C%20I%27m%20gonna%20take%20you%20up%20there%20so%20you%20can%20see%20it%20with%20your%20own%20eyes%2C%20but%20we%20don%27t%20have%20time%20with%20that%20now.%22%20%22See%20what%3F%22%20%22The%20monsters%3F%22%20%22Where%20are%20they%3F%22%20%22!%22%20%22You%20know%2C%20you%20have%20really%20good%20instincts%2C%20Ethan.%22%20%22But%20when%20push%20comes%20to%20shove%2C%20you%20will%20always%20follow%20orders.%22%20%22You%20have%20made%20the%20same%20mistake%20before.%22%20%22Well...%22%20%22I%27m%20not%20following%20orders%20this%20time.%22%20%22I%27m%20just%20trying%20to%20make%20sure%20that%20nobody%20gets%20killed.%22%20%22What%20happened%20to%20you%3F%22%20%22We%20were%20partners%3F%22%20%22Don%27t%20you%20trust%20me%20at%20all%3F%22%20%22These%20people%20want%20to%20be%20free.%22%20%22And%20I%20owe%20them%20that%20chance.%22%20%22Amy%20is%20holding%20steady%2C%20and%20Ben%20Burke%20looks%20like%20he%27ll%20pull%20through.%22%20%22Ruby%27s%20one%20of%20them.%22%20%22Ruby%3F%22%20%22Have%20you%2C%20uh%2C%20notified%20Ethan%20Burke%20she%20needs%20to%20be%20locked%20up%3F%22%20%22We%20need%20to%20put%20our%20own%20house%20in%20order%20first.%22%20%22I%27m%20not%20following.%22%20%22We%20have%2024%20people%20manning%20surveillance%20around%20the%20clock.%22%20%22Yet%2C%20somehow%2C%20these%20insurgents%20are%20managing%20to%20meet%20in%20secret%20and%20build%20bombs.%22%20%22Someone%20must%20be%20helping%20them.%22%20%22David%2C%20everyone%20up%20here%20is%20family%2C%20loyal%20to%20you%20to%20a%20fault.%22%20%22Someone%27s%20betraying%20us%20and%20we%20need%20to%20find%20out%20who%20it%20is.%22%20%22If%20it%20will%20help%20you%20to%20feel%20better%2C%22%20%22I%27ll%20conduct%20a%20full%20security%20review.%22%20%22Yes%2C%20it%20would%20help%20me%20feel%20better.%22%20%22Snipers%20have%20checked%20the%20north%20quadrant.%22%20%22All%20clear.%22%20%22You%20still%20happy%20with%20your%20decision%20to%20join%20us%20here%3F%22%20%22It%27s%20an%20absolute%20privilege%20to%20be%20here.%22%20%22Indeed.%22%20%22Indeed.%22%20%22And%20working%20Surveillance%2C%20is%20it%20ever%20uncomfortable%20for%20you%3F%22%20%22Do%20you%20ever%20feel%20like%20you%27re...%22%20%22I%20don%27t%20know...%22%20%22invading%20people%27s%20privacy%3F%22%20%22Uh%2C%20it%27s%20the%20job.%22%20%22I%20mean%2C%20we%20do%20it%20to%20protect%20them%2C%20right%3F%22%20%22Absolutely.%22%20%22Absolutely.%22%20%22How%27s%20Reggie%3F%22%20%22%20Very%20good.%22%20%22%20And%20the%20kids%3F%22%20%22Full%20of%20energy%2C%20as%20always.%22%20%22Oh%2C%20super%20good.%22%20%22How%20about%20your%20post%20at%20Surveillance%3F%22%20%22You%20enjoying%20that%3F%22%20%22I%20like%20it%20a%20lot.%22%20%22But%20sometimes%20you%20might%20want%20to...%22%20%22I%20don%27t%20know...%20avert%20your%20eyes%20or%20maybe%20even%20wipe%20video%20%27cause%20of%20something%20you%27ve%20seen%2C%20erase%20it.%22%20%22Are%20you%20kidding%3F%22%20%22Oh%2C%20I-I%20love%20it%20when%20they%20let%20something%20juicy%20slip.%22%20%22Very%20good.%22%20%22Super.%22%20%22Thank%20you%20so%20much%2C%20Gina.%22%20%22Can%20you%20send%20the%20next%20person%20in%3F%22%20%22Sure.%22%20%22Sweetie%3F%22%20%22Ben.%22%20%22Sweetie.%22%20%22Hi.%22%20%22How%20are%20you%20feeling%3F%22%20%22Water%3F%22%20%22Oh%2C%20yes.%22%20%22Yeah.%22%20%22There%20you%20go%2C%20sweetie.%22%20%22Don%27t%20lift%20your%20head.%22%20%22You%20have%20no%20idea%20how%20happy%20it%20makes%20me%20to%20see%20you%20open%20your%20eyes.%22%20%22Your%20dad%20and%20I%20were%20so%20scared.%22%20%22Where...%20where%27s%20Amy%3F%22%20%22She%27s%20here%20in%20the%20hospital.%22%20%22Is%20she%20okay%3F%22%20%22Yeah%2C%20s-she%27s%20fine.%22%20%22She%20was%20asking%20about%20you.%22%20%22Can%20you%20go%20check%3F%22%20%22Yeah%2C%20sure%2C%20I%20will.%22%20%22I%20love%20you%20so%20much.%22%20%22How%20are%20you%20feeling%3F%22%20%22Oh%2C%20okay%2C%20I%20guess.%22%20%22Oh%2C%20Ben.%22%20%22Oh.%22%20%22Everyone%20in%20town%20has%20been%20so%20worried%20about%20you.%22%20%22I%27m%20so%20relieved%20you%27re%20all%20right.%22%20%22Yeah%2C%20me%20too.%22%20%22Oh%2C%20it%27s%20just%20terrible%20what%27s%20happened.%22%20%22Sometimes%2C%20the%20choices%20one%20makes%20can%20lead%20to%20consequences%20we%20don%27t%20intend.%22%20%22I%20never%20should%20have%20snuck%20out%20with%20Amy.%22%20%22Oh%2C%20no%2C%20no.%22%20%22No%2C%20I%27m%20not%20talking%20about%20that.%22%20%22We%20want%20you%20to%20grow%20your%20relationships%20here.%22%20%22I%27m%20talking%20about%20decisions%20made%20by%20the%20Sheriff%20in%20pursuing%20the%20case.%22%20%22He%27s%20a%20good%20man%2C%20Ben.%22%20%22He%27s%20well-intentioned.%22%20%22And%20I%27m%20sure%20he%20had%20his%20reasons%20for%20letting%20Harold%20Ballinger%20go.%22%20%22Oh%2C%20I%20just%20hope%20his%20judgment%20wasn%27t%20clouded%20by%20the%20fact%20that%20Harold%27s%20wife%20is%20an%20old%20friend%20of%20his.%22%20%22Kate%20and%20your%20father%20are%20friends%2C%20right%3F%22%20%22Yeah%2C%20sort%20of.%22%20%22He%20arrested%20Harold%20and%20then%20he%20let%20him%20go.%22%20%22And%20then...%22%20%22I%20guess%20I%20just%20don%27t%20agree%20with%20that%20kind%20of%20leniency.%22%20%22I%20believe%2C%20as%20David%20Pilcher%20believes%2C%20in%20a%20philosophy%20that%20I%20like%20to%20call%20Clear%20and%20Severe.%22%20%22Clear%20laws%20and%20severe%20punishments.%22%20%22Clear%20and%20Severe.%22%20%22To%20be%20honest%2C%22%20%22I%20think%20your%20father%20and%20I%20disagree%20on%20this%20issue.%22%20%22But%20you%27re%20gonna%20have%20to%20give%20it%20some%20thought.%22%20%22People%20are%20gonna%20want%20to%20hear%20from%20you.%22%20%22What%20is%20the%20proper%20punishment%20for%20speech%20or%20actions%20that%20harm%20Wayward%20Pines%3F%22%20%22Leniency%20or%20Clear%20and%20Severe.%22%20%22You...%22%20%22you%20say%20that%20people%20are%20gonna%20want%20to%20hear%20what%20I%20have%20to%20say.%22%20%22What%20does%20it%20matter%20what%20I%20think%3F%22%20%22Ben%2C%20you%20survived%20a%20terrorist%20attack.%22%20%22You%27re%20a%20hero%20now.%22%20%22How%20long%20you%20think%20we%27re%20gonna%20survive%20out%20here%3F%22%20%22We%27ll%20think%20of%20something.%22%20%22Mm%2C%20good.%22%20%22That%27s%20what%20people%20always%20say%20when%20they%27re%20at%20the%20end.%22%20%22Hey.%22%20%22Don%27t%20fall%20apart%20on%20me.%22%20%22We%27ll%20think%20of%20something.%22%20%22Eric.%22%20%22Hey.%22%20%22I%27m%20not%20doing%20this%20by%20myself.%22%20%22Not%20here.%22%20%22What%20do%20you%20mean%3F%22%20%22I%27m%20not%20gonna%20let%20him%20rot%20for%20all%20eternity%20inside%20this%20prison.%22%20%22What%20are%20you%20talking%20about%3F%22%20%22We%27re%20not&settings=echo_prompt%3A%20true%20%20%23%20Analyze%20the%20prompt%0Amax_tokens%3A%200%20%20%23%20Don%27t%20generate%20any%20more%0Atop_k_per_token%3A%201%20%20%23%20Show%20alternatives%20for%20each%20position%0Amodel%3A%20ai21%2Fj1-jumbo&environments=) (logprob: -5534.59)
[Prompt with 2048 tokens](https://crfm-models.stanford.edu/static/index.html?prompt=%22Previously%20on%20%22Wayward%20Pines%22...%22%20%22This%20fake%20little%20town%20is%20all%20that%27s%20left.%22%20%22There%27s%20a%20faction.%22%20%22They%27re%20gonna%20take%20down%20the%20fence.%22%20%22Surrender%20your%20arms%20and%20explosives%20by%20tomorrow%20morning%20and%20everything%20stays%20between%20us.%22%20%22Wayward%20Pines%20needs%20a%20new%20generation.%22%20%22You%20and%20Ben%20look%20so%20nice%20together.%22%20%22How%20is%20that%20working%20out%3F%22%20%22It%27s%20great%2C%20actually.%22%20%22You%20were%20right.%22%20%22They%20got%20to%20Ethan.%22%20%22We%20execute%20tonight.%22%20%22%20All%20right.%22%20%22Who%27s%20that%3F%22%20%22%20Ted%20Laufer.%22%20%22He%20drives%20the%20delivery%20truck.%22%20%22He%27s%20always%20right%20on%20time%2C%20right%20at%208%3A00.%22%20%22Okay%2C%20let%27s%20go.%22%20%22Help!%22%20%22I%20need%20a%20doctor!%22%20%22Help!%22%20%22Come%20here.%22%20%22Come%20here.%22%20%22%20I%20need%20a%20doctor.%22%20%22%20Sir%2C%20we%20can%20help.%22%20%22You%27re%20okay.%22%20%22Come%20with%20us%2C%20please.%22%20%22%20What%20happened%3F%22%20%22%20Truck%20exploded.%22%20%22Prep%20radiology%2C%20now!%22%20%22Oh%2C%20my%20God!%22%20%22Wait%20a%20minute.%22%20%22Is%20this%20guy%20a%20real%20doctor%3F%22%20%22%20Of%20course%20he%20is.%22%20%22%20We%20need%20to%20move!%22%20%22Ben%20will%20receive%20the%20best%20possible%20care.%22%20%22You%20know%20the%20children%20are%20our%20most%20precious%20resource.%22%20%22Pam%20to%20ICU%2C%20please.%22%20%22Try%20to%20remain%20calm.%22%20%22Go%20ahead%20and%20look.%22%20%22There%20you%20go.%22%20%22%20Hey.%22%20%22%20Oh%2C%20my%20God.%22%20%22Ah%2C%20here%27s%20Dr.%20Carol.%22%20%22So%20far%2C%20I%20see%20no%20significant%20injury%20to%20his%20brain%2C%20but%20we%20won%27t%20know%20exactly%20where%20we%20stand%20until%20he%20regains%20consciousness.%22%20%22But%20he%27s%20gonna%20be%20okay.%22%20%22If%20he%20comes%20to%20in%20the%20next%2024%20hours%2C%20the%20odds%20of%20a%20full%20recovery%20are%20very%20good.%22%20%22It%20could%20be%20a%20long%20night.%22%20%22Try%20to%20get%20some%20rest.%22%20%22What%20kind%20of%20person%20sets%20off%20a%20bomb%20in%20the%20middle%20of%20town%3F%22%20%22%20I%20told%20him%20to%20stay%20home.%22%20%22%20Hey.%22%20%22%20I%20did.%22%20%22%20It%27s%20not%20your%20fault.%22%20%22He%27s%20just%20a%20kid.%22%20%22He%27s%2014.%22%20%22Remember%20what%20you%20were%20like%3F%22%20%22Do%20you%20think%20he%27s%20involved%20with%20any%20of%20this%3F%22%20%22No.%22%20%22If%20you%20need%20anything%20at%20all%2C%22%20%22%20you%20just%20press%20this%20buzzer%2C%20all%20right%3F%22%20%22%20Thank%20you.%22%20%22Oh%2C%20Dr.%20Jenkins!%22%20%22How%20are%20the%20children%3F%22%20%22Amy%20Breslow%27s%20gonna%20be%20all%20right%2C%20all%20things%20considered.%22%20%22Ben%20Burke%20is%20still%20unconscious.%22%20%22But%20not%20to%20worry...%22%20%22Dr.%20Carol%20is%20with%20him.%22%20%22He%27s%20absolutely%20going%20to%20pull%20through.%22%20%22How%20have%20they%20been%20able%20to%20do%20this%3F%22%20%22!%22%20%22Settle%20yourself%20down%2C%20now.%22%20%22Remember%20where%20you%20are%20for%20God%27s%20sake%2C%20David.%22%20%22W-We%27ll%20put%20out%20an%20issue%20of%20the%20Chronicle.%22%20%22We%20explain%20this%20is%20a...%20it%27s%20a...%20an%20explosion.%22%20%22It%27s%20a%20gas%20leak.%22%20%22Yes.%22%20%22It%27s%20a%20fine%20idea.%22%20%22I%20just%20hope%20they%20buy%20it.%22%20%22I%27m%20worried%20about%20the%20townsfolk.%22%20%22And%20people%20have%20already%20started%20talking.%22%20%22I%20think%20we%20should%20do%20something%20for%20them%2C%20something%20very%2C%20very%20special%2C%20for%20the%20entire%20community.%22%20%22A%20celebration%3F%22%20%22Yes.%22%20%22Yes%2C%20a%20celebration%20of%20life%20in%20Wayward%20Pines.%22%20%22Remind%20everybody%20exactly%20how%20blessed%20we%20actually%20are.%22%20%22Hmm%3F%22%20%22This%20is%20internal%20bleeding.%22%20%22It%27s%20bad.%22%20%22We%20should%20keep%20moving.%22%20%22No.%22%20%22No.%22%20%22No%2C%20we%20have%20to%20stay%20here%20and%20wait%20for%20the%20others.%22%20%22%20No%20one%27s%20coming%2C%20Harold.%22%20%22%20We%20don%27t%20know%20that.%22%20%22And%20he%20is%20not%20gonna%20survive%20another%20move.%22%20%22Here%20they%20come.%22%20%22Thank%20God.%22%20%22I%20got%20some%20food%2C%20water%2C%20and%20first%20aid%20in%20there.%22%20%22Wait.%22%20%22What%27s%20Ruby%20doing%3F%22%20%22She%20had%20to%20go%20back.%22%20%22She%20can%27t%20risk%20showing%20up%20late%20for%20work.%22%20%22What%20happened%20to%20Eric%3F%22%20%22He%20got%20pinned%20between%20the%20truck%20and%20the%20dumpster.%22%20%22Well%2C%20we%20should%20take%20him%20down%20to%20the%20hospital.%22%20%22So%20they%20can%20execute%20him%3F%22%20%22What%20happened%20at%20the%20fence%3F%22%20%22Two%20got%20away%2C%20four%20got%20taken%2C%20and%20Kate%27s%20in%20jail.%22%20%22%20Oh%2C%20my%20God.%22%20%22%20Look.%22%20%22I%20really%20want%20to%20help%20you%20guys%2C%20but%20I%20can%27t%20stay.%22%20%22Sorry.%22%20%22I%20want%20to%20get%20out%20of%20this%20town!%22%20%22Why%3F%22%20%22Because%20none%20of%20it%27s%20real.%22%20%22It%27s%20a...%22%20%22it%27s%20a%20Potemkin%20village.%22%20%22They%20have%20them%20in...%20in%20Syria%2C%20North%20Korea.%22%20%22They%27re%20fake%20cities%20built%20to%20impress.%22%20%22Who%27s%20behind%20it%3F%22%20%22CIA%3F%22%20%22Is%20it%20social%20or...%22%20%22or%20medical%3F%22%20%22What%3F%22%20%22This%20government%20experiment.%22%20%22Is%20it%20social%20or%20medical%3F%22%20%22It%27s%20just%20a%20town.%22%20%22Just%20a%20town.%22%20%22With%20an%20electrified%20fence%3F%22%20%22W-W-W-With%20a%20microchip%20in%20my%20leg%3F%22%20%22!%22%20%22You%20have%20to%20write%20that%20down%2C%20huh%3F%22%20%22I%27m%20just%20noting%20your%20progress.%22%20%22I%27m%20not%20making%20any%20progress.%22%20%22I%20don%27t%20want%20to%20make%20any%20progress.%22%20%22I%20want%20to%20talk%20to%20someone%20in%20charge%20now!%22%20%22It%27s%20been%20two%20months!%22%20%22I...%22%20%22I%20am%20sorry.%22%20%22Oh%2C%20poor%20Katie.%22%20%22Not%20feeling%20so%20well%2C%20eh%3F%22%20%22Don%27t%20worry.%22%20%22We%27ll%20get%20you%20all%20fixed%20up.%22%20%22That%27s%20a%20good%20girl.%22%20%22Oh%2C%20shh%2C%20shh%2C%20shh%2C%20shh%2C%20shh%2C%20shh%2C%20shh%2C%20shh.%22%20%22Ruby%27s%20here%2C%20you%20guys.%22%20%22Heard%20the%20driver%20and%20two%20kids%20are%20still%20in%20the%20hospital.%22%20%22If%20that%20was%20the%20gas%20line%2C%20then%20how%20come%20the%20asphalt%20wasn%27t%20damaged%3F%22%20%22Only%20thing%20exploded%20was%20the%20truck.%22%20%22Had%20to%20be%20a%20bomb.%22%20%22What%20do%20you%20think%2C%20Dr.%20Jenkins%3F%22%20%22Well...%20when%20a%20disaster%20like%20this%20occurs%20in%20a%20town%20as%20beautiful%20as%20ours%2C%20it%27s%20natural%20for%20folks%20to%20ask%20questions.%22%20%22But...%20we%20should%20be%20careful%20not%20to%20spread%20rumors.%22%20%22Hello%3F%22%20%22Who%20is%20it%2C%20Ruby%3F%22%20%22A%20fellowship%20gathering%2C%20mandatory%20attendance.%22%20%22Give%20me%20a%20reading%20on%20Ruby%27s%20chip.%22%20%22She%20was%20late%20to%20work.%22%20%22Pine%20needles%20in%20her%20hair.%22%20%22She%27s%20at%20home%20in%20bed.%22%20%22Let%20me%20see.%22%20%22She%20must%20have%20taken%20her%20chip%20out%20last%20night%20and%20left%20it%20in%20her%20room.%22%20%22I%20wonder%20how%20many%20more%20people%20are%20home%20in%20bed.%22%20%22All%20right%2C%20where%20are%20they%2C%20Kate%3F%22%20%22Five%20of%20your%20people%20are%20off%20the%20grid%20right%20now%2C%20including%20Harold.%22%20%22You%20think%20I%20want%20to%20help%20you%20find%20my%20husband%3F%22%20%22Your%20husband%20blew%20up%20a%20truck%20last%20night%20on%20Main%20Street.%22%20%22He%20nearly%20killed%20my%20son.%22%20%22Ben%3F%22%20%22W-What%20are%20you%20talking%20about%3F%22%20%22I-Is%20he%20gonna%20be%20okay%3F%22%20%22Don%27t%20even%20say%20his%20name.%22%20%22%20Just%20tell%20me%20where%20they%20are.%22%20%22%20I%20am%20so%20sorry%2C%20Ethan.%22%20%22Something%20must%20have%20gone%20wrong%20with%20the%20timer.%22%20%22It%20was...%20it%20was%20meant%20to%20go%20off%20at...%20at%20the%20fence.%22%20%22Well%2C%20that%27s%20the%20last%20thing%20that%20we%20need%20to%20have%20happen.%22%20%22You%20know%20what%20the%20difference%20is%20between%20you%20and%20me%3F%22%20%22I%20believe%20what%20I%20know%20in%20my%20heart.%22%20%22You%20believe%20what%20they%20tell%20you.%22%20%22Look%2C%20I%20know%20you%20don%27t%20get%20it.%22%20%22I%20know%20you%20think%20they%20got%20to%20me.%22%20%22But%20I%20know%20what%27s%20out%20there%20and%20it%27s%20not%20Boise.%22%20%22You%20ever%20think%20about%20why%20they%20picked%20you%20to%20be%20Sheriff%3F%22%20%22%27Cause%20I%20have.%22%20%22You%20know%2C%20I%27m%20gonna%20take%20you%20up%20there%20so%20you%20can%20see%20it%20with%20your%20own%20eyes%2C%20but%20we%20don%27t%20have%20time%20with%20that%20now.%22%20%22See%20what%3F%22%20%22The%20monsters%3F%22%20%22Where%20are%20they%3F%22%20%22!%22%20%22You%20know%2C%20you%20have%20really%20good%20instincts%2C%20Ethan.%22%20%22But%20when%20push%20comes%20to%20shove%2C%20you%20will%20always%20follow%20orders.%22%20%22You%20have%20made%20the%20same%20mistake%20before.%22%20%22Well...%22%20%22I%27m%20not%20following%20orders%20this%20time.%22%20%22I%27m%20just%20trying%20to%20make%20sure%20that%20nobody%20gets%20killed.%22%20%22What%20happened%20to%20you%3F%22%20%22We%20were%20partners%3F%22%20%22Don%27t%20you%20trust%20me%20at%20all%3F%22%20%22These%20people%20want%20to%20be%20free.%22%20%22And%20I%20owe%20them%20that%20chance.%22%20%22Amy%20is%20holding%20steady%2C%20and%20Ben%20Burke%20looks%20like%20he%27ll%20pull%20through.%22%20%22Ruby%27s%20one%20of%20them.%22%20%22Ruby%3F%22%20%22Have%20you%2C%20uh%2C%20notified%20Ethan%20Burke%20she%20needs%20to%20be%20locked%20up%3F%22%20%22We%20need%20to%20put%20our%20own%20house%20in%20order%20first.%22%20%22I%27m%20not%20following.%22%20%22We%20have%2024%20people%20manning%20surveillance%20around%20the%20clock.%22%20%22Yet%2C%20somehow%2C%20these%20insurgents%20are%20managing%20to%20meet%20in%20secret%20and%20build%20bombs.%22%20%22Someone%20must%20be%20helping%20them.%22%20%22David%2C%20everyone%20up%20here%20is%20family%2C%20loyal%20to%20you%20to%20a%20fault.%22%20%22Someone%27s%20betraying%20us%20and%20we%20need%20to%20find%20out%20who%20it%20is.%22%20%22If%20it%20will%20help%20you%20to%20feel%20better%2C%22%20%22I%27ll%20conduct%20a%20full%20security%20review.%22%20%22Yes%2C%20it%20would%20help%20me%20feel%20better.%22%20%22Snipers%20have%20checked%20the%20north%20quadrant.%22%20%22All%20clear.%22%20%22You%20still%20happy%20with%20your%20decision%20to%20join%20us%20here%3F%22%20%22It%27s%20an%20absolute%20privilege%20to%20be%20here.%22%20%22Indeed.%22%20%22Indeed.%22%20%22And%20working%20Surveillance%2C%20is%20it%20ever%20uncomfortable%20for%20you%3F%22%20%22Do%20you%20ever%20feel%20like%20you%27re...%22%20%22I%20don%27t%20know...%22%20%22invading%20people%27s%20privacy%3F%22%20%22Uh%2C%20it%27s%20the%20job.%22%20%22I%20mean%2C%20we%20do%20it%20to%20protect%20them%2C%20right%3F%22%20%22Absolutely.%22%20%22Absolutely.%22%20%22How%27s%20Reggie%3F%22%20%22%20Very%20good.%22%20%22%20And%20the%20kids%3F%22%20%22Full%20of%20energy%2C%20as%20always.%22%20%22Oh%2C%20super%20good.%22%20%22How%20about%20your%20post%20at%20Surveillance%3F%22%20%22You%20enjoying%20that%3F%22%20%22I%20like%20it%20a%20lot.%22%20%22But%20sometimes%20you%20might%20want%20to...%22%20%22I%20don%27t%20know...%20avert%20your%20eyes%20or%20maybe%20even%20wipe%20video%20%27cause%20of%20something%20you%27ve%20seen%2C%20erase%20it.%22%20%22Are%20you%20kidding%3F%22%20%22Oh%2C%20I-I%20love%20it%20when%20they%20let%20something%20juicy%20slip.%22%20%22Very%20good.%22%20%22Super.%22%20%22Thank%20you%20so%20much%2C%20Gina.%22%20%22Can%20you%20send%20the%20next%20person%20in%3F%22%20%22Sure.%22%20%22Sweetie%3F%22%20%22Ben.%22%20%22Sweetie.%22%20%22Hi.%22%20%22How%20are%20you%20feeling%3F%22%20%22Water%3F%22%20%22Oh%2C%20yes.%22%20%22Yeah.%22%20%22There%20you%20go%2C%20sweetie.%22%20%22Don%27t%20lift%20your%20head.%22%20%22You%20have%20no%20idea%20how%20happy%20it%20makes%20me%20to%20see%20you%20open%20your%20eyes.%22%20%22Your%20dad%20and%20I%20were%20so%20scared.%22%20%22Where...%20where%27s%20Amy%3F%22%20%22She%27s%20here%20in%20the%20hospital.%22%20%22Is%20she%20okay%3F%22%20%22Yeah%2C%20s-she%27s%20fine.%22%20%22She%20was%20asking%20about%20you.%22%20%22Can%20you%20go%20check%3F%22%20%22Yeah%2C%20sure%2C%20I%20will.%22%20%22I%20love%20you%20so%20much.%22%20%22How%20are%20you%20feeling%3F%22%20%22Oh%2C%20okay%2C%20I%20guess.%22%20%22Oh%2C%20Ben.%22%20%22Oh.%22%20%22Everyone%20in%20town%20has%20been%20so%20worried%20about%20you.%22%20%22I%27m%20so%20relieved%20you%27re%20all%20right.%22%20%22Yeah%2C%20me%20too.%22%20%22Oh%2C%20it%27s%20just%20terrible%20what%27s%20happened.%22%20%22Sometimes%2C%20the%20choices%20one%20makes%20can%20lead%20to%20consequences%20we%20don%27t%20intend.%22%20%22I%20never%20should%20have%20snuck%20out%20with%20Amy.%22%20%22Oh%2C%20no%2C%20no.%22%20%22No%2C%20I%27m%20not%20talking%20about%20that.%22%20%22We%20want%20you%20to%20grow%20your%20relationships%20here.%22%20%22I%27m%20talking%20about%20decisions%20made%20by%20the%20Sheriff%20in%20pursuing%20the%20case.%22%20%22He%27s%20a%20good%20man%2C%20Ben.%22%20%22He%27s%20well-intentioned.%22%20%22And%20I%27m%20sure%20he%20had%20his%20reasons%20for%20letting%20Harold%20Ballinger%20go.%22%20%22Oh%2C%20I%20just%20hope%20his%20judgment%20wasn%27t%20clouded%20by%20the%20fact%20that%20Harold%27s%20wife%20is%20an%20old%20friend%20of%20his.%22%20%22Kate%20and%20your%20father%20are%20friends%2C%20right%3F%22%20%22Yeah%2C%20sort%20of.%22%20%22He%20arrested%20Harold%20and%20then%20he%20let%20him%20go.%22%20%22And%20then...%22%20%22I%20guess%20I%20just%20don%27t%20agree%20with%20that%20kind%20of%20leniency.%22%20%22I%20believe%2C%20as%20David%20Pilcher%20believes%2C%20in%20a%20philosophy%20that%20I%20like%20to%20call%20Clear%20and%20Severe.%22%20%22Clear%20laws%20and%20severe%20punishments.%22%20%22Clear%20and%20Severe.%22%20%22To%20be%20honest%2C%22%20%22I%20think%20your%20father%20and%20I%20disagree%20on%20this%20issue.%22%20%22But%20you%27re%20gonna%20have%20to%20give%20it%20some%20thought.%22%20%22People%20are%20gonna%20want%20to%20hear%20from%20you.%22%20%22What%20is%20the%20proper%20punishment%20for%20speech%20or%20actions%20that%20harm%20Wayward%20Pines%3F%22%20%22Leniency%20or%20Clear%20and%20Severe.%22%20%22You...%22%20%22you%20say%20that%20people%20are%20gonna%20want%20to%20hear%20what%20I%20have%20to%20say.%22%20%22What%20does%20it%20matter%20what%20I%20think%3F%22%20%22Ben%2C%20you%20survived%20a%20terrorist%20attack.%22%20%22You%27re%20a%20hero%20now.%22%20%22How%20long%20you%20think%20we%27re%20gonna%20survive%20out%20here%3F%22%20%22We%27ll%20think%20of%20something.%22%20%22Mm%2C%20good.%22%20%22That%27s%20what%20people%20always%20say%20when%20they%27re%20at%20the%20end.%22%20%22Hey.%22%20%22Don%27t%20fall%20apart%20on%20me.%22%20%22We%27ll%20think%20of%20something.%22%20%22Eric.%22%20%22Hey.%22%20%22I%27m%20not%20doing%20this%20by%20myself.%22%20%22Not%20here.%22%20%22What%20do%20you%20mean%3F%22%20%22I%27m%20not%20gonna%20let%20him%20rot%20for%20all%20eternity%20inside%20this%20prison.%22%20%22What%20are%20you%20talking%20about%3F%22%20%22We%27re%20not&settings=echo_prompt%3A%20true%20%20%23%20Analyze%20the%20prompt%0Amax_tokens%3A%200%20%20%23%20Don%27t%20generate%20any%20more%0Atop_k_per_token%3A%201%20%20%23%20Show%20alternatives%20for%20each%20position%0Amodel%3A%20ai21%2Fj1-jumbo&environments=) (logprob: -10564.16)

After some testing, I found the issue came from the AI21 API instead of our server code. Asked in their Discord Channel on 05/13/2022.



AI21's response: This is a server bug. Solution: Users should use 2047 as the max request length instead of 2048.
![image](https://user-images.githubusercontent.com/42804517/169782918-6d6d1b7d-cd15-438f-89c6-d2aa84ad6b35.png)


@YianZhang Thanks for reaching out to them! Can you create a PR and set the max context length to be 2047 instead?

@teetone I am doing it as a part of #311