Climate(Informa.cs(Recent(advances(and(challenge(problems(for(Machine(Learning(in(Climate(Science((Claire(Monteleoni(Computer(Science(George(Washington(University(Mo.va.on(for(Climate(Informa.cs(The(threat(of(climate(change:(((one(of(the(greatest(challenges(((currently(facing(society.((We(face(an(explosion(in(data!(((Climate(model(outputs(((Satellite(measurements((Environmental(sensors((…(Machine(Learning(has(made(profound(impacts(on:(((websearch,(internet(adver.sing,(Bioinforma.cs,(etc.(

Challenge:(accelerate(discovery(in(Climate(Science(with(ML((Climate(Data(is(Big(Data( ( ((with(credit(to(G.(Schmidt(Climate(Informa.cs:(related(work(• ML(and(data(mining(collabora.ons(with(climate(science(– Atmospheric(chemistry,(e.g.(Musicant(et(al.(’07((‘05)(– Meteorology,(e.g.(FoxURabinovitz(et(al.(‘06(– Seismology,(e.g.(Kohler(et(al.(‘08(– Oceanography,(e.g.(Lima(et(al.(‘09((– Mining/modeling(climate(data,(e.g.(Steinbach(et(al.(’03,((Steinhaeuser(et(al.(‘10,(Kumar(’10(• ML(and(climate(modeling(– DataUdriven(climate(models,(Lozano(et(al.(’09(– Machine(learning(techniques(inside(a(climate(model,(or(for(calibra.on,(e.g.(Braverman(et(al.(’06,(Krasnopolsky(et(al.(‘10((– ML(techniques(with(ensembles(of(climate(models:(((• Regional(models:(Sain(et(al.(‘10((Climate(Informa.cs(• The(First(Interna.onal(Workshop(on(Climate(Informa.cs,(2011(– New(York(Academy(of(Sciences,(New(York,(NY,(August(2011(• The(Second(Interna.onal(Workshop(on(Climate(Informa.cs,(2012(– Na.onal(Center(for(Atmospheric(Research,(Boulder,(CO,(September(2012(• Climate(Informa.cs(wiki:((((((((hcp://sites.google.com/site/1stclimateinforma.cs/materials(– Data(sources(and(descrip.ons(– Challenge(problems(– Links(to(tutorials(and(materials(• Climate(Informa.cs(book(chapter([M,(Schmidt(et(al.(2012](– Challenge(problems((– Data(descrip.ons(– Success(stories(and(related(work(PaleoUtemperature(Problem:(– To(understand(climate(change(we(need(to(understand(past(climates.(– NOTE:(climate(has(ﬂuctuated(at(much(greater(scales(in(the(past(than(in(the(20th(Century.(– However(the(variance(on(measurements(is(higher(in(the(past.(• We(did(not(have(a(global(grid(of(measurements(• Measurements(corrupted(or(lost(Challenge:(use(paleoUproxies(to(reconstruct(temps(e.g.(tree(rings,(ice(cores,(water(isotopes.((Credit:(J.(Smerdon(Climate(extremes(There(is(evidence(that(even(with(a(warming(trend,(variance(is(predicted(to(increase.(! Increasingly(extreme(events(e.g.(– (cold(spells(– (droughts((Challenge:(detec.ng,(predic.ng(climate(extremes.((Drought(detec.on(over(the(past(century(with(MRFs([Q.(Fu,(A.(Banerjee,(S.(Liess,(and(P.(K.(Snyder,(SDM(2012](Each(panel(shows(the(drought(star.ng(from(a(par.cular(decade:(1905U1920((top(lel),(
1921U1930((top(right),(1941U1950((bocom(lel),(and(1961U1970((bocom(right).(The(regions(in(black(rectangles(indicate(the(common(droughts(found(by(previous(work(in(climate(science.((((((((((((((((credit:(A.(Banerjee((Climate(change(acribu.on(((Challenge:(which(factors(have(contributed(to(temperature(changes(and(to(what(extent?

(([Lozano(et(al.(KDD(2009]:((Which(factors(grangerUcaused(extreme(temperatures?((Approach(using(group(elas.c(nets.(

credit:(Lozano(et(al.(Climate(modeling(Climate(model:(a(complex(system(of(interac.ng(mathema.cal(models(Not(dataUdriven(! Based(on(scien.ﬁc(ﬁrst(principles(!

••••Meteorology(Oceanography(Geophysics(…(Climate(model(diﬀerences(Assump.ons(! Discre.za.ons(! Scale(interac.ons(!

••

Micro:(rain(drop(Macro:(ocean(A(climate(model((image(credit:(G.(Schmidt)(

Climate(forcings( ( ( ( ( ( ( ( ( ((Slide(credit:(G.(Schmidt(Surface(temperature(anomalies(Slide(credit:(G.(Schmidt(Climate(models(• IPCC:(Intergovernmental(Panel(on(Climate(Change(– Nobel(Peace(Prize(2007((shared(with(Al(Gore).(– Interdisciplinary(scien.ﬁc(body,(formed(by(UN(in(1988.(– Fourth(Assessment(Report(2007,(on(global(climate(change(450(lead(authors(from(130(countries,(800(contribu.ng(authors,((((((((over(2,500(reviewers.(– Next(Assessment(Report(is(due(in(2013.(• Climate(models(contribu.ng(to(IPCC(reports(include:((((((((Bjerknes(Center(for(Climate(Research((Norway),(Canadian(Centre(for(Climate(Modelling(
and(Analysis,(Centre(Na.onal(de(Recherches(Météorologiques((France),(Commonwealth(Scien.ﬁc(and(Industrial(Research(Organisa.on((Australia),(Geophysical(Fluid(Dynamics(Laboratory((Princeton(University),(Goddard(Ins.tute(for(Space(Studies((NASA),(Hadley(Centre(for(Climate(Change((United(Kingdom(Meteorology(Ofﬁce),(Ins.tute(of(Atmospheric(Physics((Chinese(Academy(of(Sciences),(Ins.tute(of(Numerical(Mathema.cs(Climate(Model((Russian(Academy(of(Sciences),(Is.tuto(Nazionale(di(Geoﬁsica(e(Vulcanologia((Italy),(Max(Planck(Ins.tute((Germany),(Meteorological(Ins.tute(at(the(University(of(Bonn((Germany),(Meteorological(Research(Ins.tute((Japan),(Model(for(Interdisciplinary(Research(on(Climate((Japan),(Na.onal(Center(for(Atmospheric(Research((Colorado),(among(others.(Climate(model(predic.ons(Global(mean(temperature(anomalies.((Temperature(anomaly:(diﬀerence(w.r.t.(the(temperature(at(a(benchmark(.me.((Magnitude(of(temperature(change.((Averaged(over(many(geographical(loca.ons,(per(year.(1.2

Global mean temperature anomalies

1Thick blue: observed
Thick red: average over 20 climate model predictions
Other: climate model predictions

0.8

0.6

0.4

0.2

0−0.2

−0.4

−0.6

−0.8

1020

30

40

50

60

70

Time in years (1900−2008)

80

90100

Climate(model(predic.ons(4.5Global mean temperature anomalies

4Thick blue: observed
Thick red: average over 20 climate model predictions
Black (vertical) line: separates past from future
Other: climate model predictions

3.5

32.5

21.5

10.5

0−0.5

20406080100120140160180

Time in years (1900−2098)

Future(fanUout.(Improving(predic.ons(of(Mul.UModel(Ensemble(of(GCMs(• No(one(model(predicts(best(all(the(.me.(• Average(predic.on(over(all(models(is(best(predictor(over(.me.(([Reichler(&(Kim,(Bull.(AMS(‘08],([Reifen(&(Toumi,(GRL(’09](• IPCC(held(2010(Expert(Mee.ng(on(how(to(becer(combine(model(predic.ons.(Can(we(do(becer,(using(Machine(Learning?((((Challenge:(How(should(we(predict(future(climates?((– While(taking(into(account(the(20(climate(models’(predic.ons(Tracking(climate(models([M,(Schmidt,(Saroha,(&(Asplund,(SAM(2011((CIDU(2010)]:(• Applica.on(of(LearnUα(algorithm([M(&(Jaakkola,(NIPS(‘03]((– Online(learning(to(track(a(set(of(“expert”(predictors(under(changing(observa.ons.((• Tracking(global(climate(models,(on(mean(temperature(anomaly(predic.ons.(– Experiments(at(global(and(regional(scales,(annual(and(monthly(.meUscales.(• Experiments(on(historical(data((– Valid,(since(climate(models(are(not(dataUdriven.(• Future(simula.ons(using(“perfect(model”(assump.on(from(climate(science.(Online(learning(with(expert(advice(Learner(maintains((distribu.on(over(n$“experts.”((• Experts(are(black(boxes:(need(not(be(good(predictors,(can(vary(with(.me,(and(depend(on(one(another.(We(use(GCM(temp.(predic.ons.(• Learner(maintains/updates(probability(distribu.on(pt(i)(over(experts,(i,(represen.ng(how(well(each(expert(has(predicted(recently.((– Used(to(inform(learner’s(predic.on.((• L(i,$t)(is(predic.on(loss(of(expert(i(at(.me(t.(We(use(squared(loss.((• Family(of(Mul.plica.ve(Updates(algorithms((cf.(“Hedge,”(“Weighted(Majority”),(descended(from(“Winnow,”([Liclestone(1988],[Liclestone(&(Warmuth’89]. ((Online(learning:(.meUvarying(data(
pt+1 (i)pt (j)e L(j,t) p(i|j)
j• For(a(family(of(these(algorithms,([M(&((Jaakkola,(2003](derived(pt(i)(as(Bayesian(updates(of(a(generalized(Hidden(Markov(Model(• Hidden(variable:(iden.ty(of(current(“best(expert”(• Transi.on(dynamics,(p(i$|$j),$model(nonUsta.onarity(Online(learning:(.meUvarying(data(FixedUShare(Algorithm([Herbster(&(Warmuth,(1998]:(• Assumes(there(is(a(probability(α(that(the(hidden(“best(expert”(switches(at(each(.me(step((Online(learning:(.meUvarying(data(
pt+1 ( )pt ( )e L( ,t)LearnUα(Algorithm([M(&(Jaakkola,(2003]:((• Learns(the(α(parameter(by(tracking(a(set(of(metaUexperts,(FixedUShare(algorithms,(each(with(a(diﬀerent(α(value(Performance(guarantees([M(&(Jaakkola,(NIPS$2003]:((Bounds(on(“regret”(for(using(wrong(value(of(α for(the(observed(sequence(of(length(T:(((((Theorem.((O(T)(upper(bound(for(FixedUShare(α)(algorithms. (((((((Theorem.((Ω(T)(sequence(dependent(lower(bound(for(( ( ( ( (FixedUShare(α)(algorithms.((( ((Theorem.((O(log(T)(upper(bound(for(LearnUα(algorithm.(((• RegretUop.mal(discre.za.on(of(α for(ﬁxed(sequence(length,(T.((• Using(previous(algorithms(with(wrong(α can(also(lead(to(poor(empirical(performance.((((Tracking(climate(models:((experiments(• Model(predic.ons(from(20(climate(models((– Mean(temperature(anomaly(predic.ons((1900U2098)(–(CMIP3(archive(• Historical(experiments(with(NASA(temperature(data(–(GISTEMP(• Future(simula.ons(with(“perfect(model”(assump.on.(– Ran(10(such(global(simula.ons(to(observe(general(trends(– Collected(detailed(sta.s.cs(on(4(representa.ve(ones:(best(and(worst(model(on(historical(data,(and(2(in(between.(• Regional(experiments:((data(from(KNMI(Climate(Explorer(– Africa(((U15(–(55E,(U40(–(40N)(– Europe(((0(–(30E,(40(–(70N)(– North(America(((U60(–(U180E,(15(–(70N)(– Annual(and(monthly(.meUscales;(historical(&(2(future(simula.ons/region.(( Learning(curves(((-<;12=-,>?,1=@,2=-,>?,1=
AB,10C,-?1,9*D=*;.-;B,1-!"-+;9,:2
E,01.!0:?F0-0:C;1*=F+67801,9-:;22

#

'!

&"-!"

#"

$"

%"

&""

&!"

&#"

&$"

&%"

)*+,-*.-/,012-3&4""!!"4%5.

"'#("'#=-3>.-?@-2>
AB-21C-.@2-:+D>+</.<B-2.!".,<:-;3
E-12/!1;@F1.1;C<2+>F,"')(78912-:.;<33"')"'!("'!

"'&("'&"'"(".

!"

#"

$"

%"

&""&!"*+,-.+/.0-123.4&5""!!"5%6&#"&$"&%"

Global(results(On(10(future(simula.ons((including(1U4(above),(LearnUα(suﬀers(less((loss(than(the(mean(predic.on((over(remaining(models)(on(75U90%(of(the(years.(

Regional(results:((historical(((((((((( ( ((((((Annual ((((((((((((((((Monthly(Regional(results:((future(simula.ons(Contribu.ons(Tracking(climate(models((TCM)((([M,(Schmidt,(Saroha,(&(Asplund,(SAM(2011((CIDU(2010)]:(– Applied(online(learning(with(expert(advice(to(track(GCMs(– Considered(each(geospa.al(region(as(a(separate(problem(((• ((NeighborhoodUAugmented(TCM((NTCM)(([McQuade(&(M,(AAAI(2012]:(– Build(a(rich(modeling(framework(in(which(the(climate(predic.ons(are(made(at(higher(geospa.al(resolu.ons(– Model(neighborhood(inﬂuences(among(geospa.al(regions(•(NeighborhoodUAugmented(TCM((NTCM)(• Run(instances(of(LearnUα((variant)(on(mul.ple(subUregions(that(par..on(the(globe(• Global(temperature(anomaly(computed(as(mean(of(subU
region(algorithm(predic.ons((• Experiments(conducted(using(several(diﬀerent(region(sizes((NeighborhoodUAugmented(TCM((NTCM)(
NonUhomogenous(HMM(transi.on(matrix:(••••

S(r)$U(neighborhood(scheme:(set(of(“neighbors”(of(region(r(Pt,s(i)(U$probability(of(expert(i(in(region(s$β(U(regulates(geospa.al(inﬂuence$
Z(U(normaliza.on(factor((Neighborhood(schemes(• Update(is(modular(with(respect(to(neighborhood(scheme(S(r).(• A(possible(neighborhood(scheme(below(– Could(also(be(con.nuous(set(of(neighboring(regions,(e.g.(using(a(Gaussian.(Experimental(Setup(• GCM(hindcasts(from(the(years(1890U2000((– IPCC(Phase(3(Coupled(Model(Intercomparison(Project((CMIP3)(– Climate(of(the(20th(Century(Experiment((20C3M)((– One(run(from(each(contribu.ng(ins.tu.on(arbitrarily(selected((• Observed(temperature(anomaly(data(from(NASA(GISTEMP(• All(data(converted(to(temperature(anomalies(– Benchmark(period(1951U1980((Results(Challenges(in(climate(modeling((Challenge:(Improve(the(predic.ons(of(the(mul.Umodel(ensemble(– Extensions(to(Tracking(Climate(Models(• Diﬀerent(experts(per(loca.on;(spa.al((in(addi.on(to(temporal)(transi.on(dynamics(• Tracking(other(climate(benchmarks,(e.g.(carbon(dioxide(concentra.ons(– {Semi,un}Usupervised(learning(with(experts.((Largely(open(in(ML.(– Challenge:(try(other(ML(approaches!((e.g.(batch,(transduc.ve(regression?)(

Challenge:((Improve(the(predic.ons(of(a(climate(model(– Challenge:(resolve(scale(interac.ons((“climate(model(parameteriza.on”)(– Challenge:(harness(both(physics(and(data!((• Hybrid(methods(• Data(assimila.on(– Challenge:(Calibra.ng(and(comparing(climate(models(in(a(principled(manner(More(challenges(in(Climate(Informa.cs((Challenge:(Clustering(/(detec.ng(spa.otemporal(pacerns((e.g.(droughts,(cyclones(– Algorithms(for(streaming(and(online(clustering(– Graphical(model(approaches,(e.g.(from(topic(modeling(Challenge:(Building(theore.cal(founda.ons(for(Climate(Informa.cs(((– Coordina.ng(on(reasonable(assump.ons(in(prac.ce,(that(allow(for(the(design(of(theore.cally(jus.ﬁed(learning(algorithms(Challenge:(tracking(polar(ice(melt(from(satellite(image(data(Challenge:(short(term(climate(predic.on(Challenge:(regional(climate(predic.on(:(Thank(You!(( ( (And$thanks$to$my$coauthors:$“Tracking(Climate(Models”((Gavin(Schmidt,(NASA$GISS$&$Columbia$University$(Shailesh(Saroha,(Amazon$(Eva(Asplund,(Columbia$University$“Global(Climate(Model(Tracking(using(Geospa.al(Neighborhoods”((Scoc(McQuade,(George$Washington$University$“Climate(Informa.cs”((Gavin(Schmidt,(NASA$GISS$&$Columbia$University$(Frank(Alexander,(Los$Alamos$NaJonal$Laboratory((Alex(NiculescuUMizil,$NEC$Laboratories$America$$Karsten(Steinhaeuser,$University$of$Minnesota((Michael(Tippec,(The$InternaJonal$Research$InsJtute$for$Climate$and$Society,$Columbia$$Arindam(Banerjee,(University$of$Minnesota((M.(Benno(Blumenthal,$InternaJonal$Research$InsJtute$for$Climate$and$Society,$Columbia$$$Auroop(R.(Ganguly,$Civil$and$Environmental$Engineering,$Northeastern$University((Jason(E.(Smerdon,$LamontODoherty$Earth$Observatory,$Columbia$University((Marco(Tedesco,$CUNY$City$College$and$Graduate$Center$(

Climate(Informa.cs(wiki:(hcp://sites.google.com/site/1stclimateinforma.cs(
data,(links,(and(challenge(problems(Climate(Informa.cs(2011(August$2011,$New$York$Academy$of$Sciences$
CoUChairs:(Claire(Monteleoni(&(Gavin(Schmidt$
Organizing(Commicee:((Frank(Alexander((Alex(NiculescuUMizil((Karsten(Steinhaeuser((Michael(Tippec(( ( ( (Climate(Informa.cs(2012(