「インタラクション，97」平成9年2月

lへ

′

ヽ1ヽ
−、慮

一∴DeslgnlngStory−Based壬nterfacesbyI、nterValScriptsT

●

●

†

MITMediaLaboratory．

γ1

〉

ぎ璧・ 1

Claudiざ膏．pinhanez

KenjiMase鞠pinhanez＠media．mit．edu

AramiBobitk．1
MITMedi島La払ratory

軍R⊥MIeResearchLab・
maBe＠mic．atr．coJP

bobick＠media．mit．edu♪1

う【テ11鶴ヽ．J■∵∵＝ ＝Jl晶l〜

、 寸

言 ろ

′ナ

1

Abstract 墨痕p叩era）rgueSthatint甲aCtioninimmersive，StOry−basedinterfaJ轡ご￡anbe

describedbyst軸t㌻甘asedら血temp嶽正■i翫折alsandtheirlocalrelationships．Ins定chinterval
SCriptsthe．．sysiem？邑desi甲erattaChes′亭enSOrand・醍CtuatOrrOutinestotimelintervalsandthe i−ヽ／developmentof ●theinterac毛ionisd誠五占db■yノ1もcal，PreCedence・rQlati9nSPrOvidedby埴e4esigner
Ofthesystem．Intervalscriptsha，Vethepotential・tOeXPreSSmOre．Cl号arlytheco叫Plexstructure

oftimeeventsini血mefsiveleiivironmentswhbrethe′uSer，s、aCtionsLSPaJn．nOn−P11nCtual・intervals
Oftime，makihr岳ntheuseofevent二ba眉edintera，Ctiondesignノquitedi伍cult′．Thispapertexamines
indetai1twoscenesimplementedinaprbtotypeinteratctivesy昏temCal1ed・SingSong．

イ′ンタ「パル・スクリプトを用いた物語的インタフコ∵「スの記述法
l あらまし■臨瘍感があ的な関係に基づくスクリプト・（イン示す。それ御国々めセンサー関数とアクチ皐エータ関数を時間区間に結合させておいて、インタラク
ションの展開をその時間区間の並びを定義することによって記述する。本文では∫如∫0れgと呼ぶ実験システムの2つの場面をとり．あげて、スクリプトの記述法を辞しく述べる。

1 Introduction

mousd，OreVen、speech．1Wewa．nttobea，blettI
StePhrtherfromthe よsk＆tell interfaceera，
to
The design ofhumanmachineinteractio血re− the㍑a，Ctio血＆feelわerawhere users become

q−11reS a■lot ofknowledge and experience、in ● ableto11Seth6irwholebodyforinteractionin

immersiヤe6nvironments（【5，6，8】）．Tbhandle

manydifhrentfi
actionthedesignofsuchimmersiVe血Vifonmentsitis
is animportahtsubjectwhichha，S nOt

necessarytodevらlop岳criptingtooIswhichab−stract sensor and act11atOr COntrOlissues a血dmulti−mOdalandgesture−basedscriptedint占f−
been well discussed especially in the case ofactioふs（［2］）．Oneoftheobjectivesofourcur−enablediiectexpre畠sionofintera，CtiVeaction．
In this papef we prQPOS占．チ血ovel．script
rentresearchisthedesignandimplementaJtion
Par
Ofaninteractionmanagersy岳temwhichisa，ble

adig亘fori．

tohandlecomplexpatternsofimmersiveinter−acti血evoIvinguthrough、time∴The∴interactionモ 1ng uSIPg intervalsis di岳clissed and ekempliて ●fiedihahihte■ralctivesyste叫叫medSingSong
manqgershoddbeabletotrackmultiple？On−
CTr！entStOriesturnedヰoroGactordi叩tOtheWhichwaJSdesignedandimplepenteduslngthe ●Paradigm．We、havenoticedthatusersseemeddevelop甲entOfabasicstoryandtheusers ac−tionミ・Therehavebeenf6wexperimentswith、 to be q11ite comfortable tointeract with the㌢ active objectsin the SingSong environmerLt
mostIyduetd、the 1d6seconstr血tsoh壷ratiムn t
also−￣int．9reStedin？Ⅹam！nlngtheimpa≠tthat

StO中や車中車中聖m棚】）叫やや

SOmedramatic年aturespresentinstoriescan
andtiihingofふctionwhichisam■aihfba，turi of
haveiムint占rfaceaesign（［4］）．

intervalscripts．

Fbrtheactual ru平Ofthesy声tem．

AIso，geStllre−and actionvba声edint9raCt．ion lembodies physicalactions which makein：terfaces！fun．dam印tal1y 4i鮎rent to conven− intervalscript・tOdeterminewh6nitLisappro−
tio？almoふQtO読icinterfacesbasedonkQyboard，Priateto cal1senslngand actuating．irOutines．
●

ー17−

TheinteractionmanagerWaSdevelopedba・Sed＝＝＝・‡Q仙L8

on the PⅣF calculus of Pinhanez and Bobick（【7］）．Thispap．eralsoprovidesdetai1edexam−
一−一丁■抽ORE■
plesoftheintervalscriptoftwoscenesanda−▲−
一丁▲購℡○
generalevaluationofthestrengthsandweak−

一丁一−−▲1郡RE−丁−▲一⊥▲1氾王℡8nessesofthepara，digm・−−8−−▲ov恥入p8▲10VERuP8

三±＝＝抽IpG。

▲1DtJRエNGO−・▲−−

2 A NovelParadigm：Inter−val Scripts

▲ −

T−

▲15T▲R℡○

Aniruert）alscriplis alowlevelinteractive▲1FェNエSg8
script paradigm based on explicit declarationof the relationships between the timeinter−
Figurel：AllenIsIntervalAlgebra：Thepossi−
valscorrespondingtoactionsandtosensorac−●
tivities．In aninterval畠cript the designerble13prlmitivetimerelationshipsbetween2
oftheinteractivesystemdeclarestemporalinter−intervds【1】・

valscorrespondingtothedi鮎rentactionsand
eventsandthetemporalrelationship between

declaredtha．tintervalAisBEFOREB，andBis

someofthose二Pa，1rSOfiIlt占rvals，i・e・，Whether ● BEFOREC，Allen）srepresehtationenablesthein−
twointervalshappeninsequence，OVerlap，Or
ferencethatA
aremutual1yexclⅦSive．Noexplicittinierefbr−
analgorithm，laterrevisedby［91，Whichprop−
ences are neededfor6ither duration，Start，Or
agatesthetimerelationsthroughacollection

finishofaninterval．

ofintervalsdetermlnlngthemo？tCOnStrained ●●disjunCtionofrelationshipsibr

2．1Allen，sIntervalAlgebra

te王vals￣which satisfies the glVenrelationships
andis consistentintime．

Tbmodelthe timerelationships betweentwo
Touseanintervalscriptinthereal−timecon−
int8rVals we employ theinterval−based time trolofaninteractivesystemwedevelopedan
representationproposedbyAllen［1】・There？−intera，Ction．managerprogra．mbasedonthePⅣF
rese？tation主sbasedonthe13possibleprlml−
CalculusQfPi串鱒Zand声Obick（【て】）・Thein−tiverelationshipsbetweentwointervalswhichteractionmanagprlSreSPOnSibleforcontrollingares11mmarizedinfig．・1．
allsen＄Oralndactuatorrqutines，decidingwhen
Giventwoevent声intherealworld，theirpos−
itisapprQPria，tetOCal1each、rOutineandtrans−

sibletimeしrelationshipcanalwaysbedescribed
ferrlngVal11eS正omsenβOrStOaCtua・tOrS・The
managerStOreStheLintervalscriptinaninter−byadisjunctionoftheprlmitivetimerelation−●● ships．Forinstance，theaJCtionofdrivlngaCar
nal陶bleandis abletomaintaininforma，tion
mu？thappenwhile，thecarenglneison・Usinga．boutevent＄Whichhappenedinthepast・lAllen，stemporalprlmitives，the′iIlterValasso」 ●cia，tedwithdrivingthecar＿eitherSTARTsor
2．2 ConnectingtotheRealⅥわrld
FINI．S抒由OrhappensI）URING−OrisEQ
totheinter）alwhentheenglnやison．Thatis，Acqotdingtoour proposalofintervalscripts
thetimerelationshipbetween′drivingandhav−
theinteractionofasystemisdescribedbytem−

1ngthecare喝1meOnCanbedescribedbythe ●●poralintervalsconpectedtosen80r8andactu−
diijun云tiondf（START，DURIN G，FIⅣISH，EqUAL）．
a．tor8．Connectorswithrealworldeventsar？
Ofco11rSe，1narealoccurrenceofadrivingac−
general1yre知redas exte；nals．Inth占inter−tion，Onlyoneoftherelationshipsact11al1yhap−
valscriptparadigmthedesignerhastwobasic

tasks：
MostoftheinterestinAllen srepresenta，tion
atingroutinescorrespondingtodiffbrehtexter−
fortimeintervalscomesfromamechanismby
nalsandtodeterminetherela，tionshipsbetween
penS・● Whichthetim色relatibnshipsbetweenthepalrS
theintervalsdefinedbythoseexternals・
Ane3：te←nalisthe concept ab占tracti血gthe
1ection ofal1intervals．Forinsta′nC畠，ifitis
internalmechanisms req11ired torun the dif−bfintervalscanbepropagatedthroughthecol−−18−

Hultl叫■OttVlty
lnt●r一義I・■■●Y●nt −◆
I巾t●rY●llnt●rV■1
8￠tu■llnt●rV8I

HOT＿仙押…トH▲■■馴卜」HOW▲印判卜鵬押tHIHO†＿H▲■■lH

T唾Or 申￠tlvl坤郎椚●VO叫■￠t暮VIty

OMFl＋

01l

tnt●rV■l◆●Y●nt 一◆暮nt●rY■lO一戸トー馴 →○押

d…t．．d○■■HO▼H▲■■馴

1F：＝

HOLDO川○㌻ ■ 仲川○ 100H∈

Figllre3：IntervalsalSSOCiatedwithana・CtuaJtOr・

：○■■
書
こ
トH▲押馴」NO†＿H▲押■H

ActllatOrS

Inthecaseofactuator＄thedesignerhastopro−● Figure2：Intervalsas＄OCiatedwitha8enSOr？＿1nvidearoutinewhichacceptsaswitchingcom−

twodi鮎rentconfigurations・mand（ON，OFF，RESET）and returnS aState−descriptive message：NOT−DOIⅣG，DOIⅣG，Or

ferent sensorsand actua，tOrS．In fact，an DONE．The
eX−
fbedbackfrom the routineisim−
ternalsea血1esslyencapsulatestheconnections
portantbecauseactionsintherealworldhave
between．aJdesigner）s routine and theinter−
theirowntimlngandprlOrity，independentof ●■valstruCtureuSedtomanagetheinteraJCtion・
the desires ofthe designer oroftherunnlng
Q11itecommonlymorethanoneintervalisas→
script．Asituationmightcal1fbrtheplaJying

sociatedtooneexternalasshownla，ter．

ofasoundbutthesoundmightbedelayedby

Sensor岳if，forinstance，anOther actuatorhasalreadygrabbedsomerequiredhardwareconnection・Those characteristics of act11atOrS are re一

年netWOrkproblemormightnotha・PPenatal1

In interactive environments sensors can play
且ectedinoursystembytheassociationoftwo
therolesofchooser，locator，Valuator，etC・（seeintervals to act11atOrS：a desiredintervaland【2】）．WehaveanalyzedaJndimplementedonly
anaCtualinterval．Figure3shows therela−
the binary case ofa chooser sensor，thatis，
tionshipbetweentheintervalsaJndtheactuator■ a sensor which detects whether somethinglS
routine providedbythe designer・When thehappenlngOrnOt・lIowever）al1sensors have ●desiredintervalishappenlng，theintera，Ction ●atlea眉ttWOtimeintervalsnatural1yassocia，ted
managerSends ONmessagestothe designerIs
tothem：a，naCtivityintervalwhichdeterminesroutine．When，andifthe・aCt11atOrgOe＄On，
whenthesensoris active，andan eventinter−
theretufnlng．DOIⅣGmessa，getel18theinterac− ●valwhichcorrespondstoanoccurrenceofthetionmanaJgerthattheactionisreallyoccurrlng ●andthereforethattheactuallintervalishap−

SenSOr．

In the case ofbinary・Chooslng SenSOrS・the ● penlng・
Whenthede8iredintervalfinishes，thein−
designeroftheinteractivesystemhastopro−teractionmanagerStartSSendinganOFFmes−
videaroⅦtinewhichreceive＄aSlnPutaSWitch− ■8agetOtheactua・tOrrOutine・IIowever†theend
ing command（0Ⅳ，OFF，RESET）and returnS

ofthe actualintervalis decidedbythero11−
QneOfthefo1lowlngthreevalues：HAPPENIⅣG，
tineitselfiitmayhappenbefore，atthesame，
NOT−HAPPENIⅣG，OrUNKⅣOWN．DuringLthetime
orsometimeaStertheroutinereceivestheoFF● theactivationintervalisormaybehappenlng，
message，dependingontheproperticsofthede−
theinteractionma・naJgerSendsanONcommand．to地e，desi苫ner，srotLtine，且ndoFFotherwise・ VicebeingcontrdLled・

Figure2showstheintervalsassociatedwith
asensorintwodi飴reムtsituations．Inthefirst
Timerssit11ationitisshowntha，ttheeventintervalcan

Althoughthegeneralobjectiveofthisproposal

OCCurisin OⅣ．−The second situation shownin theistowritescriptswithoutexpliとittirhere鮎r−bottomoffig．2exemplifi6sthecaseoftriggers
which turnbn only once；thisis achievedby

ences，80metimesitPis necessary to constfain

thedlirationofanaCtionora．senslngaCtivity．
automaticallyincorporati血gintothescriptthe
In out conceptualization a．timeris a special
relatipnshipstaJtingthattheactivityinterval caseofanactuator，thusdefini血gd8Siredand
actualintervals．Thedesired、intervalisused
MEETsorhappensBEFOREtheevQntinterval．

ー19−rightnoteun1esstheconductorkneesdown勃nd．

Pleads・ A鮎ral1si平geTS

こ÷・・・；・ll、 ） ▼ ■∴・ −J、 ）■・ ・・■∴‥こ newrroteofTth占sor［gi＄・triggeredby：araisin査of

thearms・Whenthesongis触shed，ap→Pl叫更甲
arehea，rd，andtheslngerSfo1low地econdqctor ▼蕪′t

PNF・8■●●d川t●r▲￠tl011
H＝g■r／ifshebowsback．Wh融thcf・C6競ductor・StaSt8・・tO

leave・thescehe，Singer＃1strikesanewround
Ofcomplaints．
＿一J」■

●OUnd

Alltheinteractionisnonverbal，．the、．uSerOf
Performergesturesandthe・CG−Character畠′Slmg
notesandmove．Aswesee，animportantfea−●P叩kor8ynth…l王○−

Figure4：ThebasicsetupofSingSong・

t11reOfSingSongis thefact thatitimmerses

theuser7inasimplestorywhichun血1dsastheinteraction−prOCeeds．

toturnthe、timer on and o環；the actualin− SingSbngwas designed to be enJOyedboth
terval−eSPeCial1yitsendTCaJn．beusedto
as血u＄ereXPerienceandasacomputerthe−

triggerotheractionsasthetimerexpires・

aterperforma軋Ce・Inthelater caseチYaSde■
scribed by Pinhanezin［6］L，Our SyStemJPrO−

3 Designing an・Application Videscomputer−generatedpartnerstoahumanperformerwhicharenotonlyreactivebutalso
WithInterv血IScripts
abletofo1lowapre−definedscript・Thetran−
sition between the performance and the user
The，methodologyandalgorithmsdescribedinmodeissea，mless，enablingJtheusertoexperi一
thispaperhavebeentestedinastory−based，
encethestoryaslivedbytheperformer・Typ−interactivesyste血named SingSong・・Figure4
ical1y a，Performeris able toproduce aJゝmore

vividandinterestingresultforthoseobservlng

showsthebasicstruCtureOfSin9Son9Wherea

large video screen displaystheima・geOffour
thesceneffomo甘tSidebecausesheca，nClearlycomputergra，phics−a，nimatedcharacterswhich
reacttothesituationsandexpressivelydispla）yS
canf sing musicalnotes（asprod11CedbyaJSyn−her emotions．

thesizer）・Acチ？eraWatChestheuserorper−

former determlnlngthe position ofher head，

3．1IntervalScriptoftheFirstScene

hands，andfeet．Thebodypo＄itionis recov−
eredbythe、SOftware＿PPnderdevelopeda，t Thefirstthesqene ofSingSongemploys several● di蝕rent externals．Ch？ttinglSanaJCt11atOr

MITMedia■Laboratory（【10】）・

SingSong makes the user take the role ofwhichcontrol声theso11p．dandthemouthmove−a conductor of a chorus ofrfour comp：uter−
m印tS＄imulatingthe chatting a，Ction ofea仁hSlnger・FourcopleSOfCh．atting？reuSed）On乍 ●●graphics characters．EIThe story starts withthe singers anima．tedlytalkingto′eaLChother・for ea．qh singer．Bequiet and。Bequiet2are
ThecondllCtOrenterS．and，tOgettheslngerS triggersensorswhichfireiftheus？rraJisesboth●a，ttention，raisesher，armS、．Thisge＄ture：StOPS
arms abovehis hea，d．stareConduGtOr、is anthechattingofonlythreeof．theslngerS，Since
actuator which makes′a Slrtger s eyes，fo1low

OneOfthem−Singer＃1†doe＄nOtSt・Op11ntil
the conductonl′arOund the space．．Toprovide

beingcommandedtwiceanda戯ercomplaining
a：ShorLpatlSebet，Wee？the・COnductor sges，tureandsin壷r＃1，scomplaintswedefinea3ユecond

byutteringsoundsandincreaslngits申Ze・ ■tim甲、Cal1edReactionTimq・，Fi8叫y，qQ叩Iain

Thenextstepfortheconductoristotilnetheisanactuator−uSedsolelybysinger如−Singers・Atunlngfork．appear＄Oqthe声Creen
and■the conductor has：手O POint to，One par−Whichc？ntrOIsthesQun顛卿d．graphic甲ticularslnger血dsim111atehittip．gtheforkby
tothecomplainipgaction．，

WaVlng．herarm・Inthatca亨ethetunl聾gfork ●● Figure5displaysadiagr？mShowl叩ho示thePrOd11．CeSam画calnoteLWhich＝isimmediately
ヰi蝕rentintervalsofeachexteTnalaret占mpo−
repeatedbyth9Singer．Hムwever，Singer＃1con−；al1yLrelated・Thedia卵m＄hows・therelation−
tinuestomisb占haveanddoesnotproducetheships＿forsinger＃1andsinger＃？，andthere−−20−interv扇s．

BeQulet l 矧1etl

ThenextdefinitionstatesthattheVQntin−ltervalofBeQui台上ニBequiet．event二finishes
the dQBiredintervalofChatting＃2，i・e・，theSlngerSa，reCOmmandedtostopchattingwhen
theconductorraiseshisarms．Bequiet．evQnt
alsot11rnSO打theactivityofBQquiet，Whatmakesthisexternalatriggersensor．AIso，thiseventsta，rtSStareConductor＃2．desired．The

turnlngOnandoffofintervalsisdescribedby
thesTARTorEqUALoriSTART，andtheMEETor
BEFORErelationships，reSPeCtively，aSShownin
BeQuletactivity
BeQ山etactivlty…認認 chattl瑚1

丘g．5．

詰缶認 chattl岬2Chattinguntilthe conductor rai去es his arms

1＄T▲RT qe81red

for aJSeCOnd time，BcQuiQt・Q†ent does not

椅TART de雨red

Chattl噂

BeQulet8Ctlvlty

．HEET
8EFOR

BeQulet

ST▲RT
∈QUAL

eVent

StarQConductor＃1．Instead，／BequiQt．eVent

BeQulettriggers− START or EqUAL oriSTART−

event

椅丁山IT

BeQulet
eveqt

＄TART
EQUAL
椅TART

BeQulet2
actil【ity

BeQ111et2
aetlvlty

MEET
8【FORE

BeQulet二2
event

BeQulet2

ST▲RT
EQUAL

evモnt

はT▲RT

＄TART
EQUAL
幅T▲RT

BQquiQt2

StareConductor♯2

BeQuiet2

Shuts offthや SenSOr）s．activity）−
StareConductor＃1，a虹dr．the desiredinter−valof tim
ReactionTime．actual．sta＊tsthecomplainac−
tua・tOr，finishingthefirstscene．

ReactlonTlme
de81red

A8itcanbesee？infig・占，al1the8truCture

isdescribedbythetimerclationshipsbetween

StareConduetor‡1
de8iredintervalsandtherea，renOeXPlicitrefbrencesto

Reactlon，H亡亡T，Complaim
Tlmeevent・ictivity．

A detection of an ev6nt、by

de8ired

丘Vent

BeQulet2neither turn 0ぽChatting11nor turn On

BeOulet。E deユ土red ・event

However，Sin？e Singer＃1does not stop

durationofintervals．TLis＄CeneOfSingSong

de且1redisagoodexampleofp＆iilelactionsthatsta．rt
企omaslngleBVent． ●Fig11re5：Dia．gramoftemporalrela，tions andintervalscriptcorfespondingto−thefirstseene
Of5伽夕餉叩．

3・2IntervalScr衝こ、LPf
Scene

the Singlng ●●● The slnglng SCene OfSingSongis basical1y〉

1ationshipsforthe｝OthertwoslngerSareiden−
ldop ofshorttinteraJCtionsbetween thもsIPgerS ●tical七othoseof＃2．Figure5also／Shows＝the
andcondllCtOr、壷hotriggerstherfeXtmOtebfa
intervalscript」COrreSPOnding√tOthe鮎stscene
SOngbyralSlnghisarms．Figure6毎払鵬■−the ●■（wher亘the．detai180fthe8トトCOdeareomi七ted
temporaldiagramoftheslnglngSCenea，ndits ●forclarity）．

definingscript．
The、intervalscriptdescribegcompletelyhow
TheslnglngOfeachnotestartswiththe、・正一

tivationofthesensofArmsUpwhichRresonly

eachexternalrelatetotheothers．Initial1ythe
de8iredintervalofallchattingactuatorsand
the activityintervalofBQQuiQt aJedefined

Whenboththeconductor sa，rmS−areup．・Wllen
ArnsUp・eVent OCCurS，its corresponding sen−
to・lStart tOgether．■Thisis shownin・thefirstSOristllrnedoffandtheact11atOrSingNotei＄
f＞artOfthe〈SCriptinfig．5whichrstatesthatthe
Statfedよsdescribedinthefirst＞JtWOSta，teme乱tS
activityintervalofthesensorBequietmu＄t
Ofthel・intervalscriptoffig：6．Itis・impor七ant

STARTorE叩ALoriSTARTt士Iedesiredintetval
tonoticethat actuators arealways started

OfChatting＃1Iandchatting＃2・Inthetempo−
throughthe血相iredinteFVal．rThelbeginnl喝 ■raldiaJgra，mOffig．5werepresent・thisdefinition
Oftheactualintervali竜completelydetermined
bypthebutput ofits cofresponding actuating

bythedashedlineJOlnlngthebeginnlngOfbothー21−

asdescribedinthescriptoffig．6．

山一……：…‡p l

lA竺「Sl坤 ≡9批eⅣotEndSong and EndSong a，re COmPlemen−

トSl岬眈el．

tarysensorswhichdetectiftheal1thenotesof

暮 reきetニ

thesonghavealreadybeensung・Theyconsti−

I

ドOtEndSo？
l

ド■−NotEndSon9「 re5ett ；単一tlltetheterminaJteCOnditionoftheloopwhichplays the entiresong．After being activated，tthesensorsclleCkaninternal，COmmOnVariablewhichis11Pdatedeverytimea：nOteissungbyl」琵≡…冒n9

theslngerS・IftheendofthesonglSreaChedl

MEET
8EFOR∈

ArmsUpactivlty

＄TART
∈QUAL
l＄TART

ArmstJp
event

anEndSong・eVentOCCurS）triggerlngtheend

ArmsUpevent

ofbothsensors andthe start ofthenext scene（notshowninthescriptoffig・6）・
In the case that the songlS nOtfinished， ●Sln9Note
des土redNotEndSong・eVentShutso仔bothsensorsand

Sin9Notesi岬。teactuallFINISH

5in9Note MEET

NotEndSon9

actualactlvity

Sln9Note MEET

EndSong

actualactlvlty

ME∈T

event

8E

ev色nt

NotEndSon9
event

NotEndSon9
event

NotEndSon曽event

terminedstateeveniftheintervalshadalreadyoccurred．Forexample，ifthe re＄etinterval

MEET
8EFO糀

NotEndSon9

8E

event

MEET
8EFOREÅrmsUpofasensor happens both the activity，thecNent，andtheRESETintervalitselfaresetto
an11ndeterminedstate．Basical1ythisenablesa

EndSon9

movementbackwa，rdsintimewhich，Whencou−

pledwithasensorofloopterminationImakes
theconstruCtionofloopspossible．
The script of SingSongincllldes ma，ny dii
ferent construCtions which are handled con−event

NotEndSon9

On9

event

r悶etintervalha．ppensanyintervalsassociatedwiththatparticula，reXternalaresettoanunde−

EndSon9

附OR∈
On9

NotEndSon9

triggersaspecialintervalassociatedwithevery
externalcal1edthereBQtintlerval．Whenevera

deslred

鵬∈ETVemiently．、by the tirneintervalrelationshippa．radigm．Thedetai1edexaminationofthosere白etSlnすNote

8∈FOR亡re8etconstruCtionsarebeyondthescopeofthispa−

HE∈T
8EFORE

NotE；ndSon9

per・

MEET
8EFORE

FndSるn9re8et

3．3InteractingwithSingSong

reset

SingSbngwasdesignedconsideringbothuserandperformerintera，Ction．Theleftpictureof
Figure6r：DiagramOftemporalrelations−andin−
fig／．7showsauserlreaCtingto8inger＃1com−

1● tervalscriptcorrespondingtotheslnglngSCene plaints（justafterit・WaSCOmmandedtostop
Ofg如タ5bng．−

Chatting）；therightpictⅦredisplaysamimきng

ClownconductingthechoruSdhringthesinglng
SCene．

Ananaly8isoftheSingSbngexperienceisbe−

ro甘tine．

Therefore，WhileSingNote．de8iredishap−
yoれd the8COpeOfrtLis paper．一Ⅱowev併，itis
Penlng，ONcommandsareb七ingsenttotherou− ●interesting、tOpOintotlt阜OmeObservationswe

madeduringtherun＄OfSingSongwith狙SerS

tinewhichproducesthenextnoteofthe80ng

blltthe▲aCtualintervalもappensonlywhenthe
a，ndperformers which，inoⅦr、OplnlOn，′，狙nder− ●●ro廿tine successfu11ymanages tosend aMIDISCOreS OurinterestinimmersiveiStOry−based
NoteOncomma，ndtothesynthesizer．Thein−
SyStemS．
tervalSingⅣote．actualendちWhenthesynthe−
Uslers seems tobe quite comfortable−in as−
SizerfinishesproducingthemusicalnQte，trig−
Sumlngtherbleoftheconductor．Inparticula・r ●gerlngtheenddf．SingⅣot0．deBireda・ndthe they
● appear tohave agreat time conducting
S・tartOftwosensors，Ⅳ0七EndSongandEndSong
thechor11S．Thesimplicityoftheinterfaceco11−−22−

Figure7：TwoscenesffomSin9Song・Theleftpict11reShowsauserplaylngWiththesystem，

Whiletherightpictureportraysaperformancecase．

●The existence of Allen s algorithm for

Pledwiththejoyofgeneratinginterestingmu−

PrOpagationoftimecon8traintsallowsthe
Sicprovide＄aVeryPleasantexperience．AIso，

thewell−definedendtotheinteraction（signaled designertodeclareonlytherelevantrela−bythe applauses）makes Sin9Songterminate

tionsleadingtoacleanerscript．

just after adramatic climax．These arepre−

Ciselythekindofe鮎ctwewantinstory−based●ThenotionofdisjunCtionofintervalrela−tionshipscanbeused）．tOdeclaremultiple
Path＄卑ndintera，Ctionsina，nStOry．Aswementionedbefore，anyinstanCeOfanaC−
finedin［6］．The choiceofaclowncostume， tualintera．ctiondeterminesexactlyonere−
1ationshipforeachpaユrOfintervals．Tlms， ●COmPletewith redno8e，SeemS tOPrOducean

environments．
Sin9SonglnperformanCemOdeconstit11teS ●typicalexperimentin computertheateras de−intere＄tinge鮎ctofblendingtherealandthe WeCa・nSeetheintervalscripta・SthedecてCGworld・Theperformer scharacterizationas ．1a，ra，tionofagraphstruCture Whereeachaclownsomewhatputshiminaworlda．shn−
tasticasthesinger svirtualworld．

nodei＄anintervala．nd whoselinks a．re

COnStrainedbythestmctureoftime．An
intervalscriptdescribesaspaceDf＄tOries
andinteractio笹S．

4 Discu琴Sion

Webelievethattheinterval＄CriIitparadigm，

a．＄describedinthispaper，Stinemploysprlmi−
tiv甲Whicharetoolow−1evel．Intervalstripts

Theintervalscriptpara．digmproposedinthis
PaPerisalfirststeptowardsmoregeneraltooIs
and paradigmsforinteractive script writing．

looklike a．n assembly 1angu喝efor events
intimc．However，throughoutourexperi占五ce
Themethodseem＄tOhavetherequiredexpres−

Writing theintervalscriptfor Sin9Song，WeSi、vecapabilitiesbut，a＄theanalysisoffi如res5

haNedetectedpatter？SOfinterv山int甲COnneC−

and6qllicklyrevcals，itsti111acksclarityand
Simplicity．Partialblameshouldbeputinthe

tionwhichappearmanyti鱒eSindi飾rentsit−

uation＄inthescript：Tho甲《やattein8Can、betaskit＄eifsinc6itisveryhardtbdら盲tribea，nd

embodiedinhigherlevelexternalsdefining，for
VisualizPemultiple，SOmetimes11nrelatedactivi−
寧ⅩamPle，thainsofevents，COnditionalbranCh−ties．
1ng，andloops．
●
WeseeseveralreasonstouseAllen，salgebra
ItisimportanttOnOticethatimmersiveenvi−
ronmentsposemoredifRcultscriptingproblems

todesigninteractivescriptsbasedontemporalinterv山s：thannormalcomputer−interhces．Thecurrent●Noexplicit mentionoftheintervaldllra−interaction between comp11ter a．nd humanistion or specification ofrela，tions between㌣OStlybasedonnon−・geS七山alevents（keytyp−theinterval，sextremitiesisrequired．

1ng，locator，Selector）．Boththesensing and−23−

S七axrFoundationthroughtherMIT−Japanpro−
gram・

References【1】ALLEN，J・F・Towardsageneraltheoryofac−tionandtime・Ar岬ciatIniFltigence23（1984），
123−154．

【2】FuKUMOTO，M・，MASE，K・，ANDSuENGA，

Y・Finger−pOinter：PointingintQrfacebyimage
processing・Compui・8Graphics・ブ8，5（May1994），633−642・Figllre8‥ Animmersive†′interノaCtiveenviron−ment．portraylngaVisittoanancientYayoIVil一 ● ［3］GAIJYEAN，T・A■ NarrⅦiive Guidanceqf九−
ieraciivity・PhDthesis，M・Ⅰ・T・MediaArtsand

1age．

SciencesProgram，1995・［4】LAUREL，B．Compuiers′qSm云aire・Addison−thegenerationofgesturaleventsrequlremOre
Wesley，Reading，Mas＄ふchusetts，1991・
complexpatterns oftimeinteraction・Inour【5】MASE，K・，KADOBAYASHI，R・，ANDR・Meta−
paradigmthiswasreAectedinmanyinstances
museum：Asupportiveaugumentedrealityen−
as，for、eXample，intheneedfordQ8iredand
vironmentfor knowledge sharin
actualintervalsforactuators．

Currcntly we arealso applying theinter−Cα扉0几Ⅵ血αJ∫yβまemβα乃d肋〜子細e擁邪（Sept．1996）・

valscript paradigmfor animmersive†inter−【6］PINHANEZ，C・S・Computertheater・Technicalactivevirt11alrealityenvironmentwhereusers

Report378，M．Ⅰ．T．MediaLaboratoryPercep−

can・Walkthro11ghavirtualspaceandexplore tualComputingSection，May−1996・
thehyper−1inkedinformationspace・Unlikethe
・【7】PINHANEZ，C・S・，ANDBoBICK，A・
Calculus：Amethodfortherepresentationandconv9ntionalsystemswhichusethesameevent

handlingschemeforessential1ydi蝕rentinputfastrecognitionoftempor争IstruCture・Te血ni−

media，1．e．bodygestures，mOuSedragglng，OrcalReport389，M．Ⅰ．T．MediaLaboratoryPer−●
ceptualComputingSection，Sept・1996・

keyboard・strOkesItheintervalscript willbe【8】Tosふ，N．，ANDNAKATSU，、R・Forinte；ac−ableto provid6relaxed，multi−mOdalirtterac−
tive●virtu aldrama：Bodyco血municationよc−titeenvir6nment．Fig血e8showsthet由tVR tor．In釣郎∴げ袖＝如か血抗職汀勒叫押流㈹e五vironment which ena，bles the u＄er tO Walkon Etecirvnic Ari（Rotterdam，The Nether−throughananCientJapaneSeVi11age（［5］）・The lands，Sept．1996）・

systemwa眉Original1ydevelopeduslngaCOn−【9］VILAIN，M・，KAUTZ，H・，ANDVAN寧EEK，P・
ventionaleventhandlingmechanism・W占are Constraintpropagationalgorithmsfonempo−

startingtofeJcodetheinter嶽tion′inthis：SyS− ralreaBOnlng：Arevisedreport．InReadingstこemllSlngint6rvalscriits bothasaway＾toim− 壷働埴励正郎蜘血り抽隼勒画サ坤−
provethei●nt占血ce桓dasatestfbrltheinterval iems，D．S，We14a．ndJ．．deKleer，Eds・MorT
ganKaufmannISanMateo，CalifomiaI1990〉

scfiiitparadigm．

Designing andimplementing SingSong as ●pp．L37畠−381． tl

fast aswedidwodldnot bepossiblewithout【10］VREN，C・■R・，AzARBAYEJANI，Aリ」｝DAR一

usingtheirLterValscriptparadigm・Theinter− 叩LL，T．，ANDPENTL照p，、A・P6nder：Real−
timetrackingbfthehumanbody・恥chnicalvalscript／providedaAexible血ethodtochange Report35a，M．Ⅰ二T，＝MediaIJaboratoryPercep−
the岳criptaswe壷ed6signlngneW、rduti五もsand ■testi鴫the■in七色raJCtion・Inspiteof thelowlevelofth昌1a，nguage the、int由valsc軸t＿Palradigm
considerablysimplifiedthetask．

Acknowledgment＄
TheworkofClaudioPinhanezintheSingSong
project was supported by a grant from・the−24−

t血1ComputingSedtio叫1995・lヽ｛㌔