2007/10/29

Research Activities, Results,
C ll bCollaborations
iandd Pl
Plan
Computational Media Group
Division of Computational Informatics
Center for Computational Sciences
University of Tsukuba
2007.10.30

Division of Computational Informatics• Newly founded in 2004.7.
– To investigate novel methods at the frontier ofcomputationalt til sciencesi• Guiding principle for research activities– To try to establish a new framework ofcomputational sciences whose target is thehuman society and its environment– Real‐World
Real World Computational Informatics• Two groups in the division– Computational Intelligence Group– Computational Media Group12007/10/29

Computational Media Group• What is “computational media?”– “Computational media” will be the fusion of technologies on
sensing, visualization, grid computing, and computer
network.
network– The purpose of “computational media” isto augment the human sensing abilities
by fully utilizing the capability of computational resources.

• Computational Media Group– 3 faculties• Y. Ohta (professor), Y. Kameda (associated prof.), I. Kitahara (assistant prof.)– 15 graduate students, 8 undergraduate students– Researches on cutting‐edge technologies and developmentof application‐oriented systems are conducted in parallel.

Sensing as Robot Technology
SENSING
Computer Vision
Pattern Recognition

WORLDCOMPUTERACTION

22007/10/29

Sensing as Media Technology
HUMAN VISION‘1’
1SENSING(CV,PR)

VISUALIZATION (CG)‘4’WORLD‘2’COMPUTERHUMAN‘3’
3ACTIONSENSING(CV,PR)ACTION

Robot vs. Medium• The robot technology creates machines thatcan substitute humans byy simulatingg humanbehavior.
– The term robot is a symbol of the technology for
substituting humans.

• A medium offers environment that getshhumans
tto learn,lthink,thi k andd come up withithideas.
– The term medium is a symbol of the technology
for cooperating with humans.

32007/10/29

Research Activities
in Computational Media Group
Cutting‐Edge Technologies• Mixed Reality• Massive Sensing• Video Surveillance
Application‐Oriented Systems• LiveLi 3D VideoVid ini Soccer
SStadiumS di(3D TV)(3D‐TV)• Visual Augmentation for Drivers (NaviView)• Visual Augmentation for Pedestrians(See‐Through Vision)

Mixed Reality
Mixed Reality is a fusion of sensing and visualizing technologies.
It seamlessly merges the visual data obtained from the real world
and the visualized data in the computer.

Remote face‐to‐face collaboration
HMD can be diminished by MR technology

4

2007/10/29

Massive Sensing
Sensing and understanding of human behaviors with amassive number of sensors (cameras, microphones, etc.).

CAM
MICPSD

Video Surveillance
An advanced video surveillance system by combining mobileand fixed cameras.
Environmental Camera
MobileCameraMobileCamera

Occluded by Obstacles

Out of the Field of View

Video Surveillance System by Combining
Mobile Cameras and Environmental Cameras.

52007/10/29

Live 3D Video in Soccer Stadium (3D‐TV)

Multiple audiences can arbitrarily
select their viewing positions ofsports events.
Our technology enables live
transfer of 3D‐TV via network.

Visual Augmentation for Drivers (NaviView)
Application of Mixed Reality in ITS.
Drivers can see the blind spots by an augmenting visual support
utilizing the videos obtained by road surveillance cameras.

6

2007/10/29

Visual Augmentation for Pedestrians(See‐Through Vision)
Citizens can effectively utilize the video dataobtained by many surveillance cameras in town.
A pedestrian can see‐through a blind area
occluded by a building simply by holding up hisPDA toward the blind area.

Real Camera A

Smart PDAGPSInertia Sensor

CameraReal Camera B

Research Fundsof Computational Media Group• 3D‐TV: 49,140,000 yen (2002‐2004)
Grant‐in‐Aid for Scientific Research (A), Japan Society for the Promotion of Science• 3D‐TV: 56,843,800 yen (2004‐2006)
StrategicStt i Information
I fti anddC
Communicationi ti R&D P
Promotionti Programme,
P
Ministry of Internal Affairs and Communications• NaviView: 39,087,100 yen (2004‐2006)
Special Coordination Funds for Promoting Science and Technology,
Japan Science and Technology Agency• See‐Through Vision: 45,630,000 yen (2006‐2009)
Grant‐in‐Aid for Scientific Research (A), Japan Society for the Promotion of Science• Sensing Web: 40,000,000
40 000 000 yen (2007(2007‐2009)
2009)
Special Coordination Funds for Promoting Science and Technology,
Japan Science and Technology Agency• Massive Sensing: 28,210,000 yen (2004‐2006) by Kameda
Grant‐in‐Aid for Young Scientists (A), Japan Society for the Promotion of Science• Video Surveillance: 29,640,000 yen (2006‐2008) by Kitahara
Grant‐in‐Aid for Young Scientists (A), Japan Society for the Promotion of Science7

2007/10/29

Publications (2004～2007)
from Computational Media Group• Journal Papers– 6 (in English)– 16 (in Japanese)• International Conference Papers– 55 (in English)• Other Papers– 60 (in Japanese)Awards (2004‐2007)
received by Computational Media Group• Microsoft Innovation Award (IT Division), Innovation Japan 2007(2007.9.13)• Image Electronics Technology Award 2006, The Institute of Image
Electronics Engineers of Japan (2007.6.23)• IPSJ Fellow, Information Processing Society of Japan (2007.3.6)• IEICE Fellow, The Institute of Electronics, Information and Communication
Engineers (2004.9.9)• FIT 2004 Paper Award, Forum on Information Technology (2004.9.7)• IAPR Fellow, International Association for Pattern Recognition (2004.8.25)
Awards received by students•
Dean Award (K. Tateno), Graduate School of Systems and Information Engineering, University of Tsukuba(2007.3)•President Award (M. Takemura), University of Tsukuba (2006.3)•Dean Award (T. Nishizaki), Graduate School of Science and Engineering, University of Tsukuba (2006.3)•Young Researcher Award (M. Takemura), Forum on Information Technology (2005.9)•Dean Award (M. Ozeki), Graduate School of Systems and Information Engineering, University of Tsukuba(2005.3)

8

2007/10/29

Collaborations• Computational Informatics Seminar– Purpose• To share the awareness of problems– Members• Faculties of Computational Informatics Division• Researchers from other departments• Researchers from AIST

• Sensing Grid Planning Group– Purpose• To launch a new project of the Grant‐in‐Aid for Scientific Research onPriority Areas– Membersb• Computational Media Group & Grid Computing Group from CCS• Groups from Kyoto University, Osaka University, etc.

– Current Status• A new project “Sensing Web” has started from 2007.9 supported by
the Special Coordination Funds for Promoting Science and Technology.

Future Plan
• Researches on elemental state‐of‐the‐art technologies– Acquisition/analysis/recognition of massive visual data
– Computer vision for recovery of 3D from 2D– Real‐time
R l isensingi off humanhb h ibehavior– Computer graphics for visualizing data

• Researches on Mixed Reality as the technology fusionof elemental ones
• To create a new framework of Computational Science– “Real‐World Computational Informatics” whose target isthe human society and its environment
environment.
– “Initiative for Real‐World Computational Informatics” hasbeen selected as one of the strategic initiative project ofthe university.
• Divisions of Computational Informatics, High Performance
Computing Systems, and Global Environment from CCS

9