# Presentation: 081207

## Information Workplaceof the Future

- Jerry Johnson
- Director, IT Services Division
- Pacific Northwest National Laboratory

- PNNL-SA-43624

## Information Workplace of Today?

## Information Workplace of the Future?

**Information Workplace of the Future?**

## TubSpaceTM

## Premise

**Decision Superiority is a function of both speed and quality**

**Premise**

## The ChallengesInformation Explosion

| Table 1.12: The size of world telephone calls in terabytes. |  |
| --- | --- |
| Line calls | 15,000,000 |
| Wireless calls | 2,300,000 |
| TOTAL | 17,300,000 |

| Table 1.13: The size of the Internet in terabytes. |  |
| --- | --- |
| Medium | 2002 Terabytes  |
| Surface Web | 167 |
| Deep Web | 91,850 |
| Email (originals) | 440,606 |
| Instant messaging | 274 |
| TOTAL | 532,897 |

| Table 4.1: Annual production of original items for the major magnetic media types– 2003 Sources |  |  |  |  |
| --- | --- | --- | --- | --- |
| Media Type |  | Unique Items per Year | Conversion Factor | Total Annual Terabytes (World) |
| I | Video tape (VHS and camcorder) | 220,000,000 | 4 GB per tape (MPEG-2 compression) | 1,340,000 |
| II | Audio tape (analog) | 128,800,000 | 1 GB per tape (CD audio format - no compression) | 128,800 |
| III | Digital tape  | 5,000,000 | Varies | 250,000 |
| IV | Mini-DV | 115,000,000 | 11 GB per tape | 1,265,000 |
| V | Floppy disks | 55,000,000 | 1.44 MB per disk | 80 |
| VI | Zip disks | 1,400,000 | 250 MB per disk | 350 |
| VII | Audio MiniDisks | 10,450,000 | 160 MB per disk | 1,700 |
| VIII | Flash memory | 43,000,000 | Varies | 1,200 |
| IX | Hard disk drives | 43,928,000 | Varies | 1,986,000 |
| Total: |  |  |  | 5,187,130 |

- Data sources increasingly becoming multi-media

- Source: Lyman, Peter and Hal R. Varian, "How Much Information", 2003. Retrieved from _[http://www.sims.berkeley.edu/how-much-info-2003](http://www.sims.berkeley.edu/how-much-info-2003)__ on October 19, 2004._

## The ChallengesGlobal Scope

_**World Distribution of Internet Users (millions)**_
** **
**	****Africa****	**** 6.31**
** **
**	****Asia Pacific****	****187.24**
** **
**	****Europe****	****190.91**
** **
**	****Middle East ****	****5.12**
** **
**	****Canada and USA****	****182.67**
** **
**	****Latin America****	****33.35**
** **
** **
**Source: Nielsen / NetRatings via CyberAtlas**

- Global markets
- Global social groups
- Global sources

- Translation of multiple languages, multiple cultural contexts

## The ChallengesTime is Critical / Stakes are High

## The ChallengesNon-Intuitive Human-Computer Interaction

## The ChallengesThe table gets larger and rounder

- Collaboration is messy, frustrating, time consuming,
- ... and indispensable

## Research Areas

**Research Areas**

- Visual Analytics
- Rich InteractionEnvironments

## Information Visualization

- Problem
**HUGE** Datasets: How to understand them?
- Solution
- Take better advantage of human perceptual system
- Convert information into a graphical representation
- Research Challenges
- How to convert abstract information (text, audio, video) into graphical form?

- This tutorial is adapted from: Hearst, Marti, “User Interfaces & Visualization for Information Access", 2000. Retrieved from _[http://](http://bailando.sims.berkeley.edu/infovis.html)__[bailando.sims.berkeley.edu/infovis.html](http://bailando.sims.berkeley.edu/infovis.html)_.

## Visualization Success Stories

**Visualization Success Stories**

- From Visual Explanations by Edward Tufte, Graphics Press, 1997

- Illustration of John Snow’s deduction that a cholera epidemic was caused by a bad water pump, circa 1854.
- Horizontal lines indicate location of deaths.

## Visualization Success Stories

## Goals of Information Visualization

- Make large datasets coherent
- Present huge amounts of information compactly
- Present information from various viewpoints
- Present information at different levels of detail
- From overviews to fine structure
- Support visual comparisons

## Why Visualization?

- People are good at
- Scanning
- Recognizing
- Remembering images
- Graphical elements facilitate comparisons via
- Color
- Shape
- Length
- Orientation
- Texture
- Animation shows changes across time
- Aesthetics make the process appealing

## Example:  Color Selection

## Example: Shape Selection

## Example: Conjunction of Features

- Viewer cannot rapidly and accurately determine
- whether the target (red circle) is present or absent when target has two or more features.  Viewer must search sequentially.

## Why Text is Tough to Visualize

- Text is not “pre-attentive” – it requires focused attention
- Text consists of abstract concepts
- Text has very high dimensionality
- Text represents similar concepts in many different ways
- space ship, flying saucer, UFO, figment of imagination
- Most meaning of text lies within our minds and common understanding
- “How much is that doggy in the window?”
- how much: social system of barter and trade (not the size of the dog)
- “doggy” implies childlike, plaintive, probably cannot do the purchasing on their own
- “in the window” implies behind a store window, not really inside a window, requires notion of window shopping

## Why Text is Tough

- “The man walks the cavorting dog.”

- We can show this in a picture

## Why Text is Tough

**Why Text is Tough**

- “As the man walks the cavorting dog, thoughts
- arrive unbidden of the previous spring, so unlike
- this one, in which walking was marching and
- dogs were baleful sentinels outside unjust halls.”

- How do we visualize this?

## Why Text is Easy

- Text is highly redundant
- When you have lots of it
- Pretty much any simple technique can pull out phrases that seem to characterize a document
- Instant summary
- Extract the most frequent words from a text
- Remove the most common English words

## Guess the Texts

- 64 president
- 38 jones
- 38 information
- 32 evidence
- 31 lewinsky
- 28 oic
- 28 investigation
- 26 court
- 26 clinton
- 22 office
- 21 discovery
- 20 sexual
- 20 case
- 17 testimony
- 16 judge

- 478 said
- 233 god
- 201 father
- 187 land
- 181 jacob
- 160 son
- 157 joseph
- 134 abraham
- 121 earth
- 119 man
- 118 behold
- 113 years
- 104 wife
- 101 name
- 94 pharaoh

## More Words ≠ Greater Clarity

- Pythagorean theorem: 24 words
- The Lord's Prayer: 66 words
- Archimedes' Principle: 67 words
- The Ten Commandments: 179 words
- The Gettysburg Address: 286 words
- The Declaration of Independence: 1,300 words

- The U.S. government regulations on the sale of cabbage: **26,911 words**

## Text Collection Overviews

- How can we show an overview of the contents of a text collection?
- Show information external to the documents
- e.g., date, author, source
- Does not show what they are about
- Show the meanings or topics in the documents
- List of titles
- Results of clustering words or documents
- Organize according to categories
- Multi-dimensional semantic “signatures”
- Examples – Not just “eye candy”

## Slide 27

## Slide 28

## Slide 29

## Slide 30

## Slide 31

**Notes:**
ThemeRiverTM 
ThemeRiverTM, a prototype system, allows you to "see" trends, patterns, and unexpected occurrence or non-occurrence of topics over time across a collection of documents.
In ThemeRiver, the metaphor used for the information over time is a river. This "river" changes width to depict changes in the thematic strength of documents temporally collocated. Themes or topics are represented as colored currents flowing within the river that narrow or widen to indicate decreases or increases in the strength of a topic in associated documents at a specific point in time.

## Rich Interaction Environments

**Rich Interaction Environments**

- Advancing the state-of-the-Art in:
- Synergistic combination of touch, pen, gesture, voice interaction
- Narrative and discourse
- Mixed reality
- Socially-aware tools
- User modeling
- Contributing Novel Approaches to:
- Decision-support
- Collaboration
- Edutainment
- Embedded systems

## Directly Mediated Interaction

**Directly Mediated Interaction**

- Mixed reality interaction workspace
- Use natural interaction techniques
- Minimize user encumbrance
- Requires support for new interaction types

**Notes:**
Need Movie 

## Hi-Space – Interacting with your fingers

**Hi-Space – Interacting with your fingers**

**Challenge:** Interactions are limited by Windows paradigm and mouse and keyboard input, thereby failing to support direct engagement of multiple people
**Approach:** Hi-Space: a simple, robust tracking technology that supports table, wall, or room interactions. The system tracks multiple objects, pointers, and individual fingers, and performs pose analysis.
**Impact:** Untethered, physical interaction with information
**Hard Problems:** Real-time, precise tracking of untethered hands, fingers, and physical tools in 3-dimensions

- In collaboration with the University of Washington’s*Human Interface Technology Laboratory (HITLab)*

**Notes:**
Need Movie 

## Virtual Dig Brushing Video 

**Notes:**
This movie shows a group (up to 10 can fit around a table) all working together to clear the grass and then the dirt to get down to the artifacts buried in the pit.

## Virtual Hockey Video 

## ARToolKit – Interacting withaugmented reality visualizations

**Challenge: **Flexibility in visualization of 3D models is limited by the user interface and available toolset.
**Breakthrough: **3D models may be viewed and manipulated using voice-issued commands and paddle position in order to rotate, scale, pick, and slice 3D geometry.
**Impact: **These are more “natural” than using a CAD tool or other conventional visualization tools.
**Hard Problems:** Robust recognition of voice commands.  Precise tracking of head and paddle position.

- In collaboration with the University of Washington’s*Human Interface Technology Laboratory (HITLab)*

## Slide 38

## Bringing the Technologies Together

**HI-Space**

**ARToolKit**

**Environment using both technologies**

**Bringing the Technologies Together**

## Information Workplace of the Future?

**Information Workplace of the Future?**

## To learn more about Information Technology at PNNL, visit us on the web:
http://www.pnl.gov/main/sectors/information.html

- http://www.pnl.gov/main/sectors/information.html