# Presentation: 128125

## Computer-Aided Rhetorical Design: Decomposing Composition

**Nancy A. Chinchor**
**CIA GVAC**
**Visual Analytics Consortium**
**The Next Generation**
**23 & 24 May 2006 **

## “Although we often hear that data speak for themselves, their voices can be soft and sly.”

*“**Although we often hear that data speak for themselves, their voices can be soft and sly.”*

- Frederick Mosteller, Stephen E. Fienberg, and Robert E.R. Rourke, *Beginning Statistics with Data Analysis* (Reading, Massachusetts, 1983), p. 234.

## “The universe is made of stories, not of atoms.” 

*“**The universe is made **of stories, not of atoms.”*

- _[Muriel Rukeyser](http://en.thinkexist.com/quotes/muriel_rukeyser/)_ (_[American](http://en.thinkexist.com/nationality/american_authors/)__ __[Writer](http://en.thinkexist.com/occupation/famous_writers/)__, __[1913](http://en.thinkexist.com/birthday/december_15/)__-__[1980](http://en.thinkexist.com/birthday/february_12/)__)_

## Overview

***Overview***

- Visual Analytics Research
- Production, Presentation, and Dissemination
- GVAC Progress Report
- Decomposing Composition
- GVAC Future Work

## Visual Analytics

***Visual Analytics***

-  Visual Analytics is the science of analytical reasoning facilitated by interactive visual interfaces.
-  Developments have changed the original recommendations in *Illuminating the Path*

## Production, Presentation, and Dissemination

***Production, Presentation, ******and Dissemination***

- Analysts spend 5% of their time thinking and 95% of their time composing product
- Visual analytics’ effectiveness is judged by its appearance in product
- We must, therefore, provide support for composition

## Original Recommendation

***Original Recommendation***

-  Create visual analytics data structures, intermediate representations, and outputs that support seamless integration of tools to:
-  support around-the-clock operation
-  provide robust privacy and security control
-  support these functions within a cohesive environment:
-  data requests and acquisition,
-  visual analysis,
-  note-taking,
-  presentation composition,
-  and dissemination

## Developments

***Developments***

-  Assignment from NVAC: make it happen
-  NVAC-supported workshop to create the vision
-  Write R&D agenda for implementing the vision
- Coordinate the activity

## Intelligence Community Changes

***Intelligence Community Changes***

- Presidential Directive for All Source Analysis including Open Source
- Presidential Directive for Information Sharing
- Office of the Director of National Intelligence has requested that DST produce technologies for the DI to make analysis Dynamic and Collaborative

## GVAC Progress Report

***GVAC Progress Report***

- Works in progress:
-  Finding the right people for the workshop (found 3 of 6)
-  Planning workshop activities
-  Making workshop arrangements

## Workshop Participant Characteristics

***Workshop Participant Characteristics***

-  Analyst
-  Designer
-  Communications
-  Agent of Cultural Change
-  Simplifier
-  Composer

## Making Something from Nothing(or alchemy without straw) 

***Making Something from Nothing******(or alchemy without straw) ***

- Visiting network of people
- Communicating vision
- Renew vision continuously
- Analyze current practices
- Analyze current and future requirements
- Discover natural phases of reaching vision

## Planning Workshop Activities

***Planning Workshop Activities***

- Insights that foster vision (video)
- Defining scope
- Assistant to make arrangements, prepare agenda, and take notes for the workshop report
- Putting materials together to collect more information from participants (e.g., bibliography, software list, requirements, resources, etc.)

## Decomposing Composition

***Decomposing Composition***

- Production methods
-  current advantages and shortcomings
-  future directions
- Analytic workflow
- current advantages and shortcomings
- acceptable dynamic and collaborative methods

## Decomposing Composition

***Decomposing Composition***

- Argumentation structure
- Evidence choices
- Visual analytic tools used
- Other analysts vs. end audience
- Collaborative dynamics

## Decomposing Composition

***Decomposing Composition***

-  Points of view
-  Steps
-  Roles
-  Standards
-  Tools
-  Quality control
-  Weaknesses
-  Solutions to weaknesses

## Decomposing Composition

***Decomposing Composition***

-  Towards requirements
-  Architecture
-  Rhetorical and graphical design intelligence built in
-  Product “publication” - dynamic multimedia with reach-back
-  Collaboration - privacy/security, moving between versions, co-analysis methods, co-authoring, and co-editing
-  Dialogue
-  Evidence-analysis-collection cycle

## Decomposing Composition

***Decomposing Composition***

- innards
- edit widgets
- group, ungroup
- text - fonts, styles, effect
- rhetoric - prose and visual
- analyst versus audience - who is who, what are their needs, and who decides what they see

## Decomposing Composition 

***Decomposing Composition ***

-  Workshop activities – brainstorming
-  Devices for brainstorming
-   Figures of speech, sources, mixtures
-  Editing analytic product – untangling the spaghetti for those with less context
-  Simplifying – make direct – distillation
-  Quicken reading – fast fiction sentence structure, font, weight, layout
-  Look at culture – pop and art, animation simplification
-  Gromit’s eyebrows, eyeballs, and ears do all of the “speaking” _Video-clip_
-  Principles of design and rhetoric

## Resources

***Resources***

- Emergent academic fields
- Visual Rhetoric
-  Visual Culture
- Leaders in multimedia production and communication
- Leaders in visual analytics and other information technologies
- NVAC, RVAC, IVAC, GVAC
- Current leaders in the Intelligence Community, their directives, and those charged with carrying them out
- Financial analysts

## Actions Taken

***Actions Taken***

- Assisting Pat in planning workshop on Mathematics for Visual Analytics (October)
- Planning workshop on Composition Tools for Visual Analytic Results (January)
-  Developing requirements for Composition Tool
- Trip to Pgh to visit CMU and MayaViz
- Meeting with Director of Multimedia Production Group at CIA – “gold standard” – Adobe
- Pinpointed “right” analyst for further discussions

## Future Work

***Future Work***

- Continue growing the group for the workshop (have participants chosen by mid-summer)
- Continue developing requirements
- Continue learning the division of labor in the business of intelligence and how it is changing
- Maintain contacts with people as everything is changing
- Develop opportunities as the momentum for tools grows

## Background Slides

***Background Slides***

## Definition of Terms

***Definition of Terms***

- Production - the creation of materials that summarize the results of an analytic effort for the intended audience
- Presentation - the style of those materials that conveys the analytic results effectively
- Dissemination - the process of delivering the information to the intended audience

## MayaViz “Command Post of the Future” (MAYA= Most Advanced Yet Acceptable)

***MayaViz “Command Post of the Future” (MAYA= Most Advanced Yet Acceptable)***

## Oculus Sandbox (c) 2004

***Oculus Sandbox (c) 2004***

## Polaris (Current Practice)

***Polaris (Current Practice)***

- Textually Designed
- Tracks Evidence
- Provides Interface to Word

## Workshop Participant Characteristics

***Workshop Participant Characteristics***

- Analyst - person who writes well but is stuck in their head
- Designer - person who interactively develops solutions by refining needs
- Communications - range from high level policy makers to the public to first responders
- Agent of Cultural Change - business and technology
- Simplifier - person who can simplify the path from the head to the audience
- Composer in specialty - specialty that requires and uses custom tools that are along the path to the vision (e.g., animated film production, financial analyst)

## Visual Rhetoric

***Visual Rhetoric***

- Visual rhetoric is the fairly recent development of a theoretical framework describing how _[visual](http://en.wikipedia.org/wiki/Visual)_ _[images](http://en.wikipedia.org/wiki/Image)_ communicate, as opposed to _[aural](http://en.wikipedia.org/wiki/Aural)_ or _[verbal](http://en.wikipedia.org/wiki/Verbal)_ messages. The study of visual rhetoric is different from that of _[visual or graphic design](http://en.wikipedia.org/wiki/Graphic_design)_, in that it emphasizes images as rational expressions of cultural _[meaning](http://en.wikipedia.org/wiki/Meaning)_, as opposed to mere _[aesthetic](http://en.wikipedia.org/wiki/Aesthetic)_ consideration (Kress 18).
- Visual rhetoric examines the relationship between images and _[text](http://en.wikipedia.org/wiki/Text)_. Some examples of artifacts analyzed by visual rhetoricians are _[charts](http://en.wikipedia.org/wiki/Charts)_, _[paintings](http://en.wikipedia.org/wiki/Paintings)_, _[sculpture](http://en.wikipedia.org/wiki/Sculpture)_, _[graphs](http://en.wikipedia.org/wiki/Graphs)_, _[web pages](http://en.wikipedia.org/wiki/Web_pages)_, _[advertisements](http://en.wikipedia.org/wiki/Advertisements)_, _[movies](http://en.wikipedia.org/wiki/Movies)_, _[architecture](http://en.wikipedia.org/wiki/Architecture)_, _[newspapers](http://en.wikipedia.org/wiki/Newspapers)_, _[photographs](http://en.wikipedia.org/wiki/Photographs)_, etc.
- Visual rhetoric is closely related to the older study of _[semiotics](http://en.wikipedia.org/wiki/Semiotics)_. Semiotic theory seeks to describe the rhetorical significance of sign-making. Visual rhetoric is a broader study, covering all the visual ways humans try to communicate, outside academic policing (Kress 11).
- Visual _[tropes](http://en.wikipedia.org/wiki/Trope)_ and tropic thinking are a part of visual rhetoric (the art of visual persuasion and visual communication using visual images). The study includes, but is not limited to, the various ways in which it can be applied throughout _[visual art](http://en.wikipedia.org/wiki/Visual_art)_ history.
- The term "visual rhetoric" has emerged mainly as a way of marking out disciplinary territory for scholars interested in non-textual artifacts such as those mentioned above; conceptually, the term "visual rhetoric" is itself somewhat problematic. It is usually used to denote non-textual artifacts, yet any mark on a surface -- including text -- can be seen as "visual." Consider the texts available at _[Project Gutenberg](http://en.wikipedia.org/wiki/Project_Gutenberg)_. These "plain vanilla" texts, lacking any visual connection to their original, published forms, nevertheless suggest important questions about visual rhetoric. Their bare-bones manner of presentation implies, for example, that the "words themselves" are more important than the visual forms in which the words were originally presented. Given that such texts can easily be read by a _[speech synthesizer](http://en.wikipedia.org/wiki/Speech_synthesizer)_, they also suggest important questions about the relationship between writing and speech, or orality and _[literacy](http://en.wikipedia.org/wiki/Literacy)_.
- Author: Wikipedia contributors
- Publisher: *Wikipedia, The Free Encyclopedia*.
- Date of last revision: 23 November 2005 14:01 UTC
- Page Version ID: 29056711

## Visual Culture

***Visual Culture***

**Visual culture** is a field of study within _[cultural studies](http://en.wikipedia.org/wiki/Cultural_studies)_ focusing on aspects of culture that rely on visual images. Among cultural studies theorists working with contemporary culture, this often overlaps with _[film studies](http://en.wikipedia.org/wiki/Film_studies)_ and the study of television, although it can also include _[video game studies](http://en.wikipedia.org/wiki/Video_game_studies)_, _[comics](http://en.wikipedia.org/wiki/Comics)_, traditional artistic media, _[advertising](http://en.wikipedia.org/wiki/Advertising)_, and any other medium that has a crucial visual component.
- Major work on visual culture has been done by _[W. J. T. Mitchell](http://en.wikipedia.org/wiki/W._J._T._Mitchell)_, particularly in his books *Iconology* and *Picture Theory*. Other writers important to visual culture include _Stuart Hall_ and _Slavoj Zizek_.
- Visual culture is related to _visual sociology_ and _visual studies_. There is debate over how art history and visual culture are distinct from one another.
- Visual Studies, an inter- or postdisciplinary field, aims to integrate and expand the already existing disciplines of Art History, Film and Media Studies, and Cultural Studies. Though often engaging objects or artifacts included within these fields, it can often incorporate those overlooked or excluded by more traditional fields of study. Often criticized for its lack of historical rigor, this is not necessarily intrinsic to the field, and many of its practitioners remain rigorous in their historical foundations and object analysis. Because Visual Studies aims not just to fill in gaps to challenge disciplinary boundaries, it can also be said to have political implications. In fact, Visual Studies is often quite closely linked to Critical Theory.

## References

***References***

- Kress, Gunther, and Theo van Leeuwen. _Reading Images: The Grammar of Visual Design_. New York: Routledge, 1996. _ISBN 0-415-10600-1_
- Handa, Carolyn, ed. _Visual Rhetoric in a Digital World_. New York: Bedford/St. Martin's, 2004. _ISBN 0-312-40975-3_
- Hill, Charles, and Marguerite Helmers, ed. _Defining Visual Rhetorics_. Mahwah: Lawrence Erlbaum Associates, Publishers, 2004. _ISBN 0-8058-4403-1_
- Sturken, Marita; Lisa Cartwright (2000). *Practices of Looking: An Introduction to Visual Culture*, Oxford: Oxford University Press. _ISBN 0198742711_.
- Mirzoeff, Nicholas (1999). *An Introduction to Visual Culture*, London: Routledge. _ISBN 0415158761_.
- Mirzoeff, Nicholas (ed.) (2002). *The Visual Culture Reader*, 2nd ed., London: Routledge. _ISBN 0415252229_.
*Rhetoric and the Arts of Design*. Lawrence Erlbaum, 1996 (with Brian Butler).
*Creating Interactive Worlds with Words: Principles of Writing as Representational Composition*, in press (with Brian Butler). [_Return_]
- Gunther Kress - 2
- Stanford book published by Pearson on Persuasive Visual Communication

## Suggested Additions

***Suggested Additions***

- Include a database/mining/representation person at the workshop
- Add visual studies to list of resources
- DIA is currently setting ground rules for using blogs and wikis for dynamic intelligence products -- visit them to see where they are
- Add the caveat that the percentages of analysis time and production time are based on self-reporting and not on any measured data
- The data reported by Jeff Cooper was from RDEC which is not a true production system and was based on software usage time on software packages exclusively categorized as research, analysis, and production.