# Presentation: 258090

## Digital Libraries: Re-inventing Scholarly Information Dissemination and Use

*Robert Wilensky*
*Principal Investigator*
*David Forsyth*
*Co-principal Investigator*
*The  UC Berkeley Digital Library Team** *
* *

## Who we are

- PI and Co-PI:
- Robert Wilensky (CS & SIMS)
- David Forsyth (CS)
- Faculty Investigators
- Richard Fateman (CS)
- Marti Hearst (SIMS)
- Joe Hellerstein (CS)
- James Landay (CS)
- Ray Larson (SIMS)
- Jitendra Malik (CS)
- Philip Stark (Statistics)
- Robert Twiss (CED)
- Doug Tygar (CS & SIMS)
- Nancy Van House (SIMS)
- Hal Varian (SIMS)
- Post-docs
- Chad Carson
- Tom Phelps

- Other Investigators
- Henry Baird (Xerox PARC)
- Bernie Hurley (UCB Library)
- Students
- Serge Belongie
- Hao Chen
- Byunghoon Kang
- Thomas Leung
- Taku Tokuyasu
- Barbara Rosario
- Shengdong Zhao
- Staff
- Ginger Ogle
- Jeff Anderson-Lee
- Howard Foster
- Loretta Willis
- Joyce Gross
- Tony Morosco

## Who we plan to work with

- Corporate
- Xerox PARC
- Hewlett-Packard
- NEC
- SUN Microsystems
- IBM Almaden
- Microsoft
- Sharp

*DLIB InterOp Project* Partners
- Stanford, UCSB
- California Digital Library
- SDSC
- Not-for-profits
- California Academy of Science
- California Department of Fish and Game
- California Native Plant Society
- UC Davis ICE project
- Museum Digital Library Collection
- USGS
- Federal Bureau of Investigation
- others tba

- UCB Organizations
- U.C.B. Library
- U.C.B. Instructional Technology Program
- Museum of Vertebrate Zoology
- UCB School of Environmental Science Policy and Management

## Current (Print) System

**Libraries**

**Originators**

**Users**

**Publishers**

- $

- $

- $

- $

- $

- $

- $

- $

- $

- $

**Reviewers**

## Current Electronic System

**Users**

**(text-based)**
**Index Services**

**Repositories**

**Originators**

**Publishers**

**Libraries**

- $

- $

- $

- $

- $

- $

**Reviewers**

## A Fully Distributed Model

**Originators/**
**Reviewers**
**Commentators/**
**Users**

**Text, image, video,**
**spatial, etc., **
**access services**

**Repository **
**services**

**Collaboration **
**“****services”**

**Dissemination **
**services**

**New services**

- $?

## What we’d like to make it possible for users to do

- Easily find, access and annotate any available digital object (journal paper, tech report, data set, map, annotation) in any format.
- to be used by peer reviewers, NSF reviewers, colleagues, students
- Spontaneously make a group of distributed users and give them access privileges to a paper/annotation/datum.
- Find all the annotations that have been made on one’s draft/published paper.
- Click on a citation in a scanned document image, generating a search for the underlying reference.
- Access federated repositories that contain all relevant data for a scientific purpose; contrast against other information
- E.g., all occurrences of a given species in North America, presented as a county-by-county distribution map.
- Incorporate papers, notes, annotations, etc. into an everywhere available electronic notebook.
- Benefit from what your colleagues have found useful.
- Have system that will support all of the above and is both economically and technologically scalable.

## Desirable technologies

- Collection and dissemination
- easy to pass information to a (virtual) collection
- Search
- potential users must be able to find what they want
- Viewing
- clean display of complex datasets
- Interaction and annotation
- by referees, collaborators, others

## Collection example

- InterBiome (I.e., CalFlora++)
- Basis for a federated set of national on-line, in-depth, freely available information resource of American life forms
- Technological enablers
- general taxon name translation service.
- location resolution service
- Experiment in alternative information dissemination:
- information continually disseminated by originators
- critiqued by distributed experts
- federated with similar and complementary resources
- Collaboration with many partners

## Testbed Data Status

## Collections - the future

- Work with MVZ to expand biological collections
- Work with ECAI to obtain tools for art collection
- Respond to other opportunities - we didn’t see Calflora coming!

## Content Analysis for Access

- Image/video Analysis
- Document Analysis
- Text Analysis

## Image Analysis

- Blobworld implementation
- probably best “general” image finding-by-image-content technology
- Body plans
- much higher accuracy for specific object classes
- requires lots of engineering per object class

## Blobworld Status

## Blobs vs terms

## Blobs AND terms

## Content Analysis - the future

- Handle such queries as
- “which flowers are easily confused” (CALFLORA)
- “how often do religious pictures show...” (ECAI)
- by developing
- a new framework for segmentation
- e.g., checked petals
- reasoning about spatial arrangements of regions
- e.g., fritillary=many checked petals in a ring
- reasoning about specific activities
- e.g., person with arms above head = striking a blow

## Distributed Geographic Information Use

- Objective: Investigate geodata federating technologies.
- Approach: Develop proxy services that use OGDI to access OpenGIS-compliant (and OGDI) repository servers.
- UCB GIS Viewer extended to provide data visualization services
- InterLib collaboration:
- Data discovery and access enhanced as proposed by UCSB
- OGDI geodata transformation via a Stanford InterServ service

## GIS Viewer Status

- Layers are geo-referenced data sets
- Raster: GIF, JPEG
- Vectors: internal,  *ArcInfo Shape files*
- Grouping format/protocol: tilePix
- Habanero-ized (with help from UIUC)
- Support for multiple projections with automatic conversion
- To be used by Microsoft’s next Terraserver release.

## A distant view

## Closer - with streetfinder

## We’re there (with photo!)

## Tools for Information Management and Collaboration

- “Multivalent Documents” as a primary enabling technology.
- “Anytime, Anywhere, Any Type, Every Way User-Improvable Digital Document Platform”
- A framework of *behaviors* and *layers* for extending document functionality.
- Conducive to developing a “digital library”-centric browser.

## MVD Status

- Implemented behaviors:
- Media Adaptor: OCR, *full-fledged HTML*, ASCII
- Search with search hit visualization
- Structural: alt. select-and-paste, Notemarks
- Span: hyperlink, highlight, copyeditor marks
- Lens: OCR, magnify, notes, *Pilot notes*
- Manager: lens coordination, user interface
- Other: Ink
- Habanero-ized (with help from UIUC)
- Initial experimentation with behaviors with temporal extent

## Searching a page image

## Highlighting and annotating

## Saved annotations on 

- DARPA home page
- persist and stay in the
- right place, despite
- changes to the page.

## MVD Plans

- Support project goals by providing
- “Media adaptors” for common document formats (esp. XML, LaTeX/DVI, PDF)
- Support for (non-textual) data types having temporal and geographic extent, involving dynamic elements, and data set elements.
- Improved annotation tools
- Mechanisms for manipulating multiple annotations
- Annotation server support.
- Behaviors to support multi-lingual interactions

## What We Need to Provide

- Technology
- Some testbed applications
- to engage and support real users
- Evaluation
- Economic analysis to understand the space of possible viable models

## Economics of New Models of Information Use

- Model economic implications of different forms of cost recovery
- Some salient issues:
- who pays (author, reader, institution)
- how they are charged (usage-based, flat fee)
- how material is vetted (technical reports, conference proceedings, peer reviewed)
- degree of aggregation (articles, journals, collections),
- terms and conditions of use (individual view only, institution-wide license, unlimited redistribution).
- Investigate practical details of applying second-degree price discrimination in the context of information goods
- Explore ways to determine how different classes of users value different services
- needed to determine effective pricing of scholarly goods
- via marketing experiments and econometric analysis

## Evaluation and Evaluation Methodology

- Assess usability of tools and content analysis.
- Improve understanding of the work/technology relationship and collaboration.
- Use ethnographic (and other) methods to study a community’s information activities and practices, the use of information technology to coordinate work across space and time, and the impact of the InterLib.
- Study how  users continue to design technology in the process of use, and modify practices to suit technology.
- Develop better methods of collecting and interpreting data and evaluating DLs suitable for a large and diverse user community.
- Automated evaluation of information-centric user interfaces

## Evaluating Technology and Testbed 

- To be carried out in the LE, among InterBiome users.
- Measured by
- Collecting and analyzing data on use
- Lab-based usability assessment
- Measuring impact on work
- Using ethnographic methods to study the information activities and practices, and artifacts used and produced by InterLib Community.
- Assessing introduction of proposed technology into other environments

## Slide 33

## Testbed Activities

- Special Collections Development
- A Library-based Learning Environment
- Application of technology to other environments
- Experimenting with a Fully Electronic System

## Rethinking Information Use

- Support:
- entire “information cycle”: creation, dissemination and collaboration
- organization, access, presentation and preservation, too
- non-textual material (photos, video, maps)
- as well as text-based content
- primary data sources, informal “publication”
- as well as traditional archival product
- radically new modes of use
- Scholarly information use is a great start point

## Scholarly Information

- Cost of maintaining collections is growing ~15%/year.
- The library subsidizes a University’s access to world’s content.
- Imposes large delays
- filters first,  publishes later.
- Digitization?
*increased* costs for little additional functionality
- finding things is still hard, especially non-textual items

## Proposed space of models

- Each community pays for dissemination of its content.
- Cost grows linearly with output.
- Immediate
- “publish” first, filter later
- New functionality
- collaboration, annotation, electronic notebooks supporting all document types
- Supports all forms of context
- scientific data sets, images, maps, video, ...

## Document Analysis

- Rationalize and extend DID (document image decoding) implementation
- Test via a significant conversion task (e.g., a rare botanical manual)
- Extend DID to tabular layouts using ideas from turbo coding
- Extend parsing technology to recognition of 2D expressions (e.g., math)

## Text Analysis

- Word-sense-based text retrieval
- Use newly available resources for word-sense-based retrieval and thematic-relation-based retrieval.
- Text Data Mining
- Tools to aid in the automated discovery of useful, information
- New statistical models for document selection
- Improvement over LSI

## System Support

- The InterLib Security System
- Distributed Information Architecture
- Distributed Geographic Information Use
- Scaling technology
- On Line Data Query Control
- Indexing Multimedia
- Conforming Repository Standards

## Security System

- Toolkits for building access control systems
- support set of primitives for authentication, access control, and structuring complex protocols
- User-interfaces for access control
- use *scaffolded systems* to support learning of access control mechanisms
- Safe summary monitoring
- usage through the use of *secure fissioned data*

## Tools for Information Management and Collaboration

- Electronic Research Notebook
- integrate digital library services into notebook architecture
- built on top of MVD
- Interfaces for supporting complex information seeking/analysis processes
- Integration of browsing, search, & use
- Aiding source selection
- Effective exploitation of metadata

## Cha-Cha Search Engine

## A Distributed Information Architecture

- Divide IR functionality into distributed architecture
- functionality currently represented by Cheshire II
- to be implemented as CORBA/ILU/Jylu/InfoBus distributed objects
- Construct middleware services
- provide resource discovery and IR
- based on mapping of natural language to entry vocabularies of remote databases
- Access via MVD (among other methods)
- E.g., bibliography automatically becomes hyperlink that attempt to find resource.

## Scaling Technologies

- Indexing Multimedia
- apply and extend GiST et al. to indexing non-alphanumeric data types generated by InterLib content analysis mechanisms.
- E.g., “Blobworld” image signatures
- Explore indexing strategies that can exploit the image content analysis types proposed for InterLib.
- On Line Data Query Control
- apply CONTROL technologies to data intensive, long-running of InterLib service components.
- experiment with techniques to allow users to interact with and control continuous feeds,
- examine providing on-line control over large-scale InterLib data extraction tasks that acquire data from multiple InterLib repositories.

## Online Aggregation

## CLOUDS

## Conforming Repository Standards

- Problem:
- Distributed components having varying availability, stability, persistence attributes.
- Proposed Solution:
- Define specifications for well-behaved repository.

## A Library-based Learning Environment (LE)

- LE allows scholars and students to access InterLib resources and  special collections.
- Collects data use.
- Provides
- Discovery Services
- Research and Collaboration Tools
- Evaluation and Collaborative Filtering Services
- “Just-in Time” Mediation