**Raw Flip Chart Notes, Aug. 1 Video Archiving Conference --**

**with minimal annotations in brackets**

**Glenn Pearson August 3, 2005**

*Note that the numbering mainly reflects the order that charts were
ripped off the pad and posted on the wall. There was also some jumping
around when creating charts. Consequently, the order below may not
always match the audio chronology.*

**Early Afternoon Discussion**

\(1\)

File Formats,

Codecs,

Metadata

Use Cases

\[then above further decorated with a different marker, arriving at\]

Strategies

File Formats,

Codecs,

When?

\[bracket Metadata and Tools together\]

Metadata

Repositories

Tools

Use Cases

Requirements

Source: tape, ...

Digitize?

\(2\)

Use Case \[need to define this first\]

Old tape -- \[including\] Betacam SP

(Old film) \[It was decided not to pursue this\]

\[Scratch out: New Digital...\] \[Scratch out: New Tape\]

Born Digital

Archive vs. Production

*\[5 major themes were proposed over 3 sheets of paper. The numbering of
the last two sheets is misleading.\]*

\(3\) \[first draft\]

\[1.\] Longevity

\[2.\] Fidelity

\[see continuation of this later.\]

(II-1)

\[3.\] Authenticity

\[4.\] Interoperability

\[Glenn adds these subdivisions at some point, not necessarily from
discussion:\]

A/V

Repositories

(II-2)

\[5.\] Cost & Scalability

\(3\) \[continued\]

\[1.\] Longevity

\[A report held that\] cold! film \[would last\] 200 yrs \[if color\]

400 yrs B&W

\[LoC's Karl F. says that LoC did a report categorizing different video
file formats on about 7 different scales like the listed here. Some
findings:\]

MJ2 -- good except \[on\] adoption \[scale\]

\[Glenn said\] -- cost \[of JP2 hardware \> JP hardware

in intended digital still cameras with video-clip functionality\]

MP4? -- better for highly compressed, worse for less compressed \[says
Karl\]

\[Back to Longevity -- redraw as\]

Infrastructure for Migration

Sustainability

Longevity -- \[exit strategies relying on\] one way transcode

Institutions/Resources

Future Proof

Lossless -- reversible

or

uncompressed

\[Anyone here used lossless form\] MPEG/AVC\[? No response implies\] --
NEVER

\(4\)

One format?

Open

\- - -

Hardware Rots

Media

Storage System

Software/firmware

Who pays \[for storage and migration\]: IT or Archivist

PBS: \[archiving to\] tape now... \[move to\] disk in 3 yrs

Abstract storage \[architecture, makes tape and disk look the same\]

**Mid Afternoon Discussion**

\(A\)

\[re-ordered a bit to reflect discussion flow\]

Trusted Repository \[, what about? - probably Laurie Baty\]

\[back to preservation of bits\]

\[Merrill or Jim K...\]

Hard drives -- removable? \[as preservation strategy\]

still spins? \[after prolonged storage\]

\[More about Trusted Repository -- mainly Grace talking\]

Rights & provenance tracking -- Authenticity, Audit \[trail of changes\]

Directory -- Personnel \[in repository\]

OAIS \[model of repository\]

About People & \$ Too

OCLC & RLG -- Certify \[they may offer this service at some point\]

\[i.e., human, other resources also part of trust, and describable in
repository\]

adequate \[for rights & provenance tracking\]:

Fedora, aDora

\[one discussion over lunch mentioned DSpace as possibly most popular,

because easy to put up. Also another new federated repository, Cedar 3,

> by UMCP and partners\]
>
> Tools: SRB \[Storage Resource Broker from SDSC. Client-server
> middleware for uniform interface to heterogeneous, replicated data
> over networks. SRB + Metadata Catalog (MCAT) allow access based on
> attributes or logical names rather than actual names or physical
> locations.\]

Need to Federate \[as repository strategy\]

\(B\)

uncompressed vs. lossless

Keep in acquisition \[format, vs. convert to standard format\]

MXF --

MJ2 inside? \[i.e., within MXF wrapper\]

in theory

not yet in practice!

\(C\)

JPEG 2000 --

codec not so "available" \[to end users, compared with others\]

lowest common denominator

platform -- a use case

\[preceding relate to it needing better\] Distribution

\- - -

\[Issue of patents; on-going annual\] Licensing costs with Real
\[codecs\]

\- - -

MJ2 -- not on Helix \[server\]

not for web yet

users must \[be able to actually\] use it

Master on-line \[vs separate access/distribution formats\]

\- stream? \[on-the-fly extraction of lossy MJ2\]

\- edit  transcode \[needed after edit change when using separate
access format\]

\(D\)

Requirement \[to effectively use\] Lossless

\[insertable into\] Transcodable work flow

\- in editing suites

Lossless for HD

Companies \[like Sony\] must sense market

IT (storage) part \[of companies\] rather than video side \[see
archivists as market\]

Govt. as market driver

Military as market driver

COTS requirement

KLV -- SMPTE video from Predator \[i.e., drone plane as application -
Merrill\]

Commercial as market driver, not archivists

Hospitals \[as one example of several\]

\(E\)

BBC

Dirac -- codec

Lossless

\- - -

Military \[as a source for tools\] - ?

Security makes less useful \[by limiting access to tools "out in the
world"\]

**Late Afternoon Discussion, after coffee break**

(II-3 continued)

\[4.\] [Metadata]{.underline}

MPEG-7 \[mainly Grace here\]

Manifestations

Profiles

Outside of media file  sync \[via\] timecode \[,versus\]

MPEG 4 stream

\[stream contents alternatively\] could be Dublin Core, etc.

\[MPEG7 allows\] structured annotation, down to frame object

Timecodes for synch with annotation -- TEI or MPEG7

Shot or Object/keyword \[are other ways to associate or "sync"
annotation\]

\[MPEG7 has a model that is\] "extensible" but \[imposes a\] worldview

MIC maps \[to\] Dublin Core, MPEG-7, PBCore, \[and soon\] DMS-1

(II-4)

What's essential \[in terms of metadata elements\]?

METS List \[has been developed, says Grace\]

In MIC

\- \[tried to define\] Minimum for collaboration

\- But keep max \[that user chooses to supply\] -

can be vast metadata

\[new topic\]

Techy metadata - Jerry McDonald \[sp?, \] NISO

\[SMPTE\] RP210 M\[etadata\] Dic\[tionary\]

In progress -- \[developing\] XML form

90 day \[turn-around on\] term change

\[Glenn, Grace complains about current lack to hierarchy, use cases\]

PBCore.org\['s\] XML -- \[has\] Tech part

\[some arrows here indicating that the tech part of PBCore

is related to RP210 and to a subset of\] MPEG7 \["+" notation for
subset\]

SAMMA \[metadata captures\] tape problems \[/Anomalies\]

METS-like schema

(II-5)

\[Any examples of\] MPEG-7 in XML \[form, actually used\] In Production
\[?\]

\[See\] MIC (Archivists Portal)

IBM Marvel

MP7.watson.ibm.com

\$3K for NISO \[MPEG-7 XML Schema\]

\[Are you really buying just\] XML Schema Snippets?

\- - -

Manual vs. Auto Metadata

\[A problem with automatic, besides the fact that it may not be too
good,

is that it doesn't deliver metadata for the needs of the end user.\]

M.D. \[i.e., Metadata\] for end user

use this \[manual MD\] to structure this \[auto MD\]

\[Examples of Auto:\]

Autonomy \[formerly Verage; now yet another name\]

StreamSage

BlinkX -- ccTV \[i.e., used to generate closed captioning\]

Google TV

IBM Marvel

\[Grace reports with respect to \] MPEG-7 \[extraction of\] shape/color

> \[that Marvel is\] -- not as good as Inforspace \[presented in a.m. by
> Alex\]

(II-6)

\[About how much work is involved in manual metadata entry.\]

\[When digitizing a typical collection\] Most tech \[meta\]data &
provenance is standardized \[and\] profiled \[so doesn't have to be
re-entered repeatedly\] --

write once, copy often

\- - -

\[Evaluation of quality of automatic metadata extraction:\]

NIST -- \[has annual competition\] TRECVID

Compare\[s\] Semantic MD Retrieval & Extraction

\- - -

Syracus \[U. did comparison research\] -- Manual Catalogers vs. Auto
(screen scrape \[of web sites\]) \[Manual won\]

(II-7)

[NEXT STEPS]{.underline}

[SMPTE]{.underline}

Sept. in UK

Dec. in US

\[Plausible requests that could be made\]

MJ2 in MXF

Lossless JP2 in MXF \[analogous to\] (DCDM)

\[Carl F - This case may already be covered by general JP2 in MXF draft
doc,

which possibly is numbered\] 422M?

\[A SAMMA guy notes for audio there's also a possible \] draft AES/BWF
in MXF

[ISO]{.underline}

\[Carl F. mentions Glenn P's previous suggestion for\] MJ2 timecodes

\[If ISO is unresponsive, this might also be an area for\] -- SMPTE

MPEG7 stream\[s\] in MJ2

Text \[streams in MJ2\]

(II-8)

Govt wants tools -- \[Government agencies & their requirements as market
makers\]

editors

servers

browsers

Plug in QT

Codec in Windows

Spin! Buzz! \[needed about MJ2 and as outcome of this meeting, e.g.,
publicity, word of mouth\]

Research Studies \[George suggests\]

DigiGov \[Digital Government\]

\[Aside about just-awarded Phase I contracts from NARA to two companies
to develop competitive prototypes for an Electronic Records Archive:\]

Harris & Lockeed \[Martin\] -- \[will be funded in \] Sept. \[by\] NARA