Brochure

IDOL MMAPMedia Management and Analytics Platform

Brochure
IDOL MMAP

Simplify How You Capitalize on
Video, Image and Audio Data

Empowering organizations to leverage rich media in gaining comprehensive intelligence by providing
easy to use media analysis, management, and visualization.
The media analytics and management platform provides all components necessary to facilitate analysis, management, and visualizationof large volumes of rich media allowing:■ Video analysis and enrichment■ Real-time monitoring and alerting■ Search and retrieval■ Recording and review

From a wide array of sources:■ Dedicated streaming sources:– CCTV cameras– Mobile devices■ File-based rich-media archives:■ Integration—seamlessly integrated within IDOL for comprehensive

analytics across unstructured, semi-structured, and structured
data sources

Use Cases
Broadcast Monitoring
Broadcast monitoring allows you to automatically monitor, analyze, andindex live broadcast feeds in real time from digital sources, satellite andcable television, radio, and the Internet. Broadcast monitoring delivers
the capabilities to enable you to automatically monitor multiple broadcast streams for instant visibility of breaking stories, competitor moves,and company news—in virtually any format and language.
■ Rich media analysis including speech-to-text transcript highlights,– Voice call recordings

entity extractions of speaker and company names, places, etc.,
key frame and logo detections, and on-screen text recognition– Enterprise data lakes■ Ability to record, store, search, and retrieve broadcast content– Digital asset management (DAM)■ Real-time alerting■ Public domain sources– Broadcast TV and radio– Online video/audio archives■ Social media sites– Facebook– Instagram– Twitter– YouTubeBeing part of OpenText™ IDOL, MMAP supports:

Voice Call Analytics
Voice call analytics with speech recognition, processing, and management capabilities delivers insight from large volumes of voice calls.
Typically a call center will handle a large number of calls a day and understanding what those calls are about can improve productivity, optimize
resources, and increase customer satisfaction.
■ Integration with existing recorded content retaining meta-data links■ Real-time speech-to-text for advanced text analytics including

concepts, trends, patterns, relationships, categorization,and clustering■ Usability—highly intuitive and simple to use■ Search and retrieval of voice calls■ Availability—cloud, on premises, and on mobile devices■ Rich audio asset playback including highlighting of speakers,■ Performance—industry-leading accuracy and speed■ Enterprise—robust scalable architecture2

names, places, words etc.

SURVEILLANCE

Surveillance allows the automated monitoring of thousands of CCTV
cameras, whether at fixed locations, mounted in cars or body-wornby operatives. Monitoring for particular activities, persons, or vehicles
within the scene in real time or retrospectively is made easy. Items andevents of interest can then be used to tag the video and send alerts.
The actual evidential video can easily by reviewed and distributed
as required.

Media servers provide the ability to analyze, record, and distributemedia. Management of functionality is handled by Restful API calls
and visualization

HTML5 widgets■ ALPR (automatic license plate recognition), VMMR (vehicle model

Restful API

and make recognition)■ Facial recognition and demographics analysis■ Event detection from within a scene including tripwire, zone

detection, and suspicious movement tracking

Media server...

Media server■ Object classification to help retrospective search■ Audio signature functions can identify the nature of the sound such

Figure 1. MMAP Components

as a gunshot, glass breaking, alarms, shouting■ Real-time alerting■ Search of CCTV content■ Secure recording and storage of evidential content
MEDIA ARCHIVE AND SEARCH

Huge volumes of video and audio files can be analyzed and indexed
for searching. This allows more efficient use of these valuable asserts within an organization or even possible commercialization ofthese resources.
■ Integration with existing recorded content retaining meta-data links■ Speech-to-text for advanced text analytics including concepts,

Media Server
The media server itself consists of three dedicate engines seamlessly
integrated to simplify analysis of rich media. Depending on the source
and type, the following configurations are used:
No visual analytics, all audio analytics

VideoMedia server

Image

Visual server

Audio

Speech/Audio server

IP camera

Surveillance server

All visual analytics, no audio analytics

VideoMedia server

Audio metadata

Image

Visual server

Hi-Res copy

Audio

Speech/Audio server

Visual metadata

Low-Res copy

IP camera

Surveillance server

Visual metadata

Audio metadata

Hi-Res copy

Low-Res copy

trends, patterns, relationships, categorization, and clustering■ Search and retrieval of video and audio files■ Rich audio asset playback including highlighting of speakers,

names, places, words, etc.
SAFE CITY

Safe city is the combination of all the above use cases in addition to numerous other data sources such as sensors and databases to provide
holistic and actionable insights for accelerating and improving actions
against safety concerns and security threats.

MMAP Components

All visual analytics, all audio analytics

VideoMedia server

Image

Visual server

Audio

Speech/Audio server

IP camera

Surveillance server

Face, vehicle and event recognition only

Visual metadata

VideoMedia server

Audio metadata

Image

Visual server

Audio

Speech/Audio server

Hi-Res copy

Low-Res copy

IP camera

Surveillance server

Visual metadata

Audio metadata

Hi-Res copy

Low-Res copy

Figure 2. Media Server

The following sections describe the analytics each of the underlying
servers provide for the specific to the media type.

MMAP is a suite of media analytics and management components designed to make the use of rich media in any application as easy as possible. It consists of three layers from analytics through to visualization.

www.microfocus.com/opentext

3Brochure
IDOL MMAP

Visual Server

Speech (Audio) ServerUsing Web APIs the server provides analysis of audio files and streams.
Integrated with IDOL Connector Framework Server (CFS) provides indexing of analysis direct into IDOL. Each server is licensed per channelof ingest and for that channel any combination of the media analytics
can be applied.

TypeFunction

ImageVideo/Image
Video/Image

BarcodeFaceDetect
Demographics

Video/Image
Video/Image

Visual ServerUsing Web APIs the server provides analysis and encoding of the visualcomponents of image files, video files, and video streams, outputting
analysis results to data repositories. Integration with IDOL Connector
Framework Server (CFS) provides indexing of analysis direct into IDOL.
Each server is licensed per channel of ingest and for that channel any
combination of the media analytics can be applied. When combinedwith speech (audio) server licenses, visual server provides visual andaudio analysis in one seamless package.

Surveillance ServerUsing Web APIs the server provides dedicated video analysis and encoding for IP CCTV surveillance camera streams, outputting analysis
results to data repositories. Integration with IDOL Connector Framework
Server (CFS) provides indexing of analysis direct into IDOL. Each serveris licensed per camera IP stream and for that IP stream any combinationof the analytics can be applied.

Speech (Audio) Server

VideoVideo/Image
Video/Image
Video/Image
Video
Video/Image

Surveillance Server
SourceFunction

Description

CameraSceneAnalysis

CameraNumberPlate

CameraCameraFaceDetectDemographics
FaceRecognize

Run intelligent scene analysis to identify
important events
Detect and read license plates on vehicles,
including the ability to Identify color and makeof vehicle
Detect faces
Obtain demographic information such as age,gender, and ethnicity for detected faces
Run face recognition on detected faces

TypeFunction

Description

CameraSpeechSpeech to text

SpeechPhonetic phrase search

MMAP Restful API

SpeechSpeaker segmentationand identification
Spoken language
identification
Transcript alignment

Converts spoken speech to a text transcriptof the most likely words
Converts spoken speech to a phonetic
index, which can be searched against
Identifies speakers in spoken speech

SpeechSpeech
Audio

Audio

Audio quality andclassification

Audio

Audio fingerprint
identification
Audio security

Model

Language customization

Model

Acoustic adaptation

4

Identifies the language spoken
Aligns a given text transcript with an audio
file producing time stamps for all words
Classifies audio segments as music, noise,or speech, as well as giving details on theaudio quality
Allows creation of an audio database for
identifying audio segments
Identifies common security threats fromaudio captured
Allows customization of language models
used in speech-to-text operations
Allows adaptation of acoustic models
used in speech-to-text, phonetic-phrasesearch operations

Description

Detect and read QR codes
Detect faces
Obtain demographic information such as age,gender, and ethnicity for detected faces
FaceRecognize Run face recognition on detected faces
FaceState
Obtain additional information, such as facialexpression, about detected faces
Keyframe
Identify keyframes
ObjectRecognize known objects in video
ObjectClas
Recognize known object classes in videoOCR
Run intelligent scene analysis to identify important
SceneAnalysis Run intelligent scene analysis to identify
important events
NumberPlate
Detect and read license plates on vehicles,including the ability to Identify color and makeof vehicle

The management layer comprises a set of Restful APIs to control andconfigure your media analytic and recording on the servers above.
Although MMAP is licensed in batches of 100 analytics servers it can be
expanded as required. The following functions are available via the API:■ Folder management– Merged view of folder– Get folder– Add or update a folder– Move a folder– Delete a folder■ Camera management– Get camera– Add or update a camera

– Move a camera

HTML5 Visualization Widgets– Delete a camera

OpenText™ MMAP comes with three visualization widgets designed towork together synchronously in HTML5-based applications:■ Channel management– Get channel– Add or update a channel– Move a channel■ Media player■ Timeline widget■ Transcription widget– Delete a channel■ Recorder management

Sample application pages– Get recorder– Add or update a recorder– Delete a recorder■ Source recording– Get source status

HTML templates
AngularJS Directives
MediaElement Java Script API– Assign Source– Unassign source– Camera recording status

Media player
pluginBrowser Native
MediaElement– Start recording– Stop recording– Channel recording status

Figure 3. HTML5 Visualization Widgets– Start recording– Stop recording■ HLS streaming– Get a HLS playlist– Get a HLS video segment■ Keyframes– Get a list of keyframes– Get a keyframe image■ Video clipping– Extract video clip
– Create video clip

Figure 4. Multiple levels of technology– Download video clip
■ Frame extraction– Extract frame imagewww.microfocus.com/opentext

These widgets are supplied with the ability to integrate at multiple levels of the technology stack to suit the media analytics application requirements and include levels up to and including a sample application.
Automatic time synchronization between each widget and its content
gives a dynamic user experience without the need for complex coding
within the application itself.

5

Brochure
IDOL MMAPMedia Player

Transcription Widget

The OpenText™ Media player (requires Chrome browser) extends functionality beyond the standard HTML5 video element. It will automaticallyload in applications and does not require acknowledgement or acceptance as a plug-in, simplifying the user experience.

The OpenText™ Transcription widget displays transcriptions generated
by the speech-to-text analytics, highlighting the words in the content
that are being spoken in the media player.

Frameaccurate
Go live

Navigate bytext
Infinite time
windowMulti-speed
playback

Seek toUTC time

Go fullscreen

Reverseplayback

Live updating

Sync’dhighlighting

Figure 7. Transcription widget

Figure 5. Media Player

OpenText Rich Media Analytics SKUsTimeline Widget

SKU

Products

The OpenText™ Timeline widget provides navigation within the media
stream as well as visualization of activity. It directly controls the media
available in the OpenText Media player and exposes the advanced features such as UTC time seeking, reverse play back and frame accuracy.
The Timeline widget can also be used with native media player elementsthat do not support the advanced features.

H9L90AAE

HPE MMAP 100
analysis servers

Seek by Dateand Time

Scroll andzoom

Create a clip

Display
thumbnails

Figure 6. Timeline Widget

6Grab a screenshotMark inMark out

Navigate bycursor

Display
metadata

Description

HTML media widgets, media management APIs,
and 100 media servers enabled for audio andvideo recording only. These servers can be
upgraded with analytics using the products below.
H9L88AAE Visual server
Enables all video and image analytics for use on
image files or video files and streams. This is afunctional upgrade to any media server.
H9L89AAE Audio server
Enables all speech and audio analytics for audio
and video files and streams. This is a functional
upgrade to any media server.
H9L87AAE Surveillance
Enables ANPR, face, and event analytics
serverspecifically for CCTV camera streams. This is afunctional upgrade to any media server. Suppliedin packs of 10.
Note: SKUs for perpetual licenses, support for Windows Server (2012, 2008) andLinux (CentOS, Ubuntu) 64 bit OS.

Learn more at
www.microfocus.com/richmedia
www.microfocus.com/opentext

Connect with Us
OpenText CEO Mark Barre­nechea’s blog

263-000022-001 | O | 05/23 | © 2023 Open Text