Skip to main content    

An official website of the United States government

Here’s how you know

**Official websites use .gov**              A **.gov** website belongs to an official government organization in the United States.            

**Secure .gov websites use HTTPS**              A **lock** (  LockA locked padlock) or **https://** means you’ve safely connected to the .gov website. Share sensitive information only on official, secure websites.            

https://www.nist.gov/itl/iad/mig/video-surveillance-technologies-retail-security-visitors

            -  Topics  -  All Topics 
-  Advanced communications 
-  Artificial intelligence 
-  Bioscience 
-  Buildings and construction 
-  Chemistry 
-  Climate 
-  Cybersecurity 
-  Electronics 
-  Energy 
-  Environment 
-  Fire 
-  Forensic science 
-  Health 
-  Information technology 
-  Infrastructure 
-  Manufacturing 
-  Materials 
-  Mathematics and statistics 
-  Metrology 
-  Nanotechnology 
-  Neutron research 
-  Performance excellence 
-  Physics 
-  Public safety 
-  Resilience 
-  Standards 
-  Transportation 
 
            -  Publications 
            -  Labs & Major Programs  -  Laboratories    -  Communications Technology Laboratory 
  -  Engineering Laboratory 
  -  Information Technology Laboratory 
  -  Material Measurement Laboratory 
  -  Physical Measurement Laboratory 
-  User Facilities    -  NIST Center for Neutron Research 
  -  CNST NanoFab 
-  Research Test Beds 
-  Research Projects 
-  Tools & Instruments 
-  Major Programs    -  Baldrige Performance Excellence Program 
  -  CHIPS for America Initiative 
  -  Manufacturing Extension Partnership (MEP) 
  -  Office of Advanced Manufacturing 
  -  Special Programs Office 
  -  Technology Partnerships Office 
 
            -  Services & Resources  -  Standards and Measurements    -  Calibration Services 
  -  Laboratory Accreditation (NVLAP) 
  -  Quality System 
  -  Standard Reference Materials (SRMs) 
  -  Standards.gov 
  -  Time Services 
  -  Office of Weights and Measures 
-  Software 
-  Data    -  Chemistry WebBook 
  -  National Vulnerability Database 
  -  Physical Reference Data 
  -  Standard Reference Data (SRD) 
-  Storefront 
-  License & Patents 
-  Computer Security Resource Center (CSRC) 
-  NIST Research Library 
 
            -  News & Events  -  News 
-  Events 
-  Blogs 
-  Feature Stories 
-  Awards 
-  Video Gallery 
-  Image Gallery 
-  Media Contacts 
 
            -  About NIST  -  About Us    -  Leadership 
  -  Organization Structure 
  -  Budget & Planning 
-  Contact Us 
-  Visit 
-  Careers    -  Student programs 
-  Work with NIST 
-  History    -  NIST Digital Archives 
  -  NIST Museum 
  -  NIST and the Nobel 
-  Educational Resources 
 

Information Technology LaboratoryInformation Access Division

## Multimodal Information Group

-  Tools 
-  Past HLT Evaluation Projects 
-  Staff 

# Video Surveillance Technologies for Retail Security (VISITORS)

## Share

Facebook

Linkedin

Twitter

Email

The U.S. Retail Industry experiences over $32B in losses per year (2008 statistics) due to retail theft and frauds. Organized crime accounts for a staggering portion of these losses. Current video surveillance networks rely heavily on an eyes-on approach to alerting officials of specific human-related behaviors. Unfortunately, humans are unable to maintain focus and attention across several video monitors for an extended period of time. Improved video behavioral analytics will serve to alert loss professionals and security personnel to behavioral abnormalities, direct their attention to the monitor and area of interest, and allow them to engage with the shoplifter before departure from the store. This will have a dramatic impact on Industry and our overall Economic Security. Improved technologies in the "Commerce" environment are directly applicable to improvements needed to notify police and security forces of potential threats. Hence, VISITORS receives a lot of attention from several communities.

The VISITORS project goes a step beyond any video analytic work done to date, in the sense of promoting the advancement of video analytics that are able to predict that a criminal event is about to take place through the observation of specific behaviors. This is done by predictive analysis, using software to analyze a video stream and to identify suspicious behaviors that enable notification of security personnel while tracking the person of interest up to, and including, the shoplifting event. The VISITORS project will require the development of a distributable video data corpus of normal and abnormal activities encountered in a retail environment.

**Current Activities:**

As a direct result of the June 2010 Technical Symposium several senior-level working groups were developed and began meeting in the latter portion of 2010. The active working groups are:
                  - Suspicious Behaviors which encompasses law enforcement, psychologists, senior loss prevention officials, computer vision experts, and scientists. Intense brainstorming produced a list of salient external, internal and group behaviors which may be precursors to a shoplifting event.
                  - Strategic Planning which is comprised of government only personnel and is looking at steps forward in evaluation protocols and planning.
                  - Video Data Collection which met to discuss the various issues involved in collecting and disseminating video for training and testing algorithms. Options for using existing retail video databases and alternatively creating scenarios, based on desired suspicious behaviors, are being pursued. The group discusses a myriad number of issues, not least being dealing with legal issues concerning use of Human Subjects in research.

The heaviest push is focused on receiving clearances for data access and dissemination. Human subject protection and personal identifying information concerns must be resolved. Much effort remains in developing scenario based data collection protocols.

Efforts to develop the VISITORS Evaluation plan and metrics for an initial pilot evaluation are underway.

**Past Activities:**
                  - 2010 Technology Symposium for Video Surveillance Technologies for Retail Security

NIST has brought together major stakeholders from the retail and security industries, computer vision technologists/developers, the research community, law enforcement, and government agencies in a common mission to advance the state-of-the-art in predictive video analytics. The focus of the VISITORS project is to advance technologies and methodologies used to detect persons engaged in suspicious activities as applied in the retail domain. The initial "meeting of the minds" was held via a technical symposium in June 2010 to identify interest and key issues among the stakeholders. The resulting roadmap indicating the pathway ahead is now available.

Information technologyBiometricsData and informaticsData and informaticsData and informaticsData and informaticsLaw enforcementLaw enforcementLaw enforcementForensic Science

### HEADQUARTERS

301-975-2000

Webmaster | Contact Us | Our Other Offices

TwitterFacebookLinkedInInstagramYouTubeGiphyRSS FeedMailing List

Feedback

            -  Site Privacy 
            -  Accessibility 
            -  Privacy Program 
            -  Copyrights 
            -  Vulnerability Disclosure 
            -  No Fear Act Policy 
            -  FOIA 
            -  Environmental Policy 
            -  Scientific Integrity 
            -  Information Quality Standards 
            -  Commerce.gov 
            -  Science.gov 
            -  USA.gov 
            -  Vote.gov