# Patent

## Title
Method for analyzing time series activity streams and devices thereof

## Abstract

A method, non-transitory computer readable medium, and data manager computing device comprises retrieving a time series data of a monitored asset based on one or more tags in response to a request. Further, a heterogeneous data based on the one or more tags is retrieved. Furthermore, a cause of an anomaly period in retrieved time series data of the monitored asset is determined based on the retrieved heterogeneous data. Finally, the determined cause of the anomaly period in the time series data in the monitored asset is provided.

## Background
This application claims the benefit of U.S. Provisional Patent Application Ser. No. 61/560,390 filed Nov. 16, 2011, which is hereby incorporated by reference in its entirety.


FIELD
This technology generally relates to method for analyzing data and particularly relates to analyzing time series activity streams and devices thereof.
BACKGROUND
The connected world, also referred to as the internet of things, is growing quickly. Analysts have estimated that along with the continued growth of humans using the Internet, the number of connected devices and systems will rise from five billion to one trillion in the next ten years. However, the traditional ways to manage and communicate with these systems has not changed. In other words, all the information from these systems is not accessible or is not able to be correlated in a way that helps people or businesses do their jobs better and more efficiently, find information they are looking for in the proper context, or make this data consumable in a meaningful way.
There are a variety of specific solutions to handle the rising amount of data found in industry today. These solutions can be categorized into the following types of systems: Enterprise Resource Planning (ERP) systems; Portals and related technology systems; Traditional Business Intelligence systems; and Manufacturing Intelligence systems.
Enterprise Resource Planning systems are used by large and small companies to run their businesses. The typical minimal requirements for these systems are to provide financial and accounting services. However, these systems often have additional functionality for specific vertical industries, such as manufacturing, utilities, construction, and retail by way of example. These Enterprise Resource Planning systems are rigid, in both business process support and data models. They also are very expensive to implement and maintain. Further, these systems are usually implemented to enforce repeatable, standard business processes and it generally is not possible to use these systems for dynamic analysis of different types of data.
Traditional Business Intelligence systems usually rely on specific, detailed data models, such as data warehouses. While the data is typically current, for example about a day old, in these systems, the models are rigid and report writing may require Information Technology (IT) skills. While these systems have become much better at providing users with the ability to self-serve, the self service capability is restricted to the previously designed semantic search models. As a result, these Traditional Business Intelligence systems do not address current conditions, rapidly changing data, third party collaboration, or external data sources.
Manufacturing Intelligence systems (also referred to as Enterprise Manufacturing Intelligence or EMI) are typically concerned with real-time data collected from machines and devices. This time series data usually does not have any business context associated with it. The users of these Manufacturing Intelligence systems typically are plant operators and engineers. These systems do not handle other business related data, do not understand or correlate unstructured data, and are not easily readable.
Currently, most of the utilized solutions to pull all these separate systems with their different sources of data together so users can consume data from more than one of these solutions in a meaningful way, is to execute a complex, multi-year integration project that results in a data mart. Typically, this involves replicating large quantities of data from multiple systems into a rigid model, similar to a hub and spoke model. The hub is the data mart holding all the replicated data. As the systems changes at the end of the spokes, new time consuming integration and modeling is required. Unfortunately, this type of solution is expensive to maintain, the data model and semantics are not dynamic, and the ability to consume data is available only through pre-defined reports.
Other existing approaches to pull all these separate systems with their different sources of data together rely on relational data bases which are adept at answering known questions against known data structures (Known-Known) and can answer known questions against unknown data structures (Known-Unknown). Unfortunately, these existing approaches can not effectively answer unknown questions against known data structure (Unknown-Known), and unknown questions against unknown data structures (Unknown-Unknown).
As a result, currently users of existing technologies to identify and access data are concerned with the timeliness and relevance of acquired data. In particular, there is a concern about deficiencies with accurately identifying and accessing real-time data from devices and other storage systems. Additionally, these existing technologies have difficulties identifying and accessing different types of relevant data, such as business related data which can be stored in many varying formats and unstructured data. Further, these existing technologies typically require large quantities of data from multiple systems to first be entered into a rigid model and then this entered data can only be access in limited manners.
SUMMARY
A method for analyzing a time series activity stream including a data management computing apparatus for retrieving a time series data of a monitored asset based on one or more tags in response to a request. Further, a heterogeneous data based on the one or more tags is retrieved by the data management computing apparatus. Furthermore, a cause of an anomaly period in retrieved time series data of the monitored asset is determined based on the retrieved heterogeneous data by the data management computing apparatus. Finally, the determined cause of the anomaly period in the time series data in the monitored asset is provided by the data management computing apparatus.
A non-transitory computer readable medium having stored thereon instructions for analyzing a time series activity stream comprising machine executable code which when executed by at least one processor, causes the processor to perform steps including retrieving a time series data of a monitored asset based on one or more tags in response to a request. Further, a heterogeneous data based on the one or more tags is retrieved. Furthermore, a cause of an anomaly period in retrieved time series data of the monitored asset is determined based on the retrieved heterogeneous data. Finally, the determined cause of the anomaly period in the time series data in the monitored asset is provided.
A data management computing apparatus comprising one or more processors, a memory coupled to the one or more processors which are configured to execute programmed instructions stored in the memory including retrieving a time series data of a monitored asset based on one or more tags in response to a request. Further, a heterogeneous data based on the one or more tags is retrieved. Furthermore, a cause of an anomaly period in retrieved time series data of the monitored asset is determined based on the retrieved heterogeneous data. Finally, the determined cause of the anomaly period in the time series data in the monitored asset is provided.
This technology provides a number of advantages including providing more effective and efficient methods, non-transitory computer readable medium and device for analyzing time series data. With this technology, a wide variety of different types of data, such as business related data, social media data and unstructured data, can be easily identified and accessed. Further, this technology does not require the data to be first loaded into a rigid model which can only be accessed in limited manners.



BRIEF DESCRIPTION OF THE DRAWINGS
FIG. 1 is a block diagram of an environment with an exemplary data management computing apparatus for analyzing time series activity steam;
FIG. 2 is a flowchart of an exemplary method for obtaining and tagging time series data;
FIGS. 3A-3B are flowcharts of an exemplary method for analyzing time series activity steam;
FIG. 4 is an exemplary diagram of a method for obtaining and tagging heterogeneous data from multiple sources; and
FIG. 5 is an exemplary illustration of a method for servicing the request from a client computing device.



DETAILED DESCRIPTION
An exemplary environment 10 with a data management computing apparatus 14 that analyzes time series data is illustrated in FIG. 1. In this particular example, the environment 10 includes the data management computing device 14, plurality client computing devices 12, and a plurality of data servers 16, a social network database 17, monitored asset 32 and sensors 34 which are coupled together by the Local Area Network (LAN) 28 and Wide Area Network (WAN) 30, although the environment 10 can include other types and numbers of devices, components, elements and communication networks in other topologies and deployments. While not shown, the exemplary environment 10 may include additional components, such as routers, switches and other devices which are well known to those of ordinary skill in the art and thus will not be described here. This technology provides a number of advantages including providing more effective and efficient methods, non-transitory computer readable medium and device for analyzing time series data.
Referring more specifically to FIG. 1, the data management computing apparatus 14 provides a number of functions analyzing time series data, although other numbers and types of systems can be used and other numbers and types of functions can be performed. The data management computing apparatus 14 includes at least one processor 18, memory 20, input and display devices 22, and interface device 24 which are coupled together by bus 26, although data management computing apparatus 14 may comprise other types and numbers of elements in other configurations.
Processor(s) 18 may execute one or more computer-executable instructions stored in the memory 20 for the methods illustrated and described with reference to the examples herein, although the processor(s) can execute other types and numbers of instructions and perform other types and numbers of operations. The processor(s) 18 may comprise one or more central processing units (“CPUs”) or general purpose processors with one or more processing cores, such as AMD®processor(s), although other types of processor(s) could be used (e.g., Intel®).
Memory 20 may comprise one or more tangible storage media, such as RAM, ROM, flash memory, CD-ROM, floppy disk, hard disk drive(s), solid state memory, DVD, or other memory storage types or devices, including combinations thereof, which are known to those of ordinary skill in the art. Memory 20 may store one or more non-transitory computer-readable instructions of this technology as illustrated and described with reference to the examples herein that may be executed by the one or more processor(s) 18. The flow chart shown in FIGS. 2 and 3A-3B is representative of example steps or actions of this technology that may be embodied or expressed as one or more non-transitory computer or machine readable instructions stored in memory 20 that may be executed by the processor(s) 18. Additionally, as illustrated in FIG. 4-5, the memory 20 includes a graph database to which maintains the model relationship and indexes which support rapid retrieval of tag and nodal relationship data.
Input and display devices 22 enable a user, such as an administrator, to interact with the data management computing apparatus 14, such as to input and/or view data and/or to configure, program and/or operate it by way of example only. Input devices may include a touch screen, keyboard and/or a computer mouse and display devices may include a computer monitor, although other types and numbers of input devices and display devices could be used. Additionally, the input and display devices 22 can be used by the user, such as an administrator to develop applications using an application interface.
The interface device 24 in the data management computing apparatus 14 is used to operatively couple and communicate between the data management computing apparatus 14, the client computing devices 12, and the plurality of data servers 16 which are all coupled together by LAN 28 and WAN 30. By way of example only, the interface device 24 can use TCP/IP over Ethernet and industry-standard protocols, including NFS, CIFS, SOAP, XML, LDAP, and SNMP although other types and numbers of communication protocols can be used.
Each of the client computing devices 12 includes a central processing unit (CPU) or processor, a memory, an interface device, and an I/O system, which are coupled together by a bus or other link, although other numbers and types of network devices could be used. Each of the client computing devices 12 communicate with the data management computing apparatus 14 through LAN 28, although each of the client computing devices 12 can interact with the data management computing apparatus 14 in other manners.
Each of the plurality of data servers 16 includes a central processing unit (CPU) or processor, a memory, an interface device, and an I/O system, which are coupled together by a bus or other link, although other numbers and types of network devices could be used. Each of the plurality of data servers 16 enters, updates and/or store content, such as files and directories, although other numbers and types of functions can be implemented and other types and amounts of data could be entered, updated, or stored used. Each of the plurality of data servers 16 may include by way of example only, enterprise resource planning (ERP) systems, portals and related technologies, traditional business intelligence systems and manufacturing intelligence systems.
The social network database 17 includes a central processing unit (CPU) or processor, a memory, an interface device, and an I/O system, which are coupled together by a bus or other link, although other numbers and types of network devices could be used. The social network database 17 includes heterogeneous data entered by users from social network platforms, although the social network database 17 can include any additional information. By way of example only, the contents of the social network database 17 includes information from the users of Wikipedia, blogs which are entered and tagged by the users. As illustrated in FIG. 1, the data management computing apparatus 14 interacts with the social network database via LAN 28, although the data management computing apparatus 14 can interact with the social network database 17 via other network topologies.
The monitored asset 32 includes a central processing unit (CPU) or processor, a memory, an interface device, and an I/O system, which are coupled together by a bus or other link, although other numbers and types of network devices could be used. In this technology, the monitored asset 32 can be an electrical or mechanical devices, machines, or instruments. Additionally, the monitored asset 32 includes sensors 34 which assist with obtaining information from the monitored asset 32 or transmitting data out of the monitored asset 32. Although the sensors 34 has been illustrated in FIG. 1 to be coupled with the monitored asset, as it may be appreciated by a person having ordinary skill in the art, the sensors 34 can exist outside the monitored asset 34 and could be communicably coupled to the monitored asset 34. Further, the data management computing apparatus 14 interacts, obtains data or sends data to the monitored asset 32 or the sensors 34 via LAN 28, although the data management computing apparatus 14 can interact with the monitored asset 32 and the sensors 34 in other manners.
In this technology, sensor 34 is an electro-mechanical device which receives electrical data from the monitored asset 32 and converts the electrical signals to a format which can be read by an observer. By way of example only, sensor 34 can be a pressure sensor, thermal, heat, and/or temperature sensor, although other types and numbers of sensors and other monitors could be used. Accordingly, in this technology, sensors 34 are used by the data management computing apparatus 14 to obtain time series data from the monitored asset 32, although the data management computing apparatus 14 can use the sensors 34 for other additional functions.
Although an exemplary environment 10 with the plurality of client computing devices 12, the data management computing apparatus 14, the plurality of data servers 16, the social network database 17, the monitored asset 32 and sensors 34 are described and illustrated herein, other types and numbers of systems, devices in other topologies can be used. It is to be understood that the systems of the examples described herein are for exemplary purposes, as many variations of the specific hardware and software used to implement the examples are possible, as will be appreciated by those skilled in the relevant art(s).
In addition, two or more computing systems or devices can be substituted for any one of the systems or devices in any example. Accordingly, principles and advantages of distributed processing, such as redundancy and replication also can be implemented, as desired, to increase the robustness and performance of the devices and systems of the examples. The examples may also be implemented on computer system(s) that extend across any suitable network using any suitable interface mechanisms and traffic technologies, including by way of example only tele-traffic in any suitable form (e.g., voice and modem), wireless traffic media, wireless traffic networks, cellular traffic networks, 3G traffic networks, Public Switched Telephone Network (PSTNs), Packet Data Networks (PDNs), the Internet, intranets, and combinations thereof.
Furthermore, each of the systems of the examples may be conveniently implemented using one or more general purpose computer systems, microprocessors, digital signal processors, and micro-controllers, programmed according to the teachings of the examples, as described and illustrated herein, and as will be appreciated by those of ordinary skill in the art.
The examples may also be embodied as a non-transitory computer readable medium having instructions stored thereon for one or more aspects of the technology as described and illustrated by way of the examples herein, which when executed by a processor (or configurable hardware), cause the processor to carry out the steps necessary to implement the methods of the examples, as described and illustrated herein.
An exemplary method for analyzing time series data will now be described with reference to FIGS. 1, 2 and 3A-3B. Particularly with respect to FIGS. 1 and 2, in step 205, the data management computing apparatus 14 receiving the time series data of the monitored asset 32 from the sensors 34 in real time as illustrated in the first step of FIG. 4, although the data management computing apparatus 14 can obtain the time series from the plurality of data servers 16. By way of example only, the time series data can include real time data of monitored asset 32, such as continuous temperature readings or pressure readings, although the time series data can relate to other readings. However, in another example, the data management computing apparatus 14 may periodically obtain the time series data from sensors 34. Additionally, in yet another example, the data management computing apparatus 14 can obtain the time series data in response to a notification received from the sensors 34 when there is an event triggered in the monitored asset 32.
Next, in step 210, the data management computing apparatus 14 embeds tags to the obtained time series obtained in step 105, although the data management computing apparatus 14 can use other techniques to quickly and efficiently identify the time series data. In this example, the data management computing apparatus 14 automatically embeds tags to the time series data based on pre-defined rules. As it would be appreciated by a person having ordinary skill in the art, a tag is a non-hierarchical keyword or term or a metadata assigned to a piece of information. The tag helps describe an item and allows it to be found again by browsing or searching. Additionally, tags are can be customized depending on the system and can be of various types, such as a dynamic tag which can be created by the data management computing apparatus 14 based on the obtained time series data or fixed tags which are created by the data management computing apparatus 14 based on pre-defined vocabulary. By way of example only, the pre-defined rules can relate to embedding tag for a particular type of data, such as embedding “temperature values” as tags for all the time series data obtained from the sensors 34 relating to the temperature values of the monitored asset 32 and/or add the name of the particular component as the tag for all the data obtained from the sensors for particular component of the monitored asset 32, such as “therometer1”.
Optionally, the data management computing apparatus 14 can add metadata, such as the data source, the relationship of the source to the monitored asset 34 and additional context information to the obtained time series data.
In another example of the technology, the data management computing apparatus 14 can obtain the time series data from the sensors 34 and collectively create an activity stream. Additionally, the activity stream can be tagged using techniques illustrated in step 210 and store the activity stream within the memory 20.
In step 215, the data management computing apparatus 14 stores the tagged time series data in memory 20 as illustrated in FIG. 4, although the data management computing apparatus 14 can store the time series data at other memory locations. In this technology, the data management computing apparatus 14 stores the tagged time series data and in the memory 20 and the exact memory location of the tagged time series and the associated memory location is stored in the index table which is also present in the memory 20. By storing the tagged time series data and having an index table, the technology disclosed in this application provided benefits of rapid and accurate retrieval data.
Additionally, in this technology, the data management computing apparatus 14 stores the tagged time series in the memory 20 with time stamp. In this technology, time stamp relates to the information regarding the exact time and date the time series data was obtained in real-time from the sensors 34 and stored. By storing the heterogeneous data and the time series data with time stamp, the technology disclosed in this application provides benefits to further analyze the cause of an anomaly period accurately, although storing with the time stamp may provide other additional benefits.
In step 220, the process of obtaining and storing the time series data ends.
Next, in FIG. 3A, in step 305, the data management computing apparatus 14 receives a request to analyze time series data with a particular tag for a monitored asset 32 via an executing application in client computing device 12 as illustrated in FIG. 5, although the data management computing apparatus 14 may receive other types of requests from the client computing device 12.
In step 310, the data management computing apparatus 14 retrieves the stored time series data in step 115 of FIG. 2 associated with the received tag in response to the received request, although the data management computing apparatus 14 can obtain the stored time series data without using the received tag information. By way of example only, obtains the time series data stored in the step 215 from the memory 20 by referring to the index table and using the tag information present in the received request as illustrated in FIG. 5, although the data management computing apparatus 14 can directly obtain the heterogeneous contextual data from memory 20 without directly referring to the index table stored in memory 20 or without using the tag information received in the request for the time series data. By way of example only, the data management computing apparatus 14 uses the tag information received in the request for the time series data, matches the tag information with the listed tags in the index table and accordingly obtains the time series data from the memory location associated with the tag in the index table. As previously illustrated, the technology disclosed in this application provides advantages by to quickly and effectively obtain the requested data by referring to the index table. However, as illustrated earlier in another example, if the data management computing apparatus 14 obtains all the time series data present within the memory 20 when the data management computing apparatus 14 does not use the received tag to obtain the time series data stored in step 215.
In step 315, the data management computing apparatus 14 determines if there was an anomaly period within the time series data of the monitored asset. If the data management computing apparatus 14 determines there was no observed anomaly period within the time series data, then the No branch is taken to step 317 where the data management computing apparatus 14 provides the requesting client computing device 12 with the obtained time series data and the process flow ends. If the data management computing apparatus 14 determines there was an observed anomaly period within the time series data, then the Yes branch is taken to step 320.
In this example, the data management computing apparatus 14 determines when an anomaly period is observed within the time series data by comparing the time series data of the monitored asset 32 against threshold values for the monitored asset 22, although the data management computing apparatus 14 can determine when an anomaly period is observed in other manners well known to those of ordinary skill in the art, such as monitoring for readings in the time series data which are greater than a standard deviation by way of example.
In step 320, the data management computing apparatus 14 retrieves structured and/or unstructured heterogeneous data using the tag information received in step 305 from the multiple sources, such as plurality of data servers 16, social network database 17 or from sensors 34 as illustrated in FIG. 4 by way of example only, although the data management computing apparatus 14 can obtain structured or unstructured heterogeneous data from other sources. However, in another example, the data management computing apparatus 14 may obtain heterogeneous data associated with tags which are present in the anomaly period. In this technology, the data management computing apparatus 14 obtains the unstructured heterogeneous data relating to the received tag information by crawling to the plurality of data servers 16, although the data management computing apparatus 14 can obtain information relating to the tag information from other sources in other manners. In this technology, the structured or unstructured data relates to environmental data obtained from sensors 34 and business process information from one or more applications on one or more third party computing devices as illustrated in FIG. 4, although the contextual information can relate to other types and amounts of additional information obtained from other sources. For further illustrative purposes, the data management computing apparatus 14 obtains the user entered structured or unstructured data found in wikis, blogs or other social platforms from the social network database 17, although the data management computing apparatus 14 can obtain the user entered data from other sources.
In step 325, the data management computing apparatus 14 provides the obtained time series data and the heterogeneous time series data to the requesting client computing device 12. Additionally, in this technology, while providing the time series data and the heterogeneous data, the data management computing apparatus 14 converts the tagged time series data into a format convenient for viewing in the requesting client computing device 12. By way of example only, formats can be in a PDF, textual format, graphs, charts, tabular columns or an image format, although other formats can be used. Further, in this technology, the data management computing apparatus 14 provides the tagged time series data to the requesting client computing device 12 by embedding the converted time series data and the heterogeneous data within a work-flow of the executing application of the client computing device 12, although the data management computing apparatus 14 can provide the tagged time series data to the requesting client computing device 12 using other methods.
In step 330, the data management computing apparatus 14 receives a request from the client computing device 12 via the executing application for heterogeneous contextual data relating to the anomaly period, although the data management computing apparatus 14 may receive other types of request from the client computing device 12.
In step 335, the data management computing apparatus 14 retrieves the heterogeneous contextual data stored relating to the anomaly period from the plurality of data servers 16, social network database 17 or sensors 34 based on the model relationships in response to the received request, although the data management computing apparatus 14 can obtain the heterogeneous contextual data without a model relationship based on other parameters from other sources. In this technology, the model relationship defines the relationship, hierarchy, data or process flow, and/or interaction of the monitored asset 32 with other related assets. In this technology, the model relationship is present within the memory 20, although the model relationship can be stored at other locations. As it would appreciated by a person having ordinary skill in the art, heterogeneous contextual data in this technology relates to environmental data, such as temperature pressure, operator blog entries, customer order details, although heterogeneous contextual data can include other types and amounts of information.
In step 340, the data management computing apparatus 14 provides the obtained heterogeneous contextual data relating to the anomaly period to the requesting client computing device using techniques illustrated in step 325.
In step 345, the data management computing apparatus 14 receives a request for related heterogeneous asset data relating to the anomaly from the client computing device 12 via the executing application. Additionally, as illustrated in step 240, the data management computing apparatus 14 can receive keywords along with the request for the related heterogeneous asset data.
In step 350, the data management computing apparatus 14 retrieves the related heterogeneous asset data, such as upstream data and/or downstream data based on model relationships and also activities of the other machines associated during the anomaly period from the sensors 34, plurality of data servers 16 as illustrated in FIG. 4, although the data management computing apparatus 14 can obtain the related heterogeneous asset data from other sources in other manners. In this technology, upstream data includes data from related assets (not shown) upstream from the functionality performed by the monitored asset 32 and the downstream data includes data from related assets (not shown) downstream from the functionality performed by the monitored asset 32 during the anomaly period, although the obtained related heterogeneous asset data can also include the upstream and downstream data prior to the anomaly period. Additionally, in this technology, the data management computing apparatus 14 identifies the related assets which are upstream and downstream from the monitored asset based on the model relationship for the monitored asset 32 which explains the relationship hierarchy or flow between the monitored asset and related assets.
In step 355, the data management computing apparatus 14 provides the obtained related heterogeneous asset data to the requesting client computing device 12 using techniques illustrated in step 325.
Next, in step 360 the data management computing apparatus 14 identifies a cause of the anomaly period in the time series data from the monitored asset based on the time series data, the heterogeneous data, the heterogeneous contextual data, and the related heterogeneous asset data, although the data management computing apparatus 14 can determine the actual cause of anomaly using other techniques. In this technology, the time series, the heterogeneous data, the heterogeneous contextual data and the related heterogeneous asset data collectively provides an accurate cause of the anomaly period as one of the retrieved heterogeneous information independently may not provide the complete or accurate cause of the anomaly period.
Upon identifying the cause of anomaly, in step 365 the data management computing apparatus 14 identifies and provides corrective step(s) to the requesting client computing device 12 obtained by correlating the identified cause against a table of stored corrective step(s) to fix the cause of the anomaly period, although other manners identifying and providing corrective step(s) can be used. For example, the opinions from technical experts, suggestions from the manufacturer or comments present in blogs and other social media relating to the monitored asset mined from one or more of the plurality of data servers 16 and or the social network database 17 can be used. Additionally, the data management computing apparatus 14 may also direct the requesting client computing device 12 to a website or a technical expert who could further assist with preventing the anomaly period. In step 380, this exemplary method ends.
An example illustrating the methods for analyzing time series data is explained as follows. In this example, the data management computing apparatus 14 had captured the time series data of the electric car, such as car identification number, time started, time completed, level of charge to start, level of charge when completed from the sensors 34 when an electric car was being charged and stored the time series of the car using the date on which the car was charged and the name of the car within the memory 20.
The data management computing apparatus 14 computing apparatus 14 retrieves the stored time series data of the electric car using the tags of the date of charge and the name of the car.
Further, the data management computing apparatus 14 identifies anomaly in the obtained time series data, which in this case is the requirement for the car to be charged earlier than expected. For further illustrative purpose, the standard time for next battery recharge of the car was 48 hours, however, in this example the car is back for charging within 36 hours which means that the car has to be charged 12 hours earlier than the standard time. However, in this technology the data management computing apparatus 14 cannot accurately identify the cause for the electric car to be charged earlier than expected as the time series data obtained from the sensors 34 as the time series data of the car does not show any battery degradation.
Accordingly for further investigative purposes, the data management computing apparatus 14 obtains heterogeneous data from plurality of data servers 17 and the social network database 17, such as the driver internal blogs which indicate that the driver was behind on his delivery schedule for the day he charged the vehicle.
Next, the data management computing apparatus 14 retrieves the contextual data, such as the ambient temperature, from another heterogeneous data source based on the model relationship and determines the ambient temperature was above a stored threshold after the car was charged. The data management computing apparatus 14 retrieves other contextual data which indicates that ambient temperatures above that threshold lead to a shorter battery life.
Additionally, the data management computing apparatus 14 retrieves other heterogeneous business related blog data, such as information noted in a driver log data which indicated the driver was scheduled to visit an especially difficult customer and that the customer may lodge a complaint if the driver was late for delivery and this caused the driver to exceed speed recommendations, using more energy of the battery than normal.
Based on car battery information, the driver's internal blog, the ambient temperature and the driver log data, the data management computing apparatus 14 identifies the actual cause of the early recharge of the car to be negligence of the driver. Accordingly, the data management computing apparatus 14 provides improvement steps indicating that the driver may need to be reminded of proper hours and vehicle use and also indicates that the battery is in good condition and does not require any servicing.
Accordingly, as illustrated and described with the examples herein this technology provides a number of advantages including providing more effective and efficient methods, non-transitory computer readable medium and device for analyzing time series data. With this technology, a wide variety of different types of data, such as business related data, social media data and unstructured data, can be easily identified and accessed. Further, this technology does not require the data to be first loaded into a rigid model which can only be accessed in limited manners.
Having thus described the basic concept of this technology, it will be rather apparent to those skilled in the art that the foregoing detailed disclosure is intended to be presented by way of example only, and is not limiting. Various alterations, improvements, and modifications will occur and are intended to those skilled in the art, though not expressly stated herein. These alterations, improvements, and modifications are intended to be suggested hereby, and are within the spirit and scope of this technology. Additionally, the recited order of processing elements or sequences, or the use of numbers, letters, or other designations therefore, is not intended to limit the claimed processes to any order except as may be specified in the claims. Accordingly, this technology is limited only by the following claims and equivalents thereto.

## Claims

1. A method of operating a data management computing apparatus for analyzing a time series activity stream, the method comprising:
providing access to a time series activity stream comprising a collection of time series data and a collection of heterogeneous data, both of which are accessible to a data management computing apparatus and are associated with a plurality of monitored assets, said monitored assets being related to an industrial process,
wherein the time series data is collected from one or more sensors of a given monitored asset of the plurality of monitored assets and is associated with one or more tags, including a tag indicative of when the given time series data was created by the one or more sensors, and
wherein the heterogeneous data is originated from a plurality of sources of different types;

providing a model defining a hierarchical relationship among related monitored assets of the plurality of monitored assets;
receiving, by the data management computing apparatus, a search request to analyze the time series activity stream, the search request comprising a keyword associated with at least a portion of the one or more tags;
responsive to receiving the search request, retrieving, by a processor of the data management computing apparatus, from the collection of time series data, a set of time series data associated with the first monitored asset and associated with a tag matched to at least a portion of the keyword;
analyzing, by the processor of the data management computing apparatus, the retrieved time series data to determine an anomaly period in the retrieved time series data associated with an anomalous operation of the industrial process;
retrieving, by the processor of the data management computer apparatus, from the collection of heterogeneous data, a first set of heterogeneous data present in the anomaly period,
wherein the first set of heterogeneous data comprises a first set of business process information associated with the first monitored asset;

retrieving, by the processor of the data management computing apparatus, from the collection of heterogeneous data, a second set of heterogeneous data present in the anomaly period,
wherein the second set of heterogeneous data is associated with a second monitored asset related to the first monitored asset according to the model defining the hierarchical relationship among the related monitored assets, including the first and second monitored assets, and wherein the second set of heterogeneous data comprises a second set of business process information associated with the second monitored asset;

aggregating, by the processor of the data management computing apparatus, into a single result set, the retrieved time series data, the first set of heterogeneous data, and the second set of heterogeneous data; and
causing, by the processor of the data management computing apparatus, the result set to be displayed and/or stored in memory.

2. The method as set forth in claim 1,
wherein the first set of heterogeneous data comprises one or more of an environmental data from one or more environmental sensors, a business process information from one or more applications on one or more third party computing devices, and a human entered data from one or more blogs or social media systems; and
wherein the second set of heterogeneous data comprises at least one of an upstream heterogeneous data from an upstream source within the industrial process or a downstream heterogeneous data from a downstream source within the industrial process.

3. The method as set forth in claim 1 further comprising:
receiving, by the data management computing apparatus, time series data for the first and/or second monitored asset from one or more sensors associated therewith; and
embedding, by the data management computing apparatus, one or more contextual tags in the time series data for the first and/or second monitored asset based on one or more stored rules of the data management computing apparatus.

4. The method as set forth in claim 1 wherein the collection of heterogeneous data comprises:
one or more of an unstructured data from one or more unstructured data sources,
a structured data from one or more structured data sources, and
a crawled data from one or more third party application and index data sources.

5. The method as set forth in claim 1, wherein time series activity stream is stored on one or more types of systems selected from the group consisting of: an enterprise resource planning (ERP) system, a business intelligence system, and a manufacturing intelligence system.

6. A non-transitory computer readable medium having stored thereon instructions for analyzing a time series activity stream comprising machine executable code which when executed by at least one processor, causes the processor to:
access a time series activity stream comprising a collection of time series data and a collection of heterogeneous data, both of which are associated with a plurality of monitored assets, said monitored assets being related to an industrial process,
wherein the time series data is collected from one or more sensors of a given monitored asset of the plurality of monitored assets and is associated with one or more tags, including a tag indicative of when the given time series data was created by the one or more sensors, and
wherein the heterogeneous data is originated from a plurality of sources of different types;

receive a search request to analyze the time series activity stream, the search request comprising a keyword associated with at least a portion of the one or more tags;
retrieve, from the collection of time series data, a set of time series data associated with the first monitored asset and associated with a tag matched to at least a portion of the keyword;
analyze the retrieved time series data to determine an anomaly period in the retrieved time series data associated with an anomalous operation of the industrial process;
retrieve from the collection of heterogeneous data, a first set of heterogeneous data present in the anomaly period,
wherein the first set of heterogeneous data comprises a first set of business process information associated with the first monitored asset;

retrieve, from the collection of heterogeneous data, a second set of heterogeneous data present in the anomaly period,
wherein the second set of heterogeneous data is associated with a second monitored asset related to the first monitored asset according to the model defining the hierarchical relationship among the related monitored assets, including the first and second monitored assets, and wherein the second set of heterogeneous data comprises a second set of business process information associated with the second monitored asset;

aggregate into a single result set, the retrieved time series data, the first set of heterogeneous data, and the second set of heterogeneous data and
cause the result set to be displayed and/or stored in the memory.

7. The non-transitory computer readable medium as set forth in claim 6, wherein the first set of heterogeneous data comprises at least one of:(i) one or more environmental data from one or more environmental sensors,
(ii) one or more business process information from one or more applications on one or more third party computing devices, and
(iii) a human entered data from one or more blogs or social media systems; and
wherein the second set of heterogeneous data comprises at least one of an upstream heterogeneous data from an upstream source or a downstream heterogeneous data from a downstream source of the industrial process.

8. The non-transitory computer readable medium as set forth in claim 6, wherein the instructions, when executed, further causes the processor to:
receive the time series data from the first monitored asset; and
embed by one or more tags into the time series data based on one or more rules stored in the memory.

9. The non-transitory computer readable medium as set forth in claim 6 wherein the first set of heterogeneous data comprises:
one or more of an unstructured data from one or more unstructured data sources, a structured data from one or more structured data sources, and a crawled data from one or more third party application and index data sources.

10. A data management computing apparatus comprising: one or more processors;
a memory coupled to the one or more processors which are configured to execute programmed instructions stored in the memory, the instructions when executed causes the processor to:
access a time series activity stream comprising a collection of time series data and a collection of heterogeneous data, both of which are associated with a plurality of monitored assets, said monitored assets being related to an industrial process,
wherein the time series data is collected from one or more sensors of a given monitored asset of the plurality of monitored assets and is associated with one or more tags, including a tag indicative of when the given time series data was created by the one or more sensors, and
wherein the heterogeneous data is originated from a plurality of sources of different types;

receive a search request to analyze the time series activity stream, the search request comprising a keyword associated with at least a portion of the one or more tags;
retrieve from the collection of time series data, a set of time series data associated with the first monitored asset and associated with a tag matched to at least a portion of the keyword;
analyze the retrieved time series data to determine an anomaly period in the retrieved time series data associated with an anomalous operation of the industrial process;
retrieve, from the collection of heterogeneous data, a first set of heterogeneous data present in the anomaly period,
wherein the first set of heterogeneous data comprises a first set of business process information associated with the first monitored asset;

retrieve, from the collection of heterogeneous data, a second set of heterogeneous data present in the anomaly period,
wherein the second set of heterogeneous data is associated with a second monitored asset related to the first monitored asset according to the model defining the hierarchical relationship among the related monitored assets, including the first and second monitored assets, and wherein the second set of heterogeneous data comprises a second set of business process information associated with the second monitored asset;

aggregate into a single result set, the retrieved time series data, the first set of heterogeneous data, and the second set of heterogeneous data; and
cause the result set to be displayed and/or stored in the memory.

11. The apparatus as set forth in claim 10,
wherein the first set of heterogeneous data comprises:
(i) one or more environmental data from one or more environmental sensors,
(ii)one or more business process information from one or more applications on one or more third party computing devices, and
(iii) a human entered data from one or more blogs or social media systems; and
wherein second set of heterogeneous data comprises at least one of an upstream heterogeneous data from an upstream source within the industrial process or a downstream heterogeneous data from a downstream source within the industrial process.

12. The apparatus as set forth in claim 10 wherein the instructions when executed further causes the one or more processors to:
receive the time series data from the first monitored asset; and
embed one or more tags into the time series data based on one or more rules stored in the memory.

13. The apparatus as set forth in claim 10 wherein the first set of heterogeneous data comprises at least one of:
one or more of an unstructured data from one or more unstructured data sources,
a structured data from one or more structured data sources, and
a crawled data from one or more third party application and index data sources.