# Patent

## Title
Distributed building control system

## Abstract

An example of a building automation system utilizes intelligent system elements, some of which are lighting devices having light sources, and some of which are utility building control and automation elements. Some utility building control and automation elements include a controllable mechanism for use in control of some aspect of the building other than lighting. Another intelligent system element may include either a user interface component and be configured as a building controller, or include a detector and be configured as a sensor. Each intelligent system element includes a network communication interface, processor, memory and programming to configure the intelligent system element as a lighting device, utility building control and automation element, controller or sensor. At least one of the intelligent lighting devices is configured as a building control and automation system server. Several examples, however, implement the overall control using distributed processing.

## Background
RELATED APPLICATIONS
This application is a continuation-in-part of U.S. application Ser. No. 13/903,428, Filed May 28, 2013 entitled “DISTRIBUTED PROCESSING USING RESOURCES OF INTELLIGENT LIGHTING ELEMENTS OF A LIGHTING SYSTEM,” the disclosure of which is entirely incorporated herein by reference.
This application also is related to U.S. application Ser. No. 13/903,330, Filed May 28, 2013 entitled “LIGHTING NETWORK WITH AUTONOMOUS COMMISSIONING,” the disclosure of which is entirely incorporated herein by reference.


TECHNICAL FIELD
The present subject matter relates to techniques to implement a building control and automation system on a distributed processing basis utilizing memory and/or processing resources of intelligent elements of a building control and automation system and data communications amongst the system elements.
BACKGROUND
Building control and automation systems (BCAS) are growing increasingly common in modern building construction. These systems traditionally automated heating, ventilation and air conditioning (HVAC) systems along with other mechanical, electrical and plumbing systems. Many modern buildings, from large-scale office buildings to homes, now incorporate aspects of BCAS into their building control scheme; although in individual residential applications, they may be referred to in other ways, such as home automation systems.
The traditional BCAS is a system which operates out of a central server in the basement or other utility space of the building. This server is in turn serviced by a series of controllers and buses, which manage the data running between the server and the systems throughout the building that are being controlled in an automated fashion. The server in such a configuration is also connected to user terminals and sensors, which regulate the behavior of the overall system by providing input. Initially, such terminals were at the same premises or at most located at a premises of a management or monitoring enterprise; although increasingly, the user terminal may be any device anywhere that has data network access and appropriate programming for user interaction with the BCAS automation server.
As the technology has improved, BCAS systems have come to incorporate additional elements to further control and automate the functionality of buildings. These systems have come to additionally include security systems, building access systems, fire or safety alarm systems, commercial systems, and many other aspects of building control. The devices that populate such systems have traditionally been dumb and while they have been connected to user input devices, sensors or perhaps a central server, they generally lacked further capability to communicate and automate.
Additionally, as technology has improved, the building control elements that can be incorporated into a BCAS have become more intelligent. Of particular note is the improvement of lighting devices. Traditional lighting devices have tended to be relatively dumb, in that they can be turned ON and OFF, and in some cases may be dimmed, usually in response to user activation of a relatively simple input device. Lighting devices have also been controlled in response to ambient light detectors that turn on a light only when ambient light is at or below a threshold (e.g. as the sun goes down) and in response to occupancy sensors (e.g. to turn on light when a room is occupied and to turn the light off when the room is no longer occupied for some period). Often traditional lighting devices are controlled individually or as relatively small groups at separate locations. Traditional BCAS elements have tended to be similarly dumb and narrow in the sources of inputs they may accept, configurations they may adapt to, and the scope of control users and sensors may have over them.
With the advent of modern electronics has come advancement, including advances in networking and control capabilities of lighting devices and other utility building control and automation system elements. As increased processing capacity finds its way into building control and automation system elements, it becomes relatively easy to incorporate associated communications capabilities, e.g. to allow building control and automation system elements to communicate with other system control elements and/or with each other. In this way, advanced electronics in building control and automation system elements as well as the associated control elements have facilitated more sophisticated building control algorithms as well as increased networking of building control and automation system elements.
Sensing and network communications have included lighting functions/applications of the lighting devices. For example, sensors may be provided in a lighting device to detect parameters relevant to control operation of the lighting device, and the processor in the device controls the source(s) of the device in response to the sensor inputs. Alternatively or in addition, a communication interface in each of a number of networked lighting devices may allow communication about the status of each lighting device to a system control center. A programmed computer or a person at the control center then may be able to send commands to individual lighting devices or to groups of lighting devices, for example, based on a decision responsive to one or more conditions sensed by some or all of the lighting devices. In a similar fashion, sensing and interface devices have been provided for HVAC and other elements or systems that may be incorporated into or controlled as part of a BCAS system.
In lighting, these advances in devices and networked systems have mainly addressed aspects of the lighting provided by the lighting devices. For example, lighting devices may be adjusted, turned ON and/or turned OFF in response to user input or based on monitored conditions, either by processor logic within the device(s) or commands from a local controller (e.g. configured as a control panel on a wall) or from a central control. From the perspective of a BCAS type of arrangement, the networking may facilitate BCAS server communication with the lighting system components. The BCAS server, however, has implemented the higher level logic related to overall building control for lighting and other building systems.
The increasingly sophisticated electronics associated with lighting and other utility building control and automation elements often now include a central processing device as well as memory for program and data storage within each of many individual devices that are in or controlled by the system. Where the lighting devices and utility building control and automation elements are networked, each device also includes some form of communication interface, to enable the desired communication with other lighting devices, utility building control and automation elements, in-room lighting controllers and/or with networked control computers.
The processing, memory and communication elements of the system elements involve costs, when purchasing and deploying lighting devices or the like. Building an installed base of such equipment, with substantial numbers of individual devices each having sophisticated electronics, incurs a financial investment. Considering lighting devices by way of example, in many cases, the electronics are a substantial cost for each lighting device, and that cost may be multiplied by a large number of such devices in an extensive networked implementation owned by or operated for a large enterprise. Similar processing and memory resources may be included in other utility building control and automation system elements, such as controllers in the various areas of the premises within which the system is installed. Despite the infrastructure cost, the memory and processing resources may be idle for substantial periods of time, e.g. in the context of lighting, when lighting devices are OFF for extended periods or even during operations when individual lighting devices and/or lighting controllers are not actively communicating or not using full processing or memory resources (for example during intervals between substantial device setting changes, which may require execution of a processing intensive algorithm). In addition to the infrastructure costs for such resources in the lighting devices and/or controllers, such a system may include additional computer resources for implementation of the building control and automation system server.
Hence, there is room for improvement in the usage of the resources in various elements of a networked intelligent building control and automation system, e.g. to increase the usage of costly processing and memory resources in networked elements and/or to reduce or eliminate the need for additional computer hardware to host a centralized control functionality.
SUMMARY
The technologies disclosed herein include systems that utilize intelligent lighting devices and other intelligent utility building control and automation system elements in order to implement a distributed building control and automation server system, and techniques for using these devices to implement various types of distributed processing in service of this system.
In a disclosed example, a system includes intelligent system elements, some number of which are lighting devices, each of which includes a lighting element. The system elements also include a number of utility building control and automation elements, each of which includes a controllable mechanism to control some aspect of the building and associated drive electronics. Each of the intelligent system elements further includes an interface to communicate over a network on the system premises, a processor, memory accessible to the processor and programming which configures the processor to control the intelligent system element as a lighting device or as a utility building control and automation element.
In some examples, one of the intelligent lighting devices in the system includes an instance of server programming stored in its memory to configure the intelligent lighting device as a building control and automation system server with respect to other system elements. The server may actually be implemented on a distributed basis, for example, by multiple instances of the server programming running in a coordinated fashion on some number of the intelligent lighting devices.
The utility building control and automation elements may include non-lighting-related aspects of building control and automation, such as HVAC, security systems, access control devices or commercial systems such as refrigerators or factory equipment. In several of the examples, at least one of the intelligent system elements either includes a user interface component and is configured as a building controller, or includes a detector as the building control and automation related component and is configured as a sensor.
Several examples of distributed processing functions are disclosed in the subsequent detailed description.
For example, when one intelligent system element has a processing job to perform using resources of other intelligent elements, the one element can query the other elements of the building control and automation system and receive responses from the other intelligent elements of the building control and automation system as to whether or not the other intelligent elements of the building control and automation system have processing or memory resources available for the processing job. Based on the responses, the one intelligent element allocates portions of the processing job to some number of the other intelligent elements of the building control and automation system. The one intelligent element can then send data and instructions to each element of the other intelligent elements among that number, for performing an allocated portion of the processing job; and the one intelligent element receives from those other intelligent elements results of the performance of the allocated portions of the processing job. The one intelligent element can then process the received results to determine an overall result of the processing job and perform some action based on the overall result of the processing job.
As another example of distributed processing, an intelligent element may respond to an inquiry received from another intelligent element that has a processing job to perform on a distributed basis by sending a response with information identifying processing resources of the processor and/or resources in the memory available for distributed processing via the network to the other intelligent element. The element with the available resource(s) in this example receives data and instructions for performing a portion of the processing job from the other intelligent element via the network. The element will then process the received data in accordance with the instructions using resources of the processor and/or memory of the lighting device and send a result of the processing via the network to the other intelligent element.
Additional objects, advantages and novel features of the examples will be set forth in part in the description which follows, and in part will become apparent to those skilled in the art upon examination of the following and the accompanying drawings or may be learned by production or operation of the examples. The objects and advantages of the present subject matter may be realized and attained by means of the methodologies, instrumentalities and combinations particularly pointed out in the appended claims.



BRIEF DESCRIPTION OF THE DRAWINGS
The drawing figures depict one or more implementations in accord with the present concepts, by way of example only, not by way of limitations. In the Figures, like reference numerals refer to the same or similar elements.
FIG. 1A is a functional block diagram of a simple example of a building control and automation system having intelligent lighting devices and other intelligent utility building control and automation system elements, where the various intelligent system elements are linked or networked for data communications.
FIG. 1B depicts a somewhat different set and arrangement of examples of elements of the building control and automation system of FIG. 1, which shows some more detailed examples of the other intelligent utility building control and automation system elements.
FIG. 1C is a functional block diagram of an intelligent utility building control and automation element.
FIG. 2 is a flow chart of a simple example of a procedure for distributed processing, which may be implemented in a building control and automation system like that of FIG. 1A or FIG. 1B.
FIG. 3A is a flow chart of another example of a procedure for distributed processing involving BCAS-specific functionality in a building control and automation system like that of FIG. 1A or FIG. 1B; and FIG. 3B is a layout diagram of a simple building example with an overlay of block illustrations for some of the system elements, as referred to in the discussion of the flow chart of FIG. 3A.
FIG. 4 is an alternative diagram of selected aspects of the system of FIG. 1A or FIG. 1B, representing an example of multiple-instance server type of distributed processing.
FIG. 5 is a stack diagram useful in explaining exemplary program configuration.
FIG. 6 is a simplified functional block diagram of a computer that may be configured as a host or server, for example, to function as the external server in the system of FIG. 1A or FIG. 1B.
FIG. 7 is a simplified functional block diagram of a personal computer or other user terminal device, which may be used as the remote access terminal, in the system of FIG. 1A or FIG. 1B.
FIG. 8 is a simplified functional block diagram of a mobile device, as an alternate example of a user terminal device, for possible communication in or with the system of FIG. 1A or FIG. 1B.



DETAILED DESCRIPTION
In the following detailed description, numerous specific details are set forth by way of examples in order to provide a thorough understanding of the relevant teachings. However, it should be apparent to those skilled in the art that the present teachings may be practiced without such details. In other instances, well known methods, procedures, components, and/or circuitry have been described at a relatively high-level, without detail, in order to avoid unnecessarily obscuring aspects of the present teachings.
The various examples disclosed herein relate to building control and automation systems utilizing intelligent elements, some of which are lighting devices. Other system elements for non-lighting related control and/or automation functions are referred to as intelligent utility building control and automation elements. Each intelligent lighting device includes a light source. Each intelligent utility building control and automation element includes a controllable mechanism and associated drive electronics. Some control and automation elements are input devices, for example, for sensing conditions in the building or receiving user inputs; whereas other control and automation elements implement automatic control of some function in the building.
Several of the examples described in detail implement processing in relation to overall system functions on a distributed processing basis. Distributed processing, for example, may enable use of available processor and/or memory resources of a number of intelligent system elements to process a particular job. Another distributed processing approach might entail programming to configure two or more of the intelligent system elements to implement multiple instances of a server functionality with respect to client functionalities implemented on intelligent system elements. Reference now is made in detail to the examples illustrated in the accompanying drawings and discussed below.
FIG. 1A is a high-level block diagram of a networked building control and automation system 10, many elements of which are installed at a premises 12. The premises 12 may be any location or locations serviced for building control by a networked intelligent building control and automation system of the type described here. Most of the examples discussed below focus on building installations, for convenience, although the system may be readily adapted to outdoor installations. Hence, the exemplary system 10 provides lighting and other building control services in a number of service areas A to N in or associated with a building, represented by room A and room or other service area B, and generally by other room C and service area N. Examples of other types of service areas include a corridor a building and an outdoor area associated with a building. Further examples of indoor service areas include storage areas, stairwells, etc., whereas further examples of outdoor service areas include parking, path, roadway, area, etc.
The system elements for operation in a building control and automation system, in a system like system 10 of FIG. 1A. For lighting, the system 10 may include any number of lighting devices 11A, such as fixtures and lamps, as well as lighting controllers, such as switches dimmers and smart control panels. For other functions that are automated at the premises, the system also may include any number of utility building control and automation system elements, such as HVAC, security systems, building access systems, fire or safety alarm systems, access control or commercial systems, as well as associated user input devices and/or sensors. FIG. 1B depicts the composition and roles of such utility building control and automation system elements in such a room in greater detail. At least a substantial number of the lighting devices and other utility building control and automation system elements are implemented as intelligent system elements, which each include a processor and a memory. The intelligent system elements also incorporate network communication capabilities.
At least one of the intelligent system elements either includes a user interface component and is configured as a building controller, or includes a detector and is configured as a sensor. The exemplary system 10 includes intelligent elements of both of these types. The building controller(s) and/or sensors may be for lighting related functions or for other utility building control and automation system functions or may be for some combination of lighting and other utility functions. The building controllers may be implemented by intelligent user interface devices with processor, memory and communication components, although intelligent user interface devices on the system 10 may serve other purposes. The exemplary building control and automation system elements may also include one or more sensors used to control building functions, such as occupancy sensors, ambient light sensors and light or temperature feedback sensors, fire or smoke or gas detection, break-in detection, door or window opening-closing, room or area temperature, refrigerator/freezer temperature(s), etc. The sensors may be implemented in intelligent standalone system elements, or the sensors may be incorporated in intelligent system elements, e.g. as an enhanced capability of a lighting device.
As shown (and discussed in more detail later), many elements of the system 10 include processors and memories and such intelligent system elements are coupled or linked into a network for data communication. A system like that shown in FIGS. 1A and 1B may incorporate or at least provide communication capabilities or services for use by other devices within the premises 12.
A building control and automation system such as 10, which utilizes many intelligent elements, has considerable inherent processing and memory capacity. Many tasks can be performed by each element utilizing the element's own internal processor and memory. For example, a lighting device will be able to receive and appropriately process a lighting command, e.g. to set a light level and/or to set an associated color characteristic of the device's light source, to adjust its operational light output as commanded, without the need for resources of other intelligent elements of the system. A user interface (UI) device configured as a building controller will be able to send commands in response to user inputs to any devices it controls; and a sensor will be able to report its sensed condition to any system elements configured to receive and utilize such information. However, the presence of the extensive processing and memory resources of the system 10 offers opportunities for implementing other tasks by sharing the work to implement such tasks across multiple intelligent elements of the system 10 based at least in part on communication via the network between the intelligent system elements. Stated another way, the system 10 is also configured to allow the intelligent elements to perform at least some processing tasks on a distributed processing basis, coordinated via network communication, such that available processing and/or memory resources of multiple elements support completion of a shared task or job. Hence, in our examples of the system 10, at least some lighting devices and possibly other elements of the exemplary system each utilize programming which configures the processor to control a building control and automation related operation of the intelligent system element and which configures the processor to implement distributed processing functions with regard to that control operation.
The shared task or job may relate to system operations, including building control and automation functions. For example, centralized control functions that might otherwise be implemented in host computer hardware (e.g. configured as a control server) may be implemented by the intelligent system elements, user interface devices and/or sensors of the exemplary system 10 on a distributed processing basis. Other distributed processing tasks may be more ancillary in nature, e.g. processing an audio input from one of the intelligent system elements to recognize speech content and identify an appropriate responsive action or to perform a statistical analysis of sensor input data from all sensors of a particular type on the premises 12 for an identified purpose. Still further types of distributed processing tasks may be arbitrary and relatively unrelated to regular operations of the system 10, for example, processing a task received from an outside party needing substantial processing or memory resources for that party's own reason(s). Examples of actions that may result from or be outcomes of distributed processing may involve establishing control settings for one or more lighting devices and/or for one or more of the utility building control and automation system elements, more general activities in response to audible or visible user input (e.g. to access remote data and provide an output, to set a light parameter, to allow or disallow building access, etc.), or to provide processed results from complex data (e.g. recognize a particular face, voice or event in an audio input or image or video file, or to process data from any number of sensors to obtain a composite result) for system use or to supply to an outside entity.
In our illustrated example, each room or other type of service area controlled by the system 10 includes a number of intelligent lighting devices and may include one or more utility building control and automation system elements. Some areas may also include system elements such as one or more user interface devices each configured as a building controller or the like and/or one or more sensors, for lighting functions and/or for other utility control functions.
As shown, the service area represented by room A in the example includes an appropriate number of first lighting devices 11A, for example, to provide a desired level of lighting for the intended use of the particular space in room A. Room A also includes one or more first utility building control and automation system elements 71A, which may, for instance, regulate the temperature in room A or control access to room A. The equipment in room A also includes a user interface (UI) device, which in this example, serves as a first building controller 13A. In a similar fashion, the equipment in room or other service area B in the example includes an appropriate number of second lighting devices 11B, for example, to provide a desired level of lighting for the intended use of the particular space in area B. Room B also includes one or more second utility building control and automation system elements 71B, which may, for instance, regulate the temperature in room B or control a refrigeration unit in room B. The equipment in service area B also includes a user interface (UI) device, which in this example, serves as a second building controller 13B. Examples of UI devices that may be used are discussed in more detail later.
Although some service areas may not include a sensor, the equipment in each of the service areas A and B includes one or more sensors, although the sensors in these two examples are implemented in somewhat different ways. In room A, the sensor 15A is an element of one or more of the lighting devices 11A. In room B, the sensor 15B is implemented as a standalone system component. Such sensors may detect a condition that is relevant to lighting operations, such as occupancy, ambient light level or color characteristics of light in an area or level or color of light emitted from one or more of the lighting devices 11A or 11B serving the particular area. Other sensors may detect other conditions that are relevant to other functions of the system 10 or for more general communication about conditions in an area for still further purposes. Examples of other conditions that sensors may detect include temperature or humidity for HVAC control, vibration for reporting of earthquakes or similar events, fire, smoke or gas detection, sound for user input or for detection of breakage or the like, as well as window or door state for security or access control. Other examples of conditions that may be detected by appropriate sensors include power monitoring, an object/occupant identification, etc. Different sensors for different types or sets of conditions may be relevant in different system installations, e.g. some of these examples might be more relevant in warehouse type system applications than in retail or residential settings. For purposes of further discussion of FIG. 1A, we will focus on implementations that include sensors for purposes related to building control and automation operations of the system 10, such as lighting and HVAC.
The lighting devices 11A, the building controller 13A, the utility building control and automation system elements 71A and the sensor 15A (if provided in one of the intelligent devices 11 A) are located for building control and automation service of the first service area, that is to say, for building control and automation within room A in the example. Similarly, the lighting devices 11B, the building controller 13B, the utility building control and automation system elements 71B and the sensor 15B (if provided) are located for building control and automation service of the second service area, in this case, for building control and automation in room or other type of area B.
The equipment in room A, in this example, the lighting devices 11A, the building controller 13A, the utility building control and automation system elements 71A and the sensor 15A in one of the lighting devices 11A, are coupled together for network communication with each other through data communication media generally represented by the cloud in the diagram to form a first physical network 17A. Similarly, the equipment in second area B, in this example, the lighting devices 11B, the building controller 13B, the utility building control and automation system elements 71B and the sensor 15B, are coupled together for network communication with each other through data communication media generally represented by the cloud in the diagram to form a second physical network 17B.
Many installations will include equipment for providing lighting and building control and automation services in a similar manner in other rooms and/or other types of services areas within or on a particular premises 12, such as in a building or indoors and outdoors about a campus or the like. Although not shown, in similar detail, such other service areas are represented generally by room C to area N in the example illustrated in FIG. 1A.
The example of system 10 utilizes intelligent lighting devices. Hence, each lighting device has a light source, a processor, a memory and a communication interface. By way of an example, one of the lighting devices 11A is shown in expanded block diagram form, as represented by the dashed line box at 11A′. As shown by that expanded example, each device 11A in room A includes a light source 19A, a processor 21A, a memory 23A and a communication interface 25A. In service area A, at least one of the lighting devices 11A′ includes the sensor 15A, as well. The drawing also shows one of the lighting devices 11B′ in expanded block diagram form. As shown at 11B′, each lighting device 11B includes a light source 19B, a processor 21B, a memory 23B and a communication interface 25B. Although the communication interfaces 25A, 25B are shown communicating via lines, such as wired links or optical fibers; some or all of the interfaces 25A, 25B may use wireless communications media such as optical or radio frequency wireless communication. Also, although the examples in FIG. 1A show each of the lighting devices having one communication interface, some or all of the lighting devices 11 may have two or more communications interfaces to enable data communications over different media with the network(s) and/or with other devices in the vicinity.
The sensors also have associated intelligence and communication capabilities. In the example of room A, the intelligence and communication capabilities associated with the sensor 15A are those of the host lighting device 11A′. In the example of room or other service area B, the sensor 15B is a standalone device incorporating its own associated intelligence and communication capabilities, as will be discussed in more detail, later.
The UI devices serving as the building controllers in this example also are implemented as smart/intelligent devices with processing and communication capabilities. Hence, each building controller 13A, 13B includes a processor, a memory and a communication interface, as well as one or more input and/or output elements for physical user interaction. As shown by way of example, the UI device serving as building controller 13A in room A includes a processor 31A, a memory 33A and a communication interface 35A. The UI device serving, as building controller 13A also includes one or more user input and/or output elements represented generally by user I/O element 37A in the drawing. The element 37A, for example, may include a toggle switch, a rotary controller, one or more sliders, a keypad and/or a touchscreen display.
A touchscreen display, for example, may support touch and touch gesture input as well as visual display output. Other examples of the UI input may include a video input and associated processing for gestural control detection, a microphone, an occupancy/motion sensor, proximity sensor, etc. Outputs may be visual, audible, tactile, etc. For example, a microphone and/or speaker may be used to support audible input and/or output, whereas a camera in combination with projector or display may be used to support visual input and/or output. As shown by way of example, the UI device serving as building controller 13B in service area B includes a processor 31B, a memory 33B and a communication interface 35B. The UI device serving as building controller 13B also includes one or more user input and/or output elements represented generally by user I/O element 37B in the drawing. The element 37B, for example, may be similar to the I/O element 37A in UI device 13A, examples of which were discussed earlier. Of course, other elements may be used to receive input from and/or provide output to a user, in any of the UI devices/controllers 13A, 13B.
Like the lighting devices, the communication interface systems of the UI devices may utilize one or more interfaces to support data communication of the UI devices over the available/appropriate media at the premises 12. For example, although the communication interfaces 35A, 35B are shown communicating via lines, such as wired links or optical fibers; some or all of the interfaces 35A, 35B may use wireless communications media such as optical or radio frequency wireless communication. Also, although the examples in FIG. 1 show each of the UI devices having one communication interface, some or all of the UI devices 13 may have two or more communications interfaces to enable data communications over different media with the network(s) and/or with other devices in the vicinity.
As outlined earlier, in the example of FIG. 1A, any sensors included in the system 10 also have or are associated with intelligence and communication capabilities. The sensor 15A is integrated into a lighting device; and the processor, memory and communication interface of that device provide the intelligence and communication capabilities associated with that sensor 15A. The sensor 15B, however, is a standalone device and includes its own individual intelligence and communication capabilities.
The sensor 15B includes a physical condition detector (D) 41B, which is the actual device that is responsive to the particular condition to be sensed. The detector 41B may receive a drive signal; and in response to the sensed condition, the detector 41B produces a signal having a characteristic (e.g. voltage magnitude) that is directly related to a characteristic level of the sensed condition. The sensor 15B also includes a detector interface circuit (Int.) 43B. The circuit 43B provides any drive signal that may be needed by the particular device type of physical condition detector 41B. The detector interface circuit 43B also processes the output signal from the detector 41B to produce a corresponding output, in a standardized data format, for use by the associated intelligence. The integrated sensor 15A in lighting device 11A may be implemented by a detector and interface circuit analogous to the physical condition detector 41B and the detector interface circuit 43B.
The standalone implementation of a sensor 15B also includes a processor 45B and an associated memory 47B. The sensor 15B also includes a communication interlace 49B, typically similar to or complimentary with the interfaces 25B and 35B used by other devices 11B or 13B in the particular service area B. Like the lighting devices and/or UI devices, the communication interface systems of any standalone sensors may utilize one or more interfaces to support data communication of the standalone sensor devices over the available/appropriate media at the premises 12.
As outlined above, there may be multiple communication interfaces for data communication over multiple media in any one system element, and a particular premises 12 may use different data communication media for different networking purposes, for example premises wide network over Ethernet (wired or fiber) or DMX and local communication (e.g. in one or more of the service areas) via radio frequency wireless such as WiFi, Bluetooth or Zigbee or via optical wireless.
In the examples of FIG. 1A, the lighting devices, UI devices and stand alone sensors are shown as having one processor, for convenience. In many instances, these devices may have multiple processors. For example, a particular device configuration may utilize a multi-core processor architecture. Also, some of the other components, such as the communications interfaces, may themselves include processors.
Some of the intelligent system elements, e.g. lighting devices, utility building control and automation elements, UI devices or sensors, may have or be enhanced with audio or video input or output equipment. A sensor, for example, may include a camera and/or a microphone as the detector(s). A UI device may include a display for output and may include a camera for user input, alone or in combination with other user input elements. For example, a UI device arrangement might utilize a touchscreen alone or in combination with a camera. Alternatively, a UI device may utilize a microphone for audio input alone or in combination with a speaker for audio output to the user. Audio and/or video sensing as well as audio and/or video output capabilities also may be incorporated into enhanced intelligent system elements. Such an element, for example, might have or connect to a speaker and a projector to provide audio-visual information output. A microphone and/or camera in an enhanced intelligent system element might provide area monitoring and/or additional form(s) of user input to the system for lighting or other purposes.
Although not shown, each of the system elements that uses power to operate as described will include a power supply circuit and will connect to or possibly contain a power source. The lighting devices 11A and 11B and the utility building control and automation system elements 71A and 71B may draw power from an AC grid or from a DC grid. The lighting devices 11A and 11B and the utility building control and automation system elements 71A and 71B, for example, may draw power from alternating current (AC) mains in the building or other type of premises where the system 10 may be installed. In an AC grid type example, the power supply circuit of a particular lighting device 11A or 11B or utility building control and automation system elements 71A or 71B will include a driver circuit to process power drawn from the AC mains in any manner as may be appropriate to drive the particular type of light source or utility building control and automation element incorporated in the particular element. The source driver may be a simple switch controlled by the processor, for example, if the source is an incandescent bulb or the like that can be driven directly from the AC current. As another example, the drive circuit may convert AC power to one or more appropriate DC voltage and/or current levels to provide power to DC driven light source(s) such as light emitting diodes (LEDs). The power supply would also process AC power from the mains to provide voltage and/or current levels to power the elements (e.g. processor, memory and interface) serving as the device intelligence and for the communication interface.
In the example, the power supply circuit for each lighting device receives electricity from AC mains, however, one or more of the intelligent utility building control and automation system elements for each service area may be driven by a battery or other power source for a particular application. For example, one or more lighting devices in each room and one or more lighting devices in a corridor each may have or connect to a back-up battery or other back-up power source to supply power for some period of time in the event of an interruption of power from the AC mains. Other system elements in each service area, such as building controllers or other user interface devices and/or any standalone sensors would likewise include appropriate power supply circuits, which may rely on AC or DC power from the mains, battery power and/or ambient power harvesting, etc., as needed to operate the components of each respective system element. Examples of ambient power harvesting include vibration responsive power generation, photovoltaics, mechanical work (e.g. EnOcean), etc.
As noted, system elements within a room or other service area are coupled via suitable links for network data communications, as represented generally by the network clouds 17A and 17B, and the various communication interfaces are compatible with those links. The system 10 also includes communication links coupling the first and second physical networks into a wider area network. The local service area networks 17A, 17B may be relatively distinct from each other and distinct from but coupled to a wider area network as shown generally at 51, or the networks may be relatively unified. Various network media and protocols may be used for the data communications. The networks 17A and 17B allow elements within respective service areas A and B to communicate with each other, and the links or couplings 49A, 49B of those networks to the wider area network 51 allow the elements within each of the service areas to communicate with elements in other service areas and/or to communicate with other devices generally represented by way of example by the server/host computer 33 and the user terminal device 55.
The host computer or server 53 can be any suitable network-connected computer, tablet, mobile device or the like programmed to implement the desired functionalities. Such a device may have any appropriate data communication interface to link to the wider area network 51. If provided, a host or server computer at the premises may utilize the same networking media 17A or 17B and/or 51 utilized by the on-premises system elements.
The external host or server 53 may provide various functions in support of system operations and/or utilizing data from system elements. For example, on-site processing capability may be enhanced or redundancy may be built in for the system, by utilization of off-site computing resources. The user terminal equipment such as that shown at 55 may be implemented with any suitable processing device that can communicate and offer a suitable user interface. The terminal 55, for example, is shown as a desktop computer with a wired link into the wide area network 51. However, other terminal types, such as laptop computers, notebook computers, netbook computers, tablet computers and smartphones may serve as the user terminal computers. Also, although shown as communicating via a wired link from the wide area network 51, such a device may also or alternatively use wireless or optical media; and such a device may be operated at the premises 12 and utilize the same networking media 17A or 17B utilized by the on-premises system elements.
The wide area network 51 may take the form of a local area network (LAN) and/or a wide area network (WAN). Hence, the premises may include a LAN or other on-premises network, or the communications may go directly to a particular WAN. Alternatively, there may be a LAN or other network formed within the premises, but without a coupling or connection to a yet wider area network outside the premises, for example, to restrict access and therefore increase security of the building network and the like within the premises. A LAN/WAN combination, for example, may provide communications capabilities inside and outside the premises in a manner generally represented by the network 51 in the example of FIG. 1A. Depending on the network media and protocol(s) used, the LAN may include a frame switch, a packet router or the like providing LAN interconnectivity. Although not shown, a gateway or the like may also be deployed on the LAN to provide various functions in support of interconnectivity of the LAN to/from the WAN.
The LAN functionality, however, may essentially be embedded in the room or area elements, except for the interconnecting media. For example, any of the system elements in each room or other service area may provide connectivity and switching/routing functions to interconnect the system elements via the applicable media to form a LAN on the premises 12. Also, one of the elements in a room or area may provide the interface to any external WAN. Hence, although shown separately for convenience, the elements that form the LAN may be integral with the lighting devices, etc. of the building control and automation system in the rooms or other types of areas serviced by the illustrated system. Alternatively, all intelligent system elements may connect directly to the WAN. If the elements all connect through the WAN to a “cloud” service, the communication between elements could occur via exchange through the cloud server.
The WAN communication capability, particularly if the WAN is a relatively public network such as the Internet, may allow various parties to access the building control and automation network and the system elements that communicate via the network. For example, the enterprise or other entity that operates the premises may access the system remotely. Also, a provider of some or all of the building control and automation system equipment and network may access the element or elements of the system that they provide, e.g. for monitoring, maintenance or other system service.
The LAN as discussed here need not be a LAN of the type typically used today for computer or mobile device communications within a particular premises, although the building control and automation system may use or connect to such a network. For purposes of the present discussion, the LAN is a premises network for data communications among the elements discussed herein as part of the building control and automation system and/or using the associated networking capability of that system for communications within the premises.
Each element communicating via the premises networks that form part of the building control and automation system 10 have one or more addresses or identifiers, to facilitate communications via the particular media used for the networking and/or to identify each device to other devices on the system or outside the system with which each device may communicate. For example, if Ethernet is used, each device may have a media access control (MAC) address assigned to the Ethernet interface within the respective device. Each device may also have an Internet Protocol (IP) address assigned thereto. Depending on the interface of the LAN to the outside world, each device may have an internally assigned IP address, which a firewall or network address translation (NAT) device translates as appropriate when the device communicates via the WAN. If a device communicates with the WAN more directly, it may receive an IP address that is useable on the WAN, although if the address space is still that of IPv4, such an address would likely be assigned on a dynamic basis only for as long as the particular device in the premises may need the address. Each device will also typically have some form of electronic serial number for identification purposes, although there are a variety of different types of such identifiers that may be used for some or all of the devices that communicate via the illustrated system and its network media. Another approach might utilize cellular network type addressing and identification, in which case, each device might have an assigned cellular telephone number and an electronic device identifier such as an International Mobile Subscriber Identity (IMSI) or the like.
Although not shown, there may be an additional layer of networking and/or control, between the LAN and the WAN. For example, an enterprise having a wide geographical operation at multiple locations may have LANs at each building or campus and an enterprise-wide intranet interconnecting those locations. If desired (and security is not an issue), the enterprise-wide intranet could provide the access/connectivity to the Internet. For enterprise monitoring and control, the enterprise-wide intranet would facilitate communications for other servers and/or user terminal devices of enterprise personnel to communicate with the equipment at each location that is on the respective building control and automation network LAN. For various reasons, the communications capabilities provided at the premises 12 may also support communications of the building control and automation system elements 71A, 71B with user terminal devices and/or computers within the premises 12. The user terminal devices and/or computers within the premises 12 may use communications interfaces and communications protocols of any type(s) compatible with the on-premises networking technology of the system 10. Such communication with a user terminal, for example, may allow a person in one part of the premises 12 to communicate with a system element 71A, 71B in another area of the premises 12, to obtain data therefrom and/or to control system operations in the other area.
For some building control and automation system functions discussed more, later, it may be useful to include one or more central overseer (CO) functionalities, in or logically associated with the premises 10. Such a CO functionality provides centralized management of relevant system functions, for example, to assist in set-up of various logical relationships during provisioning and/or configuration of newly installed or repaired system elements in the various service area(s) of the premises 12. Stated another way, such a CO type functionality collects and/or distributes element configuration data during intelligent system element commissioning operations. For example, one CO may be set-up as a floor-wide CO, another CO may be set-up as a building-wide CO, etc. Another example, one type of CO (deployed as one or more instances) may serve as a “sensors” overseer that has information about sensors on the system. Likewise, the system could have overseers for “luminaires,” “security devices,” “control interfaces,” “access control,” “third party devices,” etc. Some installations may also include CO of COs to help with higher level groupings amongst various COs.
A CO and/or central controller may also assist in determining resource availability for distributed processing. Rather than query the other element directly, the CO or other central controller might have additional information regarding which devices should/can be accessed (e.g. load balancing/prioritization/management, management of policies and/or software licenses, etc.); and the element having the job to distribute could then query the CO or other central controller to obtain information about elements and/or resource availability of other system elements for use in distributing tasks to the other elements.
At least some functions of the system 10 may rely on a central controller service, which essentially provides central building control and automation control function of the system. Such a central building control and automation control function of the system, for example, may to some degree control the lights on a floor or the like, for example, under certain conditions (e.g. to turn all lighting except emergency lighting off after hours or to turn on lighting in a manner to lead people to exits in the event of a fire) or to monitor and process all data from sensors of a particular type. Central controller functionalities could be separately implemented, but in the examples are combined with the data management and commissioning assistance functions in one or more COs 57. Another example of an overall processing function of the system is a centralized communication related function, such as a gateway, firewall, network address translation (NAT) function, or the like, e.g. to support the communication with an external wide area data communication network. Although separate hardware could be included for one or more of these centralized overall processing functions of the system 10, several of the examples discussed more fully below implement such functions on a distributed processing basis utilizing memory and/or processing resources of the various intelligent elements of the system 10.
The external elements, represented generally by the server/host computer 53 and the user terminal device 55, that may communicate with the system elements at the premises 12 may be used by various entities and/or for various purposes in relation to the building control and automation system 10. For example, a terminal such as 55 may allow personnel of an entity that operates the premises to monitor operations of lighting and other systems at the premises and/or make adjustments, remotely.
As another example of use of external communications, a server or a combination of server and terminal device may be operated by a service company, for example, an HVAC system service company. Such a service provider may use the external computer equipment 53 and/or 55 to remotely monitor health of the HVAC elements of the building control and automation system 10 at the premises 12 and remotely provide related services to the entity owning or operating the premises, such as troubleshooting, software corrections/upgrades or the like via communication via the Internet or an Intranet with the building control and automation system on the particular premises. In such an example, the provider's service functionalities may be considered as being out in the ‘cloud.” As another example, an enterprise having operations at some number of disparately located premises can operate equipment like 53 and 55 to monitor lighting, HVAC operations, etc. of systems 10 at the various premises 12.
As shown, the networks and elements of the system 10 in the premises 12 are accessible from the outside, and this accessibility also may make information from within the building control and automation system at the premises 12 available to outside parties, e.g. the power company, NOAA, etc. For example, the system can provide sensor data and/or data about operating conditions of various elements at the premises 12 to such other parties.
Various circuit elements (e.g. processor devices, memories and associated architectures) may be used to implement the intelligence of the intelligent system elements in the rooms or other service areas at the premises 12. Also, the communications within the rooms and other services areas as well as the communications to and from the wider area network all may use various different types of data networking media and protocols and/or media. As a result, various types of one or more communications interfaces may be incorporated into each of the various intelligent system elements (e.g. lighting devices and/or utility building control and automation system elements) in the rooms or other services areas and/or remote devices in communication therewith, depending on the particular media and/or protocol to be used in a particular premises 12 or service area thereof.
The drawing shows one or more combined central overseer (CO) and lighting controller services 57 in or coupled to the network 51 but generally within the premises 12 (bottom middle of the drawing), by way of an example. However, the CO 57 is shown in dotted line form as it may not actually be implemented using a separate hardware element.
Instead of providing a general purpose computer as a host or server for the particular CO and controller service application, e.g. as a BCAS server at the premises 12, the CO and controller service functionality is illustrated here as an example of a type of functionality that the system 10 may implement in programming executed by one or more processors and/or using the memories of one or more intelligent elements of the building control and automation system 10. In the specific examples, the central BCAS control and other related CO function(s) are implemented via distributed processing of elements of system 10, such as the lighting devices, utility building control and automation system elements, user interface (UI) devices, sensors, etc., for example, as installed in the various service areas A to N at the premises 12. Hence, examples of the intelligent system elements, in the system 10 at premises 12, include the including intelligent lighting devices 11A, 11B, the intelligent utility building control and automation elements 71A, 71B, the user interface components/controllers 13A, 13B and any standalone sensor devices 15B.
The network links within the service areas, amongst the areas of the premises 12 and from the premises 12 to the part of the network 51 that may be outside the premises 12 all may utilize any convenient data communication media, such as power lines wiring, separate wiring such as coax or Ethernet cable, optical fiber or wireless (e.g. Bluetooth or WiFi). Some or all of the network communication media may be used by or made available for communications of other gear, equipment or systems within the premises. For example, if combinations of WiFi and wired or fiber Ethernet are used for the building control and automation system communications, the WiFi and Ethernet may also support communications for various computer and/or user terminal devices that the occupant(s) may want to use in the premises. The data communications media may be installed at the time as part of installation of the building control and automation system or may already be present from an earlier data communication installation.
Within one room or other type of service area, the system might use one, two or more types of communication media. Similarly, to interconnect equipment in various rooms or areas and in turn connect such elements into a broader network, the system may use one, two or more types of communication media. Use of multiple communication media, for example, might help to optimize bandwidth throughput, cost and/or security. As a more specific example, an application or function needing low latency communication between devices that are physically close may use one media for the local connection, but one of the devices at other times may need to send large amounts of data to a remote location for processing via a different wide-area media with faster data transport capabilities.
A particular intelligent system element may act as a router or the like to connect elements in one or more areas to the data communication media of the LAN providing communication service to other parts of the premises. The LAN interconnectivity function may be implemented in one of the lighting devices, utility building control and automation system elements, user interface devices or sensors or other purposed devices within a service area. Alternatively, some areas or groups of areas may utilize an additional gateway hub (not separately shown) to provide the LAN connectivity. The gateway hub in this later type of example is a device that provides communications capabilities and is not itself configured as a device of one of the other types. A gateway hub may support communications capabilities to and from some or all of the other devices within the room or service area. In some examples, one of the other elements in the room or service area may support the communication outside the room or area. In other arrangements, the hub gateway provides the external network communications capabilities, although in some cases is does support the local intra device communications whereas in other examples the hub gateway does not support the local intra device communications. A gateway hub might also support other, non-building-control capabilities (e.g. memory, processing power, etc.).
Also, in most of the examples, the elements of one service area (e.g. room corridor, patio, parking lot, etc.) may be networked together and connected to the broader area network; however, in some examples at least, it may be more effective to connect the elements in two or more service areas together and provide a connection thereof to the broader area network. The system elements will have stored therein provisioning data to enable physical communication through the network communication media, amongst the elements via the on-premises data communication network media and in some cases via the portion of the network 51 that may be outside the premises 12.
In addition to physical networking, such a system 10 associates various elements/components of the system in a number of ‘logical’ ways. Logical associations into groups of “sub-networks” allow elements to be linked together, for example, based on a control grouping, based on similar properties, based on proximity, a variety of other criteria and/or combinations of any or all such properties. As one example, devices within one room or other type of service area that are to be operated in some unified manner (e.g. to light the room or area, or adjust the room or area's temperature) may be linked together in one logical “Room” sub-network.
As a more specific Room network example, although generally similar in many respects, one of the devices in a room or other service area may be configured as a ‘leader’ unit whereas other system elements in the particular room or other service area may be configured as ‘follower’ units with respect to the designated leader. These relationships, however, are relatively dynamic and readily configurable. For example, programming of the devices/elements in the system provide automatic/autonomous discovery at installation; and an initial set-up routine uses results of the discovery process to set-up logical relationships between devices, for example, including selection of a device as a leader unit. However, at a later time, if the leader unit is impaired or off-line, the network is self-healing in that some or all of the set-up routine can be run again to select a replacement as a new leader unit from among the other devices that are operational on a particular part of the network. Alternatively, the system may have fallback plan in place, in which one or more other elements are pre-designated to take over the role of the leader in the event of failure or impairment of the initially selected leader. Effectively, such an arrangement may identify a first in command (leader), a second in command, etc.
Of course, there may be a variety of other types of sub-networks established amongst elements of the system 10 within the premises 12. For example, all of the wall controller type user interface devices in a building might be logically linked in one grouping as a “Building Controller” sub-network, to offer the ability to create an overall view of the building control and automation operations users have selected throughout the building. This overall view might be helpful in determining how people interact with the building control and automation system and thus help identify pain-points in the building control(s) setup. Such an overall controller view may also be helpful in remote access to system functions, for example, to offer a control service in which a user can control the building control and automation system in Room A from Area N's control interface as though that user were in Room A. As another example, all sensors (or all sensors of one type) may be linked together in a logical grouping to allow reporting of one or more detect conditions on an overall basis across the premises or some portion (e.g. one floor) thereof. At least some of these sub-networks that extend over multiple service areas may include a central controller and/or CO service.
Also, logical networks may be networked together for some purposes, e.g. so that a function of one logical sub-network may influence an operation within another logical sub-network. For example, if enough controllers indicate that lights have been turned to a particular level, other lights not to that level yet in other rooms or other areas may be similarly adjusted. One or more linked networks can affect each other and possibly still other logically networked elements. For example, if >x % of the occupancy sensors in an area or space (e.g. floor or building), then the space is considered “unoccupied.” If >y % of the lights are OFF, then the enterprise office formed by the space is considered “closed.” If the space is both “unoccupied” and “closed,” then the system can turn down the HVAC for the space and turn ON the security system.
The central BCAS monitoring and/or control functions, any other BCAS related CO functions and possibly any other CO functions of the system 10 in our examples are implemented in the intelligent system elements, for example, without the need for a hardware platform at the premises for a server. An additional hardware platform may be present for other purposes, e.g. for non-automation related purposes of the enterprise or for local backup storage for system related information. For normal real-time operation, however, the elements perform the centralized processing. The centralized processing for a particular function may be implemented by appropriate configuration of the processor of as few as one system element, e.g. one lighting device 11A or 11B. However, for complex processing tasks and/or to provide the redundancy in preparation for a possible failure of one or more system elements, the system 10 most often will implement the ‘logically’ centralized processing as a higher layer logic distributed across some number of the intelligent system elements. The examples discussed more later encompass a variety of techniques for implementing CO, central controller or other functions on a distributed processing basis. With such an approach, a server functionality is distributed as multiple instances of the applicable server programming on two or more lighting devices or other system elements. Communication traffic with other system elements acting as clients, and associated server processing loads, can be shared for example in a balanced manner, by the various lighting devices or the like acting as the servers for the particular functionality. A system element configured as a server, however, may also function as a client. In a distributed server context, for example, one element running an instance of server programming may source its client needs out to another server that is less busy or otherwise more suited to the required server task. Another distributed processing technique involves sharing of processing and/or memory and/or software resources of the intelligent system elements to handle a particular task, whether the task would otherwise be for one end-use element or would otherwise be a task for the element acting as a server. Other relevant resources for sharing in distributed processing might include input/output, networking, or any other resource. This includes resources that an individual device has (near) exclusive access to (e.g. one fixture might have a remote sensor, but the sensor is “dumb” and is not on the building control and automation network).
Considering first the resource sharing approach, different types of resources and/or more of these exemplary resources may be appropriate for sharing in distributed processing, depending on the level of questions being asked or tasks been processed. For relatively low level questions or tasks, the requestor may supply everything, such as the data, instructions, etc., as part of the work packet. In such a low level example, the remote element receiving the task to process just executes the instructions on the received data. For more complex tasks, it may make sense if the software was pre-installed on the remote element and the requestor sends basically just the data that needs to be processed through execution of that software. At still a higher level, the requestor may assign a task such that the other system elements need to pull in some of their own data to provide the appropriate processing result(s).
For example, a video camera might be sending frames out and ask other devices to seek and identify any people in the frame. The other devices may need to pull data from their cameras, and/or pull facial recognition databases from some external server.
Additionally, a particular system element might have exclusive access to resources that no other element has access to. For example, if only one intelligent building control and automation system element has a hardwire to the Internet, it may be able to pass work packets on to servers or pull data from servers via that Internet connection. As another example, one or some relatively small number of system elements may already have installed software of a type particularly useful in certain types of distributed processing tasks. For example, image processing software may be preinstalled on some elements, therefore it might be preferable to send image analysis type jobs to those units.
Several examples of distributed processing functions involve distribution of task or job processing to utilize resources of two, three or more of the intelligent elements of the system 10. Such a distributed processing operation involves an originating or distributing element, that has a task amenable to distributed processing, as well as one or more other elements serving as the responding or receiving elements that offer/provide their memory or processing resources for use in the particular distributed processing operation.
For example, when one intelligent system element has a processing job to perform using resources of other intelligent elements, the one element can query the other elements of the building control and automation system and receive responses from the other intelligent elements of the building control and automation system as to whether or not the other intelligent elements of the building control and automation system have processing or memory resources available for the processing job. Based on the responses, the one intelligent element allocates portions of the processing job to some number of the other intelligent elements of the building control and automation system. The one intelligent element can then send data and instructions to each element of the other intelligent elements among that number, instructing each receiving element to perform an allocated portion of the processing job. As the other elements complete their allocated portions of the job, the one intelligent element receives from those other intelligent elements results of the performance of the allocated portions of the processing job. The one intelligent element can then process the received results to determine an overall result of the processing job, and if appropriate, perform some action based on the overall result of the processing job.
From handling of each job in this manner, an intelligent element of the system 10 may learn of the other elements that offer resources and of the performance of those elements on portions of jobs distributed thereto. By analyzing metrics of the job distribution, and storing the analysis results, the originating element can refine its distribution process for each successive job as the originating element attempts to use resources of other intelligent elements.
In a another example of distributed processing, but from the perspective of one of the intelligent elements that makes its resources available for processing of a portion of a job from another element, the one intelligent element may receive an inquiry from the other intelligent element that has the processing job to perform on a distributed basis. In response, the receiving element may send a response with information identifying one or more of its various resources, e.g. resources of its processor, memory, software resources, etc., as available for distributed processing, via the network, to the other intelligent element. The element with the available resource(s) in this example receives data and/or instructions for performing a portion of the processing job from the other intelligent element via the network. The element will then process the received data in accordance with the instructions using the relevant available resources of the lighting device and send a result of the processing via the network to the other intelligent element.
Somewhat like the originating element, the job receiving element can analyze metrics of job processing and store analysis results to effectively learn about the impact of offering resources for processing of jobs from various other elements in the system. In this way, the element receiving an inquiry about available resources can adjust its responses to future inquiries from the other devices, e.g. to not respond or to offer less of its available resources to particular requesting elements.
As another distributed processing example, if the system is arranged to utilize a client-server model for some functionalities, e.g. for an external communication function, for a CO and/or for a higher layer control service, etc., the server providing a particular functionality may be implemented on a distributed basis, e.g. with instances of the respective server functionality running in coordinated fashion on two or more of the intelligent system elements in the premises 12. Since the higher level controllers may be implemented as individual hardware or as program functions of other intelligent elements of the system 10, they are considered as controller services, for purposes of further discussion herein. However, in view of our focus on distributed processing, we will assume that most if not all of these centralized functionalities that may be implemented as servers will be implemented using multiple server instance distributed processing; and many such examples below will utilize the higher layer control service(s) as principal examples of services implemented via such distributed server processing.
By way of an example of server types of distributed processing, the system 10 implements one or more of the services 57, e.g. for BCAS functions, on a distributed basis. In an example of this later type, the building control and automation system 10 also includes two instances of server programming. Although shown for convenience in dotted line fashion as if separate server platforms in FIG. 1A, the two instances of the server for the CO/controller/communication service 57 are actually stored in the memories of respective first and second ones of the intelligent system elements for execution by processors of the first and second intelligent system elements. The two instances of the server programming 57 configure the first and second intelligent system elements to operate in a distributed processing fashion to implement a server function with respect to an overall processing function of the system and related server communications via the data communication network. Such a system may also include client programming stored in memories of intelligent system elements other than the first and second lighting devices for execution by processors of the other intelligent elements to configure each of the other intelligent elements to implement a client function with respect to the particular overall processing function of the system and related client communications with the server function implemented by the instances of the server programming 57 on the first and second intelligent elements.
As shown by the discussion of the components of the system 10 so far, system elements in each service area include intelligence as well as communications capabilities. The precise operations of such a system can be defined by provisioning and/or configuration data stored in and used by the various intelligent system elements. In the examples, provisioning data is data used to set-up or enable operation of a system element so as to communicate via at least a portion of one or more of the networks of the system 10 and though such networking to communicate with some or all of the other elements of the system. In addition to communication via the physical network, elements of the system 10 can be logically associated to form logical groups or logical sub-networks, for a variety of purposes. In the examples, configuration data is data used to establish one or more such logical associations.
As used herein, commissioning encompasses various functions to set-up elements of the system for operations. Examples of functions involved in commissioning include provisioning elements for network communications, e.g. for physical communication with other elements via the applicable network media. Provisioning often entails at least some storage of data (sometimes referred to as provisioning data) for use in such communications within each system element. Some provisioning data also may be stored in an element implementing a routing or central network control function, e.g. to facilitate network-side aspects of the physical communications. Examples of functions involved in commissioning also include configuration of system elements to associate elements in one or more logical groupings of ‘sub-networks,’ to facilitate functional operations of the associated system elements. Configuration also will typically entail storage of data (sometimes referred to as configuration data) in the elements being associated in a particular logical group or sub-network.
For example, the data stored in an element may identify one or more logical groupings to which the particular element belongs. Some configuration data also may be stored in an element designated to implement a central overseer type control function.
In the example of FIG. 1A, provisioning data is stored in the memories 23A of the first lighting devices 11A and the memory 33A of the first building controller 13A to enable physical communication among the first lighting devices 11A and the first building controller 13A via the network 17A and to enable physical communication of the first lighting devices 11A and the first building controller 13A via the wider area network 51. Configuration data is stored in the memories 23A of the first lighting devices 11A and the memory 33A of the first building controller 13A for logically associating the first lighting devices 11A and the first building controller 13A together to operate as a first area lighting portion of the system 10, in this example, providing lighting service to the room A. Since the sensor 15A is implemented as an element of lighting device 11A′, the provisioning and configuration data of that device 11A′ facilitate communications via the networks 17A and 51 regarding sensor operations as well as operations of the sensor as part of the first area building control and automation system.
Provisioning data is similarly stored in the memories 93 (see FIG. 1C) of the first utility building control and automation elements 71A and the memory 33A of the first building controller 13A. This stored provisioning data enables physical communication among the first utility building control and automation elements 71A and the first building controller 13A and the lighting devices 11A, via the network 17A; and the stored provisioning data enables physical communication of the first utility building control and automation elements 71A and the first building controller 13A via the wider area network 51. Configuration data is stored in the memories 93 of the first utility building control and automation elements 71A and the memory 33A of the first building controller 13A for logically associating the first utility building control and automation elements 71A, the first building controller 13A and possibly lighting devices 11A together to operate as a first area portion of the building control and automation system. If there are sensors 94 implemented as elements of any of the first utility building control and automation elements 71A, the provisioning and configuration data of those elements 71A facilitate communications via the networks 17A and 51 regarding sensor operations as well as operations of the sensor as part of the first area building control and automation system.
In a similar fashion, provisioning data also is stored in the memories 23B of the second lighting devices 11B and the memory 33B of the second building controller 13B to enable physical communication among the second lighting devices 11B and the second building controller 13B via the network 17B and to enable physical communication of the second lighting devices 11A and the second building controller 11B via the wider area network 51. Furthermore, configuration data is stored in the memories 23B of the second lighting devices 11B and the memory 33B of the second building controller 13B for logically associating the second lighting devices 11B and the second building controller 13B together to operate as a second area lighting portion of the system 10, in this example, providing lighting service to the room or other type of service area B. Since the sensor 15B is implemented as a standalone device, similar provisioning and configuration data is stored in the memory 47B of the sensor 15B, to facilitate its communications via the networks 17B and 51.
Provisioning data is similarly stored in the memories 93 (see FIG. 1C) of the second utility building control and automation elements 71B and the memory 33B of the second building controller 13B to enable physical communication among the second utility building control and automation elements 71B and the second building controller 13B and the lighting devices 11B, via the network 17B, and to enable physical communication of the second utility building control and automation elements 71B and the second building controller 13B via the wider area network 51. Configuration data is stored in the memories 93 of the second utility building control and automation elements 71B and the memory 33B of the second building controller 13B for logically associating the second utility building control and automation elements 71B and the second building controller 13B and possibly the lighting devices 11B together to operate as a second area portion of the building control and automation system. If there are sensors 94 implemented as elements of any of the second utility building control and automation elements 71B, the provisioning and configuration data of those elements 71B facilitate communications via the networks 17B and 51 regarding sensor operations as well as operations of the sensor as part of the second area building control and automation system.
In addition, configuration data is stored in the memories of at least one of the first lighting devices 11A, one of the first utility building control and automation elements 71A and the first building controller 13A and stored in the memories of at least one of the second lighting devices 11B, one of the second utility building control and automation elements 71B and the second building controller 13B to logically associate the elements storing such data in respective memories together to operate as a system for a predetermined function for both the first area A and the second area B. For example, such configuration data may be stored in the building controllers 11A, 11B to group the controllers together, so as to coordinate a building status reporting function. Sensors of a particular type, e.g. temperature, ambient light level and/or occupancy, also may be grouped together for a common reporting function or to provide a common influence with respect to lighting, HVAC, safety and security or some other operation or function associated with the building premises.
The provisioning and/or configuration data may be stored into the memories of the various system elements via a variety of procedures. For example, one or both types of data may be manually input by a technician with a terminal device, as system installation or as new elements are added to an existing installation. Alternatively, the provisioning and/or configuration data may be acquired by a system element and updated in other system elements via an autonomous commissioning procedure in which the elements communicate and determine each other's capabilities. The commissioning also may lead to storage of at least some of this data in a central overseer (CO) service functionality, such as the server instances 57, and then provided to assist in commissioning of a new element on the system or in reconfiguration or corrective configuration of an existing element of the system.
The intelligent building control and automation element will include a ‘brain’ or central processing unit (CPU) component, which essentially includes the processor and memory (see examples in FIG. 1A). Although not separately shown in FIG. 1A, the intelligent building control and automation system element also may include one or more standard connectors for coupling of other components to the ‘brain’ of the element. The CPU component may include the one or more communications interfaces, or the communications interface(s) may be provided via a separate component/board/module. If built on a personal computer like design, for example, an intelligent building control and automation system element might include one mother board that has the CPU circuitry, an Ethernet port, a WiFi transceiver and one or more USB ports and a coupling to connect to a standard light driver. However, each intelligent utility building control and automation system element could utilize the same mother board, although different implementations/product offerings could incorporate different light sources coupled to the light driver port and/or different enhancements (e.g. sensors, or input/output devices coupled to the USB port(s)).
As products sold to customers, the intelligent utility building control and automation system element equipment manufacturer could offer a range of intelligent utility building control and automation system elements with a wide range of capabilities at various price points. However, across such products, many elements of the devices, including the ‘brain’ and the communications elements and other interfaces, would be essentially the same. Interfaces configured for standardized modular plug-in coupling could be provided in such devices to facilitate easy addition of various enhancements, such as sensors, input and/or output devices (e.g. for audio and/or video), extra memory, extra processor(s), additional communication components, etc. Plug-in here may utilize a physical and electrical connection or utilize some other type of coupling, e.g. capacitive or inductive. Any plug-in module that may require the ‘brain’ of the device to run additional programming for the device to be able to utilize or work with the plug-in module could have the requisite programming stored in memory in the module. In such a case, the ‘brain’ of the device and the module would be configured to upload the requisite programming from the memory of the plug-in module to the memory of the device, when the module is installed in the device. Alternatively, installation of the plug-in module could cause the processor of the device to communicate via network with an appropriate server to obtain any programming that may be required for proper device operation with the newly installed module.
Various circuit elements (e.g. processor devices, memories and associated architectures) may be used to implement the intelligence of the various lighting devices in the rooms or other service areas and/or the building control and automation system elements throughout the premises. A PC based approach, for example, may utilize any microprocessor architecture such as a Reduced instruction set computing (RISC) using an ARM architecture, as commonly used today in mobile devices and other portable electronic devices, or a microprocessor architecture more commonly used in computers such as an instruction set architecture (ISA), like those used in Intel microprocessors and the like. The PC-like or other microprocessor based approaches are discussed by way of examples; and other processor implementations may be used, such as based on a Peripheral Interface Controller (PIC) or other microcontroller architecture. Alternative intelligent architectures for the intelligence of the lighting devices and/or the building control and automation system elements, however, will still include appropriate communication interfaces and couplings for light sources and may include other standardized ports for connections of sensors, user input/output devices, etc.
The sensor elements (S) of the system (see 15B in FIG. 1A) may have electronics somewhat similar to those of the lighting devices discussed above, particularly with respect to the ‘brain’ and the communication interface(s). The sensor elements, however, may include USB or other port(s) for coupling to physical detector elements and associated interface electronics (Int.) built to the selected interface standard (e.g. USB). The user interface (UI) devices likewise may have electronics somewhat similar to those of the lighting devices and the intelligent utility building control and automation system elements discussed above, particularly with respect to the ‘brain’ and the communication interface(s); although UI devices may incorporate or have ports for particular types of user input/output components.
Although not separately shown for convenience, the intelligent system 10 may include and/or provide at least communications for a wide variety of other types of intelligent system elements in any or all of the rooms or other types of service areas A to N. Some of the other elements may be sold by the vendor that provides the other intelligent utility building control and automation system elements, sensors and user interface devices and associated intelligent element programming but be configured for other purposes. Others of such additional system elements may be manufactured and sold by other third party entities. All of these other elements that may be part of the system and/or may be communicating through the system will include some intelligence, such as some form of processor and memory; and such other elements will include communication interfaces and implement protocols compatible with the data communication networking of the system 10 at the premises 12. In some cases, third parties' system elements may themselves be ‘lighting’ related, such as lighting controllers, but manufactured by parties other than the vendor that manufactures the overall system and most of the components thereof. As another example, the other intelligent system elements may be controlled devices and/or user interfaces or controllers for other types of utility building control and automation equipment, e.g. HVAC and/or any industrial/commercial equipment running on the premises, whether or not manufactured by parties other than the vendor that manufactures the overall system and most of the components thereof. As still further examples, the other intelligent system elements may be security system devices, building access control device, inventory control monitors, location/positioning devices (e.g. indoor “GPS”) or any device using the building control network as a communication backbone.
As shown in the discussion above, the room controller typically will be an actual device, such as UI devices 13A and 13B in our examples. A floor-wide and/or building-wide controller and any associated CO functionality could be a hardware device somewhere in the system 10; but in our examples, such a broader area controller may be implemented as processing functions or services on one or more system elements deployed for other purposes. Since the higher level controllers may be implemented as individual hardware or as program functions of other equipment, they are considered as controller services, for purposes of further discussion herein. However, further discussion of such services will focus on the exemplary distributed processing implementations thereof.
For example, a lighting device 11A′, 11B′ having or enhanced with appropriate memory and processing capacity may be programmed to function as a floor-wide controller as well. To other elements on the floor, this lighting device enhanced with the controller service programming would appear on the network as a server, with respect to client programming implemented by the system elements, included within the floor-wide control grouping or sub-network. If the system is arranged to utilize a client-server model for such control functionalities, the server providing the floor or building level control may be implemented on a distributed basis, e.g. with instances of the respective server functionality 57 running in coordinated fashion on two or more of the intelligent system elements in the premises. In our example of the lighting device acting as the server for the floor-wide controller function, that device would run one instance 57 of the applicable controller server programming. At least one additional instance of that programming would run on another intelligent element, such as another lighting device, a utility building control and automation system element, a UI device or a sensor. If occasion arises when one or both instances of such a functionality might require additional resources, at any such time the controller service server instance may distribute controller related tasks to other elements, for example, by acting as a client to request assistance from another server instance that is less busy or otherwise more suited to the required server task; or the controller service server instance may distribute portions of a task for handling via resource sharing, as discussed relative to FIG. 2. Although the floor-wide controller service is used by way of an example here, a building controller service or a higher level controller service (e.g. campus or enterprise wide) may be similarly implemented via distributed processing on intelligent elements of the system 10.
The configuration data stored in the intelligent system elements that are subject to the higher level controller service(s) would include a priority relationship as between any such higher level controller services and the respective room controllers and/or any sensor responsive control functions implemented in respective individual system elements. For example, at least for some types of installations, a command from a floor-wide controller may override any command from a room building control and automation controller (from a local UI device) and override any utility building control and automation element setting established in response to a condition detected by a sensor. A building-wide controller service would have priority over any floor-wide controller services in the building, as well as over the room controllers and the sensor responsive control functions. The floor-wide and/or building-wide control services may also allow interaction with other computers and/or terminal devices, such as elements 53 and 55 in the example of FIG. 1A. The algorithms set at each level of the control hierarchy, however, may be varied and may be chosen by the system designer, the premises owner or the entities that will occupy some portion(s) or all of the service areas in the premises 12; and the priorities set amongst the system elements during commissioning may in at least some premises be similarly set by the system designer, the premises owner or the entities that will occupy some portion(s) or all of the service areas.
One or more CO/controller services may be for or include an associated system maintenance capability. Some or all of the elements of the system would then provide information to that CO/controller as may be appropriate for system health monitoring. For example, an intelligent utility building control and automation system element in a room may determine that it has not heard from a sensor in its room for some extended period of time and report to the maintenance CO/controller so that that CO/controller can initiate appropriate further action (e.g. attempt to communicate with the sensor and perform a diagnostic and correction routine and report to a technician if that communication should fail). Similarly, if an existing element receives communication from a new element, it may communicate with the system maintenance or another CO/controller to determine if the new element should be on the network, before assisting the new element in its self-commissioning into the system.
Although control functions are discussed above for purposes of explaining the controller/controller service hierarchy, the controller functionalities also will typically support related data communication for reporting or the like. For example, sensor, lighting device and/or utility building control and automation system element status data may be reported to each applicable higher level controller service and becomes available to other equipment or entities with appropriate access to the controller service, e.g. so that a building manager can see what rooms are illuminated, what rooms are occupied, ambient light levels, room temperature, UI device states, which elements are ON/OFF in relation to the other room states, and the like. Similarly, the higher level controller service(s) may offer access to some or all of such data to outside parties, such as the power company.
FIG. 1B is a high-level block diagram of an example of a room C in the networked building control and automation system 10, many elements of which are installed at a premises 12. This room is analogous to room/areas A and B described in FIG. 1A with respect to all functionality and the types of system elements that it may comprise, but this second drawing shows several examples of the utility building control and automation system elements.
Like rooms A and B, room C may include any number of lighting devices 11C, such as fixtures and lamps, utility building control and automation system elements, such as HVAC, security systems, building access systems, fire or safety alarm systems or commercial systems, as well as lighting controllers, such as switches, dimmers and smart control panels. At least a substantial number of the lighting devices are implemented as intelligent system elements, which each include a processor and a memory. The intelligent lighting devices, along with many of the intelligent utility building control and automation system elements, also incorporate network communication capabilities.
As shown in the example, the service area represented by room C includes an appropriate number of lighting devices 11C, for example, to provide a desired level of lighting for the intended use of the particular space in room C. Room C also includes a user interface (UI) device 13C, which in this example, serves as a building controller. In this particular instance, room C further includes standalone sensors 15C, which have the same composition as sensor 15B discussed above relative to FIG. 1A. In this example, room C represents a commercial area and has a number of specific examples of utility building control and automation system elements. These examples include security system elements 73C, HVAC system elements represented by the heat and/or air conditioning (AC) generator 75C and controllable vents 77C, commercial refrigeration elements 79C and building or room access control system elements 80C. Room C may also include any number of other types of utility building control and automation system elements 71C. All of these various intelligent system elements in or associated with room C are connected to the room's data communication network 17C, and the requests and data of the various building control and automation elements are handled by the lighting device 81C acting as a BCAS server (e.g. running one of the instances of the server 57 of FIG. 1). Although shown in the room C, the lighting device that also operates as the BCAS server 81C may be a lighting device in another room and may provide the server functionality for some number of the rooms or service areas of the premise 12.
The BCAS elements featured in room C may respond in a coordinated fashion to any number of inputs from the UI device 13C and/or sensors 15C. In this example, the collection of building control and automation elements can share data over the network 17C and intelligently handle requests from the UI device 13C and sensors 15C. For instance, if the sensors 17C detect that there is no occupancy in the room, one or more of the elements may send a request over the network 17 to BCAS server 81C to coordinate the other BCAS elements appropriately. This may entail coordinating the lighting devices 11C to turn the light level down, activating one or more access control elements 80C to lock one or more rooms or the entire premises against access by unauthorized personnel, activating one or more security system elements 73C to monitor for activity, adjusting the activity level of HVAC element 75C and the status of vents 77C to set room temperature to a more cost effective level, changing the temperature in refrigeration units 79C, and/or making any number of other building control and automation adjustments.
FIG. 1C depicts an example of an intelligent utility building control and automation element 71. The example 71 of the element configuration depicted in FIG. 1C may be used to implement any of the elements 71A, 71B of FIG. 1A, or any of the elements 71C to 80C in FIG. 1B.
The element 71 is an intelligent device in that the element 71 includes a processor 91 and a memory 93. This ‘brain’ of the element 71 will be coupled to and control appropriate device drive electronics 99. The drive electronics 99 provide an interface to a controllable mechanism 101 of the particular element 71, to allow the processor 91 to control the mechanism, or to receive sensor data from the mechanism or both. The drive electronics 99 and the programming (e.g. stored in memory 93) that is run by the processor 91 to control operation of each particular element 71 will depend on the particular type device used as the mechanism 101 and thus on the particular type of utility building control and automation element product that the arrangement 71 represents or implements.
The examples of element 71 may be virtually any type of device, typically not directly related to lighting operations of the system 10, which may utilize data communications, in this case, via the elements and network of the system 10, and which may interact with the server instance 51 or other system control functionality provided by the lighting elements 11A, 11B. By way of a few examples, the controllable mechanism 101 may be any of a variety of HVAC components (e.g. elements of a thermostat, one or more elements of the heat/cooling system, controllable vents or dampers within the duct work), one or more cooling or other elements of a refrigerator, any of a variety of components of a security system, any of a variety of access control elements, and/or sensors related to any or all of the above functions.
The intelligent utility building control and automation element 71 also includes a communication interface 95. Like the communication interfaces in the other intelligent system elements, the interface 95 connects or otherwise couples to the network media in the service area and supports two-way data communication through the network(s) 17A-17C and/or 51 of the system 10. Although not shown, intelligent utility building control and automation element 71 may have more than one communication interface, for example one for a wired or optical fiber medium and another for optical or radio frequency wireless communication.
In the example of FIG. 1C, the utility building control and automation element 71 is shown as having one processor, for convenience. In many instances, these elements may have multiple processors. For example, a particular configuration for an element 71 may utilize a multi-core processor architecture. Also, some of the other components, such as the communications interfaces, may themselves include processors.
An intelligent utility building control and automation element 71 may include one or more input and/or output (I/O) elements 97 for a user interface. The user I/O element 97, for example, may include a toggle switch, a rotary controller, one or more sliders, a keypad and/or a touchscreen display. The precise user I/O element, if provided, depends on the operational characteristics of the particular element 71. For example, for an HVAC controller, the user I/O element(s) 97 might be similar to those of a digital thermostat. A touchscreen display, as another example, may support touch and touch gesture input as well as visual display output. Other examples of the UI input may include a video input and associated processing for gestural control detection, a microphone, an occupancy/motion sensor, proximity sensor, etc. If provided, outputs may be visual, audible, tactile, etc. For example, a microphone and/or speaker may be used to support audible input and/or output, whereas a camera in combination with projector or display may be used to support visual input and/or output.
As an alternative or in addition to any sensors included in the controllable mechanism 101, an intelligent utility building control and automation element 71 may include one or more sensors 94. If included, the type of sensor in a particular element 71 would depend on the type of element and/or the mechanism 101 that the ‘brain’ controls through the electronics 99.
The discussion above has outlined several techniques for distributed processing that may be implemented in the context of a building control and automation system like system 10 of FIG. 1A or FIG. 1B. It may be helpful to consider some more specific examples of distributed processing operations. The process flow shown in FIG. 2 represents a simple example of a first type of procedure for distributed processing, which may be implemented in a building control and automation system like the system 10 of FIG. 1A or FIG. 1B.
In the example, a first intelligent system element has a processing job to perform. The element may be any intelligent element of the system 10, although for purposes of a specific example to discuss, we will assume that the element that has the processing job or task is one of the lighting devices, and is therefore identified as device 1 in FIG. 2. At step S1, the device 1 recognizes that it may be prudent to seek help to perform the task at hand, in this case, using resources of others of the intelligent system elements.
The device 1 can perform at least some tasks utilizing the element's own internal processor and memory. For example, a lighting device typically will be able to receive and appropriately process a lighting command, e.g. to set a light level and/or to set an associated color characteristic of the device's light source, to adjust its operational light output as commanded, without the need for resources of other intelligent elements of the system. A user interface (UI) device configured as a building controller generally will be able to send commands in response to user inputs to any lighting devices it controls; and, at least under most circumstances, a sensor will be able to report its sensed condition to any system elements configured to receive and utilize such information. Similarly, an intelligent utility building control and automation element will be able to perform some internal processing and act on the results, e.g. a heat/cooling generator 75C will be able to change back and forth between heating and cooling and turn on and off in response to individual commands to provide the appropriate operations for adjusting air temperature in the premises or in individual rooms or other service areas of the premises.
However, other tasks may more readily lend themselves to distributed processing. Some such tasks with a potential for distributed processing may call for more processing or memory resources than readily available within the device 1 (e.g. without compromising core lighting functions of the device). Tasks with a potential for distributed processing typically will be tasks that can be handled in some reasonable fashion by some number of individual elements, e.g. can be readily split into subtasks for processing and/or storage in different elements, although there may be some tasks that by the nature of the processing or storage involved cannot readily be spilt amongst multiple elements. Some tasks may require faster completion than the device alone can provide with only its own resources and therefore best implemented via distributed processing.
Conversely, some resource intensive tasks may be relatively insensitive to time-to-completion and amenable to wider distribution for processing (e.g. processing of audio, image or video data). The distributed processing tasks may relate to building control and automation system operations, general processing tasks associated with the system and/or tasks for other parties. Lighting tasks that may be amenable to resource sharing type distributed processing, for example, may relate to lighting control operations, e.g. to process data from numerous sensors and make some overall control decision. HVAC tasks or combinations of access control and security tasks may also involve processing and responding to sensor information obtained across all or a substantial portion of the premises and therefore may be amenable to resource sharing type distributed processing. Such lighting or other tasks may be implemented by an element operating as a server for one of the CO/controller services, which, when appropriate, obtains access to resources of other intelligent system elements. General processing tasks of the system may include, for example, processing audio or video inputs, either for a lighting or other building control operation in response to user input in such a fashion or for some other system function or feature (e.g. to access information or a non-lighting control function in response to the user audio or video input). A task for an outside party might entail processing sensor, audio or video input data from the system elements for delivery to an outside party, either on a regular basis or in response to a specific request/instruction from the outside party. Similar processing may be handled on a distributed processing basis within the system, to process such data received from outside the system.
From the various factors involved in the processing task at hand, in the processing flow of FIG. 2, the device 1 will recognize that the task is one that is appropriate for distributed processing, e.g. involving processor or memory intensive operations and/or not time critical, etc. Also, based on characteristics of the job, e.g. source, lighting/non-lighting function, time sensitivity, or the like, the device 1 will assign a relative priority value or level to the particular processing job. The programming and/or the protocols used for signaling between system elements that may be involved in distributed processing in the system 10 can define an appropriate format and range of values for a job priority level parameter.
The lighting device 1 will be in communication with at least some number of other intelligent elements of the building control and automation system 10, referred to in this process flow example as neighbors of the device 1. The neighbor elements may be other lighting fixtures, intelligent utility building control and automation system elements, intelligent UI devices, intelligent sensors or any other type(s) of intelligent elements that are part of or communicating via the building control and automation system 10.
At step S2, the lighting device 1 queries other intelligent system elements, i.e. the neighbors in the example, essentially to request help in performing the processing task or job. The queried neighbors may include any number of other elements of the system 10. A small group of neighbors, for example, might be those elements logically associated with the device in some small group or sub-network, such as elements in the same room or other service area sub-network. The queried neighbors may include all system elements on the system 10 or any sub-set of elements between the smallest size group and the complete set. As discussed more later, the sending device 1 may pick and choose which of its ‘neighbors’ from any particular grouping to query with regard to the current job or task, based on information about element performance learned from earlier distributed processing of other tasks and/or requirements for the task at hand.
The exemplary distributed processing procedure includes learning features, for the device that is distributing the job and for the neighbors that respond to queries or requests to contribute resources for distributed job processing and/or that actually contribute their resources to distributed job processing. The learning process on each side of the distributed processing, job sub-task distribution as opposed to offering resources and performing an allocated sub-task, help the various system elements to adapt and optimize the distributed processing operations over time. As will be discussed at various stages of our description of the exemplary processing flow, information that has been learned from distributed processing of prior jobs informs the various elements in their decisions or responses at various stages of the process. Optimization may also involve some randomization.
For learning purposes, each intelligent system element configured to distribute portions of a task may establish, maintain and store a learning table for the distribution function; and each intelligent system element configured to offer resources to another if instructed contribute such resources to a distributed intelligent system element and processing operation may establish, maintain and store a learning table for such in-bound query response and sub-task processing. Of course, many of the intelligent system elements may play both roles during processing of different jobs over a period of time and may learn about both sides of the distributed processing. An intelligent system element configured to participate on both sides of the distributed processing may maintain learned data about both types/sides of the operations, either in two tables or in a combined table. If separate tables are used, each table may be adjusted in response to a change in the other, in appropriate circumstances.
In general, learning entails analysis of performance by an element and/or by other elements involved in handling of each distributed processing job determine to distributed processing metrics of performance. Examples of learned performance parameters that may be assessed in selecting other neighbor elements during the task distribution include turn-around time or turn-around time per unit of processed data, number or percentage of dropped packets, average amount of memory resources offered (e.g. bytes of storage) and/or amount of processing resources offered (e.g. in units related to data to be processed, number of processing cycles or average processing rate) and/or actually provided, during some number of prior distributed job processing, operations. Examples of learned performance parameters that may be assessed in determining how to respond to a new inquiry for distributed processing assistance include amount of data processed, time required, resources used, delay incurred in processing of other tasks, or the like, for tasks distributed by the received device.
In general, the learned distributed processing metrics of performance allows an element to prioritize one or more lists of neighbors/other elements for use in making decisions and selections based on highest relative ranking on the applicable list. For distribution, the device 1 may select some number of the highest ranking neighbors. In contrast, an element offering to take part in a distributed task may choose whether to offer to help or how much if any of that element's resources to offer based on the ranking of the particular requesting device 1, based on learned distributed processing metrics of performance. With such an approach, an element tends to select or respond most favorably to the highest ranked element(s) in the particular prioritized listing, in an effort to optimize operations.
When decisions in the process of FIG. 2 are made based on the learned performance metrics about other elements, however, the element making the decision can introduce a random variation in the decision, for example, to select or respond to a lighting device or other element that has not or seldom been chosen or favored at the particular decision point in the past. As a result, the element making the selection or response will from time to time randomly select or favor another element that would otherwise appear as less than optimum based solely on the previously learned performance information. However, this allows the selecting or responding element to learn more about the randomly chosen element for future processing purposes and update the parameters in the learned table(s) for optimization of future distributed processing operations. A random variation of this type, for example, may allow the element making the decision to discover changes and adjust its learned information accordingly, for better optimization of future distributed processing operations.
Returning to the example of a resource sharing type distributed process flow of FIG. 2, in a particularly intelligent implementation of the distributed processing, the device with the task to distribute can select among elements in some group or sub-group based on performance data about elements in the group or sub-group learned from prior job distribution operations for sending the query in step S2. The learned performance parameters for job distribution enables the device 1 to prioritize a list of neighbor elements for job distribution and to query some number of the highest priority elements likely to offer and provide sufficient resources to handle the particular task at hand. Only a few may be chosen from the high-end of the priority list for a small task, whereas the sending device 1 may select more or all of the neighbors to query for a larger task. As the process is repeated over time for multiple distributed processing tasks, the device 1 will tend to most often choose the other elements that are rated higher for performance based on the learned performance parameters, for the query step. Lower rated elements will be selected less often. However, the priority for such selection for the query step S2 may change over time as conditions at other elements change and the sending device 1 updates its learned performance metrics accordingly; and the occasional randomization of the neighbor selection can enhance the process of learning about changes.
The device 1 sends the query message through the network media used in the relevant portion(s) of the system 10 installed at the particular premises 12, to the neighbors chosen initially for purposes of the inquiry about the current task processing. The inquiry, for example, may be sent as a broadcast, sent as a multicast to selected neighbors or sent as individual data messages to each of the selected neighbors, depending on the network media and/or data communication protocols utilized by the particular system implementation.
The request message for the query in step S2 will include at least some information about the current job, including the assigned job priority level. The information in the query, for example, may also provide various metrics about the task at hand and/or the subtasks thereof being distributed to other elements. For example, such information may indicate the type of processing involved, the type/format of the data to be processed, any time constraints or deadlines for sub-task completion, the overall amount of data or the expected sub-divided amounts of data to be processed by recipient neighbors, or any other parameters about the task that may be helpful in enabling the queried neighbors to determine how to respond to the query. The information about the current job may also include a job or task identifier.
Each queried neighbor element will analyze the information about the job from the query message it receives from the device 1 in comparison to its own resources, current data processing operations, status or the like. For example, the receiving element may compare the priority of the task that is to be distributed to the priority or priorities of any of its own tasks in progress or any distributed processing sub-tasks the receiving element may already be working on for other source elements. The receiving element may also analyze factors about the task that is to be distributed, versus what if any of its own resources that element might offer and allocate to the task, in view of its ongoing processing operations and any expected higher priority tasks. For example, if the receiving element is a lighting device, that receiving element may be able to offer some resources to handle part of the task but still reserve sufficient resources to address a command to change a light setting if received while working on a part of the task.
Neighbor elements that do not have (or for various reasons will not offer) resources may not respond to the query. Alternatively, such unavailable neighbor elements may send responses, but their responses in such cases would indicate that they are not offering resources to assist in performance of the distributed processing job currently offered by the device 1. In the example, the device 1 will adjust its learned table about its neighbors to reflect any neighbors that do not offer to assist in the distributed processing job. e.g. to indicate other elements did not respond or indicate any reason given in a response declining to participate.
Each receiving element that has resources available will set a request timeout and send a reply message back through the network to the device 1 (S3). This period essentially is a time limit during which the neighbor will wait for further instructions about the job. However, if the timeout period expires (S4) without follow-up instructions about the job from the device 1, then the neighbor will release the promised resources at step S5, in this scenario, without having processed any part of the task at hand. In this way, the unused resources are available for other uses by the neighbor or for other distributed processing operations. After releasing the resources, the neighbor element will update its learning table about distributed processing offered by other elements, as shown at S6. In the timeout scenario (that passed through S4), for example, the neighbor will update its learned performance metric information about device 1 to reflect that device 1 did not send a sub-task to the neighbor after the neighbor offered resources in response to the query. The neighbor can use such performance metric information in future to adjust its responses to future queries from device 1.
Returning to step S3, as noted, at least the neighbors that have and will offer available resources send back a reply message, which is received at the device 1. Each reply from a device offering to participate in the distributed processing operation will include information about the resources of the neighbor element which that element is offering to make available for sub-task processing of the currently offered job. Examples of such available resource information include: processing power, memory, software/capability, reservation time, etc. Each reply may also indicate the relative priority of any local task or prior distributed processing task that is already in progress on the responding neighbor element. In this step S3, the requesting device 1 will receive similar replies from some number of its neighbors, indicating whether or not the other intelligent system elements have processing or memory resources available for the processing job. In our example, at least some of the replies from neighbors offering available resources provide information about the resources that each other element offering to help in the distributed task processing can make available. In the example, the device 1 will adjust its learned table about its neighbors to reflect those neighbors that offered to assist in the distributed processing job and/or to reflect the resources each such neighbor offered in response to the inquiry sent in step S2.
In step S7, the device 1 with the task to distribute analyzes potential candidates for distributed processing of the task, for example, to prioritize a list of the neighbor elements that responded (respondents, in the drawing). The device 1 can prioritize the respondents based on information contained in the responses, for example, based on information about the resources each is offering and/or priority of any other tasks the respondents are already processing. The device 1 can also prioritize the respondents based on learned information regarding performance metrics of the respondents that the device 1 selected and used to assist in prior distributed processing operations.
The device 1 in our example will also know the priority and requirements of the data processing task that the device 1 is trying to distribute. From the prioritized list created in S7, the device 1 can now select an appropriate number of the respondents starting at the highest rank and working down through the list to select a sufficient number of the respondents to provide the resources to meet the requirements of the particular data processing task.
The device 1 essentially allocates portions of the processing job to the selected respondent elements. Hence, at step S8, the device 1 creates work packets for the selected respondents. By work packets here, we do not necessarily mean IP packets or the like, but instead are referring to sets of instructions and associated data for the portions of the job that the device 1 allocates to the selected respondents. For large processing jobs, for example, in a system using IP packet communications over the network media, each ‘work packet’ for a sub task allocated to a selected respondent may utilize some number of IP packets addressed to the particular respondent neighbor element. The device 1 may send one, two more work packets to each of the selected respondent neighbor elements. In our example, the distributing device 1 stores a record of each work packet and an identifier of the neighbor element to which device 1 assigned the particular work packet.
The work packets created for each selected respondent may be tailored to the particular respondent. For example, respondents offering more processing or memory resources may be sent more of the data to process. Respondent elements with particularly advantageous capabilities (e.g. a video processor not currently engaged in another processing task) may receive task assignments particularly suited to their capabilities. The allocations and associated work packet creations also may be adjusted based on the learning table. For example, if a particular respondent has performed better in the past when handling a somewhat smaller data allocation, the device 1 may limit the data allocation for that element accordingly.
In the process flow of FIG. 2, in step S8, the device 1 sends the work packets to the selected respondents through the network communication media of the building control and automation system 10. Although not shown for convenience, the system elements may be configured to require an acknowledgement of each work packet. In such an arrangement, a neighbor would send an acknowledgement message back through the network to the distributing device 1. If no acknowledgement is received from a particular neighbor, after some number of one or more retries, the distributing device 1 could select a lower priority neighbor from the list used in step S8 and try sending the undelivered work packet to the alternate neighbor in a similar fashion. Each work packet sent/delivered to a neighbor will include a portion of the data to be processed for the particular task as well as instructions as to how the data in the work packet is to be processed, essentially to enable each respondent to perform an allocated portion or sub-task of the distributed processing job. Each work packet may include an identifier of the overall processing job and/or an identifier of the particular assigned sub-task.
At this point in the discussion, we will assume that each intelligent system element that receives a work packet for an allocated portion of the distributed processing job will successfully complete and return results for the portion of the job allocated thereto. Several scenarios in which work packets are dropped without sub-task completion will be discussed later.
Hence, at this point in our exemplary process flow, each of the neighbor elements that the device 1 selected for a sub-task receives one or more work packets containing data and instructions for that sub-task as part of the communications in step S8. The element receiving the work packet performs its allocated portion of the processing job on the received data, in accordance with the instructions, using resources of the processor and/or memory of the receiving element of the building control and automation system (step S9). At step S10, each selected respondent neighbor element sends a result of its sub-task processing back through the data communication network of the system 10 to the device 1. In our example, each of the work result packets sent back to the distributing device 1 includes an address or other identifier of the responding neighbor element that performed the sub-task as well as an identifier of the overall task/job and/or an identifier of the respective sub-task.
Upon sending sub-task results in step S10, each respondent neighbor element will release the resources utilized in processing the sub-task, at step S5. The resources become available again for other uses by the neighbor or for other distributed processing operations. After releasing the resources, the neighbor element again will update its learning table about distributed processing (at S6), in this case, the sub-task processing that the element performed for the device 1. In the completed sub-task scenario, for example, the neighbor will update its learned performance metric information based on analysis of the task of device 1 to reflect the size of the assigned sub-task, the amount of resources and/or time utilized, what if any other tasks of the respondent neighbor element were delayed during this distributed processing operation, or the like. The neighbor can use such learned performance metric information in future to adjust its responses to future queries from device 1.
Returning to the result transmission step S10, as a result of the transmissions from the neighbors selected back in step S10, the device 1 will receive processing results or the sub-tasks from other intelligent system elements. In step S11 in our example, the device 1 compiles the received results and checks the composite result to determine if any work packets were dropped or if there are any readily apparent errors. Sub-task identifiers and/or a combination of the overall task identifier and the neighbor address/identifier may assist the device 1 in combining sub-task results from the various participating neighbor elements into the appropriate overall composite result. At this point in our discussion, we will assume that no packets were dropped and no errors are detected. Hence, the compiling of the results of the allocated sub-task processing from the other system elements assisting in the current distributed processing operation essentially determines an overall result of the processing job. Processing by the device 1 proceeds to step S12, in which the device 1 reports the overall result. The report function here is given by way of just one example of an action that the device 1 may perform based on the overall result of the processing job. The report may be sent to a higher level processing element or service, e.g. a higher level control service 57 or to an outside system management device 53 or 57. As other examples, reporting the result may involve taking some action in the device 1, accessing data via the network, sending a face or voice recognition result to an outside device of another party, etc. Of course, the device or any other system element may act in any of a variety of other ways based on the overall result of the distributed processing operation.
At this point, it may be helpful to consider a voice recognition task/job, by way of an example. The device 1 has digitized audio data to process for recognition. The work packets sent at S8 include portions of the digitized audio, e.g. sub-divided at apparent speech pauses between words. The neighbor elements process received digital audio data to recognize one or more words in the audio data segments. The returned work result packets represent words of recognized speech. Each returned result may include one or more words, depending on amount of the audio data sent to the respective neighbor element. The device 1 compiles the received words into a string of words in an order corresponding to the original audio stream (prior to division thereof for work packets).
At S12, the device 1 may simply send the string of words to another element in or communicating with the system for further processing or the like. Alternatively, the device 1 may itself perform additional processing, e.g. to analyze the word string to recognize a command, in which case the device 1 can act in response to the command or forward the command to another element in or communicating with the system for further processing or the like. For example, if the spoken command is a lighting command, the device 1 acting as a controller can then instruct some number of lighting devices to adjust light settings thereof, in the service area where the audio for the spoken was received as an input, based on the command. As another example, if the recognized command is for obtaining access to other information, e.g. a request for a current quotation of the price of a particular stock, the device 1 can format an appropriate query and send that query to a server for a stock service. In response, the device 1 receives data answering the inquiry, from the stock service server; and the device 1 sends the resulting answer information through the system to an element of the system with an audio or display output capability for local presentation in the in the service area where the audio for the spoken information request command was received as an input.
Returning to the exemplary processing flow of FIG. 2, upon completion of the distributed processing job, e.g. upon reporting the overall result in S12 in our example, the device 1 will also update its learning table (step S13) to reflect the performance of various other system elements with respect to the just completed job. For example, the table may be updated to reflect devices that did or did offer resources in response to the query. The learning table may be updated to reflect successful completion by some of the other/neighbor elements versus packets dropped or errors created by processing of sub-tasks by still others of the neighbor elements. As outlined earlier, the device 1 can utilize the learning table updated in step S13 to improve its neighbor selections (e.g. at steps S1-S2 and steps S7-S8) in future distribution of jobs amongst its neighbors.
If sufficient resources are available and/or enough other elements respond, some or all of the work packets sent out at step S8 may be duplicated and sent to two or more of the selected respondent neighbor elements, for redundant processing. When the device 1 compiles the results at S11, it may receive duplicate sub-task processing results. If the device 1 detects errors, in many cases, at least one of the duplicative sub-task processing results may be successful and free of errors; and the device 1 can utilize the error free results and discard the duplicate version that is subject to errors. In some cases, an element that accepted a sub-task may not respond, at least in a timely fashion. From the perspective of device 1, the work packet sent to such an element has been “dropped.’ However, if another element assigned the same sub-task successfully completes its processing of that sub-task, the device 1 can still compile the overall job result using successfully completed sub-task result from that other respondent. Hence, duplicative allocation of sub-tasks can improve likelihood of successful completion of the distributed processing task. However, in some cases, problems may still arise. In any of these cases, the update of the learning table in step S13 will reflect such outcomes with respect to the performance metric data stored in the table relative to the respective neighbor elements.
Assume next that when the device 1 checks results in step S11, and device 1 determines that some portion of the job has not been successfully completed. In this situation, the device 1 determines at step S14 that some rework of the job is necessary. If capable, the device 1 may perform any necessary additional processing itself. If not, however, then the device can again distribute some or all of the sub-tasks to other system elements. In our illustrated example, depending on the type and/or amount of further data processing required to complete the distributed processing task, processing flows from step S14 back to S1 or S7 and from there through the other steps of the process, essentially as discussed above, to obtain distributed processing results to complete the overall data processing job.
There may be a variety of reasons why a sub-task is not successfully completed, and either the work packet is dropped or the results returned to the device 1 are subject to errors. For example, some communication media may be subject to communication-induced errors too extensive to address with routine error correction technologies. In other cases, some part of the data network of the system 10 may be down or congested. However, in other cases, events at one or more of the selected respondent neighbor elements may result in a dropped work packet, as reflected in our exemplary process flow at steps S15 and S16.
Returning to step S9, the various neighbors that responded, were selected and received work packets are processing data from the packets in accordance with the associated data processing instructions. The overall processing job, and thus the sub-tasks thereof, will have an assigned priority. Other tasks handled by the various intelligent system elements also have assigned priorities. At step S15, one of the system elements that has been processing data from the work packets at S9 now receives (or internally generates) an interrupt in view of an apparent need to perform some other task having a higher priority than the particular distributed processing job. That element will suspend its processing of the allocated sub-task and perform the processing for the higher priority task. Depending on the resources and time taken for the higher priority task, the element may be able to resume sub-task processing after completing processing for the higher priority task and still deliver its sub-task results within the timeframe set for the particular distributed processing job. If not, however, then the system element will drop the processing of the work packet of the particular distributed processing job (step S16), to process the higher priority task. In this later situation, the element will release the promised resources at step S5. After releasing the resources, the neighbor element will update its learning table about distributed processing offered by other elements, as shown at S6. In the interrupt scenario (that passed through S15), for example, the neighbor will update its learned performance metric information about device 1 to reflect that the respondent neighbor element was unable to complete the sub-task before dropping the packet to handle the interrupt for a higher priority task. Although not discussed in detail, the device 1 may also process some portion data or otherwise perform some sub-task of the distributed job before compiling the results. Alternatively, the device 1 itself may be involved as a respondent neighbor in another distributed processing operation while it waits for responses from the respondent neighbors in the job the device 1 distributed.
Although the discussion of FIG. 2 mainly focused on distributed processing amongst lighting devices, associated user interface devices and sensor devices, as noted earlier, the resource sharing implemented by a process flow like the example of FIG. 2 may take advantage of and share resources of any type(s) of intelligent elements that are part of or communicating via the building control and automation system 10. For example, the building control and automation system 10 may be able to use the memory and/or one or more processors of a cooperative laptop, desktop computer, host/server computer or the like that is coupled to communicate via the data communication media of the building control and automation system 10. The system also may support communications and/or interactions with a wide range of other devices within the premises 12 having some level of intelligence and having appropriate data communication capabilities, e.g. HVAC components, smart appliances, etc. If any of such other devices have resources to share and are appropriately programmed, the building control and automation system 10 may be able to use the memories and/or processors of such other cooperative devices. Conversely, some computers coupled to the communication media and/or some other types of cooperative devices may be able (and permitted if appropriate) to request and obtain access to resources of the lighting devices, associated user interface devices and sensor devices available for sharing for distributed processing in a manner like that shown by way of example in FIG. 2.
The discussion of FIG. 2 related in general to resource sharing type distributed processing in a system like system 10. Such a process may support various lighting related functions of the system as well non-lighting functions of various other intelligent elements of the system 10. Hence, it may be helpful to consider a procedure with respect to a BCAS system control function, for a non-lighting type condition in the premises 12.
FIG. 3A is a flow chart of another example of a procedure for distributed processing involving BCAS-specific functionality in a building control and automation system like that of FIG. 1A or FIG. 1B. FIG. 3B shows a simple residential building layout example with an overlay of block illustrations for some of the system elements, as referred to in the discussion of the flow chart of FIG. 3A. As shown in FIG. 3B, each room or corridor has lighting devices in the form of light fixtures (LF) and a temperature sensor TS. The system includes a central HVAC system. For individual control in the rooms and corridor, each of the rooms and corridor has a controllable air-flow damper (AD) shown by way of example as vents. Duct work between the dampers AD and the central HVAC is omitted for convenience. The controllable dampers AD may be in the duct instead of implemented as elements of the room/corridor air vents. The system elements in the rooms and the corridor have are linked into local logical network(s) which in turn are elements of the overall system/lighting network at the premises.
FIG. 3A shows an example of the processing procedure that may be implemented in a system 10 of the earlier drawings, in this case to implement HVAC related control. In this example, a temperature sensor TS1, which may be a standalone device in some room in the building control and automation system 10 or implemented as part of another intelligent system element, detects the temperature in step S31. TS1 acts as a client with respect to some element acting as a BCAS server or CO for BCAS-related elements, such as device 81C acting as an instance 57 of a BCAS server. In step S32, TS1 queries BCAS server 57 for the temperature setting. The temperature setting contains a range of allowable temperatures (“tolerance”); and in step S33, the BCAS server checks whether the room temperature detected in step S1′ is within the given tolerance.
If the room temperature is found to be within the tolerance provided by the BCAS server, then the system takes no further action. In that situation, processing loops back from the decision/branch step S33 to perform step S31 again (e.g. after some period of waiting/delay).
However, assuming that the temperature is outside the tolerance (no branch at S33), then processing proceeds from step S33 to step S34, where the BCAS server queries the HVAC system elements for their status. This status may include ON/OFF settings to the air conditioning (cooling) or heat generating system, open/close status of air flow controllable dampers (AD), etc. Further processing at S35 branches based on whether or not a setting or state of one or more of the elements related to HVAC operation for the affected area should be changed.
If the HVAC is ON and operating in the correct mode, for example, then processing branches from S35 to step S36, where the server queries other temperature sensors in the room and/or nearby rooms or the corridor to see if they are also within tolerance. If the other sensors are generally within tolerance, then processing branches at S37 and proceeds to step S38, to send an “open” command to nearby air flow damper AD1, to effect a local change in temperature. In this example, processing ends at step S47.
Returning to the decision in step S37, if other temperature sensors are similarly outside of tolerance, then processing instead proceeds to step S39. At S39, the BCAS server sends a command to the HVAC system over the data communication network to turn up/down the temperature as required and sends an “open” command to AD1 in step S38, and processing ends at step S47.
Although not shown for convenience, the processing regarding TS1 and related controls returns to step S31 after S47. The example of the system 10 will also implement steps similar to S31 to S39 with respect to each of the other temperature sensors (TS).
Returning now to step S35, in which there is a decision as to whether or not to change one or more settings in HVAC status, we will assume that the determination is that an HVAC setting change is appropriate. For example, if TS1 detects an out of range temperature, then if during step S34, the HVAC is instead OFF or otherwise not on the correct mode, processing goes to step S40. At step S40, the server sends an “ON” or “mode change” command to the HVAC system to correct the temperature (e.g. turn on heat or cool air generation).
The BCAS server then continues to step S41 to send an “open” command to the appropriate air-flow damper AD1 for the area served by TS1, to better effect the temperature change. Although not separately shown, the server and sensor TS1 will communicate, e.g. periodically, until the detected temperature is back within the appropriate range.
After the temperature corrects to within the tolerance given back in step S33, processing advances to step S42, in which the server queries the other temperature sensors (TSs) in the vicinity to determine at S43 if the temperatures that the other sensors detect are also within tolerance. If the temperatures are not within tolerance (No branch from S43), then the HVAC system is left to continue to run and AD1 is left open (step S44). If the temperatures that the other sensors detect are within tolerance (Yes branch from S43), then the server issues a command in step S45 to close the room's air flow dampers AD1-ADN and an “OFF” or “mode change” command in step S46 to the HVAC system, and the current processing operations end at step S47. Although not shown for convenience, the processing regarding TS1 and related controls returns to step S31 after S47.
As outlined in the discussions above, in a system like that shown in FIG. 1A, some functions may be implemented in the form of servers, for example, for central BCAS functions, for CO functions in support of system commissioning and/or for central connectivity to outside networks and equipment. Some or all of the intelligent system elements may have sufficient capabilities to be able to run such server programming in addition to performing other processing tasks for the normal functions of such elements. For example, a lighting device 11A′ or 11B′ may be configured to operate as a server 57 for BCAS, CO and/or other controller purposes, in addition to operating as a lighting device. To the extent that a server task for such a centralized service is amenable to resource sharing type distributed processing, the element also configured as a server may distribute the server processing task to other elements, in essentially the manner described above relative to FIG. 2.
However, the system may implement an additional form of distributed processing with respect to such server functionality. A single instance of a server running on one system element may at times be stressed by high processing demands. Also, a system that utilizes a single server instance for a crucial system function or service may be vulnerable to interruptions, e.g. if there is a failure of the element or of communication with the element running the server instance. To address such possible concerns, a system 10 can run some number of separate instances of a particular server functionality, in parallel with one another on multiple intelligent system elements. Each such server instance would utilize a copy of the relevant server programming and a copy of any data or database needed for the particular system service. Use of multiple instances of the servers may also speed up response time when interacting with clients implemented on the other system elements.
To the extent that data used by the server functionality may change over time of operation of the system 10, the server instances would coordinate with each other to update the copy of the data/database at or used by each instance of the server, e.g. to maintain synchronism as between multiple instances of the relevant data. FIG. 4 is a simplified illustration of such an arrangement. Alternatively, the data used by the server functionality may be stored in a distributed manner across multiple elements (e.g. as distributed hash tables) to minimize the synchronization operations.
In the example, two of the lighting devices 11A′ and 11B′ run instances 57A and 57B of server programming for execution by processors 21A and 21B thereof. The server instances 57A, 57B configure those lighting devices 11A′, 11B′ to operate in a distributed processing fashion to implement a server function with respect to an overall processing functionality of the system and related server communications via the data communication network, generally represented again by the cloud 51. For example, the instances 57A and 57B may include server programming for a BCAS function for overall control of the system 10 at the premises 12.
The server program instances 57A, 57B are represented generally by icons similar to hardware devices such as server computers; but the program instances 57A, 57B are actually server programming stored in memories 23A, 23B for execution by the processors 21A, 21B (hence, the servers 57A, 57B are shown in dotted line form). As outlined earlier, the overall processing function of the system implemented by such server instances may relate to a CO functionality, some type of controller service, or a central communication function/service. Also, although only two instances of the server program are shown, there may be any appropriate number of such instances for implementation of a particular function or service in a system of a particular size and/or complexity. The lighting devices 11A′ and 11B′ are shown in this drawing as examples of intelligent system elements that may store and execute server programming instances. It should be noted, however, that any of the intelligent sensors, intelligent utility building control and automation system elements, user intelligent interface devices or other intelligent elements of the system 10 (FIG. 1A) communicating through the on-premises data network of the system 10 may store and execute a server programming instance instead of or in addition to one or both of the intelligent lighting devices 11A′ and 11B′. One set of server instances may implement the server-side aspects and communications with respect to one or any number of overall system functionalities. However, other overall processing functionalities of the system 10 may utilize server program instances stored in and executed on other system elements. At least with respect to the particular overall processing function of the system 10 supported by the server program instances 57A, 57B, the server program instances 57A, 57B interact with some number of other intelligent system elements represented generically by the boxes at 61. The other elements can be any of the types of intelligent system elements discussed above and will include at least a processor 63, a memory 65 and a communication interface, which may be similar to components of the intelligent system elements discussed with regard to the earlier drawings.
As shown in FIG. 4, various other intelligent system elements 61 will include client programming stored in memories 67 thereof for execution by the processors 63 of the other intelligent system elements 61, to configure each of the other intelligent system elements 61 to implement a client function with respect to the overall processing functionality of the system supported by the server instances 51A, 57B. The client programming 69 will also support related client communications with the server function implemented by the instances of the server programming 57A, 57B on the lighting devices 11A′, 11B′ in our example. Hence, the drawing shows arrows through the network for client-server communications between the server instances 57A, 57B and the clients 69 at the intelligent system elements 61.
In a multi-instance server implementation such as shown in FIG. 4, any one server may be able to perform on its own to handle client-server interactions with one or more elements 61 independently of the other server instance(s), while each the other server instance(s) independently handles other client-server interactions. To the extent that they relate to the same overall system function, however, they will often use or process some of the same data. For example, if a particular overall processing functionality of the system involves a database, all of the relevant server instances will manipulate that same database. In our two instance server example, to insure that both instances of the server programming 57A, 57B have access to the same state of the database if or when necessary, the server instances 57A, 57B will communicate with each other through the data communication network 51 to synchronize any separate copies of the database maintained by or for the individual server instances 51 A, 57B, as represented by the Sync arrow between the server instances 57A, 57B. Any appropriate data synchronizing technique may be used.
The use of multiple server instances allows for server load distribution across multiple hardware platforms of intelligent elements of the system. The use of multiple server instances may also provide redundancy in the event of impairment or failure of a system element or communications to an element executing one of the server instances. Various load distribution and/or fail-over techniques may be used.
FIG. 5 is a logical diagram of a program stack, for programming which may be used in intelligent system elements for an implementation of a building control and automation system such as that discussed so far.
At its most basic level, a processor may be considered or modeled as a state machine, as shown at the lowest layer of the stack in FIG. 5. In its simplest form, a state machine will switch between states in response to different sets of signals or values on its inputs. Core processing functions may be just above but near to the state machine level. The core function layer, for example, may implement the driver and/or interface functions for converting between the inputs and outputs of the state machine and the signals produced by or used to drive any input and/or output components of the intelligent system element. The core functions also provide a program interface between the state machine and the higher level programming.
Logically speaking, several layers of software programming run on top of the state machine and core processor functions, in our example. The next highest layer may be a real-time operating system (RTOS) configured to service real-time application requests or interrupts, or the next layer may be a more computer-like operating system (OS). The top two layers in the exemplary stack represent applications running on top of and thus through the operating system layer. Part or a sub-layer at the applications level of the exemplary stack is for applications for advanced operations (Ops). Resource sharing type distributed processing, such as discussed above relative to FIG. 2, for example, may be implemented via an advanced ops program application.
The top layer of the stack is a general application layer. Any of a wide variety of applications may reside and run at this layer of the logical program stack. The CO/controller services and the responsive operations of the system elements may be implemented at the application layer. Hence, the top layer in our example includes some applications by or controlled by the system vendor, for example, to support system services that the vendor designs the system to provide. For example, the vendor application layer may include the client 69 and/or a server instance 57A or 57B for a particular CO, controller or communication service of the system 10.
For some purposes, the protocol stack and aspects of the programming/configuration at various layers are defined and secured by the system manufacturer. It is envisioned that the system 10 will be open to third party application and/or device developers. In an open system, third parties will be able to build devices that utilize the system and its protocols for operation including interactions with elements provided by the system manufacturer. In such a system, the system manufacturer may opt to allow third parties some access to program or otherwise interact at various layers of the stack, for example, to allow third parties to manufacturer and sell other elements or devices for use on the system and/or to allow third parties to write applications for the system. Hence, the highest layer in our example also may include applications (Apps) by other providers, for example, third party software developers. Manufacturers of other elements intended for operation on or through the system are allowed to write application layer programming for their own CO/controller services and for system elements like the luminaires by the system vendor to allow the system vendor's elements to interact with elements on the system developed by other vendors. The other applications also may include client and/or server programming but for other services or functions deployed on the system using software developed by other entities.
In the discussion of programming, it was assumed that the resource sharing type distributed processing (e.g. of FIG. 2) was implemented at the advanced ops application layer of the stack. The CO/controller services and the responsive operations of the system elements are implemented at the application layer. Actual implementations, however, may involve CO/controller service implementation or include functionalities at other layers of the stack with corresponding functionalities at the same layer of the stack in the other system elements. In such a case, the system manufacturer would still have portions of the programming and configuration routine at those layer(s) limited to that manufacturer's programs, devices and personnel. However, so long as not interfering with the manufacturer's functionalities and configuration data at the particular layer(s), third parties may be allowed to program and establish configuration at the same protocol layer(s) for their own purposes.
The open approach, for example, may also enable a customer that will own or occupy a particular premises having a system 10 to purchase and install third party devices and/or to purchase additional programming for desired functions different from (or possibly competing with) those offered by the system manufacturer. The degree of third party access to the layers of the program stack may vary amongst third party vendors. A trusted or ‘certified partner’ may have access to more layers, whereas non-certified third parties may only be allowed to connect to the media and write application layer programming that otherwise conforms to the application layer programming interfaces to the lower layers of the stack.
Users of different types may also be granted access to different amounts of the program stack. For example, a government entity with a high degree of sophistication and a need for security may have greater access to control its system, whereas a small business enterprise may only be allowed access to adjust the commissioning/configuration at the application level.
As shown by the above discussion, at least some functions of devices associated or in communication with the networked building control and automation system 10 of FIG. 1A, such as elements 53 and 55, may be implemented with general purpose computers or other general purpose user terminal devices, although special purpose devices may be used. FIGS. 6-8 provide functional block diagram illustrations of exemplary general purpose hardware platforms. Many of the functions of the intelligent system elements are implemented by programming for execution by the processors of such elements, to achieve functions and methods of operation as discussed above. Such programming typically resides in memory of the elements at time of execution. However, for installation of the programming or upgrades thereof, the element programming may be downloaded from computers or the like, via transportable media or more likely via network communication. When programming is downloaded via network communication, it typically stored in and sent over the network from a computer. Although such a download system could use a purpose built architecture, such a download system typically will also utilize a general purpose computer.
FIG. 6 illustrates a network or host computer platform, as may typically be used to implement a host or server, such as the computer 53. FIG. 7 depicts a computer with user interface elements, as may be used to implement a personal computer or other type of work station or terminal device, such as one of the terminal 55 in FIG. 1A, although the computer of FIG. 7 may also act as a server if appropriately programmed. The block diagram of a hardware platform of FIG. 8 represents an example of a mobile device, such as a tablet computer, smartphone or the like with a network interface to a wireless link, which may alternatively serve as a user terminal device like 55. It is believed that those skilled in the art are familiar with the structure, programming and general operation of such computer equipment and as a result the drawings should be self-explanatory.
A server (see e.g. FIG. 6), for example, includes a data communication interface for packet data communication via the particular type of available network. The server also includes a central processing unit (CPU), in the form of one or more processors, for executing program instructions. The server platform typically includes an internal communication bus, program storage and data storage for various data files to be processed and/or communicated by the server, although the server often receives programming and data via network communications. The hardware elements, operating systems and programming languages of such servers are conventional in nature, and it is presumed that those skilled in the art are adequately familiar therewith. Of course, the server functions may be implemented in a distributed fashion on a number of similar platforms, to distribute the processing load.
Also, a computer configured as a server with respect to one layer or function may be configured as a client of a server in a different layer and/or for a different function. In a similar fashion, a central function or service 57 implemented as a server functionality with respect to client programming/functionality of intelligent system elements at premises 12 may itself appear as a client with respect to a server in a different layer and/or for a different function. For example, the service 57 may appear as a client of a server functionality provided by an external host or other computer 53, although the central function or service 57 may also appear as a server to on-premises or external user terminal devices such as 55.
A computer type user terminal device, such as a desktop or laptop type personal computer (PC), similarly includes a data communication interface CPU, main memory (such as a random access memory (RAM)) and one or more disc drives or other mass storage devices for storing user data and the various executable programs (see FIG. 7). A mobile device (see FIG. 8) type user terminal may include similar elements, but will typically use smaller components that also require less power, to facilitate implementation in a portable form factor.
The example of FIG. 8 includes a wireless wide area network (WWAN) transceiver (XCVR) such as a 3G or 4G cellular network transceiver as well as a short range wireless transceiver such as a Bluetooth and/or WiFi transceiver for wireless local area network (WLAN) communication. The computer hardware platform of FIG. 7 and the terminal computer platform of FIG. 7 are shown by way of example as using a RAM type main memory and a hard disk drive for mass storage of data and programming, whereas the mobile device of FIG. 8 includes a flash memory and may include other miniature memory devices. It may be noted, however, that more modern computer architectures, particularly for portable usage, are equipped with semiconductor memory only.
The various types of user terminal devices will also include various user input and output elements. A computer, for example, may include a keyboard and a cursor control/selection device such as a mouse, trackball, joystick or touchpad; and a display for visual outputs (see FIG. 7). The mobile device example in FIG. 8 touchscreen type display, where the display is controlled by a display driver, and user touching of the screen is detected by a touch sense controller (Ctrlr). The hardware elements, operating systems and programming languages of such computer and/or mobile user terminal devices also are conventional in nature, and it is presumed that those skilled in the art are adequately familiar therewith.
Although FIGS. 6-8 in their present form show computers and user terminal devices, generally similar configurations also may be used within other elements of the building control and automation system 10. For example, one implementation of the brain, communication and interface elements of a lighting device or of a standalone sensor, a user interface device or other type of intelligent utility building control and automation element may utilize an architecture similar to that of one of the computers or mobile terminals. As a more specific example, the personal computer type hardware in FIG. 7 (except for the keyboard, mouse and display) could serve as the brain and communication elements of a lighting device, where the input/output interface I/O would interface to an appropriate light driver and to any sensor(s) or other enhancement input or output device(s) included within the lighting device. The brain and communication components of any of the intelligent utility building control and automation elements could be similarly built over or around elements of the personal computer type hardware. As another example of use of an architecture similar to those of FIGS. 6-8 that may be utilized in a system like that of FIG. 1A, a building controller or other user interface device (UI) might utilize an arrangement similar to the mobile device of FIG. 8, albeit possibly with only one transceiver compatible with the networking technology of the particular premises (e.g. to reduce costs).
For information about other examples of intelligent lighting devices, which may be suitable for use in a networked building control and automation system like that of FIG. 1A, attention may be directed to U.S. application Ser. No. 13/463,594 Filed May 3, 2012 entitled “LIGHTING DEVICES WITH INTEGRAL SENSORS FOR DETECTING ONE OR MORE EXTERNAL CONDITIONS AND NETWORKED SYSTEM USING SUCH DEVICES,” the disclosure of which is entirely incorporated herein by reference.
As also outlined above, aspects of the building control by one or more lighting devices and/or of the distributed processing techniques (e.g. of FIG. 2, FIG. 3A and/or FIG. 4), may be embodied in programming of the appropriate intelligent system elements. Program aspects of the technology discussed above therefore may be thought of as “products” or “articles of manufacture” typically in the form of executable code and/or associated data (software or firmware) that is carried on or embodied in a type of machine readable medium. “Storage” type media include any or all of the tangible memory of the computers, processors or the like, or associated modules thereof, such as various semiconductor memories, tape drives, disk drives and the like, which may provide non-transitory storage at any time for the software or firmware programming. All or portions of the programming may at times be communicated through the Internet or various other telecommunication networks. Such communications, for example, may enable loading of the software from one computer or processor into another, for example, from a management server or host computer 53 of the building control and automation system service provider into any of the lighting devices, utility building control and automation system elements, sensors, user interface devices, etc. of or coupled to the system 10 at the premises 12, including both programming for individual element functions and programming for distributed processing functions. Thus, another type of media that may bear the software/firmware program elements includes optical, electrical and electromagnetic waves, such as used across physical interfaces between local devices, through wired and optical landline networks and over various air-links. The physical elements that carry such waves, such as wired or wireless links, optical links or the like, also may be considered as media bearing the software. As used herein, unless restricted to non-transitory, tangible “storage” media, terms such as computer or machine “readable medium” refer to any medium that participates in providing instructions to a processor for execution.
It will be understood that the terms and expressions used herein have the ordinary meaning as is accorded to such terms and expressions with respect to their corresponding respective areas of inquiry and study except where specific meanings have otherwise been set forth herein. Relational terms such as first and second and the like may be used solely to distinguish one entity or action from another without necessarily requiring or implying any actual such relationship or order between such entities or actions. The terms “comprises,” comprising,” “includes,” “including,” or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. An element proceeded by “a” or “an” does not, without further constraints, preclude the existence of additional identical elements in the process, method, article, or apparatus that comprises the element.
Unless otherwise stated, any and all measurements, values, ratings, positions, magnitudes, sizes, and other specifications that are set forth in this specification, including in the claims that follow, are approximate, not exact. They are intended to have a reasonable range that is consistent with the functions to which they relate and with what is customary in the art to which they pertain.
While the foregoing has described what are considered to be the best mode and/or other examples, it is understood that various modifications may be made therein and that the subject matter disclosed herein may be implemented in various forms and examples, and that the teachings may be applied in numerous applications, only some of which have been described herein. It is intended by the following claims to claim any and all applications, modifications and variations that fall within the true scope of the present teachings.

## Claims

1. A building control and automation system for a premises, comprising:
intelligent system elements, including:
intelligent lighting devices each including a light source,
intelligent utility building control and automation elements each including a controllable mechanism and associated drive electronics, and
either a user interface component configured as a controller, or a sensor including a detector;

wherein each respective intelligent system element further includes:
(a) a communication interface configured to enable communication via a link of a data communication network at the premises;
(b) a processor coupled to the light source, the drive electronics, the user interface component or the detector and coupled to communicate via the communication interface and the network link;
(c) a memory accessible to the processor; and
(d) programming in the memory which configures the processor to control operations of the respective intelligent system element as a lighting device, a utility building control and automation element, a controller or a sensor;

an instance of server programming stored in the memory of one of the intelligent lighting devices for execution by the processor of the intelligent lighting device, which configures the intelligent lighting device to implement a building control and automation system (BCAS) server function with respect to an overall building control and automation function of the system and related server communications with others of the intelligent system elements, via the data communication network, including for lighting and for other utility building control and automation functions; and
further comprising another instance of server programming stored in the memory of another one of the intelligent lighting devices for execution by the processor of the other intelligent lighting device, the server instances configuring the one and the other of the intelligent lighting devices to operate in a distributed fashion to implement the BCAS server function with respect to the overall building control and automation function of the system and related server communications on a distributed basis via the data communication network, including for lighting and other utility building control and automation functions.

2. The building control and automation system of claim 1, further comprising client programming, stored in memories of intelligent system elements other than the intelligent lighting device configured to implement the BCAS server function, for execution by processors of the other intelligent system elements to configure each of the other intelligent system elements to implement a client function with respect to the overall building control and automation function and related client communications with the building control and automation system server function implemented by the instance of the server programming.

3. The building control and automation system of claim 1, further comprising client programming stored in memories of intelligent system elements other than the intelligent devices configured to implement the BCAS server function, for execution by processors of the other intelligent system elements to configure each of the other intelligent system elements to implement a client function with respect to the overall building control and automation function and related client communications with the building control and automation system server function implemented by the instance of the server programming.

4. The building control and automation system of claim 1, wherein the overall building control and automation function implemented by the instance of server programming includes one or more of:
a non-lighting central building control and automation function of the system;
communication of the system with an external wide area communication network;
communication of the system with an external building control and automation service provider;
collection and/or distribution of element configuration data during intelligent system element commissioning operations.

5. The building control and automation system of claim 1, wherein the utility building automation and control system elements include elements each of which is an element from the group consisting essentially of: controllable heating, ventilation and air conditioning (HVAC) elements; fire or safety alarm elements; security system elements; access control elements; or commercial system elements.

6. The building control and automation system of claim 1, wherein at least one of the intelligent system elements:
includes a user interface component and is configured as a building controller; and
functions as an input to the intelligent lighting device acting as a server to cause the server instance to responsively adjust the overall building control and automation function.

7. A building control and automation system, comprising:
intelligent system elements, including: intelligent lighting devices each including a light source, and intelligent utility building control and automation elements each including a controllable mechanism and associated drive electronics;
wherein each respective intelligent system element further includes:
(a) a communication interface configured to enable communication via a link of a data communication network available to the intelligent lighting devices;
(b) a processor coupled to the light source or the drive electronics and coupled to communicate via the communication interface and the network link;
(c) a memory accessible to the processor; and
(d) programming in the memory which configures the processor to control operations of the respective intelligent system element as a lighting device a utility building control and automation element; and

programming in the memory of a respective one of the intelligent lighting devices which configures the processor to control operations of other intelligent lighting devices and controllable intelligent building control elements;
wherein, when the respective intelligent lighting device has a building control and automation job to perform using resources of others of the intelligent system elements, the programming further configures the processor of the respective intelligent lighting device to implement distributed processing functions, including functions to:
query other intelligent system elements and receive responses from the other intelligent system elements as to whether or not the other intelligent system elements have processing or memory resources available for the processing job;
based on the responses, allocate portions of the processing job to a plurality of the other intelligent system elements;
send data and instructions to each intelligent system element of the plurality of the other intelligent system elements, for performing an allocated portion of the processing job;
receive from at least some of the plurality of the other intelligent system elements results of the performance of the allocated portions of the processing job;
process the received results to determine an overall result of the processing job; and
perform a building control and automation action based on the overall result of the processing job.

8. The building control and automation system of claim 7, wherein the other intelligent system elements are others of the intelligent lighting devices.

9. The building control and automation system of claim 7, wherein the utility building control and automation system elements include elements each of which is an element from the group consisting essentially of: controllable heating, ventilation and air conditioning (HVAC) elements; fire or safety alarm elements; security system elements; access control elements; or commercial system elements.

10. The building control and automation system of claim 9, wherein the distributed processing functions implemented by the programming of the respective one of the intelligent lighting devices further includes functions to:
send data and instructions for an allocated portion of a processing job to equipment of an external building control and automation service provider, for performing an allocated portion of the processing job;
receive from the equipment of the external building control and automation service provider results of the performance of the allocated portions of the processing job; and
include the results received from the equipment of the external building control and automation service provider in the processing to determine the overall result of the processing job.

11. The building control and automation system of claim 7, wherein the programming in the memory of one of the respective intelligent lighting devices implements an instance of server programming for execution by the processor of the intelligent lighting device, which configures the respective one intelligent lighting device to implement a building control and automation system server function with respect to an overall building control and automation function of the system.

12. The building control and automation system of claim 11, wherein the overall function implemented by the instance of server programming in the one respective intelligent lighting device includes one or more of:
a non-lighting central building control and automation function of the system;
communication of the system with an external wide area communication network;
communication of the system with equipment of an external building control and automation service provider; and
collection and/or distribution of element configuration data during intelligent system element commissioning operations.

13. A building control and automation system, comprising:
intelligent system elements, including:
intelligent lighting devices each including a light source,
intelligent utility building control and automation elements each including a controllable mechanism and associated drive electronics, and
either a user interface component configured as a controller, or a sensor including a detector;

wherein each respective intelligent system element further includes:
(a) a communication interface configured to enable communication via a link of a data communication network;
(b) a processor coupled to the light source, the drive electronics, the user interface component or the detector and coupled to communicate via the communication interface and the network link;
(c) a memory accessible to the processor; and
(d) programming in the memory which configures the processor to control operations of the respective intelligent system element as a lighting device, a building automation element, a controller or a sensor; and

distributed processing programming stored in memories of respective ones of a plurality of the intelligent system elements including a plurality of the intelligent lighting devices, wherein execution of the distributed processing programming configures the processor of the respective intelligent system element to implement distributed processing functions, including functions to:
when another of the intelligent system elements acting as a central controller of one or more overall functions of the building control and automation system has a building control and automation processing job to perform on a distributed basis:
respond to an inquiry received from the other intelligent system element via the network by sending a response with information identifying processing resources of the processor and/or resources of the memory available for distributed processing via the network to the other intelligent system element;
receive data and instructions for performing a portion of the building control and automation processing job from the other intelligent system element via the network;
process the received data in accordance with the instructions using resources of the processor and/or memory of the respective lighting device; and
send a result of the processing via the network to the other intelligent system element.

14. The building control and automation system of claim 13, wherein the utility building control and automation system elements include elements each of which is an element from the group consisting essentially of: controllable heating, ventilation and air conditioning (HVAC) elements; fire or safety alarm elements; security system elements; access control elements; or commercial system elements.

15. The building control and automation system of claim 13, further comprising programming to configure the processor of said another of the intelligent system element so that the said another of the intelligent system element implements further system functions, including functions to:
if the intelligent system elements with distributed processing programming stored on their memories have insufficient resources to entirely perform the processing job,
send data and instructions for an allocated portion of the processing job to equipment of an external building control and automation service provider, for performing an allocated portion of the processing job;
receive from the equipment of the external building control and automation service provider results of the performance of the allocated portions of the processing job;
process the results received from the equipment of the external building control and automation service provider together with results received from other intelligent system elements to determine an overall result of the processing job; and
perform a building control and automation action based on the overall result of the processing job.

16. The building control and automation system of claim 13, wherein at least one of the intelligent system elements:
includes a user interface component and is configured as a building controller; and
functions as an input to cause another of the intelligent system elements to responsively adjust the overall building control and automation function.