# A Distributed Intelligent Lighting Control System Based on Deep Reinforcement Learning
## 2 Proposed Methodologies
### Designing of a Distributed Smart Lighting System Framework  
With the development of Building Automation Systems (BASs) [32] and IoT technologies, it is proposed that intelligent buildings will meet the requirements of modern building management. Due to the limitations of hierarchical and centralized system architectures, intelligent buildings are not well-suited to the increasing complexity of contemporary structures. Although BASs employ cloud and edge computing to the control process [33], these technologies still provide customized services and functionality by uploading data to central or cloud servers on a centralized framework [34]. Due to its low flexibility, poor dependability, and difficulty in portability, this centralized framework has resulted in a dearth of intelligent building systems that are operational for extended periods. As a consequence, the majority continue to rely heavily on manual control techniques.  
In order to surmount the issues caused by centralized architectures, this paper employs a distributed open-source system for intelligent buildings [35]. This open-source platform for intelligent building control has a fully distributed architecture based on the natural bee colony activity model. It is resilient, without a central host or global leader, and does not rely on a fixed topology. Each intelligent node functions as a \"bee\" in this system. It can exchange information with its neighbors, such as by accumulating and uploading local data and transmitting and receiving control commands. The intelligent nodes not only function as information transmitters during the running process but also facilitate the processing of local data, participate in distributed computation and decision making, etc. Each intelligent node has the same hardware structure but is responsible for various tasks and will perform those tasks based on its \"genes\". Even though the quantity of work that can be accomplished by a single individual is very small, the \"colony kingdom\" is able to function in an orderly manner due to the cooperation of multiple individuals.  
There are two categories of intelligent nodes in this system, each corresponding to a different type of task: the lighting control node and blinds control node. The root node of a single room that is connected to the root nodes of other rooms is the lighting control node, which is responsible for the optimal control of the lighting. The blind control nodes are leaf nodes within a single room that are responsible for the optimal control of the blinds' angle. Their number is equal to the number of windows within the room. As depicted in Figure 1, this distributed framework manages the indoor environment using two categories of intelligent nodes in a single room. Due to the distributed system's exceptional flexibility and scalability, the applications are universal and the control process is not restricted to a particular building structure. Therefore, there is no need to develop custom programs for various spaces, and distributed applications can be downloaded and executed directly from the intelligent nodes. Using a single room as an illustration, this paper describes how blinds and luminaires work together to maintain room lighting levels within the proper zone.