Patent ID: 11881993
Assignee: EOH LIMITED LIABILITY COMPANY
Field: Digital communication (Electrical engineering)
Classification: CPC H  G | IPC G  H

Claim 4:
5. The system of claim 4 wherein said at least one IoT server further comprises:
a Q-function data storage configured to store said future reward equation Q(s,a) and said Q-loss function;
a value data storage for storing power consumption and bandwidth for each of said plurality of IoT devices in said action map {ai}; and
a processor for executing a deep reinforcement module operable to:
(i) generate said action map {ai};
(ii) receive observations regarding bandwidths and power consumptions and calculate said reward function Rt, said, argmax
     
      a
      t
     
    
   
   ⁢
   
    Q
    ⁡
    (
    
     s
     ,
     a
     ,
     π
    
    )
   
  
  ;
 

(iii) if said, argmax
    
     a
     t
    
   
  
  ⁢
  
   Q
   ⁡
   (
   
    s
    ,
    a
    ,
    π
   
   ), is not achieved, then select another action map {ai} that has the highest probability of achieving, argmax
    
     a
     t
    
   
  
  ⁢
  
   Q
   ⁡
   (
   
    s
    ,
    a
    ,
    π
   
   ), that meets both said bandwidth and power consumption requirements; otherwise, use said action map {ai} to program a webapp configuration program.