## 3 Proposed RL-HCPV
\begin{table}
\begin{tabular}{c c c c} \hline \hline
**Algorithm** &
\begin{tabular}{c} **Number of** \\ **Iterations (Epochs)** \\ \end{tabular} & **Population Size** & **Time** \\ \hline GA & 1000 iterations & 550 & 8 ms/step \\ ANN & 50 epochs & 256 & 2 ms/step \\ \hline \hline \end{tabular}
\end{table} 
Table 8: Statistics comparison of the simulated algorithms’ performance

**Nomenclature** \begin{tabular}{l l} \(C_{opr}\) & Operation costs \\ \(C_{pr}\) & power cost of the energy provided by the main grid \\ \(C_{PV}\) & PV panels cost in (\$/W) \\ \(Pr_{PV}^{msz}\) & installed PV power \\ \(C_{SB}\) & Battery cost in (\$/J) \\ \(CAP_{SB}^{max}\) & Battery capacity \\ \(C_{pr}\) & Utility power cost \\ \(Pr_{MG}^{j}\) (\(t\)) & Power fed or supplied by utility grid \\ \(\beta_{SH}/NSH\) & Dissatisfaction price for shiftable/non-shiftable appliance \\ \(Pr_{comp}^{mode(t)}\) & Power consumption at the mode \\ \(Pr_{SH}/NSH\),max & Power rating of the shiftable/non-shiftable appliance \\ \(Cs_{SH}/NSH\) & Cost of shiftable/non-shiftable appliances \\ CT(t) & Electricity tariff at time \(t\) \\ \(S_{SH,scheduled}\) & Start time of the shiftable appliance \\ \(S_{SH,updated}\) & Newly scheduled time of the shiftable appliance \\ \(Pr_{pop,t}\) & Net power generated by PV \\ \(Loc_{EV}\) & EV location \\ \(Pr_{comp}\) (t) & Power consumption of device n at time \(t\) \\ \(\hat{C}\) & Predicted consumption cost at time \(t\). \\ \(a_{pv}\) & Solar panels area \\ \(f_{pv}\) & PV efficiency \\ rt(t) & Solar irradiation \\ \(Pr_{pv}\) & PV fully satisfies the load \\ \(Pr_{EV}\) & Power generated from EV \\ \(Pr_{SB}\) & Power generated from SB \\ \(So_{Cint}\) & Initial state of charge \\ \(CAP_{EV}^{full}\) & Power capacity of the battery \\ \(\Delta Pr_{v2g}\) & Discharged power from the grid to charge the EV battery \\ \(Pr_{EV,min}\) & Minimum operating power \\ \(Pr_{EV,max}\) & Maximum operating power \\ \(L_{SB}(t)\) & Power storage level at time \(t\) \\ \(L_{SB,loss}\) & Power loss \\ T & Time interval in hours \\ \(Pr_{SB,ch/dch}\) (t) & Charging/ discharging power \\ \(f_{SB,ch/dch}\) & Efficiencies of the SB \\ \(\Delta Pr_{v2g}\) & Power fed to the grid. \\ \(\Delta Pr_{v2h}\) & Discharged power to the household appliances \\ h & Home \\ \(m_{SB,ch/dch}\) & Charging and discharging operation modes of the SB 0/1 \\ \(C_{Tul}\) & ToU price signal \\ \(C^{+}\) & Extra cost \\ SH/NSH & Shiftable/non-shiftable appliances \\ \(Pr_{NSH,max}\) & Power rating of each appliance in the shiftable class. \\ \(m_{sh}\) (t) & ON or OFF status of each appliance \\ \(C_{RTP,SH/NSH}\) & Real-time pricing for Shiftable/non-shiftable appliances \\ \(Pr_{EV}\) & Net stored power in the EV battery \\ \(Pr_{EV,int}\) & Initial stored power in the EV battery \\ \(Pr_{trip}\) & Total consumed power by the EV during the trip \\ \(P_{sh/nsh}\) & Power rating \\ \(P_{ch/dch}\) & Charging/discharging power \\ \(m_{V2H}\) & Status of the EV connection mode 0/1 \\ \(\gamma\) & Discount rate \\ r & reward \\ \(\epsilon\) & Learning rate \\ \(s_{t}\) & State \\ \(g\) & Action \\ \end{tabular} 

## References

* (1) [PERSON]; [PERSON]; [PERSON]; [PERSON] Analysis of Energy Consumption and Optimization Techniques for Writing Energy-Efficient Code. _Electronics_**2019**, \(8\), 1192. [CrossRef]
* (2) [PERSON]; [PERSON]; [PERSON]; [PERSON]; [PERSON] Systematic Review Analysis on Smart Building: Challenges and Opportunities. _Sustainability_**2022**, _14_, 3009. [CrossRef]
* (3) [PERSON]; [PERSON]; [PERSON]; [PERSON] [PERSON] A hierarchical energy efficiency optimization control strategy for distributed drive electric vehicles. _Proc. Inst. Mech. Eng. Part J. Automob. Eng._**2019**, _233_, 605-621. [CrossRef]
* (4) [PERSON]; [PERSON]; [PERSON]; [PERSON]; [PERSON] [PERSON] Comprehensive chassis control strategy of FWIC-EV based on sliding mode control. _Intell. Transp. Syst._**2019**, _13_, 703-713. [CrossRef]
* (5) [PERSON]; [PERSON]; [PERSON]; [PERSON] Dynamics integrated control for four-wheel independent control electric vehicle. _Int. J.