## 3 Proposed System
### Detail Implementation Flow
#### 3.3.2 Phase Two
Crucially, our method demonstrates the potential to address the cold-start issue by offering well-informed recommendations despite having minimal user data. The efficacy of our integrated method is shown by its capacity to find the most favorable cumulative reward, resulting in a significant improvement in the overall performance of the system. This combination of sophisticated methodologies not only establishes a fresh benchmark in recommendation systems but also opens up possibilities for future advancements in this domain. Conceptualization, S.P., D.-S.P. and D.-Y.K. ; methodology, S.P. ; validation, S.P., S.S. and S.I. ; analysis and interpretation of results: S.P., D.-S.P. and D.-Y.K. ; writing--original draft preparation, S.P. ; writing--review and editing, D.-S.P. ; supervision, D.-S.P. and D.-Y.K. ; funding acquisition, D.-S.P. All authors have read and agreed to the published version of the manuscript. This research was supported by the National Research Foundation of Korea (grant number NRF-2022R1A2C1005921) and BK21 FOUR (Fostering Outstanding Universities for Research; grant number 5199990914048). Not applicable. ## References

* [PERSON] et al. (2017) [PERSON]; [PERSON]; [PERSON]; [PERSON]; [PERSON] Online serendipity: The case for curated recommender systems. _Bus. Horiz._**2017**, _60_, 613-620. [CrossRef]
* [PERSON] and [PERSON] (2015) [PERSON]; [PERSON]; [PERSON] Survey on collaborative filtering, content-based filtering and hybrid recommendation system. _Int. J. Comput. Appl._**2015**, _110_, 31-36. * [PERSON] et al. (2020) [PERSON]; [PERSON]; [PERSON]; [PERSON] Recommendation system using autoencoders. _Appl. Sci._**2020**, _10_, 5510. [CrossRef]
* [PERSON] (2023) [PERSON]; [PERSON]; [PERSON] [PERSON] A review on reinforcement learning for contact-rich robotic manipulation tasks. _Robot. Comput.-Integer. Manuf._**2023**, _81_, 102517. [CrossRef]
* [PERSON] and [PERSON] (2020) [PERSON]; [PERSON] Deep learning for high-dimensional reliability analysis. _Mech. Syst. Signal Process._**2020**, _139_, 106399. [CrossRef]
* [PERSON] et al. (2016) [PERSON]; [PERSON]; [PERSON]; [PERSON] Hierarchical deep reinforcement learning: Integrating temporal abstraction and intrinsic motivation. _Adv. Neural Inf. Process. Syst._**2016**, _29_, 3682-3690. * [PERSON] and [PERSON] (2015) [PERSON]; [PERSON] The moviegn datasets: History and context. _Acm. Trans. Intenet. Intell. Syst._**2015**, \(5\), 1-19. [CrossRef]
* [PERSON] et al. (2019) [PERSON]; [PERSON]; [PERSON] Personalized movie recommendation system combining data mining with the k-clique method. _J. Inf. Process. Syst._**2019**, _15_, 1141-1155. * [PERSON] et al. (2022) [PERSON]; [PERSON]; [PERSON]; [PERSON]; [PERSON]; [PERSON]; [PERSON] A Modern Recommendation System Survey in the Big Data Era. In _International Conference on Computer Science and Its Applications and the International Conference on Ubiquitous Information Technologies and Applications_; Springer Nature Singapore: Singapore, 2022; pp. 577-582. * [PERSON] et al. (2021) [PERSON]; [PERSON]; [PERSON] Advances in collaborative filtering. In _Recommender Systems Handbook_; Springer: New York, NY, USA, 2021; pp. 91-142. * [PERSON] et al. (1992) [PERSON]; [PERSON]; [PERSON]; [PERSON] Using collaborative filtering to weave an information tapestry. _Commun. ACM_**1992**, _35_, 61-70. [CrossRef]
* [PERSON] et al. (2009) [PERSON]; [PERSON]; [PERSON] Matrix factorization techniques for recommender systems. _Computer_**2009**, _42_, 30-37. [CrossRef]
* [PERSON] et al. (2016) [PERSON]; [PERSON]; [PERSON]; [PERSON] Factorization meets the item embedding: Regularizing matrix factorization with item co-occurrence. In Proceedings of the 10 th ACM Conference on Recommender Systems, Boston, MA, USA, 15-19 September 2016; pp. 59-66. * [PERSON] et al. (2018) [PERSON]; [PERSON]; [PERSON]; [PERSON] Regularizing matrix factorization with user and item embeddings for recommendation. In Proceedings of the 27 th ACM International Conference on Information and Knowledge Management, Torino, Italy, 22-26 October 2018; pp.