###### Abstract
Traditional functional testing often overlooks unexpected behaviors, while penetration testing evaluates the system's security performance against attacks. The objective of penetration testing is to ensure consistency between the realization and design of security goals [15]. Investigating the penetration testing of ICVs holds significant importance in discovering cybersecurity vulnerabilities, reducing the likelihood of accidents, and safeguarding lives and property. Based on information acquired about the target of test (TOT), penetration testing can be categorized into white-box tests, gray-box tests, and black-box tests. In terms of the TOT, penetration testing in the field of ICVs can be divided into vehicle penetration testing (VPT) and in-vehicle system penetration testing (IVSPT). Among these test scenarios, black-box VPT is considered most complex. On one hand, testers have limited access to public information about the TOT during black-box penetration testing scenarios. On the other hand, compared to in-vehicle systems, vehicles have fewer external interfaces available to access. The limited availability of information and interfaces poses significant challenges to conducting comprehensive black-box VPT research as follows. Firstly, the absence of a standardized cybersecurity testing process in the automotive industry hinders the formalization of black-box VPT. Although the utilization of penetration testing for identifying potential cybersecurity vulnerabilities has emerged as a crucial cybersecurity practice, the execution process of conducting penetration testing varies across different organizations. The absence of a standardized penetration testing process within the automotive industry results in the inexperienced testers lacking guidance on how to initiate such security assessments. Secondly, due to the intricate structure of ICVs, testers require advanced expertise to conduct VPT effectively. The development of penetration testing schemes may vary among testers with different levels of experience, leading to divergent conclusions in cybersecurity evaluations. In the absence of proper guidance, inexperienced testers lack the knowledge to select and execute appropriate test cases for a systematic evaluation of vehicle cybersecurity. Additionally, due to the emerging nature of the technology field, there is a dearth of an integrated cybersecurity testing platform for comprehensive penetration testing of entire vehicles in the automotive industry. The automotive architecture is highly intricate, encompassing over 100 cybersecurity test cases. Without an integrated platform to manage and guide numerous penetration testing tasks, it becomes arduous to effectively execute and oversee penetration testing and management endeavors. Cybersecurity is an emerging technological domain within the automotive industry. Traditional automobile manufacturers are still grappling with the challenges of transitioning towards intelligence and electrification, resulting in limited investment in cybersecurity initiatives. However, as automotive cybersecurity laws, regulations, and technical standards are gradually being implemented, both manufacturers and suppliers find themselves confronted with a significant contradiction between the demand for penetration testing and the shortage of skilled personnel. Addressing key challenges associated with penetration testing and proposing a systematic guidance framework for cybersecurity testing to facilitate efficient standardized black-box VPT have become crucial strategies to resolve the contradiction between penetration testing requirements and technician shortages. The above motivation behind this paper leads to the proposal of the black-box penetration testing framework (ICVTest). The main contributions of ICVTest are as follows:  
At first, ICVTest introduces a standardized six-step process to address the issue of testers lacking guidance when conducting VPT with limited information.