Ye came from a scholarly family in Hubei province, son of Ye Zhishen 葉志詵 and a connoisseur of antiquities. He was awarded the "juren" 舉人 degree in 1835, the "jinshi" 進士, or highest degree, in 1837, after which he briefly held the position of compiler in the imperial elite school, the Hanlin Academy 翰林院. In 1838, Ye received his first official appointment as prefect of Xing'an in Shaanxi province and he subsequently rose rapidly through the ranks in the Qing civil service. In the following years he served as circuit intendant of Yanping in Shanxi province, salt inspector in Jiangxi, surveillance commissioner in Yunnan and financial commissioner first in Hunan, later in Gansu and finally Guangdong province, of which he became governor in 1848, just as the Taiping Rebellion was breaking out.