Li Sheng was from Nanyang Commandery (), which is around present-day Nanyang, Henan. His father, Li Xiu (), was formerly a subordinate of the warlord Zhang Lu. After the Battle of Yangping in 215, Li Xiu switched allegiance to the warlord Cao Cao and eventually came to serve in the Cao Wei state during the Three Kingdoms period.