Principality of Taranto
Walter was the son of Walter III of Brienne and Elvira of Sicily. Around the time of his birth, his father lost his bid for the Sicilian throne and died in prison. His inheritance of the Principality of Taranto and the County of Lecce was confiscated.