If the Agreement allows the Overlord to construct a Holding, then they'll be able to do so by selecting their Vassal's capital planet and going to the Holdings tab, or directly through the Agreements tab on the Contacts screen.