Under the Umayyads the Caliphate grew rapidly geographically .
Under the Umayyads , the Caliphate grew rapidly in territory .