Lambeth Bridge is on the site of a horse ferry between the Palace of Westminster and Lambeth Palace on the south bank .
On the east side of the bridge is the London Borough of Lambeth and Lambeth Palace which is the official London residence of the Archbishop of Canterbury .