Clue: Agree let for building and move to a worse place (8)
Answer: RELEGATE
Explanation: Definition: move to a worse place
(Agree let)