If you disturb their nest, they might initially scarper, but there's a good chance they'll come back if the conditions are still right. They are creatures of habit and once they've found a spot they like, they tend to stick to it. So, while a bit of a disruption might make them think twice, it's not a guaranteed solution to your rat problem.