Yes, birds are very sensitive to changes in their environment, and even moving the nest a few feet can be enough to stress them out.