Question: can villagers go up ladders?
Answer: Villagers can climb ladders if they are in their path, like other mobs. This means if they walk into a ladder or a vine, they will climb it. However, in your case the villagers will not purposely climb up and down into the tree houses.