No, you can build a village any time you want, but the cost of building a village is lowest during the village master and village mania event.