Build additional houses and upgrade existing ones to increase your miner population. Construct markets and taverns nearby to attract more miners.