While a large following helps, it’s more important to build an engaged and relevant audience specific to your niche.