I don't recommend it. The fat content in whole milk is super important in an enriched dough like this. If you use a lower fat milk, the dough hydration will be slightly off. You will need to adjust by adding more flour to get the texture of the dough just right and the dough won't be as soft.