As well as class, age was a factor as well.  It is easier to see what is going on in Calvinist-dominated Dutch portraiture of the period, especially as unlike England, they have genre paintings where the middle classes are not dressed up in their best black suits.