Australian men are working much less than even 20 years ago.