No. Loafers with socks are never out of fashion. It is completely up to to you and your attire whether you would like to wear it with or without socks.