Perhaps the first difference between a handbag and a shoulder bag is the size, and that's what people think of first when talking about it. Another difference is in the number of straps, and although a shoulder bag can sometimes have two, it usually has one, while a handbag has two.