In short, the answer is yes, you can build muscle with just dumbbells. In addition to building muscle mass, dumbbells help with balance, muscle imbalances, and coordination. In order to build lean muscle, you can use a combination of heavy and light dumbbells.