Lipo batteries are indeed composed of individual cells. Each cell has a positive and negative terminal, and when these cells are connected in series, they form a battery. The voltage of a lipo battery is determined by the number of cells in the series - so, for example, a 3s lipo battery would have a voltage of 11.1v (3 x 3.7v per cell).