If they are filled with helium, balloons float because this gas has a lower density than that of Earth's atmosphere. Hydrogen would be an even better choice, but it tends to ignite.
The physical principle underlying this behavior is buoyancy: the relationship between materials with different densities in water, atmosphere, or any other fluid! Read more