Since too much heat and light can impact the quality of the oil, it's best to store baby oil in a cool, dark place. This can be as simple as a closet or dresser drawer.
You'll also want to remember to keep the lid on so that air and water don't get in causing the oil to change consistency or evaporate.