Question: is the width how wide?
Answer: Think of how you would describe the distance along a road: it is the long distance, the length of the road. (The words along, long, and length are all related.) ... It is then perfectly correct to describe how wide the rectangle is from side to side by using the word width.