To store bumper plates, place them vertically on a sturdy rack or storage system designed specifically for bumper plates.