Swimmers have skinny legs because their legs are not actually working against the resistance of the water when they are swimming. All of that resistance is taken by the upper body. As a result, more muscle will be developed in the upper body than the lower body when you are swimming. You can balance your physique by doing lower body training in the gym.