During off-season training, swimmers may need to adjust their caloric intake based on training intensity and frequency changes. They should maintain a balanced diet to support overall health while monitoring portion sizes to prevent unwanted weight gain.