Eating less on rest days is a personal choice. If your training is long or intense, structuring your calorie intake so that you eat more on workout days and less on rest days may support your energy levels and performance. It's important to understand that recovery also requires nutrients, so do not decrease your calories too much on rest days. Try consuming less on rest days if you feel you need more food on training days and see how you feel.