More linear/polynomial fitting. Month-by-month is 'legal' for competition.
Decision trees provide much better results. Try PCA to address overfitting.