Depending on many factors, deer antlers can either get bigger or smaller each year. If conditions are healthy and food, water, and sunlight are in abundance, deer may grow bigger antlers the following year. If deer are malnourished and under stress, the antlers may not have the proper nutrients to grow big and strong.