There should be systematic parallels between their abilities and those that are found in humans. It should not be acquired by slow, domain-general mechanisms of learning. My book The Number Sense is dedicated to proving these four points, as well as to exploring their consequences for education and for the philosophy of mathematics. In fact, solid experimental evidence supports the above claims, making the number domain one of the areas in which the demonstration of a biologically determined, domain-specific system of knowledge is the strongest. Here, I can only provide a few examples of experiments.
Animals have elementary numerical abilities.
For instance, rats can learn to press one lever for two events and another for four events, regardless of their nature, duration and spacing and whether they are auditory or visual. Animals also have elementary addition and subtraction abilities. These basic abilities are found in the wild, and not just in laboratory-trained animals. Years of training, however, are needed if one wants to inculcate number symbols into chimpanzees. Thus, approximate manipulations of numerosity are within the normal repertoire of many species, but exact symbolic manipulation of numbers isn't it is a specifically human ability or at least one which reaches its full-blown development in humans alone.