When you get down to it, our brains are essentially computers that are programmed in certain ways, take in data, and spit out instructions. We can program the logic in both the computer that is our mind and the computer that is our tool so that they can work together and even double-check each other. Doing that is fabulous.

For example, suppose we were trying to derive the universal laws that explain species change over time. Theoretically, with enough processing power and time, this should be possible. We would need to make sense of the formulas the computer produces, of course, to make sure that they are not data-mined gibberish, by which I mean based on correlations that are not causal in any way. We would do this by constantly simplifying these rules until their elegance is unmistakable.

Of course, given our brain’s limited capacity and processing speed, it could take us forever to achieve a rich understanding of all the variables that go into evolution. Is all the simplifying and understanding that we employ in our expert systems truly required? Maybe not. There is certainly a risk that changes not in the tested data might still occur. But one might argue that if our data-mining-based formulas seem able to account for the evolution of all species through all time, then the risks of relying on them for just the next ten, twenty, or fifty years is relatively low compared to the benefits of having a formula that appears to work but is not fully understandable (and that, at the very least, might prove useful in helping scientists cure genetic diseases).
