Simplicity, complexity and chaos are the subjects of The Collapse of Chaos by Jack Cohen and Ian Stewart. Part one is a brief history of science and its methodology. Part two examines the limitations of static reductionism.
Humans naturally seek simplicity.
Complexity is endemic. Chaos theory says that minor events can have major consequences. Context constrains the possibilities for simplification. Which simplicity actually emerges depends on the dynamics of the immediate environment. Although this book is long, it is very well written and rich in informative perceptions.