Bias includes the choice of hypothesis representation language, and the sequence in which hypotheses are considered. Bias can be domain-dependent or independent. The only satisfying answer I know is analogous to Pascal's wager. The theorem talks about a small space of hypotheses. But, the theorem provides no way of choosing between different small spaces.
Simplicity is in the eye of the beholder.
All evidence so far observed in favor of emeralds being green is also evidence that they are grue. The simple equations of physics have compex solutions. Most phenomena of chemistry, biology, psychology, etc., even when organized and generalized, remain complex. Occam's razor may not be a claim about the external world, but only an aid for our limited minds. Similarly, Occam's razor is a rational response to limited rationality for an artficial agent.