In Defense of Knowing Less