Revert "Made us not compute default_filter_val until the eval_impl in filter_term_t."

This reverts commit e6a0f3c9bbc9acb56542f190dec28128eba05de9.

It also fixes a really surprising polyglot test failure.  Our code is
completely insane fragile crap.