Check y

By using the get_debug_values() function and with flag "theano.config.compute_test_value" turned on, we can now check the value of Y before computing kl or elemwise_kl. Note that this feature should only be expected to work in test time, not for passed values in a real function call.

Should we check every mode of "theano.config.compute_test_value" in the unit test? Or, since it is only a unit test for kl (or elemwise_kl), just testing it on one of the mode will be OK?
Most of the test, starting after you assign a new value to `compute_test_value`, should be in a `try:` block, and `init_mode` should be restored in the `finally:` clause.
That way, the initial value will always be restored for the other tests, even if something goes wrong in that one.