Move invalidate_all() call to handle_interconnect_cb()

Apparently, access_fast_path() is not used for the L2.