Fixed the problem yesterday, the reason is that the zero-th page is not mapped.
I don't know why, I didn't use that page. I think part of IRQ mechanism is using it, although I've configured vector to high location.