Fix releasing of mouse to look through full layer stack.