Decouple v4 l2

This is a backport of #282 to 2.4 branch.

Additionally this drops xioctl and corresponding CMake checks.