Don't cross soft dirty bits and huge pages!

Even if the madvise works (which it seems not to), huge pages are
always marked dirty :|