Avoid leaking segment mappings when offset is not a page multiple

Found by Bob / Black Hole on the mailing list.