I now have an implementation that supports point symmetry.
The line that is used to cut the map into 2 parts can only be one of
those that are used for axis symmetry.

That limits the variations a little, but it helps with debugging.
I might still try to fix the problem but now I do not have to.