Package: pixelstitch
pyxelstitchSimple, matplotlib based tool for hand-labeling the two-image correspondencesInstallpip install pixelstitchHow to useLet's test our annotator on a sample project. It needs a list of triplets: (path_to_img1,path_to_img2,path_to_corrs_to_save).importosrootdir='sample_project'pairs=os.listdir(rootdir)img_pairs_list=[]forpinpairs:ifp=='.DS_Store':continuecur_dir=os.path.join(rootdir,p)img_pairs_list.append((os.path.join(cur_dir,'01.png'),os.path.join(cur_dir,'02.png'),os.path.join(cur_dir,'corrs.txt')))print(img_pairs_list)[('sample_project/ministry/01.png', 'sample_project/ministry/02.png', 'sample_project/ministry/corrs.txt'), ('sample_project/petrzin/01.png', 'sample_project/petrzin/02.png', 'sample_project/petrzin/corrs.txt')]


/opt/homebrew/Caskroom/miniforge/base/envs/python39/lib/python3.9/site-packages/ipykernel/ipkernel.py:283: DeprecationWarning: `should_run_async` will not call `transform_cell` automatically in the future. Please pass the result to `transformed_cell` argument and any exception that happen during thetransform in `preprocessing_exc_tuple` in IPython 7.17 and above.
  and should_run_async(code)Now we are ready to initializeCorrespondenceAnnotator. Don't forget to declare magic command%matplotlib notebook.WITHOUT MAGIC IT WOULD NOT WORKYou also should explicitly specify, if you want to save (and possibly over-write previous better annotation) current correspondences automatically when clicking onprevandnextbuttons for going to the next pair.%matplotlibnotebookfrompixelstitch.coreimport*CA=CorrespondenceAnnotator(img_pairs_list,save_on_next=True)/opt/homebrew/Caskroom/miniforge/base/envs/python39/lib/python3.9/site-packages/ipykernel/ipkernel.py:283: DeprecationWarning: `should_run_async` will not call `transform_cell` automatically in the future. Please pass the result to `transformed_cell` argument and any exception that happen during thetransform in `preprocessing_exc_tuple` in IPython 7.17 and above.
  and should_run_async(code)Now we can run the annotation.Left-clickon the image to add a pointright-click-- to remove the point from both images.Matplotlib shortcuts:ofor zoompfor pan (move)It is also recommended to set full page width for the jupyterfromIPython.core.displayimportdisplay,HTMLdisplay(HTML("<style>.container { width:95% !important; }</style>"))CA.start(figsize=(12,7))ControlsSelectorsModel. One can select between "F" -- fundamental matrix and "H" -- homography. The selection influences the reprojection error type, and the visualization of the models and reprojection errors, shown when clicked onNextCorrsValPoint,NextCorrsValAllandShowModelbuttons.ButtonsNextCorrsValPoint. Shows the correspondence in the bottom axis. The image title shows correspondence index and the reprojection error. IfModelisF, it will show induced epipolar line, ifH-- the position of the reprojected point from other image. The model is estimated with all other correspondences except current one.NextCorrsValAll. Shows the correspondences in the bottom axis. Similar toNextCorrsValPointbutton, but shows all points. The model is estimated with all  correspondences except current one, which index is shown in the title.ShowModel. Has different behavoir depending on theModelselected. ForF-- shows correspondences with their induced epipolar lines. UnlikeNextCorrsValPointandNextCorrsValPointall correspondences are used for model estimation.ForH, the button shows overlay of image 1 reprojected into image2 with image2. The reprojected area is defined by the convex hull of the labelled correspondences. Next click flips the order, i.e. shows the image 2 reprojected into image 1.Save points-- saves (overwrites) the correspondences into the text file.Prev-- Loads and shows previous image pair to label. If theCorrespondenceAnnotatorwas initialized withsave_on_next=True, the current pair correspondences are saved before the switch. Change is not cyclical, so the button does nothing on 1st image pairNext-- Loads and shows next image pair to label. If theCorrespondenceAnnotatorwas initialized withsave_on_next=True, the current pair correspondences are saved before the switch.Change is not cyclical, so the button does nothing on last image pair.CLAHE-- Images are shown with enhanced contrast withCLAHEalgorithm.Pick 4 points for homography-- Special mode. User picks 4 points in one image, which define new fronto-parallel view. This mode helps for labeling obscure views, see example below. The order of the points: top-left -> top-right -> bottom right -> bottom left. After the 4 point picked, the mode is switched off, so user needs to click the button again if she wants to rectify another image.ResetView-- Resets any recifications or zoom done to images.Rectification picking mode example3 points are selectedAll points are selected and image1 is rectified to the rectangle, defined by the selected points