How to use the code for just frontal ?

#11
by kaikreese - opened

How can we handle inference with only frontal image , with no lateral image provided ?

Microsoft org

Hi @kaikreese , you can just set current_lateral to None in the call to format_and_preprocess_reporting_input from the sample code. Just a note, if the dataset has laterals (for some subset of cases) and they are not provided to MAIRA-2, you may see a drop in performance (as shown in the ablations on model inputs in the MAIRA-2 report). This might happen especially if the technique section mentions a lateral but the lateral image is not given to the model, causing the model to generate spurious mentions to lateral images.

kaikreese changed discussion status to closed

Sign up or log in to comment