Hugging Face's logo

Spaces:
facebook
/
ov-seg
Sleeping

App Files Community
7

Apply ovseg_swinbase_vitL14_ft_mpt.pth

#4
by luoxlong - opened
Discussion
luoxlong

What should I change in the code to use ovseg_swinbase_vitL14_ft_mpt.pth ?
It seems it use ovseg_clip_l_9a1909.pth by default:
demo = SAMVisualizationDemo(cfg, granularity, './sam_vit_l_0b3195.pth', './ovseg_clip_l_9a1909.pth')
I simply change the pretrain file path to be './ovseg_swinbase_vitL14_ft_mpt.pth', but get an error.

JeffLiang

Thanks for your interest.
Actually, './ovseg_swinbase_vitL14_ft_mpt.pth' contains a MaskFormer model and a CLIP model. It is expected to be used in the 'MaskFormer' proposal generator. See https://huggingface.co/spaces/facebook/ov-seg/blob/main/app.py#L45
For the 'Segment_Anything' proposal generator, we only need to use the CLIP, which is './ovseg_clip_l_9a1909.pth'.

JeffLiang changed discussion status to closed
luoxlong

Ok, thanks.

Sign up or log in to comment