Skip to content
/ Sambor Public

Sambor: Boosting Segment Anything Model Towards Open-Vocabulary Learning

Notifications You must be signed in to change notification settings

ucas-vg/Sambor

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

3 Commits
 
 
 
 

Repository files navigation

Sambor

Boosting Segment Anything Model Towards Open-Vocabulary Learning
Xumeng Han, Longhui Wei, Xuehui Yu, Zhiyang Dou, Xin He, Kuiran Wang, Zhenjun Han, Qi Tian

Method

method Overall architecture of Sambor. (Left) We construct a SideFormer to extract features from SAM and inject CLIP visual features to enhance semantic understanding. Building upon a two-stage detector, we devise an Open-set RPN that augments the vanilla RPN with open-set proposals generated by SAM. The language branch of CLIP encodes concepts in parallel, thereby empowering the detector with open-vocabulary recognition. (Right) The specific implementations of the extractor and injector in SideFormer.

Releases

No releases published

Packages

No packages published