Finetuning options with SAM?
I guess a lot of people will be asking this in the next weeks. When can we expect support for fine-tuning the SAM models of HF on own our datasets? There are some resources online on this (e.g.How To Fine-Tune Segment Anything) and it would be cool to have it also on HF.
2023-04-25T16:51:44Z
This is in the works, we will definitely add tutorials for this!cc@ybelkada@ArthurZ
2023-05-05T21:27:54Z
Hello there, any updates on this? Thank you guys for the great and very fast work being done to have these new SOTA models available on the hub, it’s really appreciated.
2023-05-10T16:01:10Z
Hi@alzaia@nielsrjust posted a tutorial for this!https://twitter.com/NielsRogge/status/1655631771742920716?s=20please find it here to try it out! Thanks again!github.comTransformers-Tutorials/SAM at master · NielsRogge/Transformers-Tutorialsmaster/SAMThis repository contains demos I made with the Transformers library by HuggingFace.
2023-05-11T17:51:22Z
Yes I saw it yesterday. Thanks a lot for the amazing work, guys! The notebook focuses on using bounding boxes from the masks as prompts for the fine-tuning. I am wondering if the same process can be done directly by feeding the masks as prompts instead (theinput_labelsarg. of the SAM model)?