text
Microsoft released a groundbreaking model that can be used for web automation, with MIT license 🔥 
Microsoft released a groundbreaking model that can be used for web automation, with MIT license 🔥 
resource
https://huggingface.co/microsoft/OmniParser
model
microsoft/OmniParser
https://huggingface.co/microsoft/OmniParser
new_line
new_line
text
Interesting highlight for me was Mind2Web (a benchmark for web navigation) capabilities of the model, which unlocks agentic behavior for RPA agents. 
Interesting highlight for me was Mind2Web (a benchmark for web navigation) capabilities of the model, which unlocks agentic behavior for RPA agents. 
new_line
new_line
text
no need for hefty web automation pipelines that get broken when the website/app design changes! Amazing work.
no need for hefty web automation pipelines that get broken when the website/app design changes! Amazing work.
new_line
new_line
text
Lastly, the authors also fine-tune this model on open-set detection for interactable regions and see if they can use it as a plug-in for VLMs and it actually outperforms off-the-shelf open-set detectors like GroundingDINO. 👏
Lastly, the authors also fine-tune this model on open-set detection for interactable regions and see if they can use it as a plug-in for VLMs and it actually outperforms off-the-shelf open-set detectors like GroundingDINO. 👏
new_line
new_line
new_line
text
OmniParser is a state-of-the-art UI parsing/understanding model that outperforms GPT4V in parsing.
OmniParser is a state-of-the-art UI parsing/understanding model that outperforms GPT4V in parsing.
Microsoft released a groundbreaking model that can be used for web automation, with MIT license 🔥 https://huggingface.co/microsoft/OmniParser

Interesting highlight for me was Mind2Web (a benchmark for web navigation) capabilities of the model, which unlocks agentic behavior for RPA agents. 

no need for hefty web automation pipelines that get broken when the website/app design changes! Amazing work.

Lastly, the authors also fine-tune this model on open-set detection for interactable regions and see if they can use it as a plug-in for VLMs and it actually outperforms off-the-shelf open-set detectors like GroundingDINO. 👏


OmniParser is a state-of-the-art UI parsing/understanding model that outperforms GPT4V in parsing.
🔥
adorkin YaTharThShaRma999 cstr theospeak ucsahin adamelliotfields AtAndDev acidtib DivaVivy FredLaplagne ofirst
🚀
prithivMLmods YaTharThShaRma999 John6666 ucsahin Felladrin AtAndDev Csplk