text
Is synthetic data the future of AI? 🔥🔥🔥
Is synthetic data the future of AI? 🔥🔥🔥
new_line
new_line
mention
@HugoLaurencon
HugoLaurencon
text
mention
@Leyo
Leyo
text
 & 
 & 
mention
@VictorSanh
VictorSanh
text
 are introducing 
 are introducing 
resource
https://huggingface.co/datasets/HuggingFaceM4/WebSight
dataset
HuggingFaceM4/WebSight
https://huggingface.co/datasets/HuggingFaceM4/WebSight
text
 , a multimodal dataset featuring 823,000 pairs of synthetically generated HTML/CSS codes along with screenshots of the corresponding rendered websites to train GPT4-V-like models 🌐💻
 , a multimodal dataset featuring 823,000 pairs of synthetically generated HTML/CSS codes along with screenshots of the corresponding rendered websites to train GPT4-V-like models 🌐💻
new_line
new_line
text
While crafting their upcoming foundation vision language model, they faced the challenge of converting website screenshots into usable HTML/CSS codes. Most VLMs suck at this and there was no public dataset available for this specific task, so they decided to create their own.
While crafting their upcoming foundation vision language model, they faced the challenge of converting website screenshots into usable HTML/CSS codes. Most VLMs suck at this and there was no public dataset available for this specific task, so they decided to create their own.
new_line
new_line
text
They prompted existing LLMs to generate 823k HTML/CSS codes of very simple websites. Through supervised fine-tuning of a vision language model on WebSight, they were able to generate the code to reproduce a website component, given a screenshot.
They prompted existing LLMs to generate 823k HTML/CSS codes of very simple websites. Through supervised fine-tuning of a vision language model on WebSight, they were able to generate the code to reproduce a website component, given a screenshot.
new_line
new_line
text
You can explore the dataset here: 
You can explore the dataset here: 
resource
https://huggingface.co/datasets/HuggingFaceM4/WebSight
dataset
HuggingFaceM4/WebSight
https://huggingface.co/datasets/HuggingFaceM4/WebSight
new_line
new_line
text
What do you think?
What do you think?
Is synthetic data the future of AI? 🔥🔥🔥

@HugoLaurencon @Leyo & @VictorSanh are introducing https://huggingface.co/datasets/HuggingFaceM4/WebSight , a multimodal dataset featuring 823,000 pairs of synthetically generated HTML/CSS codes along with screenshots of the corresponding rendered websites to train GPT4-V-like models 🌐💻

While crafting their upcoming foundation vision language model, they faced the challenge of converting website screenshots into usable HTML/CSS codes. Most VLMs suck at this and there was no public dataset available for this specific task, so they decided to create their own.

They prompted existing LLMs to generate 823k HTML/CSS codes of very simple websites. Through supervised fine-tuning of a vision language model on WebSight, they were able to generate the code to reproduce a website component, given a screenshot.

You can explore the dataset here: https://huggingface.co/datasets/HuggingFaceM4/WebSight

What do you think?
🤗
Leyo vishaal27 lhoestq AdinaY merve Hotsnow s3nh florentgbelidji HugoLaurencon cabralski ronzyponz mishig HugoDzz victor chansung kramp ameerazam08 wjbmattingly mcpotato taufiqdp osanseviero phanes alielfilali01 duxans aliabd taesiri pierrci lvwerra VictorSanh Triyansha mrfakename dvilasuero Srulikbd julien-c samusenps Chinar PeepDaSlan9 nic221 DEKUBE LouMa Mithilss rohanbalkondekar SaylorTwift peterschmidt85 yihaopeng mkemka radames faust01 lunarflu vztay iblub zeynel rreed
👍
s3nh lhoestq AdinaY BramVanroy merve cabralski davanstrien Pwlot mishig HansKlepitko HugoDzz bstraehle Sylvestre neovalle ameerazam08 wjbmattingly osanseviero aliabd sungkim11 clementperrot cyberandy dvilasuero julien-c samusenps mrdbourke PeepDaSlan9 Frantz103 LouMa Kernel MoritzLaurer yihaopeng lunarflu Kathakali zeynel z11h rreed freddyaboulton
❤️
happymanda cabralski mishig ayut HugoDzz clefourrier ameerazam08 osanseviero aliabd dvilasuero julien-c samusenps PeepDaSlan9 DEKUBE rohanbalkondekar MaziyarPanahi yihaopeng lunarflu rreed jeffboudier sbrandeis
🤯
taufiqdp cabralski mishig Wauplin holymonkey47 aliabd doxiy dreamworks2050 Srulikbd julien-c lunarflu binga
🤝
Sharathhebbar24 lunarflu
https://cdn-avatars.huggingface.co/v1/production/uploads/1676700305651-63f0698e5c2ceb16fc745be8.png
amanda besemer
happymanda
user
https://cdn-avatars.huggingface.co/v1/production/uploads/1583857146757-5e67bdd61009063689407479.jpeg
Clem 🤗
clem
user
https://cdn-avatars.huggingface.co/v1/production/uploads/1679186088116-63fa68b0d4349b157a15cffe.jpeg
Val
vdeva
user
https://cdn-avatars.huggingface.co/v1/production/uploads/1627505688463-60107b385ac3e86b3ea4fc34.jpeg
Daniel van Strien
davanstrien
user
https://cdn-avatars.huggingface.co/v1/production/uploads/61caeda441f9432649f03ab6/0UdRCrzIqhedZblgfpMBk.png
s3nh
s3nh
user
https://cdn-avatars.huggingface.co/v1/production/uploads/64aac16fd4a402e8dce11ebe/W640vNvHPWwwG_u4TsRo0.png
Jorge Vallego
neovalle
user
https://cdn-avatars.huggingface.co/v1/production/uploads/635964636a61954080850e1d/0bfExuDTrHTtm8c-40cDM.png
William Lamkin
phanes
user
https://cdn-avatars.huggingface.co/v1/production/uploads/1619623771844-5ecea265968f6028e0559fa5.jpeg
Victor Sanh
VictorSanh
user
https://cdn-avatars.huggingface.co/v1/production/uploads/64aea8ff67511bd3d965697b/Jxn52EmDF5RApJh8antxn.jpeg
Feynman Innovations
ajibawa-2023
user
https://cdn-avatars.huggingface.co/v1/production/uploads/5dd96eb166059660ed1ee413/NQtzmrDdbG0H8qkZvRyGk.jpeg
Julien Chaumond
julien-c
user
/avatars/c96bb76b227f884114a040e9062bb005.svg
Aaron Berdanier
berdaniera
user