text
I love Depth Anything V2 😍 
I love Depth Anything V2 😍 
new_line
text
It’s Depth Anything, but scaled with both larger teacher model and a gigantic dataset! 
It’s Depth Anything, but scaled with both larger teacher model and a gigantic dataset! 
new_line
new_line
text
Here's a small TLDR of paper with a lot of findings, experiments and more. 
Here's a small TLDR of paper with a lot of findings, experiments and more. 
new_line
text
I have also created a collection that has the models, the dataset, the demo and CoreML converted model 😚 
I have also created a collection that has the models, the dataset, the demo and CoreML converted model 😚 
resource
https://huggingface.co/collections/merve/depth-anything-v2-release-6671902e798cd404513ffbf5
collection
merve/depth-anything-v2-release-6671902e798cd404513ffbf5
https://huggingface.co/collections/merve/depth-anything-v2-release-6671902e798cd404513ffbf5
new_line
new_line
text
The authors have analyzed Marigold, a diffusion based model against Depth Anything and found out what’s up with using synthetic images vs real images for MDE:
The authors have analyzed Marigold, a diffusion based model against Depth Anything and found out what’s up with using synthetic images vs real images for MDE:
new_line
new_line
text
🔖  Real data has a lot of label noise, inaccurate depth maps (caused by depth sensors missing transparent objects etc) and there are many details overlooked 
🔖  Real data has a lot of label noise, inaccurate depth maps (caused by depth sensors missing transparent objects etc) and there are many details overlooked 
new_line
new_line
text
🔖 Synthetic data have more precise and detailed depth labels and they are truly ground-truth, but there’s a distribution shift between real and synthetic images, and they have restricted scene coverage
🔖 Synthetic data have more precise and detailed depth labels and they are truly ground-truth, but there’s a distribution shift between real and synthetic images, and they have restricted scene coverage
new_line
new_line
text
The authors train different image encoders only on synthetic images and find out unless the encoder is very large the model can’t generalize well (but large models generalize inherently anyway) 🧐
The authors train different image encoders only on synthetic images and find out unless the encoder is very large the model can’t generalize well (but large models generalize inherently anyway) 🧐
new_line
text
But they still fail encountering real images that have wide distribution in labels (e.g. diverse instances of objects) 🥲
But they still fail encountering real images that have wide distribution in labels (e.g. diverse instances of objects) 🥲
new_line
new_line
text
Depth Anything v2 framework is to..
Depth Anything v2 framework is to..
new_line
new_line
text
🦖 Train a teacher model based on DINOv2-G based on 595K synthetic images
🦖 Train a teacher model based on DINOv2-G based on 595K synthetic images
new_line
text
🏷️ Label 62M real images using teacher model
🏷️ Label 62M real images using teacher model
new_line
text
🦕 Train a student model using the real images labelled by teacher 
🦕 Train a student model using the real images labelled by teacher 
new_line
text
Result: 10x faster and more accurate than Marigold! 
Result: 10x faster and more accurate than Marigold! 
new_line
new_line
text
The authors also construct a new benchmark called DA-2K that is less noisy, highly detailed and more diverse! 
The authors also construct a new benchmark called DA-2K that is less noisy, highly detailed and more diverse! 
new_line
I love Depth Anything V2 😍 
It’s Depth Anything, but scaled with both larger teacher model and a gigantic dataset! 

Here's a small TLDR of paper with a lot of findings, experiments and more. 
I have also created a collection that has the models, the dataset, the demo and CoreML converted model 😚 https://huggingface.co/collections/merve/depth-anything-v2-release-6671902e798cd404513ffbf5

The authors have analyzed Marigold, a diffusion based model against Depth Anything and found out what’s up with using synthetic images vs real images for MDE:

🔖  Real data has a lot of label noise, inaccurate depth maps (caused by depth sensors missing transparent objects etc) and there are many details overlooked 

🔖 Synthetic data have more precise and detailed depth labels and they are truly ground-truth, but there’s a distribution shift between real and synthetic images, and they have restricted scene coverage

The authors train different image encoders only on synthetic images and find out unless the encoder is very large the model can’t generalize well (but large models generalize inherently anyway) 🧐
But they still fail encountering real images that have wide distribution in labels (e.g. diverse instances of objects) 🥲

Depth Anything v2 framework is to..

🦖 Train a teacher model based on DINOv2-G based on 595K synthetic images
🏷️ Label 62M real images using teacher model
🦕 Train a student model using the real images labelled by teacher 
Result: 10x faster and more accurate than Marigold! 

The authors also construct a new benchmark called DA-2K that is less noisy, highly detailed and more diverse! 

🔥
osanseviero Ramikan-BR fynnkroeger SixOpen kingabzpro Taylor658 clem Hev832 shadinpira80 xu3kev radames louisbrulenaudet
🚀
Ramikan-BR Tuana kramp clem super-cinnamon
❤️
Ramikan-BR clem melmass shaising radames
👀
Ramikan-BR clem
🤗
kingabzpro clem