text
⚡ My PhD thesis, “Scalable Nested Optimization for Deep Learning,” is now on arXiv! ⚡
⚡ My PhD thesis, “Scalable Nested Optimization for Deep Learning,” is now on arXiv! ⚡
new_line
new_line
text
tl;dr: We develop various optimization tools with highlights, including:
tl;dr: We develop various optimization tools with highlights, including:
new_line
text
· Making the momentum coefficient complex for adversarial games like GANs.
· Making the momentum coefficient complex for adversarial games like GANs.
new_line
text
· Optimizing millions of hyperparameters using implicit differentiation.
· Optimizing millions of hyperparameters using implicit differentiation.
new_line
text
· Tuning hyperparameters using hypernetworks.
· Tuning hyperparameters using hypernetworks.
new_line
text
· Differentiably finding bifurcations in optimization for diverse solutions.
· Differentiably finding bifurcations in optimization for diverse solutions.
new_line
new_line
link
https://arxiv.org/abs/2407.01526
https://arxiv.org/abs/2407.01526
⚡ My PhD thesis, “Scalable Nested Optimization for Deep Learning,” is now on arXiv! ⚡

tl;dr: We develop various optimization tools with highlights, including:
· Making the momentum coefficient complex for adversarial games like GANs.
· Optimizing millions of hyperparameters using implicit differentiation.
· Tuning hyperparameters using hypernetworks.
· Differentiably finding bifurcations in optimization for diverse solutions.

https://arxiv.org/abs/2407.01526
🔥
nbroad ajibawa-2023 merve MexIvanov rkusch Joseph717171 osanseviero lorraine2 not-lain fsaudm
👍
Jaward merve MexIvanov Joseph717171 Aurelien-Morgan lorraine2 not-lain
https://cdn-avatars.huggingface.co/v1/production/uploads/64aea8ff67511bd3d965697b/Jxn52EmDF5RApJh8antxn.jpeg
Feynman Innovations
ajibawa-2023
user
https://cdn-avatars.huggingface.co/v1/production/uploads/6032802e1f993496bc14d9e3/w6hr-DEQot4VVkoyRIBiy.png
Omar Sanseviero
osanseviero
user