Raymond Kusch's picture
2

Raymond Kusch

rkusch
·

AI & ML interests

None yet

Recent Activity

Organizations

American Inference's profile picture

rkusch's activity

liked a Space 5 months ago
reacted to lorraine2's post with 🔥 6 months ago
view post
Post
2706
⚡ My PhD thesis, “Scalable Nested Optimization for Deep Learning,” is now on arXiv! ⚡

tl;dr: We develop various optimization tools with highlights, including:
· Making the momentum coefficient complex for adversarial games like GANs.
· Optimizing millions of hyperparameters using implicit differentiation.
· Tuning hyperparameters using hypernetworks.
· Differentiably finding bifurcations in optimization for diverse solutions.

https://arxiv.org/abs/2407.01526
  • 3 replies
·
updated a Space 10 months ago