Train an AudioClip model in Flax/Jax
The newly release AudioClip model combines, audio, text and images.Would it be possible to train an AudioClip model using Flax/Jax?GitHubGitHub - AndreyGuzhov/AudioCLIP: Source code for models described in the...Source code for models described in the paper "AudioCLIP: Extending CLIP to Image, Text and Audio" (https://arxiv.org/abs/2106.13043) - GitHub - AndreyGuzhov/AudioCLIP: Source code for mo...arXiv.orgAudioCLIP: Extending CLIP to Image, Text and AudioIn the past, the rapidly evolving field of sound classification greatly
benefited from the application of methods from other domains. Today, we observe
the trend to fuse domain-specific tasks and approaches together, which provides
the community with...paperswithcode.comPapers with Code - AudioCLIP: Extending CLIP to Image, Text and Audio🏆 SOTA for Zero-Shot Environment Sound Classification on ESC-50 (Accuracy metric)
2021-07-02T15:04:40Z
Hi! I’d be really interested in participating in this project.
2021-07-02T15:25:52Z
Do we have JAX code for this?
2021-07-02T16:03:42Z
I don’t think so, it’d probably be necessary to convert the existing implementations to JAX.
2021-07-02T18:05:16Z
Hey guys, I’m also interested in working on this project! I have created an empty repo in a Github Org I’m part of, here’s the link:GitHub - icmc-data/Jax_AudioCLIP
2021-07-02T18:23:10Z
Just to get things going,@JoaoMarcosand I started adding some “To Do” cards in theprojects tab, so the people interested in working in this project can easily find out where to start.
2021-07-04T10:26:36Z
Awesome finalizing this project then as well!