Spaces:
Runtime error
Apply for community grant: Academic project (gpu)
Hi @hysts looking to also apply for an academic grant for our new method DenseAV, an algorithm capable of discovering the meaning of language and locations of sounds just by watching unlabeled videos. DenseAV is completely unsupervised and never sees text during its training.
DenseAV’s localization abilities come from its new multi-head dense contrastive loss, which dramatically improves its ability to learn and localize words and sounds compared to ubiquitous techniques like CLS tokens and average pooling. Most interestingly, when we give DenseAV two attention heads it uses these heads to distinguish between the meaning of words and the sounds objects make, all without any supervision.
Website: https://aka.ms/denseav
We appreciate all of you awesome help in making FeatUp one of the community sponsored spaces and hope we can do the same here :)
Hi
@mhamilton723
, we've assigned t4-small to this Space as it was the hardware you were using.