hello and welcome to ml news on this glorious monday let's dive into our first story a popular ml youtuber has just reached NUMBER_TOKEN NUMBER_TOKEN subscribers this historic milestone means that he's probably going to get the silver play button by youtube which is one of the highest achievements one can reach in life now here at ml news we are unbiased we are neither pro nor con this individual but legend says that the paper review videos have been lacking recently and also rumors are that his mother is a hamster and his father smells of elderberries ml news has not been able to confirm or reject this story but will keep track of it okay first real story facebook ai releases a blog post on textless nlp generating expressive speech from raw audio this is essentially a language model that goes directly from sound to sound so previous works in these domains have always first translated the sound into text and then continued the text and generated the sound again from that but facebook has released three successive papers that do away with the text altogether going directly from the sound wave to generating more sound and not only that but they're able to do this while capturing things like the speaker's identity and the sort of intonation and rhythm of the language they do this unsurprisingly by using a vq vae based system that teases apart these individual things in the input signal so the system is specifically designed for speech and that makes it really good at for example compressing speech so what you do is you simply transmit once your speaker identity vector and then you transmit the latent information that the model captures about you to the receiver which is then able to reconstruct your speech including intonation rhythm and so on so the system naturally doesn't have an idea of what a token is in the language so it works with what it calls expressive units the expressive units are something like tokens or syllables but the model can essentially decide by itself what they are so as i understand it one expressive unit might be paw and the other one might be ba and so on now this opens up a lot of possibility you can imagine taking a piece of speech and changing its rhythm changing its intonation changing its content changing the speaker's identity while keeping the rhythm and content but also these act as real language models so you can give a prefix spoken word and then have the model continue that without the model ever having trained on text so they have some cool demonstrations in fact there's an entire website of demonstrations but it is a tendent from the people to defend himself from this information pride of the potential in criminal activity curiosity and impetuosity of the world warsu acquired and the model depending on the temperature is capable of generating something that actually sounds like real speech so this is exciting because it fulfills the end-to-end mentality that deep learning promises and it pushes this to this new domain of speech without using the intermediate text representation so hopefully this will kick off an entirely new research direction and we're excited to see what happens next news jurgen schmidt huber released a new blog post called the most sighted neural networks all build on work done in my labs it's a relatively short blog post that goes through sort of the current state-of-the-art models and he tries to argue that all of them somehow come from work that he's done undoubtedly jurgen schmidt uber has had his fingers into a lot of research
START_SPONSOR_TOKEN hello and welcome to END_SPONSOR_TOKEN BETWEEN_SEGMENTS_TOKEN START_SELFPROMO_TOKEN ml news on this glorious monday let's dive into our first story a popular ml youtuber has just reached NUMBER_TOKEN NUMBER_TOKEN subscribers this historic milestone means that he's probably going to get the silver play button by youtube which is one of the highest achievements one can reach in life now here at ml news we are unbiased we are neither pro nor con this individual but legend says that the paper review videos have been lacking recently and also rumors are that his mother is a hamster and his father smells of elderberries END_SELFPROMO_TOKEN