S.H.E. - Search. Human. Equalizer.

They have Pantene in here.


S.H.E. - Search. Human. Equalizer.

Yeah.


S.H.E. - Search. Human. Equalizer.

So yeah, if you want less biased search results for these exact terms, then install the extension,


S.H.E. - Search. Human. Equalizer.

I do not recommend you do so.


S.H.E. - Search. Human. Equalizer.

But I would like them to take on one more query that I came up with that is pretty,


S.H.E. - Search. Human. Equalizer.

pretty biased, I found.


S.H.E. - Search. Human. Equalizer.

And that's the most dangerous criminals.


S.H.E. - Search. Human. Equalizer.

All men.


S.H.E. - Search. Human. Equalizer.


Python 3 Programming Tutorial: If Elif Else

What's going on everybody and welcome to my if-elif-else tutorial video for Python 3.


The idea of this is to add yet another layer of logic to our pre-existing if and now else


statement.


See with our typical if-else statement, the if will be checked for sure and the else will


only run if the if fails.


But what if you wanted to check multiple if statements?


Well you could write them all in so you could have if blah blah blah, if blah blah blah,


if blah blah blah.


Though this is really somewhat improper if you actually desire every single if statement


to be checked and you actually want it to be all in like one big grouping because without


it if you have just multiple ifs, the else is only going to apply to the last if statement.


So there's nothing wrong with writing multiple ifs if they're necessary and you want them


all to run and you don't want them to be like tied together in one big loop.


Otherwise you should use the elif statement.


So the elif is again short for else if basically.


So let's go ahead and start.


So we're going to say x equals 5, y equals 10, and z equals 22.


So what we're going to do is we're going to say if x is greater than y print x is greater


than y.


So we know that's going to fail but we'll throw that there anyways.


Elif x is less than z print x is less than z.


So we're pretty confident that's going to work out for us.


Else we'll just say print if and elif, maybe multiple elifs, never ran.


Save run and it turns out one of our statements did indeed run and that is the x is less than


z.


But we can come down here and we could even add even more statements.


We could say elif 5 is greater than, let's see, let me think here, let's see, x is less


than z.


So what if we did something like this, 5 is greater than 2, colon print 5 is greater than


So in the old fashioned way of doing our like multiple if statements, this statement would


rain true and trigger the printage of 5 is greater than 2.


But here, let's see what happens.


We'll save and run it and again we only got x is less than z.


Now the reason this happened is this is all one big loop.


So basically it's asking if this is the case, do it.


Elif, do this.


But what happened was this was triggered as true and then the rest of this block that's


all tied together was broken and it just left, right?


And that's the idea of the elif is as soon as it finds something that's true, it's not


going to continue searching to see if it's true.


So by the same token though, we could do something like this, elif equal equal equal equal and


then we could run this and then it, but in this case, it finally got to this elf statement


and nothing ever ran so indeed it printed out if and elif's never ran for us.


So as you can see the elif statement kind of does indeed, it just adds one more layer


of logic to your script or your program but at least in this case it's just a simple script.


But it adds one more bit of logic to it where you can kind of start tying these things into


each other and using their properties to actually start building some pretty interesting logic.


So anyways, that's going to conclude the if elif else, I don't know, I would say pairing


but it's not pairing.


Anyways, the putting together and so hopefully you guys learned something new.


Hopefully you guys are enjoying learning Python and all of that.


If you have any questions, feel free to post them below.


Otherwise as always, thanks for watching, thanks for all your support and your subscriptions


OpenAI Embeddings (and Controversy?!)

Hello, everyone, welcome to a special edition of ML news, we have something to discuss.


OpenAI Embeddings (and Controversy?!)

OpenAI just released an embeddings endpoint to their API.


OpenAI Embeddings (and Controversy?!)

This is accompanied by blog posts called introducing text and code embeddings in the open AI API.


OpenAI Embeddings (and Controversy?!)

Now after the let's call them big successes of GPT-3 and codecs, which is the model that


OpenAI Embeddings (and Controversy?!)

powers GitHub's copilot, open AI pushes forward into the domain of embeddings.


OpenAI Embeddings (and Controversy?!)

Hold on, this video is sponsored by Weights and Biases.


OpenAI Embeddings (and Controversy?!)

Weights and Biases is your one stop shop for all your machine learning needs.


OpenAI Embeddings (and Controversy?!)

It will track your experiments with a single line of code, they'll upload automatically


OpenAI Embeddings (and Controversy?!)

all your logs, all your configurations, everything to your cloud, it will automatically grab


OpenAI Embeddings (and Controversy?!)

all the output, all the metrics, all the configurations of your experiments, and store that in one


OpenAI Embeddings (and Controversy?!)

neat location.


OpenAI Embeddings (and Controversy?!)

So you can see your experiments, you can track them wherever they run, you can compare among


OpenAI Embeddings (and Controversy?!)

the experiments, but you can go further, you can then tune your hyper parameters according


OpenAI Embeddings (and Controversy?!)

to the results of those experiments.


OpenAI Embeddings (and Controversy?!)

And all of this is done automatically in a distributed way, you can literally sit on


OpenAI Embeddings (and Controversy?!)

your toilet on your smartphone and tune your hyper parameters and start new experiments.


OpenAI Embeddings (and Controversy?!)

But it's not only experiments, tracking and hyper parameter tuning Weights and Biases


OpenAI Embeddings (and Controversy?!)

has tools for the entire pipeline of machine learning research from the initial idea up


OpenAI Embeddings (and Controversy?!)

until the deployment and beyond that when you actually want to track what you've deployed.


OpenAI Embeddings (and Controversy?!)

Weights and Biases has cool methods to track all of your data set and their dependencies


OpenAI Embeddings (and Controversy?!)

to each other, as well as your models and all kinds of other artifacts that you might


OpenAI Embeddings (and Controversy?!)

produce a very powerful visualizations for all the inputs and outputs of your pipelines,


OpenAI Embeddings (and Controversy?!)

as well as the models themselves.


OpenAI Embeddings (and Controversy?!)

All of this runs in the cloud. But if you're concerned about privacy, there are options


OpenAI Embeddings (and Controversy?!)

to self host the system is free for personal use and for academics and they have great


OpenAI Embeddings (and Controversy?!)

plans for enterprises, small teams, large teams doesn't matter. So thank you very much


OpenAI Embeddings (and Controversy?!)

Weights and Biases for sponsoring this video. If you don't know them yet, absolutely check


OpenAI Embeddings (and Controversy?!)

them out. It's free, it'll make your life a whole lot easier. Now let's get into the


OpenAI Embeddings (and Controversy?!)

video.


OpenAI Embeddings (and Controversy?!)

So briefly said an embedding model associates a piece of text with a fixed sized vector,


OpenAI Embeddings (and Controversy?!)

the fixed sized vector can then be used to do semantic similarity search in high dimensional


OpenAI Embeddings (and Controversy?!)

spaces among other things. They have a toy depiction of these embeddings right here.


OpenAI Embeddings (and Controversy?!)

Now as this clearly shows, furries and football fans are in fact linearly separable. So you


OpenAI Embeddings (and Controversy?!)

know, thanks open AI in order to get these embeddings you'd interact with the open API


OpenAI Embeddings (and Controversy?!)

as you would else you'd instantiate it you call it you get back a vector, they have three


OpenAI Embeddings (and Controversy?!)

different modes available. One is for text similarity, which essentially means that you


OpenAI Embeddings (and Controversy?!)

can put in pieces of text and if the vectors are close together, that means the texts are


OpenAI Embeddings (and Controversy?!)

in some way similar. The second one is for text search where they have a separate encoder


OpenAI Embeddings (and Controversy?!)

for documents which are I guess longer pieces of content and queries which are shorter pieces


OpenAI Embeddings (and Controversy?!)

of content. And the idea is that you would rank document vectors against the query vector


OpenAI Embeddings (and Controversy?!)

and then whichever ones fall closest together, those would be the relevant documents to retrieve


OpenAI Embeddings (and Controversy?!)

for that query. It's a bit similar to text similarity. The differences are in the length


OpenAI Embeddings (and Controversy?!)

of the things that you put into the models and also a little bit of the semantics although


OpenAI Embeddings (and Controversy?!)

I don't think there's too much of a difference. The last one is code search, which is essentially


OpenAI Embeddings (and Controversy?!)

the same as text search for code. What's also to be said is that these come in different


OpenAI Embeddings (and Controversy?!)

sizes other being the smallest and DaVinci being the largest DaVinci is the original


OpenAI Embeddings (and Controversy?!)

175 billion parameter GPT three model size, they do release a paper along with it on how


OpenAI Embeddings (and Controversy?!)

they train this thing and what the results are. And the brief summary is that in various


OpenAI Embeddings (and Controversy?!)

data sets and various tasks, they do beat previous state of the art results, for example,


OpenAI Embeddings (and Controversy?!)

in linear probe classification, which is where you take embeddings, and then you train just


OpenAI Embeddings (and Controversy?!)

a small linear layer on top with a label data set, they outperform previous state of the


OpenAI Embeddings (and Controversy?!)

art. They also do so in text search tasks in the buyer retrieval benchmark. And lastly,


OpenAI Embeddings (and Controversy?!)

they outperform on code search quite a bit. The paper goes into more details on how the


OpenAI Embeddings (and Controversy?!)

model was trained, they explained that it is a contrastive loss that they've used. Essentially,


OpenAI Embeddings (and Controversy?!)

what you want to do is you want to encode pieces of text through the encoder, and then


OpenAI Embeddings (and Controversy?!)

make similar things closer to each other. And negatives, in this case, in batch negatives


OpenAI Embeddings (and Controversy?!)

further apart from each other. This does require quite large batch sizes to actually get an


OpenAI Embeddings (and Controversy?!)

accurate distribution of negatives. But you know, it's a open AI so they can do it. As


OpenAI Embeddings (and Controversy?!)

I said, their models go from 300 million parameters for the smallest to 175 billion for the largest


OpenAI Embeddings (and Controversy?!)

with the embedding dimensions going from 1024 up to a ridiculous 12,288. Now you might think


OpenAI Embeddings (and Controversy?!)

the larger dimension is a good thing. But this is not necessarily the case right here.


OpenAI Embeddings (and Controversy?!)

This is one of the criticisms that's going to come up in a short while. You can also


OpenAI Embeddings (and Controversy?!)

see right here that yeah, indeed, the batch size is pretty large. The paper itself goes


OpenAI Embeddings (and Controversy?!)

into a little bit more detail into the results. And here we kind of see the first scratches


OpenAI Embeddings (and Controversy?!)

in what people are now saying about this model, namely that it doesn't seem to perform that


OpenAI Embeddings (and Controversy?!)

well. Now while these average results that they have presented, mostly from their extra


OpenAI Embeddings (and Controversy?!)

large models do outperform other things is very often that they don't outperform them


OpenAI Embeddings (and Controversy?!)

by that much. And if you actually look in selected tasks, then it's not even clear they're


OpenAI Embeddings (and Controversy?!)

the best model. Also, they seem to compare sometimes to quite outdated baselines. As


OpenAI Embeddings (and Controversy?!)

you can see, these papers are sometimes from 2021. And last I checked it's 2022. So you


OpenAI Embeddings (and Controversy?!)

know, open AI, get your crap in order. Now by far the biggest controversial point right


OpenAI Embeddings (and Controversy?!)

here is the price. As they say in their documentation, encoding 1000 tokens with a DaVinci model


OpenAI Embeddings (and Controversy?!)

will cost you 60 cents. Now 60 cents doesn't sound like a lot, but corpora often have a


OpenAI Embeddings (and Controversy?!)

lot more than 1000 tokens. Remember that tokens are not even words, they're kind of sub words.


OpenAI Embeddings (and Controversy?!)

And that means that this model is quite expensive. Now this gets drastically cheaper if you go


OpenAI Embeddings (and Controversy?!)

down to the smaller models. As you can see, the Curie embeddings are already 10 times


OpenAI Embeddings (and Controversy?!)

smaller and Babbage and Ada another factor of eight or so. So pretty shortly, this Twitter


OpenAI Embeddings (and Controversy?!)

thread here blew up by Niels Reimers, who says GPT-3 embeddings by open AI was announced


OpenAI Embeddings (and Controversy?!)

this week, I was excited and tested them on 20 datasets. Sadly, they are worse than open


OpenAI Embeddings (and Controversy?!)

models that are 1000 times smaller and running open AI models can be at 1 million times more


OpenAI Embeddings (and Controversy?!)

expensive. This is accompanied by a medium post called open AI GPT-3 text embeddings,


OpenAI Embeddings (and Controversy?!)

really a new state of the art in dense text embeddings, where he leverages a lot of these


OpenAI Embeddings (and Controversy?!)

points that I've said previously, like they seem to not compare to the most recent and


OpenAI Embeddings (and Controversy?!)

most performing baselines. And their results don't seem to be that far ahead of the competition,


OpenAI Embeddings (and Controversy?!)

especially if you consider the smaller models. And also that they did weird selections of


OpenAI Embeddings (and Controversy?!)

data sets that they've trained on. For example, the buyer benchmark has 18 data sets, and


OpenAI Embeddings (and Controversy?!)

they have chosen to just test on 11 of them and report average performance across those


OpenAI Embeddings (and Controversy?!)

11. So Niels assembled his own benchmark of tasks and tested these models against some


OpenAI Embeddings (and Controversy?!)

openly available models. And the most shocking conclusion is that it seems to be that for


OpenAI Embeddings (and Controversy?!)

some tasks, at least you can get much better performance with the open models at astonishingly


OpenAI Embeddings (and Controversy?!)

low cost. As you can see in this table here, this lists performance against the cost of


OpenAI Embeddings (and Controversy?!)

encoding 1 million documents, which even for the smallest open AI model costs $800 goes


OpenAI Embeddings (and Controversy?!)

up to $60,000 for the largest one and on the open models. Well, the most expensive tested


OpenAI Embeddings (and Controversy?!)

right here will cost you $6.80 and the best performing one $2.40. Now it is to be said


OpenAI Embeddings (and Controversy?!)

that these prices are probably made such that the largest possible shock effect is achieved.


OpenAI Embeddings (and Controversy?!)

Very often when he mentions prices, he says that, well, this is the cost of like a pre


OpenAI Embeddings (and Controversy?!)

emptible T for GPU, which I guess first of all, you get the difficulty of being preemptible,


OpenAI Embeddings (and Controversy?!)

which you don't get with open AI. And second of all, good luck finding quota for a T for


OpenAI Embeddings (and Controversy?!)

anywhere on the planet right now. But point taken, the open models can be significantly


OpenAI Embeddings (and Controversy?!)

cheaper and the blog post explores the results from the paper itself also a bit more again,


OpenAI Embeddings (and Controversy?!)

pointing out that the advantages aren't that much sometimes something like point one f1


OpenAI Embeddings (and Controversy?!)

score and oftentimes even behind the open models. Another point he makes is that the


OpenAI Embeddings (and Controversy?!)

high dimensionality of the embeddings might actually work against you if you're looking


OpenAI Embeddings (and Controversy?!)

to implement anything because higher dimensional vectors, if you want to build a search index,


OpenAI Embeddings (and Controversy?!)

for example, they require a much more memory intensive index structure, which will cost


OpenAI Embeddings (and Controversy?!)

you more money. And even disregarding money, searching through a higher dimensional space


OpenAI Embeddings (and Controversy?!)

can be a lot slower than searching through a low dimensional space. And he points out


OpenAI Embeddings (and Controversy?!)

that is not really an option to compress these high dimensional embeddings, they are using


OpenAI Embeddings (and Controversy?!)

something like PCA, as that deteriorates their performance quite quickly. Now the claim is


OpenAI Embeddings (and Controversy?!)

just made right here, but I think he must have some experience or references from somewhere.


OpenAI Embeddings (and Controversy?!)

So I guess that would also account for downsampling methods such as random projections. But I


OpenAI Embeddings (and Controversy?!)

don't know, I guess that's still open out there to try. Now it is to be said that when


OpenAI Embeddings (and Controversy?!)

the author here tried to use the open AI API to reproduce the numbers in the paper, it


OpenAI Embeddings (and Controversy?!)

resulted in different numbers, which makes one wonder, did they change the model since


OpenAI Embeddings (and Controversy?!)

the paper? Or maybe is there something wrong with this evaluation? Now, curiously, if I


OpenAI Embeddings (and Controversy?!)

read this correctly, actually, the numbers of the current API used are better than the


OpenAI Embeddings (and Controversy?!)

numbers that are in the paper, which is weird. But also people have pointed out minor issues


OpenAI Embeddings (and Controversy?!)

that can creep in and really destroy your results, such as Gwern right here pointing


OpenAI Embeddings (and Controversy?!)

out that you cannot have new lines in your embedding queries, otherwise, the embeddings


OpenAI Embeddings (and Controversy?!)

become almost unusable, which is a thing that open AI discusses in their API documentation.


OpenAI Embeddings (and Controversy?!)

However, Reimers responded to this and said that yes, indeed, he had replaced the new


OpenAI Embeddings (and Controversy?!)

lines, he'd actually use the exact code that he found in an open AI website snippet. So


OpenAI Embeddings (and Controversy?!)

these results do look pretty legit. In fact, one of the main authors of the paper has put


OpenAI Embeddings (and Controversy?!)

out a response, I guess, I mean, it's not responding to anything. It's just a Twitter


OpenAI Embeddings (and Controversy?!)

thread. But it comes kind of in the light of these criticisms about how they evaluate


OpenAI Embeddings (and Controversy?!)

their embedding models in open AI's API. This goes into more detail on the evaluation, mainly


OpenAI Embeddings (and Controversy?!)

reciting points from the paper, but being a little bit more Yeah, we don't always achieve


OpenAI Embeddings (and Controversy?!)

the best results possible than the blog post is because the blog post just shows average


OpenAI Embeddings (and Controversy?!)

numbers and says, Well, we're state of the art pretty much everywhere. But if you look


OpenAI Embeddings (and Controversy?!)

into detail a little bit more, the picture becomes a bit more murky. I'll link all the


OpenAI Embeddings (and Controversy?!)

threads here in the description. I think one point to be mentioned right here, which is


OpenAI Embeddings (and Controversy?!)

made by the author here and also by the blog post is that Hello, this is Janik from the


OpenAI Embeddings (and Controversy?!)

future. I've waited on the story a bit because we have some new development, the authors


OpenAI Embeddings (and Controversy?!)

quasi responded again, and not really brought anything new to the table, but just put sort


OpenAI Embeddings (and Controversy?!)

of the things being said into context here, in that they do point out that on many of


OpenAI Embeddings (and Controversy?!)

the information retrieval, so the search tasks, the embeddings are actually performing really


OpenAI Embeddings (and Controversy?!)

well. And that on zero shot, keep that in mind, including, for example, the phi QA data


OpenAI Embeddings (and Controversy?!)

set where they outperform something like bm 25, or other models by a wide margin. On top


OpenAI Embeddings (and Controversy?!)

of that, they also put the cost in perspective saying that for this example data set, and


OpenAI Embeddings (and Controversy?!)

this is a fairly, let's say average data set, the cost of embedding the documents and the


OpenAI Embeddings (and Controversy?!)

queries is $80. So the blog post always compared costs of embedding x many millions of tokens.


OpenAI Embeddings (and Controversy?!)

But if you go to actual data set, yes, the embeddings are still going to be more expensive,


OpenAI Embeddings (and Controversy?!)

but the absolute cost might actually not be as much as the blog post might seem. Of course,


OpenAI Embeddings (and Controversy?!)

that depends entirely on how large your data set is, but spending 80 bucks for a 62% relative


OpenAI Embeddings (and Controversy?!)

improvement seems to be a nice deal. So it seems to really depend on the data set at


OpenAI Embeddings (and Controversy?!)

hand. And you might have to try it out on a subset of your data. This was then greeted


OpenAI Embeddings (and Controversy?!)

by a response response, saying that, yes, but the much smaller model and much cheaper


OpenAI Embeddings (and Controversy?!)

model is just point one of a score better than the largest GPT three model. Also, Niels


OpenAI Embeddings (and Controversy?!)

asked why the evaluation was just done on 11 out of the 18 data sets. We don't have


OpenAI Embeddings (and Controversy?!)

a response yet to that, but it's been a week, so I don't expect we'll get one. And that


OpenAI Embeddings (and Controversy?!)

is where it stands currently back to Yannick in the past. In their experience, these embeddings


OpenAI Embeddings (and Controversy?!)

seem to do quite well when you have to transfer them to a new domain. A lot of these openly


OpenAI Embeddings (and Controversy?!)

available models, they are trained on specific data sets, you know, with specific benchmarks


OpenAI Embeddings (and Controversy?!)

in mind and all of that. So they kind of come from the academic world for the academic world


OpenAI Embeddings (and Controversy?!)

and therefore might overperform even on a different data set, it is still a clean data


OpenAI Embeddings (and Controversy?!)

set that has been assembled kind of to be a benchmark and so on. While what OpenAI is


OpenAI Embeddings (and Controversy?!)

saying that if we take these embeddings and actually go to the real world, our customers


OpenAI Embeddings (and Controversy?!)

see big improvements in their own applications. Now, of course, there's no way to verify that.


OpenAI Embeddings (and Controversy?!)

And the blog posts lists three examples of customers saying, Oh, look, they are able


OpenAI Embeddings (and Controversy?!)

to find like six to 10 times more relevant examples for something or they pump their


OpenAI Embeddings (and Controversy?!)

performance from 64% to 89%. Again, there's no way to verify that. But I wouldn't actually


OpenAI Embeddings (and Controversy?!)

be surprised if that is the case. Real world data is a lot more messy than any of the academic


OpenAI Embeddings (and Controversy?!)

data sets. And therefore, I guess only trying it out will actually tell you whether it's


OpenAI Embeddings (and Controversy?!)

useful or not. I do have to wonder about the price though, like there are two possibilities


OpenAI Embeddings (and Controversy?!)

essentially, one OpenAI has done market research and so on. And this is what they think people


OpenAI Embeddings (and Controversy?!)

will pay for this, like this is how much value they think they bring with their API. Or on


OpenAI Embeddings (and Controversy?!)

the other hand, this is kind of their operating costs plus some margin to make the shareholders


OpenAI Embeddings (and Controversy?!)

happy. Now, I really can't tell apparently they do have customers. So someone must be


OpenAI Embeddings (and Controversy?!)

willing to pay all of this. On the other hand, it does seem outrageously expensive for such


OpenAI Embeddings (and Controversy?!)

a small improvement, at least in these academic data sets. So let me know what you think is


OpenAI Embeddings (and Controversy?!)

this even profitable for OpenAI? Like does anyone have any estimates on what it costs


OpenAI Embeddings (and Controversy?!)

them to develop these new models and to keep them running? It must be massive endeavor.


OpenAI Embeddings (and Controversy?!)

In any case, that was it for the special episode of ML news. Merch is still available. And


OpenAI Embeddings (and Controversy?!)


Goroutines - Go Lang Practical  Programming Tutorial p.18

What's going on everybody welcome to another Go language programming tutorial video. In


this video what we're going to be talking about is concurrency or at least we're going


to start talking about concurrency in the Go programming language. Now first what we


should talk about is what exactly is concurrency because this is going to be kind of confusing.


So concurrency is not in parallel. The way you can think about it is concurrency is like


dealing with multiple things at any one time whereas parallel parallelism is doing multiple


things at any one time. So for example concurrency is like consider you're like a CEO of a company


you're writing a company wide memo but as emails come in you're responding to emails


maybe someone comes to your door and asks a quick question you pause the memo and you


answer that question and then you get back to the memo something like that. You're doing


those things concurrently so that way when that person comes to your door they don't


have to like stand there until you're finished with the memo necessarily or something like


that. So in our case like with our web app we're spending a lot of time just sitting


there we're sending out the request we're waiting for the request to come back that's


a lot of time it's like 50 to 75 milliseconds. Multiply that by every single site map that


we're visiting and they just keep adding up whereas we actually could be while we're


waiting for one thing to make a response we actually could send out another request or


waiting for that also to make a response we could send out another request. Chances are


we could probably send out all our requests in 75 milliseconds. So that's concurrency.


So in Go the way we do concurrency is with Go routines. The way we use a Go routine is


you just simply type Go I have no idea where it is but anyways type Go in front of the


function call. So let's just make a quick example to illustrate this. So I'm just going


to say package main and then we're going to go ahead and just we're going to make a couple


imports we're going to import time and format just to print things out and then let's say


we've got a function that says whatever string we pass and that's all it does it just says


whatever so in this case and in fact let's make it a little more complicated so let's


say it iterates like says the thing like three times so let's say for I colon equals zero


while I is less than three and then I increment let's just format dot print line s and then


also let's go ahead and do a time dot capital s sleep time dot millisecond times 100 so


okay cool I mean this should be totally clear like what's going on in this function so hopefully


you understand now let's do go ahead and make our main and then our main function if we


will be running like let's say we're gonna say two things let's say we're gonna say say


hey and then say there so let's save that come up here and then go run go tut dot go


and we see hey hey hey there there there everything kind of ran you know in parallel here or not


parallel ran linearly rather so when we got to this it ran each of the iterations before


it got to this line now instead what if we converted one of these things to a go routine


for example let's just convert the first one to a go routine so we just throw go the go


statement right in front of the function that's it so a go routine and go is just like a lightweight


thread okay so it's gonna launch say hey in a thread for us and that's it that's all you


have to do to do it so let's go ahead and run that really quick and here we can see


it's just okay this time it actually said there before hey won't necessarily I don't


think it would necessarily always do that but anyway it might maybe it would actually


for a reason I'm gonna explain in a moment so what if we made both of these go routines


so we say go say hey go say there so what if we made them both go routines what do you


what would happen so let's go ahead and run it real quick and suddenly we see nothing


what if what if we said like let's say we do say hey and then go say there so the first


example we did was go say hey and then we just said say there this time what I want


us to do is to do say hey and then do the go say there so what's gonna happen here is


it just says hey hey hey right and so and if we made again both of these go routines


whoops if we made them both go routines where is we get nothing so what's going on here


well the go routine is just kind of launched out but it's gonna it's running concurrently


there's nothing that that says hey this absolutely must finish right so if your program finishes


before the go routine finishes it's over it's it's non-blocking so it's just not gonna do


anything so even though we we asked these things to run they're just not getting done


that's why when we said go say hey and then say there well this required was required


to finish so it was definitely gonna finish and that's why this was able to actually run


and then I guess just the launching of making this concurrent took a little bit like longer


and then we actually got to this point and then that's why pride there is coming first


not positive that's just my guess so instead let's say you said go say hey go say there


we can kind of illustrate that that's the only issue that we're having by doing a time


not sleep time diet let's just do a second save that come up here and we can run this


and sure enough everything runs it waits for a second in fact it just waits for a second


right because these are just go routine so these launched launched it's not actually


waiting for these and then it sleeps for a second before the program ends so anyway so


those are that's just a really quick basic example of go routines but of course immediately


you're probably wondering well I mean that's all fine and dandy and like a simple example


where you just kind of add a sleep at the end and that's all you got to do but in practice


this is not a good idea right like you don't want to handle for your go routines by by


thinking to yourself okay how long about should these take and then you know maybe I'll just


add a little more time and then that's fine well because you're going to leave time on


the table so surely there's a better way right and there is and so in the next tutorial what


we're talking about is how you can actually synchronize these go routines to wait for


them to complete and to basically basically wait for them to complete without leaving


time on the table using something arbitrary and hacky like time dot sleep for some amount


of time so anyways that's what we're going to be dealing with in the next tutorial if


you have questions comments concerns whatever feel free to leave them below otherwise I


100K Subs AMA (Ask Me Anything)

Howdy-dowdy.


100K Subs AMA (Ask Me Anything)

Can anyone confirm that you can see me?


100K Subs AMA (Ask Me Anything)

That'd be nice.


100K Subs AMA (Ask Me Anything)

Excellent.


100K Subs AMA (Ask Me Anything)

Cool.


100K Subs AMA (Ask Me Anything)

Yeah hi everyone.


100K Subs AMA (Ask Me Anything)

I just announced that there would be a ask me anything for the 100k and I stare blank


100K Subs AMA (Ask Me Anything)

green screen.


100K Subs AMA (Ask Me Anything)

Sorry.


100K Subs AMA (Ask Me Anything)

What do you want me to do?


100K Subs AMA (Ask Me Anything)

Yeah so I thought this would be a neat thing to do and sorry it's a bit spontaneous but


100K Subs AMA (Ask Me Anything)

I had time and I realized I wouldn't have time.


100K Subs AMA (Ask Me Anything)

So much so many more times.


100K Subs AMA (Ask Me Anything)

Yeah thanks everyone for subscribing.


100K Subs AMA (Ask Me Anything)

Thanks everyone for being here and there's not really a plan for now so we'll just see


100K Subs AMA (Ask Me Anything)

maybe this is over after five minutes or so but in general it's ask me anything.


100K Subs AMA (Ask Me Anything)

It is not I'll answer anything but it's not topical.


100K Subs AMA (Ask Me Anything)

So I'm trying to catch up.


100K Subs AMA (Ask Me Anything)

Will there be more live coding sessions in the future?


100K Subs AMA (Ask Me Anything)

I hope so.


100K Subs AMA (Ask Me Anything)

I'm not really sure.


100K Subs AMA (Ask Me Anything)

I get less competent as I age with respect to coding.


100K Subs AMA (Ask Me Anything)

But yeah I don't know if live coding for some things it's good if you know what you're doing


100K Subs AMA (Ask Me Anything)

and if the experiments don't need a lot of time but inherently in machine learning at


100K Subs AMA (Ask Me Anything)

some point you do train and then you wait and then what do you do with the live stream.


100K Subs AMA (Ask Me Anything)

So I don't know if someone has neat ideas of how to bridge the time there.


100K Subs AMA (Ask Me Anything)

Yeah maybe projects where you can do first a chunk and then let it train and then the


100K Subs AMA (Ask Me Anything)

next day come back or something like this.


100K Subs AMA (Ask Me Anything)

I don't know.


100K Subs AMA (Ask Me Anything)

Dimitros asks do we need a PhD in AI to get into industry?


100K Subs AMA (Ask Me Anything)

No certainly not.


100K Subs AMA (Ask Me Anything)

It might be a little bit more difficult to get into a research position given that many


100K Subs AMA (Ask Me Anything)

people are doing AI PhDs now but also companies are looking for them.


100K Subs AMA (Ask Me Anything)

But what's also always an option is that you start as a software engineer in a company


100K Subs AMA (Ask Me Anything)

and then just you essentially make friends with the research team and you just show them


100K Subs AMA (Ask Me Anything)

that you're quite competent at research.


100K Subs AMA (Ask Me Anything)

You know however you get competent once they know you are competent they'll probably want


100K Subs AMA (Ask Me Anything)

you on their team.


100K Subs AMA (Ask Me Anything)

So if there is head count that's another way to get into the research in industry.


100K Subs AMA (Ask Me Anything)

Did you know Arsenal scored three?


100K Subs AMA (Ask Me Anything)

No sorry.


100K Subs AMA (Ask Me Anything)

Why is there no Minecraft background?


100K Subs AMA (Ask Me Anything)

I'll try to get one going.


100K Subs AMA (Ask Me Anything)

Your PhD thesis where are you working or planning to work?


100K Subs AMA (Ask Me Anything)

I work my PhD thesis is done.


100K Subs AMA (Ask Me Anything)

I do officially have my title.


100K Subs AMA (Ask Me Anything)

I'm planning I'm working in Zurich.


100K Subs AMA (Ask Me Anything)

I have a startup in NLP so yay.


100K Subs AMA (Ask Me Anything)

Most problems in deep learning boil down to cross entropy loss and gradient descent.


100K Subs AMA (Ask Me Anything)

This realization is very demotivating due to the lack of intellectual stimulus insights.


100K Subs AMA (Ask Me Anything)

Well yeah I mean you know most problems in networking boil down to sending things over


100K Subs AMA (Ask Me Anything)

cables.


100K Subs AMA (Ask Me Anything)

Yeah it's true that at least the current paradigm is deep learning which means it's gradient


100K Subs AMA (Ask Me Anything)

descent in large models but there is still enormous creative freedom on how you design


100K Subs AMA (Ask Me Anything)

the models how exactly you use them or even to just sort of research what happens when


100K Subs AMA (Ask Me Anything)

you do these very simple principles right.


100K Subs AMA (Ask Me Anything)

It's astounding very simple principles very simple training methods paired with what is


100K Subs AMA (Ask Me Anything)

essentially quite simple blocks of computation give this incredible result and I think that's


100K Subs AMA (Ask Me Anything)

pretty cool you sorry that's pretty cool in itself.


100K Subs AMA (Ask Me Anything)

Yeah so I think it's even an improvement over let's say you're in the SVM area of machine


100K Subs AMA (Ask Me Anything)

learning all you can do is SVM big right there's not a lot of freedom but now you can design


100K Subs AMA (Ask Me Anything)

models and frameworks and systems and objectives yeah.


100K Subs AMA (Ask Me Anything)

So I think it's rather than it being lack of intellectual stimulus actually frees you


100K Subs AMA (Ask Me Anything)

up to do a lot more stuff.


100K Subs AMA (Ask Me Anything)

Why sunglasses?


100K Subs AMA (Ask Me Anything)

So you ask this question of course.


100K Subs AMA (Ask Me Anything)

What are the things to be followed to become a researcher in the AI field?


100K Subs AMA (Ask Me Anything)

Whatever whatever look I can't predict what's going to happen this field changes so fast


100K Subs AMA (Ask Me Anything)

no nobody knows what's going to happen so it's probably best you just follow whatever


100K Subs AMA (Ask Me Anything)

interests you most and if it's a genuinely interesting thing and you like to do it then


100K Subs AMA (Ask Me Anything)

there will be a place for you to do research on it you know whether it becomes the exact


100K Subs AMA (Ask Me Anything)

hype of the next years that's that's just chance.


100K Subs AMA (Ask Me Anything)

Cats or dogs?


100K Subs AMA (Ask Me Anything)

Cats probably.


100K Subs AMA (Ask Me Anything)

How long have you been studying AI?


100K Subs AMA (Ask Me Anything)

I don't know well five years or so I really didn't know it existed when I started bachelor's


100K Subs AMA (Ask Me Anything)

and then I sort of knew it existed when I started masters and I learned it during masters


100K Subs AMA (Ask Me Anything)

and then yeah I applied for a PhD at that point I still really didn't know what was


100K Subs AMA (Ask Me Anything)

going on and only after maybe two three years of PhD I sort of knew what was happening.


100K Subs AMA (Ask Me Anything)

Because it's so bright.


100K Subs AMA (Ask Me Anything)

What are you working on now?


100K Subs AMA (Ask Me Anything)

I'm a I have a startup in NLP for legal document understanding well you're not supposed to


100K Subs AMA (Ask Me Anything)

say understanding it's legal document processing right what are you working oh sorry that was


100K Subs AMA (Ask Me Anything)

it can you fix my bug yes of course you missed you you added a comma oh no on it like this


100K Subs AMA (Ask Me Anything)

is commas at the end of things in python will ruin your code if you forget about them because


100K Subs AMA (Ask Me Anything)

it makes whatever you whatever you have into a tuple and that's quite messy to find later.


100K Subs AMA (Ask Me Anything)

Who do you think is better Messi or Ronaldo?


100K Subs AMA (Ask Me Anything)

I have not cared which Ronaldo even I don't know I actually when I watched soccer when


100K Subs AMA (Ask Me Anything)

Ronaldo was still playing but I have no clue.


100K Subs AMA (Ask Me Anything)

Most problems in deep learning oh we already had that what are your opinions on Vtubers?


100K Subs AMA (Ask Me Anything)

I honest I have never watched a Vtuber other than looking up what is a Vtuber if you know


100K Subs AMA (Ask Me Anything)

I have no I have no basis to complain since I'm wearing gimmicks when making videos so


100K Subs AMA (Ask Me Anything)

you know they are yeah they're fine I guess whatever they want to do.


100K Subs AMA (Ask Me Anything)

Any tips any tips could help in reading and understanding research papers not really it


100K Subs AMA (Ask Me Anything)

just I think it comes with practice and understanding that most people in their papers they they


100K Subs AMA (Ask Me Anything)

sort of want to sound more they want to sound better or more they want to sound more relevant


100K Subs AMA (Ask Me Anything)

than they are so they'll frame their work in very formal you know prosaic ways and you


100K Subs AMA (Ask Me Anything)

just have to keep in mind that their ultimate ideas are going to be there's like very few


100K Subs AMA (Ask Me Anything)

ideas per paper you try to read those out try to see a little bit what's the real meat


100K Subs AMA (Ask Me Anything)

behind a paper and yeah the rest comes with with practice.


100K Subs AMA (Ask Me Anything)

Are ANNs like real ANNs so are artificial neural networks like real neural networks


100K Subs AMA (Ask Me Anything)

well in some ways they are in other ways they're not we've certainly come a long way from the


100K Subs AMA (Ask Me Anything)

the real neural network though I think even if you know the individual neurons aren't


100K Subs AMA (Ask Me Anything)

like real neurons and backprop doesn't exist in the brain and so on the things that we


100K Subs AMA (Ask Me Anything)

learn about distributed representations of data and things like that can can definitely


100K Subs AMA (Ask Me Anything)

carry carry over from from either field so even even though there might be sort of the


100K Subs AMA (Ask Me Anything)

lowest layer has diverged there are aspects of the emerging phenomenon that might be quite


100K Subs AMA (Ask Me Anything)

the same.


100K Subs AMA (Ask Me Anything)

Advice for undergraduate deep learning researchers if you're a researcher and you're an undergrad


100K Subs AMA (Ask Me Anything)

you're already you're doing fine like I when I was an undergrad I had trouble avoiding


100K Subs AMA (Ask Me Anything)

walls if you're already a researcher you know good job that you don't need my advice.


100K Subs AMA (Ask Me Anything)

Favorite non ML book?


100K Subs AMA (Ask Me Anything)

Well I don't know that's that's tough honestly I am not much of a of a book person so I don't


100K Subs AMA (Ask Me Anything)

even have a favorite ML book I like I can like I know some but I've never read you know


100K Subs AMA (Ask Me Anything)

an actual book yeah so sorry no good answer on that oh no I lost I lost I lost all of


100K Subs AMA (Ask Me Anything)

you I'm sorry I'm I will have to skip some of the some of the question if I've skipped


100K Subs AMA (Ask Me Anything)

yours please ask again the chat has just scrolled down so I'll I'll do these ones and then I'll


100K Subs AMA (Ask Me Anything)

go up if there are not more ones I'm sorry.


100K Subs AMA (Ask Me Anything)

Is the AI field saturated?


100K Subs AMA (Ask Me Anything)

I don't know like sure there is like super duper increase in research papers and that


100K Subs AMA (Ask Me Anything)

seems a bit saturated and also there is sort of a lack of big new inventions and all of


100K Subs AMA (Ask Me Anything)

that but on the other hand there are lots of products yet to be built on these technologies


100K Subs AMA (Ask Me Anything)

so I don't think necessarily the the field itself is saturated maybe maybe the core research


100K Subs AMA (Ask Me Anything)

path we're on right now is due for a bit of a disruption a bit of a new paradigm a new


100K Subs AMA (Ask Me Anything)

idea or so but you know favorite movie yeah what do I know Lord of the Rings or something


100K Subs AMA (Ask Me Anything)

I like Lord of the Rings good movie good movie also Fight Club.


100K Subs AMA (Ask Me Anything)

Pytorch versus TensorFlow what's your perspective just use whatever like whatever makes you


100K Subs AMA (Ask Me Anything)

happy bickering about bickering about libraries and bickering about libraries and programming


100K Subs AMA (Ask Me Anything)

languages and so on is too often not worth it use whatever solves your problem the easiest


100K Subs AMA (Ask Me Anything)

or or fits your situation what do you think about prompt engineering probably probably


100K Subs AMA (Ask Me Anything)

going to become important in the near future I think we still don't understand I think


100K Subs AMA (Ask Me Anything)

there are still a lot of tricks in prompt engineering that we haven't figured out quite


100K Subs AMA (Ask Me Anything)

yet just because it's so young right why do you think we focus on big data and scalability


100K Subs AMA (Ask Me Anything)

instead of training efficiency is it just Google I guess it is probably just Google


100K Subs AMA (Ask Me Anything)

it's easier right yeah it's it's way easier to just add machines because they have money


100K Subs AMA (Ask Me Anything)

they have lots of money and as far as we can tell scaling up gives you an almost guaranteed


100K Subs AMA (Ask Me Anything)

improvement in performance and efficiency is harder because you know the I don't know


100K Subs AMA (Ask Me Anything)

the people who designed the core libraries like CUDA and and and and and Blas and Lopak


100K Subs AMA (Ask Me Anything)

they already did a lot of efficiency built in and sure we can we can make things a lot


100K Subs AMA (Ask Me Anything)

more efficient but I think it's just it's easier to just scale up especially if you're


100K Subs AMA (Ask Me Anything)

big companies what are your advice and tips for applying a PhD and AI at ETH do you need


100K Subs AMA (Ask Me Anything)

to have publication record what is the acceptance rate I don't I don't know I from the time


100K Subs AMA (Ask Me Anything)

I applied this has changed a lot you know just try to try to be as as attractive as


100K Subs AMA (Ask Me Anything)

possible to hire that's that's all I can say it's good if you know people like it's good


100K Subs AMA (Ask Me Anything)

if people in an institution already know you and know that you are capable and competent


100K Subs AMA (Ask Me Anything)

that helps but other than that just yeah look at what their criteria are and try to match


100K Subs AMA (Ask Me Anything)

that publications are certainly good nowadays it's it's astounding that you need no you


100K Subs AMA (Ask Me Anything)

don't need them but a lot of people have them but it's not necessary sorry the other question


100K Subs AMA (Ask Me Anything)

by Lucas continues is it just Google who steers the field to big data as it's their business


100K Subs AMA (Ask Me Anything)

politics yeah probably yeah also also it's a competitive advantage right if you're competing


100K Subs AMA (Ask Me Anything)

with universities you can pretty easily pull ahead by just playing to your your strengths


100K Subs AMA (Ask Me Anything)

right so you just do if you do research where universities are smaller companies simply


100K Subs AMA (Ask Me Anything)

cannot pay for it you're essentially you don't have as much competition so but also good


100K Subs AMA (Ask Me Anything)

things come from that I mean once someone I mean BERT I guess was considered large at


100K Subs AMA (Ask Me Anything)

the time and now pretty much anyone can train BERT at home or for very cheap on AWS so not


100K Subs AMA (Ask Me Anything)

sure if if good or bad but certainly they play to their strengths right do you know


100K Subs AMA (Ask Me Anything)

any other free compute programs other than TRC that could be used to train BERT, Roberto,


100K Subs AMA (Ask Me Anything)

Electra, yada yada yada I'm I'm not sure so far I've had I've had university resources


100K Subs AMA (Ask Me Anything)

which was awesome and now I have company resources which are awesome so I'm not I'm not in the


100K Subs AMA (Ask Me Anything)

situation for free compute do you have innovative idea for AGI okay as as cliche as this sounds


100K Subs AMA (Ask Me Anything)

but it's probably worth going through like the 80s and 90s and 2000s literature and try


100K Subs AMA (Ask Me Anything)

to see what people did then but didn't have the compute necessary to achieve but it's


100K Subs AMA (Ask Me Anything)

it I know this sounds Schmidt-Huber-ish but it's entirely possible that ideas from then


100K Subs AMA (Ask Me Anything)

or modifications on them come back and combine with the current things that we know and the


100K Subs AMA (Ask Me Anything)

current compute to to produce really cool things not sure if that's going to lead to


100K Subs AMA (Ask Me Anything)

AGI but certainly yeah what app do you use in your paper review videos OneNote and OBS


100K Subs AMA (Ask Me Anything)

to record do you think data scientists should learn Docker, cloud it's overwhelmingly especially


100K Subs AMA (Ask Me Anything)

for students probably not right so should should is a big word I don't think you should


100K Subs AMA (Ask Me Anything)

you should probably learn whatever is required for you to do your work I am generally interested


100K Subs AMA (Ask Me Anything)

in all kinds of technical things so I I learned Docker I learned cloud what not I learned


100K Subs AMA (Ask Me Anything)

you know whatever I could get my hands on just because I found it interesting and sometimes


100K Subs AMA (Ask Me Anything)

that helps you right sometimes you can write a better experiment code you can schedule


100K Subs AMA (Ask Me Anything)

your experiments more efficiently yada yada yada because you're more competent and some


100K Subs AMA (Ask Me Anything)

other thing but it's certainly not necessary so if you feel overwhelmed do not learn technology


100K Subs AMA (Ask Me Anything)

outside of the things that you have to know what are your routines for keeping up with


100K Subs AMA (Ask Me Anything)

the state of the art literature and filtering signal from noise this is an it's an eternal


100K Subs AMA (Ask Me Anything)

struggle I I like I've never claimed to have the best filter anything I just look around


100K Subs AMA (Ask Me Anything)

Twitter Reddit archive like the new new releases there various newsletters blogs and so on


100K Subs AMA (Ask Me Anything)

people posting stuff around on Discord and whatever interests me I look at it but there's


100K Subs AMA (Ask Me Anything)

there's too much stuff don't you know in your particular niche you should be able to keep


100K Subs AMA (Ask Me Anything)

up otherwise your niche is too broad so but that's that's sort of your focus if you're


100K Subs AMA (Ask Me Anything)

a researcher but for the general landscape you cannot hope for more than just grab bits


100K Subs AMA (Ask Me Anything)

and pieces from from everywhere so yeah would you have done a PhD looking back considering


100K Subs AMA (Ask Me Anything)

you're doing a startup right now yes I would have I enjoyed the PhD I I've never seen the


100K Subs AMA (Ask Me Anything)

PhD as sort of a thing that I need to progress or anything like this I don't I don't think


100K Subs AMA (Ask Me Anything)

a PhD is necessary for a for a career I also didn't aspire to become an academic I simply


100K Subs AMA (Ask Me Anything)

I did a PhD because honestly I didn't know what else to do and having done it I absolutely


100K Subs AMA (Ask Me Anything)

enjoyed the freedom and the fact that it placed me like in the middle of this whole happening


100K Subs AMA (Ask Me Anything)

in research in AI might be that I have done it at the been at the right place at the right


100K Subs AMA (Ask Me Anything)

time but would totally do it again yeah but not if not as a as a career move there are


100K Subs AMA (Ask Me Anything)

better ways to do career AI generated meshes and textures based on descriptions when didn't


100K Subs AMA (Ask Me Anything)

know that was the thing I mean cool how do you see the movement towards decentralization


100K Subs AMA (Ask Me Anything)

affecting the ML industry is there is there a movement towards decent I think if anything


100K Subs AMA (Ask Me Anything)

we see a movement towards centralization with the increased requirements in compute like


100K Subs AMA (Ask Me Anything)

it's not it's not it's not only so it's not only that the compute gets centralized right


100K Subs AMA (Ask Me Anything)

like okay you now can no longer do your thing on your computer you need to use your cluster


100K Subs AMA (Ask Me Anything)

and if you don't have a cluster you go to Google or AWS not only is it centralized in


100K Subs AMA (Ask Me Anything)

that but it goes further it's now you don't even train your own model you simply subscribe


100K Subs AMA (Ask Me Anything)

to language model API or something like this so I think there is a centralization centralization


100K Subs AMA (Ask Me Anything)

happening and honestly I don't see something like blockchain interfacing too easily with


100K Subs AMA (Ask Me Anything)

machine learning because the two things are sort of not only orthogonal they're kind of


100K Subs AMA (Ask Me Anything)

in opposite directions and it's going to be interesting to see interesting combinations


100K Subs AMA (Ask Me Anything)

of the two but so far I see a centralization trend in AI is math invented or discovered


100K Subs AMA (Ask Me Anything)

in Europe who knows it's math invented or discovered I have I've no I have no clue I


100K Subs AMA (Ask Me Anything)

think math as as any other sort of science is is simply enough so in my opinion math


100K Subs AMA (Ask Me Anything)

is an approximation to the world so it's it's a it's an approximate way of talking about


100K Subs AMA (Ask Me Anything)

the world and I realize mathematical systems are built upon their own axioms and so on


100K Subs AMA (Ask Me Anything)

and in theory you could come up with any mathematical system but ultimately we do math because we


100K Subs AMA (Ask Me Anything)

want to understand and describe the world and yes some people some people are very much


100K Subs AMA (Ask Me Anything)

off in the in in in abstract space and completely unrelated to the world but I think we as we


100K Subs AMA (Ask Me Anything)

by we I mean mathematicians humanity keeps math reasonably close to reality so such that


100K Subs AMA (Ask Me Anything)

my opinion is it's it's an approximate description of of reality in the same way as physics is


100K Subs AMA (Ask Me Anything)

and the same way as biology is and so on when will you do a full review of open AI codex


100K Subs AMA (Ask Me Anything)

I'm playing around with it I'm trying to to see what it can and can't do and so on also


100K Subs AMA (Ask Me Anything)

there I think people haven't haven't quite figured out yet what the people haven't quite


100K Subs AMA (Ask Me Anything)

figured out yet what what things are possible but neither have I so yeah when are you giving


100K Subs AMA (Ask Me Anything)

Kondi again it's happening every every Wednesday and Thursday at five do you think RL is under


100K Subs AMA (Ask Me Anything)

appreciated what what do I know probably probably not it's I think it's RL is appreciated quite


100K Subs AMA (Ask Me Anything)

well for essentially for essentially being random search it's it's retained it's RL is


100K Subs AMA (Ask Me Anything)

more like the this idealistic idea that there's an agent and it does nothing else than learn


100K Subs AMA (Ask Me Anything)

from observation and reward so and I think this this captures the mind of many people


100K Subs AMA (Ask Me Anything)

when they think of AI so I think it's appreciated quite well your advice for pH applying for


100K Subs AMA (Ask Me Anything)

PhD and ETH yeah just try to match try to match the criteria it's good if you know someone


100K Subs AMA (Ask Me Anything)

that's that how to get into research as a beginner I'm self-taught don't know what to


100K Subs AMA (Ask Me Anything)

do to get into research just if you're if you're really a beginner I would try to just


100K Subs AMA (Ask Me Anything)

focus on a single area like just pick an area that particularly interests you like a sub


100K Subs AMA (Ask Me Anything)

sub sub field of AI and just try to get into that you might choose that a bit smartly such


100K Subs AMA (Ask Me Anything)

that you know it's not how do I build GPT-3 but you know any anything where you can do


100K Subs AMA (Ask Me Anything)

some things yourself then try to get a good overview over that subfield and and I think


100K Subs AMA (Ask Me Anything)

once you have that you already have a lot of prerequisites to understand the whole field


100K Subs AMA (Ask Me Anything)

if you're a master student now would you still go for a PhD yes definitely how much do you


100K Subs AMA (Ask Me Anything)

bench or squat I don't I've never done single rep max so I don't know bench maybe I'm not


100K Subs AMA (Ask Me Anything)

good at bench maybe 60 kilo squat I don't know 120 many areas of ML research are fascinating


100K Subs AMA (Ask Me Anything)

so how do you decide which research problem to work on yeah so this is a combination of


100K Subs AMA (Ask Me Anything)

whatever interests you and whatever do you whatever you think so what interests you what


100K Subs AMA (Ask Me Anything)

you're good at and what's you know possible physically let's say given your your your


100K Subs AMA (Ask Me Anything)

resources so it's a bit of a strategic selection but ultimately you should go with what you're


100K Subs AMA (Ask Me Anything)

what you're interested in because you know if it doesn't work out at least you've done


100K Subs AMA (Ask Me Anything)

something that you thought was cool and you know if you if you go for a topic that doesn't


100K Subs AMA (Ask Me Anything)

interest you if it doesn't work out then there's really nothing good about that do you think


100K Subs AMA (Ask Me Anything)

no I'm not saying saying these words no mood to get kicked off YouTube you think weather


100K Subs AMA (Ask Me Anything)

forecasting will be possible in the future no you think we could create a GI in this


100K Subs AMA (Ask Me Anything)

lifetime it depends on how you define a GI I I have no I have no idea for most definitions


100K Subs AMA (Ask Me Anything)

you'll probably never reach it you think having a PhD is important for pursuing research in


100K Subs AMA (Ask Me Anything)

ML no you can do ML well completely without having a PhD your opinions about the computer


100K Subs AMA (Ask Me Anything)

vision lab I have vaguely heard like I don't know many people from there so far looks looks


100K Subs AMA (Ask Me Anything)

neat looks cool and they do interesting stuff graph neural networks versus convolutional


100K Subs AMA (Ask Me Anything)

neural networks whatever fits your probably everything the CNN is a special case of the


100K Subs AMA (Ask Me Anything)

GNN right so I don't know if you like special cases go for a CNN how can we call minimax


100K Subs AMA (Ask Me Anything)

algorithm is AI or not sure like we call if conditions AI so we should also be able to


100K Subs AMA (Ask Me Anything)

call minimax conditions AI okay now I've I've skipped a bunch of questions again so the


100K Subs AMA (Ask Me Anything)

chat refreshes periodically and I'm kicked out I'm very sorry if I skipped your question


100K Subs AMA (Ask Me Anything)

what for is your green background to to to to project stuff on it I can do I have filters


100K Subs AMA (Ask Me Anything)

here filters effect probably chroma key no there we go better why capsule networks didn't


100K Subs AMA (Ask Me Anything)

go further because it's a it's a good idea but it's it doesn't like there's a lot of


100K Subs AMA (Ask Me Anything)

magic and whenever your your model needs magic there's just a small chance that it's going


100K Subs AMA (Ask Me Anything)

to work but probably not so this one didn't plus it's it's computationally at least the


100K Subs AMA (Ask Me Anything)

way it was formulated at the beginning it's computationally not not really nice to current


100K Subs AMA (Ask Me Anything)

hardware how have you learned the math for ML you pick it up as you go like I don't think


100K Subs AMA (Ask Me Anything)

it's worth learning all the math there is and then going into ML just go into ML look


100K Subs AMA (Ask Me Anything)

at what's the math required to understand the things that I need to understand and then


100K Subs AMA (Ask Me Anything)

learn that area of math so math is too vast to try to pre-learn it did you ever do you


100K Subs AMA (Ask Me Anything)

ever talk with Lex Friedman not yet not yet divide looked at something sorry chat no okay


100K Subs AMA (Ask Me Anything)

this is this is too fast for a single human to follow sorry where were we hmm yeah I'm


100K Subs AMA (Ask Me Anything)

totally I'm totally sorry for skipping for skipping questions I'm overwhelmed I need


100K Subs AMA (Ask Me Anything)

I need some I'm saying I need some sort of automatic model to answer the questions for


100K Subs AMA (Ask Me Anything)

me no do you think love will save that's a Lex thing no that is a Lex thing totally totally


100K Subs AMA (Ask Me Anything)

can you share your thoughts on how one comes up with research problems or topics even smartly


100K Subs AMA (Ask Me Anything)

throwing spaghetti at a wall and seeing what sticks may fail or bear fruit yes it's a science


100K Subs AMA (Ask Me Anything)

in itself I guess and technically the senior people in research should be able to help


100K Subs AMA (Ask Me Anything)

you with that so this I think mostly comes with experience from research in that you


100K Subs AMA (Ask Me Anything)

have to develop a taste for what ideas are in the reach of the current state of knowledge


100K Subs AMA (Ask Me Anything)

so are not known yet but within reach and also likely to be possible this is way harder


100K Subs AMA (Ask Me Anything)

to do if you're new to the research field if even if you're super duper competent this


100K Subs AMA (Ask Me Anything)

is a bit of a taste that you acquire over a career in in research so try to maybe ask


100K Subs AMA (Ask Me Anything)

ask around people who have been around for longer or try to study papers of the past


100K Subs AMA (Ask Me Anything)

and sort of try to estimate what kind of steps they made over previous work and then you


100K Subs AMA (Ask Me Anything)

can get an idea of how far you can look ahead over the current edge of knowledge should


100K Subs AMA (Ask Me Anything)

I pursue prompt engineering sure if you're if you if you like it that's I mean it's it's


100K Subs AMA (Ask Me Anything)

it's a cool new topic right what's your favorite chai I with milk is that is that a is that


100K Subs AMA (Ask Me Anything)

a thing or do all chai have milk I'm not exactly sure


100K Subs AMA (Ask Me Anything)

did you ever consider going to a big tech company to do a research Google open AI Facebook


100K Subs AMA (Ask Me Anything)

I I was part of Google as a research consultant and an intern during the PhD and it's it's


100K Subs AMA (Ask Me Anything)

definitely a cool place to do research now I've decided that I'd rather do do a startup


100K Subs AMA (Ask Me Anything)

it's a different climate it's a different climate to be in a big corporation or or a


100K Subs AMA (Ask Me Anything)

small one all of them have their advantages and disadvantages yeah that's it's mostly


100K Subs AMA (Ask Me Anything)

a matter of of taste and you know experiencing both things I think is a is nice so if you've


100K Subs AMA (Ask Me Anything)

done one maybe give the other one a shot have you come across research regarding data set


100K Subs AMA (Ask Me Anything)

size versus data set quality I think there is I'm not sure if someone or or if there's


100K Subs AMA (Ask Me Anything)

a lot of research looking at this specifically but for sure we see that both are both are


100K Subs AMA (Ask Me Anything)

quite important so you know like these language models they over sample corpora that they


100K Subs AMA (Ask Me Anything)

know or qualitatively you know high quality so you can make up in a certain in a certain


100K Subs AMA (Ask Me Anything)

manner for lack of size with quality or possibly vice versa and there there is research on


100K Subs AMA (Ask Me Anything)

the sort of adversarially created data sets where they create the data points in such


100K Subs AMA (Ask Me Anything)

a way that you only need like one data point per class right so they could sort of condense


100K Subs AMA (Ask Me Anything)

the data set into single data points and then that's your training set like 10 data points


100K Subs AMA (Ask Me Anything)

for 10 classes and then still the classifier generalizes so that gives a hint that if your


100K Subs AMA (Ask Me Anything)

data is qualitatively quite high it can replace size but of course that's an artificially


100K Subs AMA (Ask Me Anything)

contrived example so I've come across research like this but I don't think there's a definite


100K Subs AMA (Ask Me Anything)

answer as to how important each of the factors are what is the best way to get started with


100K Subs AMA (Ask Me Anything)

using transformers well I don't know go to hugging face do a tutorial this is all possible


100K Subs AMA (Ask Me Anything)

in colabs now so a browser is probably all that all that you need what framework do you


100K Subs AMA (Ask Me Anything)

suggest for distributed or parallel inferencing for sd based object detection models on nvidia


100K Subs AMA (Ask Me Anything)

gpu I've I have no idea I've never done object detection in inference mode or anything like


100K Subs AMA (Ask Me Anything)

like I've never done object detection beyond research so don't I'm really bad person to


100K Subs AMA (Ask Me Anything)

take advice from here in your opinion is neuro symbolic BS probably not right probably there's


100K Subs AMA (Ask Me Anything)

something to it because if you if you introspect your own head you you clearly see that you


100K Subs AMA (Ask Me Anything)

yourself are sort of manipulating symbols also the fact of how we program right we manipulate


100K Subs AMA (Ask Me Anything)

variables and so on we developed programming languages to also conform to our own thinking


100K Subs AMA (Ask Me Anything)

patterns and patterns and so on so I definitely think that something symbolic is going on


100K Subs AMA (Ask Me Anything)

in the brain and I've no I've no idea whether that is an illusion and it just arises from


100K Subs AMA (Ask Me Anything)

neural networks doing their thing or whether the brains architecture has something built


100K Subs AMA (Ask Me Anything)

in to support that and we should also augment artificial neural networks by something like


100K Subs AMA (Ask Me Anything)

this I don't know but it's it's certainly not it's certainly not BS yeah I the question


100K Subs AMA (Ask Me Anything)

is whether it arises naturally and then appears to the thinker as symbolic or whether there


100K Subs AMA (Ask Me Anything)

are fundamental structures that you need in order to enable the symbolism in a what is


100K Subs AMA (Ask Me Anything)

essentially distributed hardware leticia is here nice crossover hi leticia any advice


100K Subs AMA (Ask Me Anything)

to non ml people for doing ml no you're not you're not too far behind like ml changes


100K Subs AMA (Ask Me Anything)

so fast nowadays that if you're a non ml person you're not very far behind ml people that


100K Subs AMA (Ask Me Anything)

is if you are working with the current deep learning based systems and so on if if it


100K Subs AMA (Ask Me Anything)

comes to it like if you're doing you know class classifiers from scikit-learn things


100K Subs AMA (Ask Me Anything)

like this xg boost and so on then you probably want to get reach out to a person who has


100K Subs AMA (Ask Me Anything)

been doing this for a long time and get some advice from them how was your application


100K Subs AMA (Ask Me Anything)

process for a PhD I did my master thesis with the professor that ended up hiring me for


100K Subs AMA (Ask Me Anything)

a PhD so the lab already knew me and they had openings at that point so it was relatively


100K Subs AMA (Ask Me Anything)

smooth and it was just before the big the big boom so I think had I been later I might


100K Subs AMA (Ask Me Anything)

not have been necessarily selected or at least I would have had a severe competition whereas


100K Subs AMA (Ask Me Anything)

I don't think I had like the circumstances were the circumstances were very fortunate


100K Subs AMA (Ask Me Anything)

for me I have to say do you recommend going from a bachelor's to PhD directly what do


100K Subs AMA (Ask Me Anything)

you think about EU academia I mean if you're looking for an academic career or so on it


100K Subs AMA (Ask Me Anything)

sure it's the American model right to do bachelor's and then then then PhD I don't know sometimes


100K Subs AMA (Ask Me Anything)

it's not possible like here at ETH it's it's not necessarily possible there is a special


100K Subs AMA (Ask Me Anything)

program fast track PhD but in essence you do need a master's to get into a PhD depends


100K Subs AMA (Ask Me Anything)

on your in your school yeah what's your favorite optimization technique Adam used to be RMS


100K Subs AMA (Ask Me Anything)

prop because I did like at some point I did like three consecutive projects were always


100K Subs AMA (Ask Me Anything)

RMS prop would be a little bit better so I was like RMS prop is the best always but yeah


100K Subs AMA (Ask Me Anything)

I like just throw something at it and see what see what happens you can't you can't


100K Subs AMA (Ask Me Anything)

really go wrong with with applying Adam and doing a little bit of tuning for a learning


100K Subs AMA (Ask Me Anything)

rate yeah that's that's all already do heuristic like try a bunch of learning rates I've never


100K Subs AMA (Ask Me Anything)

used genetic algorithms in in any serious way so okay chat refreshed again sorry from


100K Subs AMA (Ask Me Anything)

a scale of zero to ten how much did you suffer during your PhD well there are definitely


100K Subs AMA (Ask Me Anything)

there are definitely times when it gets more more more strict like conference deadline


100K Subs AMA (Ask Me Anything)

times and so on things when you're stuck times when your stuff doesn't work though I have


100K Subs AMA (Ask Me Anything)

generally enjoyed the PhD so I don't want to complain yeah that's that's that do you


100K Subs AMA (Ask Me Anything)

think fairness and bias in a eyes important is as important as we think now why do we


100K Subs AMA (Ask Me Anything)

expect a to be unbiased if every intelligent being is biased well yeah okay that I guess


100K Subs AMA (Ask Me Anything)

you can you can write an entire essay about this I do think fairness and bias research


100K Subs AMA (Ask Me Anything)

is definitely warranted and important because they're like there are many there are many


100K Subs AMA (Ask Me Anything)

problems with this I think you know since we're not doing AI just out of joy I guess


100K Subs AMA (Ask Me Anything)

maybe the researchers are but ultimately we want to build tools that make our lives better


100K Subs AMA (Ask Me Anything)

and you do expect from a tool that it works in a certain way that is reliable that it


100K Subs AMA (Ask Me Anything)

is you know sort of works as advertised right and in this case you should be at least aware


100K Subs AMA (Ask Me Anything)

if there is some sort of a bias in the tool right if there's a product that some company


100K Subs AMA (Ask Me Anything)

sells you know it's it's good if it if it was unbiased in all ways but at least you


100K Subs AMA (Ask Me Anything)

should be aware if it was so on so you know with respect to that I definitely think this


100K Subs AMA (Ask Me Anything)

is this is important I do I do think the fairness aspect might be a bit overhyped in the sense


100K Subs AMA (Ask Me Anything)

that I see a lot of papers that simply reframe whatever they're doing in the language of


100K Subs AMA (Ask Me Anything)

fairness or or de-biasing or something like this and in hopes of getting their papers


100K Subs AMA (Ask Me Anything)

published because it's kind of a hype topic right now and I also think there there are


100K Subs AMA (Ask Me Anything)

there are a lot of there are a lot of I don't know pointless things done down there or yeah


100K Subs AMA (Ask Me Anything)

things like this but I definitely don't think it's not important that's what I would like


100K Subs AMA (Ask Me Anything)

to say yeah but sometimes I wish that that community was a bit more like a bit more sober


100K Subs AMA (Ask Me Anything)

a bit more neutral takes on things rather than the very opinionated takes that a lot


100K Subs AMA (Ask Me Anything)

of these papers tend to have why are transformers better than fully connected networks well


100K Subs AMA (Ask Me Anything)

they're not they're probably better for some things and and then the mixers came back and


100K Subs AMA (Ask Me Anything)

whatnot it seems that the actual architecture might be less important than the fact that


100K Subs AMA (Ask Me Anything)

you have lots of parameters and somehow shuffle the data around yeah oh Connor is here thank


100K Subs AMA (Ask Me Anything)

you Connor thanks a lot this this yeah people who don't don't oh sorry Connor is a Henry


100K Subs AMA (Ask Me Anything)

AI labs if you don't if you don't know Henry AI labs you should definitely also subscribe


100K Subs AMA (Ask Me Anything)

there I think we we we complement each other quite a bit there and in fact there's probably


100K Subs AMA (Ask Me Anything)

space for a lot more of us youtubers in the AI space because there's just so much stuff


100K Subs AMA (Ask Me Anything)

like I think Connor would agree we can't we can't possibly keep up with everything that's


100K Subs AMA (Ask Me Anything)

happening it's crazy


100K Subs AMA (Ask Me Anything)

are transformers computationally more complex than convolutional models yes I mean you can


100K Subs AMA (Ask Me Anything)

you can you can debate you know which one uses more compute and more parameters but


100K Subs AMA (Ask Me Anything)

just from a perspective of of what you need to do in a convnet you it's simply a linear


100K Subs AMA (Ask Me Anything)

operation with fixed weights and in a transformer you first have to produce the weights to do


100K Subs AMA (Ask Me Anything)

the forward propagation you have to produce them in a dynamic way so that's like one more


100K Subs AMA (Ask Me Anything)

step that you need to do in each layer yeah do you think that deep learning architectures


100K Subs AMA (Ask Me Anything)

for graph processing have a future yeah sure I mean it's probably a hardware constraint


100K Subs AMA (Ask Me Anything)

a little bit right now for graph processing because it just doesn't lend itself a lot


100K Subs AMA (Ask Me Anything)

to current matrix multipliers that expect to have sort of very rigid structure tensors


100K Subs AMA (Ask Me Anything)

but a lot of problems are graph structured and not easily structured otherwise like as


100K Subs AMA (Ask Me Anything)

tables or images or sequences or whatnot so definitely graph processing it remains very


100K Subs AMA (Ask Me Anything)

important do you have tips to address burnout in ML no chill I think FOMO is FOMO is big


100K Subs AMA (Ask Me Anything)

in in ML because there's so much stuff happening right and yeah just relax like if you've ever


100K Subs AMA (Ask Me Anything)

if you've ever shut down for a week or something you realize that you know you're still alive


100K Subs AMA (Ask Me Anything)

and new things will still keep appearing even though you've missed a bunch of things so


100K Subs AMA (Ask Me Anything)

you know slow down and do your thing that's probably a good things who disliked the video


100K Subs AMA (Ask Me Anything)

who disliked the video it's fine it's fine it's cool dislikes are good I like the dislikes


100K Subs AMA (Ask Me Anything)

like I youtube discusses always to remove the dislike button I enjoy the dislike button


100K Subs AMA (Ask Me Anything)

even like on my videos this is the best signal you know sometimes I think I did a good job


100K Subs AMA (Ask Me Anything)

with this video I did a bad job with this video but you know you see it the likes are


100K Subs AMA (Ask Me Anything)

not as much an indicator as the dislikes the dislikes are like the best indicator of whether


100K Subs AMA (Ask Me Anything)

or not I'm doing a good job and so I appreciate everyone who clicks the dislike button if


100K Subs AMA (Ask Me Anything)

they are unhappy with the with the results do you think there hasn't been research do


100K Subs AMA (Ask Me Anything)

you think why do you think there hasn't been research into better deep learning initializations


100K Subs AMA (Ask Me Anything)

that allow faster conversion there there is there's like massive research into initializations


100K Subs AMA (Ask Me Anything)

still ongoing but there is a lot of research into into initializations like yeah are you


100K Subs AMA (Ask Me Anything)

into crypto I like crypto like I like the idea of of of crypto yeah it's a cool topic


100K Subs AMA (Ask Me Anything)

it's a I'm not sure like yeah because you instantly want to combine it with AI but I


100K Subs AMA (Ask Me Anything)

don't see a straightforward way and yeah other than please pay me for my computer or my gradients


100K Subs AMA (Ask Me Anything)

or something like this who knows


100K Subs AMA (Ask Me Anything)

12 dislikes within seconds thank you thank you do you like roasty no I okay I don't like


100K Subs AMA (Ask Me Anything)

potatoes too much yeah except if they're like small and and and in a frying pan I'm not


100K Subs AMA (Ask Me Anything)

a big potato fan it's a so here is here's the thing like these a lot of these traditional


100K Subs AMA (Ask Me Anything)

foods people like oh this is a traditional food of this in this area it's just the famine


100K Subs AMA (Ask Me Anything)

foods it's just whatever the people during the famines had left to eat right so like


100K Subs AMA (Ask Me Anything)

woo the potatoes here are really a national dish like no you just you had you you had


100K Subs AMA (Ask Me Anything)

nothing else like there is other food now I'm not not limited to starch ball well in


100K Subs AMA (Ask Me Anything)

any case sorry sorry if like yeah and of course I mean I like I like I'll eat the roasty I


100K Subs AMA (Ask Me Anything)

will enjoy it if it is served to me I would not necessarily cook it myself how does your


100K Subs AMA (Ask Me Anything)

ideal day look like in terms of being productive I asked myself I asked myself this every single


100K Subs AMA (Ask Me Anything)

day and I constantly fail so you know ideally I get some work done I get some sports in


100K Subs AMA (Ask Me Anything)

and I do something for the channel every day that's sort of the ideal day and I don't I


100K Subs AMA (Ask Me Anything)

don't always like things come up and so on I don't always get to do it but I try what


100K Subs AMA (Ask Me Anything)

do you find the most awesome in AI I think it's just I think it's quite cool that the


100K Subs AMA (Ask Me Anything)

barrier to entry is low right in general for computer science topics the barrier to entry


100K Subs AMA (Ask Me Anything)

is so low like sure you cannot train GPT-3 at home but for many things you need a laptop


100K Subs AMA (Ask Me Anything)

and that's it right you can learn you can do research you can participate by simply


100K Subs AMA (Ask Me Anything)

having a laptop and and that I find something extremely cool because in many other research


100K Subs AMA (Ask Me Anything)

fields this is completely out of question you cannot go into synthetic biology with


100K Subs AMA (Ask Me Anything)

a laptop I mean you can but good luck yeah so yeah what's your favorite ML technique


100K Subs AMA (Ask Me Anything)

what do I know no idea probably logistic regression I mean you just take whatever solves the problem


100K Subs AMA (Ask Me Anything)

and that probably solves the problem most of the time can you cook sushi yes how AI


100K Subs AMA (Ask Me Anything)

hardware should be large lots good and cheap food for masters and PhD students here the


100K Subs AMA (Ask Me Anything)

University Mensa has the cheapest food just saying do you work now yes I well I try what


100K Subs AMA (Ask Me Anything)

do you think about Kaggle I think it's a it's a cool concept I know that very often Kaggle


100K Subs AMA (Ask Me Anything)

solutions are quite overfit to the particular problem but I see that more as a failure of


100K Subs AMA (Ask Me Anything)

the competition of a competition proposers than the competition solvers so I think if


100K Subs AMA (Ask Me Anything)

anything Kaggle is cool and we need to train the competition hosts better you cannot train


100K Subs AMA (Ask Me Anything)

GPT-3 at home how much would you bet on that yes if you if you don't know yet look up look


100K Subs AMA (Ask Me Anything)

up Lucas's homebrew NLP project they'll be able to train GPT-3 at home quite quite soon


100K Subs AMA (Ask Me Anything)

so it's on github it's clash Luke homebrew NLP what is your preferred operating system


100K Subs AMA (Ask Me Anything)

oh okay um for for phones Android because I'm not sure if the iPhones have widgets by


100K Subs AMA (Ask Me Anything)

now or so on but Android is just it's more sympathetic to me the iOS is just too too


100K Subs AMA (Ask Me Anything)

restrictive like I get it to streamline things but it's too much and then for computers I


100K Subs AMA (Ask Me Anything)

use I use macOS and yes I know I know that's not really popular but as a like it just works


100K Subs AMA (Ask Me Anything)

like okay I haven't used Linux for a while but it just it's it's a really good UI it


100K Subs AMA (Ask Me Anything)

just works and I have a Unix shell so yeah I can I can do my my coding and all in the


100K Subs AMA (Ask Me Anything)

terminal and I have a UI that works for everything else and yeah that's I'm happy with that for


100K Subs AMA (Ask Me Anything)

servers I prefer something like like Ubuntu just because I know it I know where where


100K Subs AMA (Ask Me Anything)

things are there so yep share your vimrc file okay I will I will I will share my vimrc file


100K Subs AMA (Ask Me Anything)

some I can give an introduction to it in some video it's true if your startup fails would


100K Subs AMA (Ask Me Anything)

you consider moving to Silicon Valley no why what I have been I've been in California a


100K Subs AMA (Ask Me Anything)

bunch of times now why would anyone live there like I get that in something like the 90s


100K Subs AMA (Ask Me Anything)

this had an appeal but now it's like the state is super duper dry it's burning all the time


100K Subs AMA (Ask Me Anything)

there's giant there's like a risk of earthquakes constantly they have rolling blackouts because


100K Subs AMA (Ask Me Anything)

there are too many people their farmland is degrading heavily so it's not like they're


100K Subs AMA (Ask Me Anything)

they're gonna be this who were the the farm of the nation for very long anymore they've


100K Subs AMA (Ask Me Anything)

like giant problems with homelessness and where they haven't there the the the prop


100K Subs AMA (Ask Me Anything)

the cost of living is so high if you live like in San Francisco or or in the Bay Area


100K Subs AMA (Ask Me Anything)

I don't I don't get why people still go there like if you're there you're established and


100K Subs AMA (Ask Me Anything)

so on I sure but actively going there like I think there are just just quality of life


100K Subs AMA (Ask Me Anything)

wise better better options even if you say you want to go to like the center of what's


100K Subs AMA (Ask Me Anything)

happening in tech there are probably better options available how do you go through CVPR


100K Subs AMA (Ask Me Anything)

and Nurev submissions and identify quickly what papers matters I don't like conference


100K Subs AMA (Ask Me Anything)

okay well submissions are different submissions are a different thing but certainly accepted


100K Subs AMA (Ask Me Anything)

papers are they're just out of date like they're just they're like half a year old like who


100K Subs AMA (Ask Me Anything)

cares can NLP automate bureaucracy yes it can I mean some well I'm building a startup


100K Subs AMA (Ask Me Anything)

based on that premise so are there any significant foundational works in AGI yet I don't know


100K Subs AMA (Ask Me Anything)

it depends on what you consider AGI who knows no idea sorry like probably probably


100K Subs AMA (Ask Me Anything)

a significant work will already be defining AGI in a correct way I'm not sure you can


100K Subs AMA (Ask Me Anything)

consider everything we're doing now significant or foundational to it is a t5 optimization


100K Subs AMA (Ask Me Anything)

a good thesis topic for a master's degree depends so depends on you know which lab and


100K Subs AMA (Ask Me Anything)

what you're trying to do after if you're aiming for like certainly it's a good topic right


100K Subs AMA (Ask Me Anything)

it's cool topic you can do something right and you can you can go and you can say here's


100K Subs AMA (Ask Me Anything)

a bunch of stuff I found that make a difference and now I'm X much faster or better or something


100K Subs AMA (Ask Me Anything)

like this if you have the compute available sure you have to be careful what you want


100K Subs AMA (Ask Me Anything)

to do after if you want to go into like a PhD and you want to go to a professor that


100K Subs AMA (Ask Me Anything)

requires that sort of so some professors they like their students to be competent in a more


100K Subs AMA (Ask Me Anything)

theoretical or mathematical way so you'll have to see that in your thesis somewhere


100K Subs AMA (Ask Me Anything)

you demonstrate a little bit that you're not just like a practical person that that hacks


100K Subs AMA (Ask Me Anything)

around but that's that's pretty much all I have to say please suggest a good research


100K Subs AMA (Ask Me Anything)

topic bandits band like they don't die banded research does not die I don't get it but you


100K Subs AMA (Ask Me Anything)

know I'm hearing computational intelligence more these days what's your opinion in it


100K Subs AMA (Ask Me Anything)

sure you mean other than you mean instead of AI sure I mean it's probably a more descriptive


100K Subs AMA (Ask Me Anything)

a better better description of what's going on rather than artificial intelligence computational


100K Subs AMA (Ask Me Anything)

intelligence because artificial could also mean that like Frankenstein is is franken


100K Subs AMA (Ask Me Anything)

sorry Frankenstein's monster is also artificial intelligent what was the homebrew link again


100K Subs AMA (Ask Me Anything)

look it is a Chinese repos sorry it's a it's it's on github it's or you can on our discord


100K Subs AMA (Ask Me Anything)

we have a channel for a homebrew NLP and the discord link should be somewhere in the description


100K Subs AMA (Ask Me Anything)

yeah cheap 80k dollars budget lambda labs a GPU system or spend it on cloud if you have


100K Subs AMA (Ask Me Anything)

the opportunity for if you have the opportunity for a local machine and you use it continuously


100K Subs AMA (Ask Me Anything)

it's probably better to get a local machine if you can manage it right you also need to


100K Subs AMA (Ask Me Anything)

calculate that you have to actively maintain it yeah but the costs are are way cheaper


100K Subs AMA (Ask Me Anything)

if you have it locally sorry sorry C++ for machine learning or just learn a lot of Python


100K Subs AMA (Ask Me Anything)

you know yeah again programming languages I like don't care but right now it's probably


100K Subs AMA (Ask Me Anything)

way easier for you if you do learn Python it's not it's not a hard language that I mean


100K Subs AMA (Ask Me Anything)

it is a hard language don't don't get me wrong I so like really understanding the object


100K Subs AMA (Ask Me Anything)

model and things like I don't know like when late binding pulls and exactly what order


100K Subs AMA (Ask Me Anything)

things are resolved and so on like there's a lot to learn in Python but the level you


100K Subs AMA (Ask Me Anything)

need for doing machine learning it's pretty easy to learn so and and it will be it will


100K Subs AMA (Ask Me Anything)

be useful rather than trying to stick to C++ not not you know not the least because everyone


100K Subs AMA (Ask Me Anything)

else's code is in Python and you'll be able to just copy that of course retaining the


100K Subs AMA (Ask Me Anything)

appropriate license notifications any tips for someone getting into legal tech wanting


100K Subs AMA (Ask Me Anything)

to apply and machine learning data to legal problems should I focus on NLP anything less


100K Subs AMA (Ask Me Anything)

obvious that I should know apply to our startup no I mean other than that you know just domain


100K Subs AMA (Ask Me Anything)

knowledge is important understand what your data understand what you're doing so if you're


100K Subs AMA (Ask Me Anything)

a tech person try to team up with legal people because it'll save you it'll save you a lot


100K Subs AMA (Ask Me Anything)

of of headaches of course yeah did you do any work relating to biology in your time


100K Subs AMA (Ask Me Anything)

at ETH no I have I've I've taken a bunch of life science courses in my bachelor's at the


100K Subs AMA (Ask Me Anything)

University of Basel I also before that I did a year of studying human medicine so I have


100K Subs AMA (Ask Me Anything)

some I have some background in biology but I have never done any research in it but I


100K Subs AMA (Ask Me Anything)

know it's a cool cool new upcoming topic yeah do you have guilty pleasures or are you just


100K Subs AMA (Ask Me Anything)

studying or working all day yes I waste I waste a lot of time watching YouTube videos


100K Subs AMA (Ask Me Anything)

on whatever today I wasted like an hour just watching Casey Neistat videos or I watch videos


100K Subs AMA (Ask Me Anything)

about urban planning or something like like this like I I waste I waste time just as anyone


100K Subs AMA (Ask Me Anything)

else does so like yeah what do you think about Microsoft brainwaves crypto mining sounds


100K Subs AMA (Ask Me Anything)

legit is this legit I mean this might be legit I don't even know I don't even know at this


100K Subs AMA (Ask Me Anything)

at this point do you think we can reach AI by gradient descent or do we need new learning


100K Subs AMA (Ask Me Anything)

algorithms well in gradient descent it certainly might have its part right it's a good optimization


100K Subs AMA (Ask Me Anything)

algorithm for for neural networks so yeah who are your top three AI researchers I you


100K Subs AMA (Ask Me Anything)

know like Schmidt Uber has this new blog post where he calls look up Benjo and Hinton LBH


100K Subs AMA (Ask Me Anything)

I just thought that's a cool acronym like LBH but I don't I don't know I don't have


100K Subs AMA (Ask Me Anything)

favorite favorite researchers you know there are there many more than three that do cool


100K Subs AMA (Ask Me Anything)

work do you play any games I I used to I used to play games I no longer have time for playing


100K Subs AMA (Ask Me Anything)

games so yeah could you upload this AMA on your channel I haven't said anything outrageous


100K Subs AMA (Ask Me Anything)

so far so I actually might you know it's always a bit yeah a bit a bit with the live things


100K Subs AMA (Ask Me Anything)

especially when I show my screen I never know like have I typed something into my browser


100K Subs AMA (Ask Me Anything)

and then an auto suggest had like some search from I don't know when where I was wondering


100K Subs AMA (Ask Me Anything)

hmm how like how does this very gory thing work or something so you never you never know


100K Subs AMA (Ask Me Anything)

yeah but given that this is just this I might sorry why is genetic algorithms not more popular


100K Subs AMA (Ask Me Anything)

well I think it's well first of all it's not suited to the hardware we have and I don't


100K Subs AMA (Ask Me Anything)

mean just GPUs genetic algorithms need super duper duper massive parallelism because usually


100K Subs AMA (Ask Me Anything)

they happen in populations of living beings with I don't know thousands or millions of


100K Subs AMA (Ask Me Anything)

individuals at the same time recombining and developing with different pressures from the


100K Subs AMA (Ask Me Anything)

environment and so on and and that is just not going to happen on a computer that essentially


100K Subs AMA (Ask Me Anything)

does sequential computations or minimal parallelism even on a GPU do you always wear glasses yes


100K Subs AMA (Ask Me Anything)

they're stuck yeah are you still active in us that said what sports do you do else I'm


100K Subs AMA (Ask Me Anything)

yes I'm still active that's that pretty much covers my sports needs at the moment other


100K Subs AMA (Ask Me Anything)

than that I just lift sometimes Lex asking it what's what is your meaning to life I have


100K Subs AMA (Ask Me Anything)

no idea no clue what is the story of the big sunglasses I don't know I just I thought


100K Subs AMA (Ask Me Anything)

I'd wear them and now people ask that question and I think it's funny that people ask the


100K Subs AMA (Ask Me Anything)

question so I keep wearing them why don't you use night but in your chat I don't know


100K Subs AMA (Ask Me Anything)

what night but is I am terrible at tech I guess what university did you graduate I have


100K Subs AMA (Ask Me Anything)

a bachelor's degree from the University of Basel in Switzerland and I have a master's


100K Subs AMA (Ask Me Anything)

and a PhD from ETH in Zurich what do you think of the learned hyper parameter optimizer paper


100K Subs AMA (Ask Me Anything)

and why does it get zero news coverage I have not heard of it maybe because it's gotten


100K Subs AMA (Ask Me Anything)

zero news news coverage but usually just just usually I don't know the paper but usually


100K Subs AMA (Ask Me Anything)

the meta learning frameworks and so on they sort of they shift the problem right they


100K Subs AMA (Ask Me Anything)

shift the problem from optimizing a problem to optimizing the optimizer and usually they


100K Subs AMA (Ask Me Anything)

run into the same problems when optimizing the optimizer and it happens to work for the


100K Subs AMA (Ask Me Anything)

papers or the techniques they look at but then very often the trade-off of using such


100K Subs AMA (Ask Me Anything)

a system aren't worth it because they often don't work as well as advertised plus you


100K Subs AMA (Ask Me Anything)

still have the problem of having to now optimize or hyper parameter search inside of your optimizer


100K Subs AMA (Ask Me Anything)

yeah even if the papers say you don't have to do that you quite often do do you think


100K Subs AMA (Ask Me Anything)

Sanskrit is good for AI I'm not sure what what you mean like to research on Sanskrit


100K Subs AMA (Ask Me Anything)

or I'm not I'm not sure about the question have you been in Poland I have been in Poland


100K Subs AMA (Ask Me Anything)

yes I have visited Poland before cool country very very there's sort of a there's also a


100K Subs AMA (Ask Me Anything)

bit of a like I experienced the Polish as being very proud of Poland or being being


100K Subs AMA (Ask Me Anything)

Polish and and and in general they have they think yeah Polish things are cool and you


100K Subs AMA (Ask Me Anything)

know that gives it gives the gives the people a I don't know a nice a nice attitude because


100K Subs AMA (Ask Me Anything)

they're well they're in Poland so they're they're a bit you know already a bit happy


100K Subs AMA (Ask Me Anything)

about that which is cool what do you do for your day job I am a I yeah program mostly


100K Subs AMA (Ask Me Anything)

for my own startup what do you think about geometric deep learning well given that haven't


100K Subs AMA (Ask Me Anything)

we haven't we just released like a giant street talk episode but is this no am I saying


100K Subs AMA (Ask Me Anything)

too much here no we have right yeah it's I mean it's it's it's certainly certainly cool


100K Subs AMA (Ask Me Anything)

like this this pushing pushing it's it's time we push the deep learning to to new modalities


100K Subs AMA (Ask Me Anything)

and so on be that graphs or be that you know other manifolds and whatnot there's an entire


100K Subs AMA (Ask Me Anything)

problem space out there that is not accessible by the classical methods of just assuming