skysight-inc/HackerNews huggingface dataset:
Here's a (kinda) ELI5: you would use a language model to create "embeddings" of the text, which you can think of as a set of numbers representing the "meaning" of a set of characters.

These numbers can be plotted as points in a space, and embeddings of things with similar meanings are plotted close to each other. So things like "exam preparation" would have embeddings close to things like "top study tips".

Say you have created embeddings for a large corpus of text (in this case all youtube captions) once. If you create embeddings for a user query, you can search for embeddings close to it, and these will be "semantically" similar to the query.

The advantage is that unlike traditional full-text search, the user doesn't need a query that includes words present in the text.
What do you expect when you get a few 10s of millions of users basically overnight. Id take the more generous view which is what they have provided in a short time is very impressive.
You'll be pleased to hear it is something! There's a whole school system designed around this approach - parents as staff, non-directive learning, secular, democratic, no age stratification, school as an Ivan Illich style workshop for learning. They're called Sudbury Valley and they've been around since the 1960s. https://en.wikipedia.org/wiki/Sudbury_Valley_School

I actually made a radio documentary about one of these schools, Wicklow Sudbury in the South East of Ireland
https://soundcloud.com/garethstack/the-free-school

As someone who had a very rough experience of school (the social side being the worst part), it was inspiring to see a place where kids could truly be themselves and pursue their interests (often to levels far beyond their 'grade year' in traditional education).
We will home school our children. They're not old enough but my wife is not planning to go back to work until all our children have completed their home schooling.

We've seen friends do an amazing job and their children have done very well academically and socially.

I have friends who work in our public school system. They tell me how hard it is. Most of their time is spent on a few problem kids. I respect what they do but think my wife can do better as she will be better resourced to teach when compared to one teacher with 30+ students.

It's our dream to give our children the best we can. We might sacrifice on our income but we think it's worth it.
It actually seems plausible since it has the side effect of stopping addictions and improving your self-control!

https://www.theatlantic.com/health/archive/2023/05/ozempic-a...

But I don't think behavior and diet are necessarily the cause; there's some room for gut bacteria (which control your behavior anyway) and environmental pollutants.
The problem with homeschooling is that it makes it very easy to hide all kinds of child abuse. In government-run or at least government-audited schools, teachers (who are often mandatory reporters) have a chance to spot signs of sexual, emotional or physical abuse - children who are homeschooled have no one to turn to.

Additionally, government-run/-audited schools have a mandate to actually teach children science and facts, whereas homeschooling parents or religious cults often have absolutely zero requirements on what they have to teach their children - no requirements about even basic sexual education, biology, history, maths or ethics. These children often enough are so under-educated the only employment they can find is at some sort of religious cult.

Homeschooling without audits is child abuse.
Public school is one of the few places and times in life where people are forced to be closed in a room with people they don't like at best, or suffer systematic violence at worst, with no chance to just leave.

Would be funny to see workplaces try to implement some of the weird practices schools do, like shuffling people around into random groups that may have built zero social rapport and have zero idea of each other's skills, and make them complete a project in a few days.
Show HN: PuzzleMoji, a daily emoji pictionary challenge against ChatGPT
And somehow the prison-scholar complex doesn't count?
If that was truly the reason why, and not a convenient excuse, then governments would state mandate social activities and not take children from their parents, which would be just as abusive.

Instead, it’s all about mandating government control over children.
> Nginx was forked from Apache

Source? I fail to see any similarities between the two.
And why not see which parents teach the best by measuring test results? And then have that person teach full time and the rest can work regular jobs again and oh wait it’s schools again isn’t it
I know many home schooled children. I see no evidence of poor social development. In fact I see more emotional scars left by bad interactions at public schools than I do from homeschooling.
I think they also had problems before with the opposite issue. Once OpenAI introduced paid subscription, they didn't implement "back to basic" account conversion after the billing expiration, I think I used it for more than two months instead of a single one that I paid for. Felt really startup-y
People in the U.S. Think They Are Better Than They Are. Asians Don’t
I'd suggest that this perspective is tainted by the association in the United States between home schooling and religious separatism. Home schooling in Europe (and in some places in the US) is much more often about parents coming together to provide a safer, less structured, less authoritarian, more project based space for their kids to learn. Check out the unschooling movement - https://en.wikipedia.org/wiki/Unschooling#:~:text=Unschoolin....
Anecdotally, I was brought in to improve data processing for semiconductor manufacturing quality control. To say that wasn’t exactly my field is an understatement. Working with an amazing team that was open to change was a great experience and we managed to implement significant improvements for many aspects of the processes we looked at.
> I stopped using cocaine and for some reason gained weight, the post
And barley is correctly spelt, just not the intended word. A grammar check might have revealed it.
Could you give an example of an embedding space that is only meaningful locally?

The word vector idea of modifying a word by some operation e.g King->Queen ~= man->woman ~= uncle->aunt
Which intuitively seems non-local to me.
Owning a gun is not a human right and I will never entertain any supposition that it is, no matter how zealous or contrived.
Discovering (in my late 20s) that I was a natural-born follower of Epicurus[1] was a revelation that helped solve some (seemingly insurmountable) mental and emotional problems I was going through at the time - once I realised I needed to stop self-imposing tasks, schedules and deadlines on myself and accept/work with my natural instincts towards life.

I'm also, in a strange way, glad that I didn't discover Epicurus earlier. Choosing the more difficult path is also part of my personality - but I have found some incredible friends as a result.

[1] - https://en.wikipedia.org/wiki/Epicurus
> s/he

It's a "she": https://openheartproject.com/about/

> has been failing

Not so sure about that. Read the page at the link (It's the "About" page on the site).
Dividing by 7 is also a cool trick and it’s way easier than this.

1/7th is 0.142857 recurring. All you need to remember is one-four-two-eight-five-seven. Say it over and over. It’s my favourite number.

The magic: to get 2/7, 3/7, any/7, just move the decimal point:

- 2/7: 0.285714285714…

- 3/7: 0.428571428571…

- 4/7: 0.571428571428… (I’m typing these out but ‘from memory’ but not really: only by knowing 1-4-2-8-5-7)

- 5/7 & 6/7: left as an exercise for the reader.

So then the trick is to play a bit of mental magic. Pretend like this is really hard and that every decimal point is stretching your mental capacity to its very edge.

31/7? That’s 4, with 3/7 left over. Say it out loud as you gaze in to the middle distance and do this difficult, difficult calculation in your head: “four point four two eight five seven … one four … two eight five … seven one four …” and so on.

A fun trick which is very occasionally practically useful.
In your opinion, which should apply to your own children.

It might also be argued that "in many cases" sending your children to public school where they'll receive a vastly inferior education is child abuse.

In some people's opinion, not teaching your children about Jesus is child abuse, and vice versa.

So then who should draw the lines? When should the government and society have a greater say over a child than their own parents?

If literacy is falling year after year in a country and the schools are not making changes, should a parent not consider homeschool?

My kids attend public school, by the way, but I think this is a worthwhile discussion.
I got a placeable fax machine...
If X works in something low level like device physics then there are a limited number of companies doing cutting edge fab stuff like that. Intel, TSMC, Samsung. The small number of companies limits your salary potential.

It's the same with being a maintenance technician for a piece of ASML 3nm semiconductor manufacturing equipment. You may be highly skilled but if there are only 3 companies in the world that will hire you then your salary potential is limited.

I know about 30 people developing hardware at Apple (writing Verilog, custom analog serdes design) and you can see that their software and hardware salaries are similar. In some cases hardware is higher although I suspect that is because of the limited sample size of salary data at the ICT6 level.

https://www.levels.fyi/companies/apple/salaries/software-eng...

https://www.levels.fyi/companies/apple/salaries/hardware-eng...

There is more to life than money but people who care about money need to look into the companies and salaries before they commit themselves to 4 to 10 years of college.
There has been a drastic degradation of crypto culture in the last couple of years. From speculation being the trojan horse that was supposed to lead to a decentralized future, it has devolved into speculation being the only use case.

The problem with monetizing anything with crypto in this environment means that people will only buy it for speculative purposes. Which means that instead of building anything sustainable, you just end up building trash and spending on marketing to keep the speculative hype train going.

It’s like running a publicly traded company, but with extremely fickle shareholders.
How secure is your Kubernetes environment?
This will come in handy. I’ve always wanted to count how many times Lex Fridman has referred to something as a beautiful dance.
Apple? How are they involved?
Indeed. "Object-oriented" fluent notation is basically equivalent to infix notation.

https://mlajtos.mu/posts/new-kind-of-paper-2
Perhaps I'm wrong but how is this full text search? It's just using the LIKE operator
The Apollo 13 crew might have preferred to have a backup sent rather than piecing together a working craft from scraps.
I'm quite surprised to read what feels like a cloudflare ad from THC..
> the world is working just fine and I am unable to adjust to it

It is not. Believing that everything is just fine would be actual proof of privilege. Because the average Westerner has a roof over their head, heating, food and are chronically dissatisfied, depressed, purposeless, powerless against their bosses and those in high power that rule over us (yet they tell you your vote counts!). But somehow they are shamed by their peer if they voice their dissatisfaction, and told "oh, you would prefer a life of subsistence? Because that is the only path!"

Where have all the philosophers, activists, idealists of the 19th century gone? Those that thought of a better world, workers to be respected, a fair economy? Many would like to think we have arrived, that this is the fated utopia they have worked for.

Nonsense.
The light doesnt have to reach all the water... it has to reach the molybdenum sulfide/copper catalyst in the first stage of the process so stirring should enable that
Public schooling without audits is just as likely, if not more so, to result in child abuse as well.
Here in NZ you have to apply for permission to homeschool. You typically need to follow a curriculum.

The homeschooled people I know have outperformed most of their peers academically. Except one with Asperger's.

As for child abuse, sure but most will still have interactions with medical personnel, and other families via sports and friends.
> One way to tackle this undersupply/oversupply issue

...is to pay the drivers while they are working for you. While waiting for fares, they're not free to do whatever, and should thus be compensated. That Uber won't pay their drivers while they're working seems criminal.
I thought that they use the dot product during training[0] and then the cosine similarity during inference.

Sometimes the vectors are pre-normalized for inference (thus reducing cosine sim. to just the dot product), is this what you're thinking of perhaps?

[0]. Not at my desktop, but I read this in the Stanford NLP course in the past two weeks, specifically the section on the skip gram algorithm (word 2 vec)
Its frustrating to realize we've been at this task of raising and educating children for the better part of 250,000 years and we still haven't got the knack of it.
Thank You for share with us, Looking good to me
How would making videos more indexible move people off of YouTube? Once you're there, you'd stay there, with all the current recommender algorithms still in effect; all the external indexability would do is give Google (and Bing, and everyone else) more reasons to lead you into that labyrinth.
They are probably collaborating with the Chinese now since Chang'e 4.
Abstraction layers become simpler, more rigid and more robust as you peel them.

A painter uses rules of thumb all of the time, yet his work is entirely dependent on chemical engineers getting their science and formulas right. Artistic painting is just one of many uses of paint (and probably its most approximate), but both the painter and the industrial product engineer need the same quality assurances regarding their colors.

Hardware needs to be solid to allow all kinds of software the freedom to be built.
Adding a lot of algae always makes daphnia reproduce a lot and eventually they eat all the algae.

But I think I figured out the solution: many fish. With enough fish you can keep that initial wave of daphnia under control, so that they don't eat all the algae and crash the oxygen, so the fish don't die.

This seems to last, although it is still right on the edge of oxygen.
> This is opposed to coming up with long term solutions that involve re-evaluating daily decisions that lead to some of these diseases in the first place.

Medicine tried this. It's extremely hard to actually to do it in practice. Obviously, it's better solution, but we are living in real world, where we have to choose "good enough" solutions over those deemed "better, but infeasible for 90% of patients".
I spent much of my life doggedly clinging to the idea that if I managed to beat myself hard enough, morale would improve.

It worked, insofar as it kept me going for years, and years, and took me places - but by the end I was a husk. This path leads to burnout.

Post-burnout, the floggings continued until I finally got it through my thick skull that I was inflicting harm on those around me, as watching someone you love castigate themselves incessantly is apparently not easy.

I’ve finally just about stopped, after a few years of therapy and a lot of time in nature. Turns out that the motivation I had as a small kid, before I was taught to be cruel to myself at age seven, was still there, but had been overlain with a system of brutality that was necessary for my survival in the boarding school environment.

I once again find myself doing things with passion and joy, rather than drudgingly hauling my sorry ass through the thorns.
That is full text search. It just doesn't maintain an index because it's a small enough dataset per channel that it can brute force it in memory.
It’s also tainted by authoritarian regimes indoctrinating people to believe the only ones capable of teaching the children are the aforementioned regimes.
While we're too busy to homeschooling, we love our children too much to do other than pay for tuition at a school that is committing acts of education on the kids.

I have plenty of conversations about the TWO genders, and the truth that "form follows function".

One hopes that the storm of folly raging in the culture consumes itself soonest.
There's only one of these Good Things I regret never having succeeded at starting, and that's journaling. As I'm getting older, I realize there are more and more years during which I've been alive and it's getting harder to look back at them and make sense of them, or remember when a particular thing happened. I'm 45 now, which really isn't that old, but also not that young anymore. When I was younger, say 25, I had 5 years of (somewhat) adult life behind me, and they formed a relatively coherent and linear story. I now look back at 25 years of being an adult, and that story is now five times as long, way less coherent, and no longer linear, so remembering it all is becoming almost impossible. But the longer I live, the more often I find myself wanting to remember when a certain thing happened, or what my state of mind was at a certain point. I also have a wife and have three kids, so those add more stories to remember (or more characters in my own story).

I've been thinking of catching up. To start an Excel sheet, with years in the left column, and then start filling in events that I can remember or verify with certainty (marriage, births of kids, buying the house, jobs, projects, travels). Hopefully this would trigger more and more memories that I can then fit into that context, until I get to a somewhat complete and coherent story of what's been going on until now.

I think this might also make starting journaling easier because I would be continuing a story, instead of starting to write one at a random point in time.
> Why do think the state is capable of addressing it better than the market?

Because the status quo isn't working. There are by contrast state housing provided solutions that are working to allow people to live affordably, even in expensive european countries. See Vienna

https://www.politico.eu/article/vienna-social-housing-archit...

> Well literally everyone needs a home so I have to disagree. No matter who has the money, they need a home.

Agreed. Everyone needs and should have a right to a home. However if you have means in Ireland you are likely not in danger of homelessness, likely not living in a literal slum, and can to a much greater extent protect yourself from abusive behaviour from rentiers. You're not in the emergency situation many of us find ourselves in currently.

> The fix is not necessarily to build more cheap homes, it's just to build more homes, period.

Absolutely. We need to build a vast amount of new homes. Most of these need to be much more affordable than the existing supply - which is currently out of the reach of an entire generation - https://www.irishtimes.com/your-money/2023/03/07/housing-cos...
Agreed. Allowing children to sleep at home is also very dangerous. Not to mention spending unsupervised time during their waking hours with parents and family members without regular government audits. Thank you for standing up for children.
Yeah you're right. It probably really comes down to a lack of potential employers. Hopefully this push by the US can change that.
Careful about your experience representing a biased sample. For children who had poor social development likely resulted in less likelihood of knowing you at all.
Being forced to be in a room and work with people who may not like you or you may not like I think is great for a developing child.

It teaches resiliency, builds mental strength, and can develop strategies on how to work with people someone may not get along with.

Taking out extreme bullying or worse, we need to stop sheltering the younger generation else they’ll, on average, become less able to handle stressors later in life.

The key part of this equation, to my armchair thinking, is having parents who are active in teaching the child what strategies to employ in difficult situations, and teachers that mediate to ensure nothing gets out of hand.
It was not a fork. Some ideas from apache which were good can be found in nginx (as well as many other web-servers), but not the code. Also nginx architecture is fundamentally different from apache of that time (pre event mpm).
> Would be funny to see workplaces try to implement some of the weird practices schools do

The objective of a school (education/socialization) is totally different than a workplace. IMO Oranges x Apples comparison

> like shuffling people around into random groups that may have built zero social rapport and have zero idea of each other's skills, and make them complete a project in a few days.

Not everyone is software developer. You described exactly the working environment of police officers, doctors, civil servants or even people working in huge institutions like banks
The problem I ran into is that, like I said, YouTube doesn't seem to get indexed by hypertext inward-edges from other sites like a regular website does — and so you can't search by how you recall a video being described in pages that link to it; instead, you have to remember how the video describes itself. Which it may not always do well.
People need to read about Cognitive Distortions: that's the fancy pants term for "playing yourself", which is maintaining a negative or otherwise deceptive self conversation about what you are doing, thinking, and behaving. If you're self conversation is not honest, you're capable of literally anything, because your self deception is the vector you can be emotionally manipulated by irrational desires, the hypocritical values you may have been raised, or bad actors seeking to exploit others.

All this can be avoided by seeking to audit one's own self conversation. If this sounds reasonable to you, I suggest you do a web search or ask ChatGPT about Dr. David Burns, the School Of Cognitive Behavioral Therapy (CBT) and the checklist of common Cognitive Distortions (common self lies). In little more than a half hour of research you can begin your own self honesty revolution. It is HUGE and it is PERSONAL REVOLUTION that will remake you entirely as a significantly more rational, adept and capable individual.
Do you have a link for that claim?
I once read that a family from Germany tried to get asylum in the USA because they weren't allowed to homeschool in Germany.

They didn't succeed.
> how is this full text search?

It allows searching the full text, instead of just title, description, or keywords.
On web search, you can append &lr=lang_it to the URL. Maybe make it into a Chrome extension.
pay very little to do
SpaceX benefits from Elon Musk's obsession with becoming the first feudal lord on Mars. That helps with long-term focus.
>The most obvious downside is probably that the social dimension of public schools is hard to replace.

I bet it's not that hard to replace. There are opportunities for interactions outside of school. Sports teams are a common example.

There are many after school clubs that children can join to be exposed to other children.

If you only have one child I could see them having limited contact with children during their school day but often siblings provide lots of opportunities to learn how to get along with others.
The federal government can’t put in a property tax on these rights because of the direct tax clause. The state governments could tax the water rights, but not in a way that is “confiscatory” or “excessive.”