skysight-inc/HackerNews huggingface dataset:
This is the first time I have heard Yoshua Bengio described as "dumb".

According to the Oxford English Dictionary, the definition of AI is:

>the theory and development of computer systems able to perform tasks normally requiring human intelligence, such as visual perception, speech recognition, decision-making, and translation between languages.

Clearly GPT-3 fits that. You are welcome to have your own definition, but you can't just claim that everyone else is wrong just because they are instead using the standard one.

>2. Goals for LLM development were set for the personified attributes, and not the actual functionally of the real thing. OpenAI brags about how GPT4 scores at human tests: as if that has any bearing on the model itself, and not simply its content.

Yeah, evaluating language models is extremely difficult. Hence OpenAI Evals, etc.

>3. The success of an LLM at a personified goal is determined by magic. Does the black box output what I am hoping it will? How do I improve it? Weights? Better training corpus?

Not sure what you mean by magic, but it is certainly hard to predict what they can and can't achieve. I suspect if you asked a panel of experts in 2020 when we would see something that can achieve what GPT-4 was almost all of them would have been wrong, but I am open to evidence to the contrary.

>4. An LLM is understood to be a person in a black box, and we could not possibly understand what that person will do next. Danger!

No serious person believes this.
> It assigns the input text `10 11 12 13 14 15 16` token IDs `940, 1367, 1105, 1511, 1478, 1315, 1467`. How is it supposed to figure out incrementing numbers from that?

Having the token numbers sequential is meaningless and makes no difference to how a NN works. They are just pointers.

It needs to learn that the sequential value of the things pointed to by these tokens is important and it has only partially done that.

We see that in children learning their numbers too: As a small child "what comes after 39" (or some number) and you'll often get wrong answers.
> "If somebody builds a too-powerful AI, under present conditions, I expect that every single member of the human species and all biological life on Earth dies shortly thereafter."

> "There’s no proposed plan for how we could do any such thing and survive. OpenAI’s openly declared intention is to make some future AI do our AI alignment homework. Just hearing that this is the plan ought to be enough to get any sensible person to panic. The other leading AI lab, DeepMind, has no plan at all."

Relative to the people actually building the AIs, Eliezer Yudkowsky is more pessimistic. But not to nearly the extreme you might think. Here's a recent survey of published machine learning researchers: https://aiimpacts.org/how-bad-a-future-do-ml-researchers-exp... . Those predictions are optimistic enough that, given the astronomical upside, if we were making a one-shot decision to plough ahead with AI or commit to no AI forever, it might be worth the risk.

But this is a survey of published machine learning researchers. People who think AI will destroy humanity are a lot less likely to write papers about machine learning. And we aren't talking about giving up on AI forever, just delaying it until we're closer to ready. I don't know how long a delay will be necessary; it might be years, it might be decades. Research into AI alignment seemed to speed up pretty drastically when LLMs hit the scene, so I think there's cause for hope. But right now the status quo is zero time: the AI labs are rushing ahead as fast as they possibly can.

If you think Eliezer's right about the risk, then the right decision for us to make, collectively as a species, is to shut down AI development for awhile. If you think Eliezer's wrong about the risk, but the survey of published ML researchers is right about it, then the right decision is also to shut it down for awhile.

Lots of people are responding to this by talking cynically about politics. This is a mistake. Cynicism like that makes self-fulfilling prophecies; but the ability to coordinate does exist.

You think China will build it if we don't? I don't think Xi Jinping is suicidal. You think AI labs will do it anyways, in spite of a government ban? The US government isn't very competent overall, but there are parts of it that can wake up and get things done when literally every executive, Senator, and Representative is otherwise likely to die. You think individuals will do it on their own, in secret? Right now those individuals are getting prestige, GPUs, and venture capital; they'll at least do it a lot less, without those things.

Many people have become desensitized to talk of human extinction, due to repeated hyperbole coming from the environmentalist movement. This is not the same. Global warming might be very bad, but it probably isn't going to kill you personally. Rushing to make a superintelligence is likely to kill you personally.
That was the release schedule, but the average is one every two weeks to hit it. If you were trying to get it all in the can before anything aired you'd be committing to finishing an episode per week.

My understanding is that they split the difference: you needed to do most of your principle photography in the first half of the year, and then post-prod earlier episodes to account for delays.
Well, as one frustrated would be immigrant (mind you, it was not to the US) once said to me:

"What other evidence do these people need that we have not yet sent!? Do they want to see us f***?"

It seems some people get more frustrated than others.
Yes, my impression is there are less such books written nowadays that explain the conceptual fundamentals, unfortunately.
(Off topic)

“despite or perhaps because of, sucks” - https://idlewords.com/2003/04/despite_or_perhaps_because_of_...
I believe the moral of the story is to run your opening line by literally any human ("Modern software engineering is rotten. I should know — it's been my livelihood since I graduated from college in late 2019." - literally laugh out loud funny) before submitting it to one of the main discussion boards on modern software engineering - sometimes you reap what you sow
Scale was a good book -- "Dragon's Egg" meets noir/espionage thriller. Had a good time with it. I'll paste my Amazon review here, for it seems it works as something of an "intro to the science of Scale":

In the real world, elements often have different isotopes with slightly different properties. Boron-10 is slightly lighter than Boron-11, and it's a much better radiation shielding material.

In the world of Scales, there's another atomic property that doesn't exist in the real world, but is crucially important to the story: To simplify things a bit, "scale zero" atoms are enriched in one set of leptons. Scale one atoms are enriched in a slightly different set. Scale two is slightly different from scale one, and so on, all the way to scale seven.

Materials at different scales have wildly different properties, though these are mostly related to density and atomic spacing. Scale one material is light and diffuse. Scale seven material is extremely dense and damage resistant.

The materials are ultimately the same -- or analogous.

In the real world, there is "heavy water" that is enriched in deuterium, the heavy isotope of hydrogen. In Scales, there's light scale zero water and ultra-dense scale seven water, and everything in-between.

There are also living things at every scale.

Now, imagine a scale one person stands six feet tall and weighs 200 pounds. A scale seven person is about the size of your thumbnail and yet also weighs 200 pounds. These small-but-tough scale seven people live, think, and develop dozens or hundreds of times faster than their lower-scale cousins. They also cannot be harmed by lower-scale weaponry, and they have fearsome natural weapons.

Scale seven people are VERY reminiscent of the neutron star denizens in Robert L. Forward's "Dragon's Egg." In terms of applied technological development, they run circles around the other humans, who are larger and slower. The scale sevens are not intrinsically smarter, but they are many times faster, and that counts for a lot...
Height is a quantifiable value heavily influenced by genetics, race is not even a biological concept amongst humans.
> I’ve had cops plant evidence in my car, I’ve been hit by trucks running red lights, I’ve gotten in a knife fight with a hobo, I’ve been shot at on the highway, I’ve been fired for no reason, I’ve gotten in a motorcycle accident that fucked me over seven ways to Sunday.

Are you quite sure you're not misremembering an action movie for your own experiences? Living in America is not even remotely this exciting for most people. T-boned in intersections not just by a truck, but multiple trucks? Shootouts on the highway and knife fights with bums? Are you Neo from the Matrix?
All I can say is that with both experience, and after getting into the groove and flow of working with a particular team - one starts to learn how to read the tea leaves, as it were, and to make reasonably accurate judgement calls about such things.

I'm not saying the "soft, guarded" approach is never suitable; quite often it is.

Most of the time, though -- especially after we've gotten to know the people we work with -- it's more efficient (and genuinely less distracting / bothersome to the other party) to just get to the point.
This book is the scariest thing I have ever read.
I found the opposite when I was in China, I don't think I had much of a social advantage although I didn't speak the language very well at the time.
with a lot of hesitation and even regret I agree with this assessment.

obviously, it's a matter of degree, but competence means paying customers because their output is externally visible and incompetence - nice or not - doesn't.
It does matter if people aren’t getting the nutrients they need or if something else in the environment is interfering with their development.

An individual person’s height isn’t an indicator of health but in aggregate the statistics matter.

I don’t see the analogy with race working in this context.
I can only speak to my own experience but I suspect there is some generational component to the increased awareness of mental health issues.

I was in high school during late 90's and early 00's. I was not diagnosed with anything until 2009 (around the articles timeline) looking back in hindsight I struggled with issues for years, lack of energy (some days just dragging myself out of bed was chore), lack of motivation to do anything, I avoided socializing with people I had no energy to stay in touch with friends I would make excuses to avoid hanging out with people all of the time because I never felt up to it.

If I spoke up to family members etc I was told what I was going through was normal, everyone feels tired, in essence to suck it up and stop being a wimp. It got to the point I just assumed everyone felt the way I did all of the time.

It wasn't until by chance I saw a different and younger doctor one day for an unrelated health issue I mentioned (again) how tired I felt all the time lack of energy I had it was explained to me that what I was experiencing very much not normal. That was the first time anyone took what I was saying seriously. My life drastically improved afterwards. I was 24 at the time.

When I was a teenager no one talked about mental health it just wasn't done. So I would not be surprised if some component of the statistics is an increased willingness among medical personnel to notice and diagnose the issues.
Yet congress won't do a fucking thing to keep guns away from child killers. Childhood education is one remaining basic social safety net and is more and more at risk with every school massacre.

The mental health impact of kids, parents, and teachers having to worry about STAYING THE FUCK ALIVE IN SCHOOL EVERYDAY cannot be understated.
No, the five over one section mostly talks about architectural choices, which is important to a degree.

This is more of an elaboration; people don’t see architectural renders when they walk down the street, they see the combination of building and tenant.

The most obvious manifestation of this is storefront areas; in old shopping districts in New York you’ll see a variety of awning shapes and colors, whereas in newer developments if you are even allowed to have one they must match every other one on the building.
There's nothing in a NN that would make the token order important.
I'm curious to hear anyone's experience using the language. Or is it brand spanking new and no one has yet?
Oh what's worse? If you have a happy consummate marriage, you will still be issued RFEs for "more" evidence of your marriage of a random officer feels like it.

It's like they need to come see you having sex and making babies to be really sure.
Honestly, you'd think it would help.
If that's meant to be an RFC:

> Other apps, such as Wickr and Matrix, are planning to transition to MLS [...]

Matrix is a protocol, not an app, right? Maybe I'm being pedantic, but I tend to trust RFCs, so... cannot hurt to be precise, I think.
I have similar sounding goals except my first goal is this instead:

1. That the other person know they are valued by me as a person and feel safe talking with me.

It shifts the goal from one that is about me to one that is about them. And that is really what I want. It's not to be liked but for them to feel valued.
We are starting from a place of weak democracy. I don’t think the tea leaves can be read otherwise. We aren’t alone - but that’s not much succor.
It's it's the meta/instagram tiktok clone.
The majority of women, especially before we began to actually combat racism, would also agree that being white is preferable, as would black men who were subjected to the results of living in a racist society. We currently live in a heightist society so naturally being taller is perceived as better. The crux of the issues is that it shouldn't be considered better. It's a totally inconsequential trait.
Absolutely, without any doubt in my mind. DC [1] and Baltimore when compared to the rural areas are significantly different ethnic demographics. This might be one of the most dramatic, but I have seen it in nearly every city I have ever visited. LA, Seattle, DC, Baltimore, Philadelphia, Miami, SF, Portland, London, Lisbon, Amsterdam, Frankfurt, Munich, Vienna, Geneva and dozens others that I have traveled to have significantly different demographics in the city than their rural areas surrounding them.

The only places I feel have been homogeneous with their rural areas surrounding them, have been some of nordic places like Copenhagen, Oslo, Stockholm and Tallinn.

1 - https://ggwash.org/view/6497/maps-show-racial-divides-in-gre...
> They host a lot of the FOSS and are a huge infrastructure provider in the space

You could say the same about Docker, I think? It seems to have been a mixed blessing for them.
Our teens problem might be they only value the number of likes on their profile.
Note that I won't get any credit to what I'm saying : I have less than 10 followers.
SportsCenter for meetings: Seattle startup uses GPT to create meeting highlight
Read AI, the Seattle startup whose software measures engagement and sentiment of participants on video meetings, is taking a page out of ESPN’s “SportsCenter” playbook with its latest product.

Much the way a sports highlight reel distills a complete event into a more manageable and entertaining chunk of video, Read has launched “Read Highlights” to convert video of a work meeting to find the best parts.

By leveraging OpenAI’s GPT technology, Read Highlights can convert a 60-minute video recording into a 2-minute highlight reel. Large language models integrated with video identify the key moments from a meeting, analyzing not just the spoken words, but reaction from participants.
Yes this is the point of Stanford Alpaca https://github.com/tatsu-lab/stanford_alpaca

They used the larger and more expensive text-davinci-003 model to fine-tune the smaller and cheaper 7B LLaMA model.
> I'll just live here as a temporary visa holder instead

Be glad that your temporary visa doesn't expire. That's... not common in other countries.
Nothing gets upended, you just say "dark matter" and call it a day.
The reason we need this is because there's a non-trivial amount of people signing marriage papers for a visa. This happens because basically every other road, for a vast majority of people, is closed, or very difficult.

I am married to another immigrant: We had been a couple for quite a few years before marriage, but we did sign papers right away when, through some strange USCIS situation, a whole lot of visas that weren't going to be processed for years became current. She was still in school, so the green card process wasn't available to her yet. If we got married, she would skip at least 6 years of her own green card process, and it'd not cost anyone any extra. This also meant that she could go to any employer, instead of having to look for one sponsoring immigrants: A huge difference.

If it was far easier to become a US citizen, then we'd not have such pressure to sign papers, either for legitimate marriages or straight out fabrications. But it sure seems that the US has no appetite to, say, triple the employment-based visa caps, which I suspect is as much as we'd need to clear up that side of the system, once we take into account the Chinese and Indian side of the backlog.
300m dead humans later, we’ve nearly eradicated it, or perhaps found a way to live with it

It’s a very asymmetrical game. A virus is a special arrangement of a few thousand atoms, an antidote is a global effort and strained economy
Thoughts on Rust for Game Development
Of course, similar to biological sex
I think I may have been misreading, I was assuming that these effects were meant to be composed, but I guess they're exclusive to each other and form a tower (the preceding line even calls them the "exclusive effects", but I thought it just meant that this was an exhaustive list of effects).
Reminds me of meebo
You can do the same with statics in Java
Yeah, it's special for historical reasons, the 444 visa. It's temporary in the sense that it would expire if I left Australia, but I could get another one if I came back. The other downside for any non-citizen is getting deported (or being denied reentry) if the government thinks you are undesirable for any reason.

Edit: and I just want to make clear that I'm not criticising the Australian government in any way with these comments. Please don't deport me.
It's more about levelling the playing field. While FB, IG, YouTube, New York Times, etc. are blocked in the PRC, TikTok are allowed to operate freely in the U.S.
Not if it is a laid off biotech worker that goes mad and builds the GPT6 designed virus because his wife or kids died due to his loss of employment. We are safer, all of us, the entire species, when all the people feel the group is watching out for them and we are all in it together.
Duplicate thread https://news.ycombinator.com/item?id=35360080
Except those groups didn’t just move into cities recently, so even if that were genetically true (it’s not), it wouldn’t explain the change.
IMO any complicated protocol or format will be subject to crashing bugs because just verifying correct behavior is difficult.

To discover bugs, just build the xyz file yourself. People tend to use tools to generate content, and those tools generally don't make invalid content. That's a general problem with qa/verification.
Consider that classic programming language of old - LOGO.

It's a really neat LISP. Yes, a LISP.

to factorial :number
if :number = 1 [output 1]
output :number * factorial :number - 1
end

or...

to reverse :stuff
ifelse equal? count :stuff 1
[output first :stuff]
[output sentence reverse butfirst :stuff first :stuff]
end

From https://el.media.mit.edu/logo-foundation/what_is_logo/logo_p...

And from https://dl.acm.org/doi/pdf/10.1145/3386329

Logo’s design drew upon two theoretical frameworks: Jean Piaget’s constructivism and Marvin Minsky’s artificial intelligence research at MIT. One of Logo’s foundational ideas was that children should have a powerful programming environment. Early Lisp served as a model with its symbolic computation, recursive functions, operations on linked lists, and dynamic scoping of variables.

....

In LCSI Logo, the if instruction above becomes a call to the if procedure, which takes three inputs:

if :x<0 [right 90] [left 90]

The first input is a Boolean value, reported by the < procedure. The second and third inputs are instruction lists, only one of which will be evaluated by if depending on the value of the first input. Square brackets both delimit and quote a list, so [right 90] is equivalent to ’(right 90) in Lisp. The entire expression is therefore equivalent to

(if (< x 0) ’(right 90) ’(left 90))

in Lisp notation. How can Logo represent a thunk as merely the text of its body, without wrapping it in a lambda expression to capture its closure? See Dynamic Scope below (Section 3.7).

The use of quoted instruction lists didn’t start with LCSI. From the beginning, the main looping facility has been

repeat 4 [forward 100 right 90]

with the instructions to be repeated inside square brackets.

----

LOGO was secretly introducing us to lambdas and thunks and closures... back in 3rd grade on the Apple][+.

One of my laments is "I wish that we had computer scientists teaching us LOGO back then rather than the librarian who just wanted some quiet while we played Oregon Trail."

So... the weird characters? We dealt with them as kids, that's no weirder than LOGO.
It's more like first contact.
That's a good corroboration of my point that height being a positive characteristic is largely cultural/societal and of no true importance as it relates to a person's worth.
> Have there been big demographic shifts between rural/urban in that time?

The best one that I can think of is the fact that rural children probably spend more time outside engaging in physical activity. Even in the US, I know of high schools where a substantial number of the students are working full-time jobs outside during the summer, in addition to doing outdoors sports and other activities during the school year.
Do you mean within a culture? And what do you mean by culture?
When I first saw this video, besides laughing constantly I also generally anticipated what was coming next because I was intimately familiar with JS type coercion esoteria. A decade later with a near decade long strict personal rule to never rely on implicit type coercion (with one exception, undefined/null, because it’s almost always what you’d want/intend), quite a lot of that memorization has fallen out of my head, and I’m prepared to let it stay that way.

Because yep, it pretty much reduces to the category Type Coercion Rules. But that category in JS is so absurd that normal absurdities feel like minor tomfoolery. (And lest I paint myself as the typical HN anti-JS crusader, I do almost all of my work and personal dev in JS/TS, mostly without complaint.)
I didn't know they had ADHD at the time (still don't know for sure), this was almost 30 years ago so ADD wasn't really well know at the time, they may also have not known they had this issue either.
I feel more sympathy for that Google engineer that feel in love with their LLM. I am sure more people will become attached, at least once the rate limits are relaxed.
This problem has a much better solution than blocking technical progress: UBI etc.

But, yeah, I can totally believe that our elites would prefer a solution that doesn't require a major reconfiguration of the economic system from which they benefit so much.
Yes, I think you’re right. Might not be a great strategy for the geriatric politicians to tell a generation of parents who are the first generation of parents who have ever had to navigate anything like this, that they just need to do better.
I am a bit confused, I only find an abstract there. Is it supposed to link to a longer definition that would become an RFC?