skysight-inc/HackerNews huggingface dataset:
I don't think many informed people doubt the utility of LLMs at this point. The potential of human-like AGI has profound implications far beyond utility models, which is why people are so eager to bring it up. A true human-like AGI basically means that most intellectual/white collar work will not be needed, and probably manual labor before too long as well. Huge huge implications for humanity, e.g. how does an economy and society even work without workers?
I think TypeScript is part of the problem here. It's a thin layer atop a dynamically typed language with giant escape hatches and holes. I think it's great if you're stuck in JS, it's so much better than JS, but I can't think why anyone would choose it compared to a "real" statically typed language.
That prevents overdraft charges, but not declined payment/NSF charges from the biller or your bank.
How do you define "algorithm"? I suspect it is a definition I would find somewhat unusual. Not to say that I strictly disagree, but only because to my mind "neural net" suggests something a bit more concrete than "algorithm", so I might instead say that an artificial neural net is an implementation of an algorithm, rather than or something like that.

But, to my mind, something of the form "Train a neural network with an architecture generally like [blah], with a training method+data like [bleh], and save the result. Then, when inputs are received, run them through the NN in such-and-such way." would constitute an algorithm.
It's easy to miss, but if you look closely at the first sentence of the announcement they mention that they used a version of o3 trained on a public dataset of ARC-AGI, so technically it doesn't belong on this list.
The books fit in the current long context models, so it's not merely the context size constraint but the length is part of the issue, for sure.
Given we have shaped so many tasks to fit our bodies, it will be a long time before a bot able to do a variety/majority of human tasks the human way won’t be valuable.

1000 machines specialized for 1000 tasks are great, but don’t deliver the same value as a single bot that can interchange with people flexibly.

Costly today, but wont be forever.
It doesn't matter if it's literally stealing -- it's the mentality that is important here.

Sure, you could always quit -- but the thing is, if you're pushing for these kinds of policies, you may very well push your best talent to accepting that option!
Absolutely. And smart phones are also not literally a drug. Drugs, video games, alcohol, and religion, are all used as a part of coping mechanisms for many, however.
I believe this is a valid point: HF's replication indeed uses larger off-the-shelf model as a verifier.

In contrast, in the original paper, verifier is a fine-tune of the exact same base model which is used to sample step-by-step solutions (="solver").
This article is about 3 years late, Parker first flew through the Sun's atmosphere in 2021. This is its closest approach but definitely not the first time it's doing it.
I don't really do autopay, but I've adopted using a separate account for all bills, and I explicitly move funds as I pay them (pretty easy these days with Zelle). I've since changed this out of laziness, but at one point I didn't even have a debit card attached to the account where my income is deposited to. (the financial equivalent of one-way data binding?)
Then have the entire terminal a single tax jurisdiction, federal-taxes-only one. Or apply a front door rule like Baarle does.
Hopefully will detect whether a small child is inside or not.
There's nothing easy about Cecil Taylor.
> Basically nobody today thinks beating a single benchmark and nothing else will make you a General Intelligence.

People's comments, including in this very thread, seem to suggest otherwise (c.f. comments about "goal post moving"). Are you saying that a widespread belief wasn't that a chess playing computer would require AGI? Or that Go was at some point the new test for AGI? Or the Turing test?

> I'm not playing any games... "General" is a moniker for everything under the sun that are playing games with definitions.

People have a colloquial understanding of AGI whose consequence is a significant change to daily life, not the tortured technical definition that you are using. Again your definition isn't something anyone cares about (except maybe in the legal contract between OpenAI and Microsoft).

> Who are these people ? Do you have any examples at all. Genuine question

How about you? I get the impression that you think AGI was achieved some time ago. It's a bit difficult to simultaneously argue both that we achieved AGI in GPT-N and also that GPT-(N+X) is now the real breakthrough AGI while claiming that your definition of AGI is useful.

> What do you expect from 'AGI'?

I think everyone's definition of AGI includes, as a component, significant changes to the world, which probably would be something like rapid GDP growth or unemployment (though you could have either of those without AGI). The fact that you have to argue about what the word "general" technically means is proof that we don't have AGI in a sense that anyone cares about.
Compiling to Categories [pdf] (2017)
Sorry, but this feels entirely wrong.

If I didn't have a smart meter my levellised cost of energy wouldn't be negative like it is now (EV tariff + Solar + Battery).
Does the fact that the "jurors weren’t able to agree on whether Nuvia breached the license" mean that the legal fight isn't over?

Or is that question irrelevant in light of the other findings, and the legal fight is actually over, with Qualcomm as the clear winner?
Maybe a stinky bike lock like this would be better protection for a bike.

https://skunklock.com/
I wholehearted agree with your mantra. But I need banks and other businesses to learn this. Particularly banks.

My bank has literally called me with what amounts to "ur being haxxor3d", and like … who are you? The representative literally would not tell me who he worked for. I was 210% sure it was a scam, and hung up on him. Turned out, it was legit.¹

Companies need to make sure their own operations don't bear the trappings of fraud.

¹(I don't regret hanging up, though. Calling back to a known, published-by-the-business-itself number is the right thing to do.)
The public school accent I'm thinking of is a notch plummier than RP.
FWIW, the government is in the middle of reviewing how the electricity market works, although it’s probably not going to be implemented until 2025+
https://www.gov.uk/government/collections/review-of-electric...
This is such a cool toy!

I'm curious how the internal prompting works in certain cases, and whether there's any way to customize a particular module's default or hidden prompt. Particularly with speech. I was trying to get it to sing a made-up Christmas carol, with generate lyrics and chords. I tried a bunch of different ways, but at best the speech module would only read it out. In one funny case, the speech module added on its own beforehand: "a spoken-word piece".

I made a "Cuisine Synthesizer". [Edit: Updated to "Fusion Food Truck Simulator"]. I love how easy this was to snap together!
https://computer.tldraw.com/p/m15giebhYxD6RfWmho7R5J
Really the issue is python itself, it shouldn't be treating it's installs and packages as something that's linked and intertwined to the base operating system.

People like to complain about node packages but never seen people have the trouble with them that they have with python.
Yes! This seems to be a really neat combination of 2010's Bayesian cleverness / Tenenbaumian program search approaches with the LLMs as merely sources of high-dim conditional distributions. I knew people were experimenting in this space (like https://escholarship.org/uc/item/7018f2ss) but didn't know it did so well wrt these new benchmarks.
Pretty sure a waymo car drives better than an average SF driver.
You seem to be arguing that large unemployment rates are logically impossible, so we shouldn't worry about unemployment.

The fact unemployment was 25% during the great depression would seem to suggest that at a minimum, a 25% unemployment rate is possible during a disruptive event.
Carlos Ghosn Says Nissan Is 'Desperate' Amid Merger Talks with Honda
Suicide (Durkheim Book)
Wondering what are author's thoughts on the future of this approach to benchmarking? Completing super hard tasks while then failing on 'easy' (for humans) ones might signal measuring the wrong thing, similar to Turing test.
Woahhhh thank you for sharing! I had never heard of these initiatievs, they're really interesting and I'm going to take a closer look at each of them.

Also sounds really cool with what you've done with your own Twitter data! Would love to connect and hear more about it if you're willing to share some of the outputs -- I'm @_re_pete on X and Instagram!
> The scratchpad is a nice attempt but [...] A sufficiently clever liar

Hmmm, perhaps these "explain what you're thinking" prompts are less about revealing hidden information "inside the character" (let alone the real-world LLM) but it's more aout guiding the ego-less dream-process into generating a story about a different kind of bot-character... the kind associated with giving expository explanations.

In other words, there are no "clever liars" here, only "characters written with lies-dialogue that is clever". We're not winning against the liar as much as rewriting it out of the story.

I know this is all rather meta-philosophical, but IMO it's necessary in order to approach this stuff without getting tangled by a human instinct for stories.
The scheme, yes. But, even on that screenshot, an active window has two separate accent colors (title bar and the frame). Even that’s too much.
I'd look more into it - Octopus Agile can save you a heap of money, doubly so if you have Solar + Battery so can more effectively load balance.

And Intelligent Octopus Go is a variable rate - 7p 23:30-05:30 (and any time during the day your EV is plugged in and there's a glut of green cheap energy on the grid).
You don't think every platform will be doing the same within a year or two?
> what do you want to do that is entirely local?

Keeping my daily life from becoming public? These companies can't be trusted with the information they have. Why should I give them more that they can leak?
FWIW it doesn't seem to be much more effective than tirzepatide:

> Lilly is also working on a next-generation medicine, called retatrutide, which helped people lose up to about 24% of their weight in a mid-sized study last year.

(Tirzepatide saw 22 or 23%.) Unclear to me if or how the retatrutide numbers might improve.
Didn't samsung fab a lot of the chips nvidia used for the crypto and AI hype? Are you conflating samsung consumer devices with samsung fabs?
Who said anything about perfection? About life being perfect, or about perfect optimization? Or about expecting perfection?

You can just pick a better movie and make life better.

What is your objection to that?
I had a bunch of equipment stolen from a car in Mountain View and the lazy cops just dropped the case.

Those guys probably went on to steal more shit from someone else.
The workflow that you show in your repository is really not that different from Chezmoi. If you configure a post-add hook in Chezmoi (https://www.chezmoi.io/reference/configuration-file/hooks/), you can do `chezmoi add ~/.config/whatever/whatever.conf` and have the file auto-added to the Chezomi git repo + push it to some remote if you'd like.

yadm made it difficult for me to take specific actions when a file changed. For example, I configure a lot of macOS settings in my dotfiles (https://github.com/cweagans/dotfiles/tree/main/dot_config/ma...). When any of the JSONC files change, I need to run a script to actually apply them (https://github.com/cweagans/dotfiles/blob/main/.chezmoiscrip...), but I don't want to do that unconditionally. Chezmoi tracks that state for me and only runs the script when needed. Ditto with the macOS config profile (https://github.com/cweagans/dotfiles/blob/main/dot_config/ma... and https://github.com/cweagans/dotfiles/blob/main/.chezmoiscrip... respectively).

I was also not thrilled about the idea of shipping an encrypted blob of important secrets around. I want my dotfiles to be public, so it's much nicer when the tool I use for managing my dotfiles natively integrates with 1password. Much of the templating functionality that I use from chezmoi is specifically for pulling stuff out of 1password.

Finally, the yadm "alternate files" functionality is nice, but I didn't really care about alternates for different OSes or hostnames or whatever. I wanted some configuration for my work machine(s) and some configuration for my personal machine(s) - that's it. That's the only distinction I care about. Chezmoi made it easy to prompt for the type of machine + change the things that get configured accordingly when bootstrapping a new machine (https://github.com/cweagans/dotfiles/blob/main/.chezmoi.toml...).
Yeah, I finished a PhD in machine learning around 2016 and have been working professionally as a researcher since then, though I'm currently between jobs. It's a fun gig, but the "publish or perish" aspect of academic-ish research roles gets old fast.
I think you missed the very first sentence of my comment.
Fair point - I did not consider purchasing price parity.
Yes - for now. I think the ultimate end-goal is to get rid of the YAML config files, which, makes sense for the median user, but not for power users.

For example, I have my config on GitHub and share various YAML blueprints with a friend who also has the same Solar+Battery system as I do.
Excellent advice. I would also add to tread lightly when discussing the problem employee. I had one coworker whose only contribution was drama and constantly interrupting me and after 20 minutes I still had no idea what she was ranting about. Many months later I learned she was the VP’s sister-in-law.
To spend more compute at inference time, at least two simple approaches are readily available:

1) make model output a full solution, step-by-step, then induce it to revise the solution - repeat this as many times as you have token-budget for. You can do this via prompting alone (see Reflexion for example), or you can fine-tune the model to do that. The paper explores fine-tuning of the base model to turn it into self-revision model.

2) sample step-by-step (one "thought"-sentence per line) solutions from the model, and do it at non-zero temperature to be able to sample multiple next-steps. Then use verifier model to choose between next-step candidates and prefer to continue the rollout of the more promising branches of "thoughts". There are many many methods of exploring such tree when you can score intermediate nodes (beam search is an almost 50 years old algorithm!).
"Use case" perhaps wasn't the right word for me to use. Maybe "applications" would have been a better word. What this enables is speech-to-speech applications in embedded devices. (From my quick scan) it doesn't seem to do anything around other ML applications that OpenAI could potentially be involved in, such as speech-to-text, text-to-speech, or computer vision.

But yeah, once I figured out that this enables streaming speech-to-speech applications on embedded devices, then it's easy to think up use cases.
I've been realizing that intelligence has two factors, raw capacity and effective output, with the latter determined by how much noise "gets in the way" of accurate results. More important than either, arguably, is the wisdom of knowing one's limitations and adapting accordingly.

Someone can be really clever at finding ways of being stupid. https://www.youtube.com/watch?v=3O9FFrLpinQ
> This picture doesn't make sense. If most don't have any money to buy products, just invent some other money and start paying one of the other people who doesn't have any money to start making the products for you.

Ultimately, it all comes down to raw materials and similar resources, and all those will be claimed by people with lots of real money. Your "invented ... other money" will be useless to buy that fundamental stuff. At best, it will be useful for trading scrap and other junk among the unemployed.

> In reality, if there really is mass unemployment, AI driven automation will make consumables so cheap that anyone will be able to buy it.

No. Why would the people who own that automation want to waste their resources producing consumer goods for people with nothing to give them in return?
My Waymo ride went through a construction zone without trouble. I don’t know how much mapping it needs or how they keep it current but it’s not constrained to ideal conditions.
I toyed with an approach once that separated animations from game state updates.

Every player action could cause a cascade of updates, which would all be resolved “instantly” to the point no more cascaded updates were left to be processed.

While this is happening, any update that includes an animation pushes that to an “animation stack”, then the animations are played back one by one to show the player what happened. In this animation state most input in disabled and the game is effectively on hold until the animations complete (or are skipped by the player).

The “animations” were basically commands that the Model used to update the View, just with the option to apply them one by one over time. So the model is always up to date as fast as possible as possible, and the view just lags behind a bit and catches up.
According to the EIA Monthly, average California residential prices were 30¢ in October. Your statement is closer to being correct if you say "PG&E prices" instead of "California prices". PG&E has ~6 million accounts in a state of 40 million people.
"Compersion" is usually more than just "it makes me happy to see my partner happy", but "it makes me happy to see my partner happy, even when that would (at least traditionally) inspire some bad feeling in me."

Compersion isn't the feeling you get when you give your partner flowers and they smile, it's the feeling you get when your partner tells you a story about how nice their date with someone else was. It's a very particular flavor of joy-for-partner, that for some people doesn't exist at all because it is clouded by jealousy or fear or other feelings.

> poly people had to make a word because its not seen as the default in that community.

Feeling joy at your partner going on a date with someone else is not seen as the default in any community except the poly community.
The CCP is at least heavily motivated to get rid of coal because the wealthy and leadership can't buy their way out of Shanghai's smog problem.
The YouTube link that starts with RJUvNV, titled "(a). sip" IMO, the first track is a banger (I really like it), and it doesn't sound obviously AI.

The second track is more obviously AI, mostly due to the high frequency "dullness". Likewise, the second link iBT051 seems to have the same issue, it's low fidelity (but in a different way than the lo-fi style is).
Or the Digital alchemy addon. Let's you write your automations using typescript
Tldraw computer – how does it work? https://www.youtube.com/watch?v=Kn1De5uwrlY
Steve from tldraw gives a tour of how tldraw.computer handles AI generation on the canvas, including a peek at prompts and models.
Notorious on social media perhaps. I am yet to see someone in Frankfurt passed out with a needle in their arm. I've been to Frankfurt several times in the last years -- slept once in a hotel near the train station, spent a couple hours until 2-3am at and around the train station because of a missed train, spent a lot of time waiting for my next train connection etc.
There have been VR headsets since before there were PDAs. The first VR Headsets were made in the 80s by VPL (https://en.wikipedia.org/wiki/VPL_Research). This no where near being a new idea, this is a forty year old idea that gets a resurgence every 5 to 10 years then everyone remembers why it never caught on the last item. It is a niche consumer peripheral, but it has a lot of applications in professions such as Architecture, Engineering, Medicine, Aerospace, and Training. But those industries can probably only support one or two small manufacturers.
Their reasoning models can learn from procedures and methods, which generalize far better than data. Software tasks are diverse but most tasks are still fairly limited in scope. Novel tasks might remain challenging for these models, as they do for humans.

That said, o3 might still lack some kind of interaction intelligence that’s hard to learn. We’ll see.
That's called a second dishwasher: one is for taking out, the other for putting in. When the latter is full, turn it on, dirty dishes wait outside until the cycle finishes, when the dishwashers switch roles.
I love it when people get overconfident.
We have people beating the drums of how this is just shy of taking the world by storm, and AGI is just around the corner, and it will revolutionize all economy and society and nothing will ever be the same.

Where are you seeing this? I pretty much only read HN and football blogs so maybe I’m out of the loop.
Time's Up for AI Policy
In my city the cost of labor is very much a limiting factor. Robot drivers will open up transit options that aren’t practical now.
I think a successful high level intelligence should quickly accelerate or converge to infinity/physical resource exhaustion because they can now work on improving themselves.

So if above human intelligence does happen, I'd assume we'd know it, quite soon.
FYI: I accidentally logged into my wrong patreon account and expected "logout then login" to prompt me to login again. It doesn't. It just logs me back in with the same user.
Let's say that Google is already 1 generation ahead of nvidia in terms of efficient AI compute. ($1700)

Then let's say that OpenAI brute forced this without any meta-optimization of the hypothesized search component (they just set a compute budget). This is probably low hanging fruit and another 2x in compute reduction. ($850)

Then let's say that OpenAI was pushing really really hard for the numbers and was willing to burn cash and so didn't bother with serious thought around hardware aware distributed inference. This could be more than a 2x decrease in cost like we've seen deliver 10x reductions in cost via better attention mechanisms, but let's go with 2x for now. ($425).

So I think we've got about an 8x reduction in cost sitting there once Google steps up. This is probably 4-6 months of work flat out if they haven't already started down this path, but with what they've got with deep research, maybe it's sooner?

Then if "all" we get is hardware improvements we're down to what 10-14 years?
Learn UX design and product design and you will become stronger
>It is sad to see stereotype threat being one of those findings that seems less and less credible.

While I'm sure it is an honest statement, this sentiment is itself concerning. Science is ideally done at a remove - you cannot let yourself want any particular outcome. Desire for an outcome is the beginning of the path to academic dishonesty. The self-restraint required to accept an unwanted answer is perhaps THE most important selection criteria for minting new academics, apart from basic competency. (Acadmeia also has a special, and difficult, responsibility to resist broader cultural trends that seep into a field demanding certain outcomes.)
There are levels of privacy. Because I'm not going to ask deeply private questions, it doesn't mean that I want everyone to be snooping into what I'm planning to eat tonight.
Your economic analysis is deeply flawed. If there was anything that valuable and that required that much manpower, it would already have driven up the cost of labor accordingly. The one property that could conceivably justify a substantially higher cost is secrecy. After all, you can't (legally) kill a human after your project ends to ensure total secrecy. But that takes us into thriller novel territory.