skysight-inc/HackerNews huggingface dataset:
It's not saturated. 85% is average human performance, not "best human" performance. There is still room for the model to go up to 100% on this eval.
'Yes, I am a human': bot detection is no longer working
Full title: ‘Yes, I am a human’: bot detection is no longer working – and just wait until AI agents come along
These comments are getting ridiculous. I remember when this test was first discussed here on HN and everyone agreed that it clearly proves current AI models are not "intelligent" (whatever that means). And people tried to talk me down when I theorised this test will get nuked soon - like all the ones before. It's time people woke up and realised that the old age of AI is over. This new kind is here to stay and it will take over the world. And you better guess it'll be sooner rather than later and start to prepare.
Uhh...some of us are apparently living under a rock, as this is the first time I hear about o3 and I'm on HN far too much every day
This looks really interesting. Specifically I would love to be able to set up something like this for my kids so that I have control over what they are able to watch on YouTube. I want to offer my kids whitelisted shows and creator accounts. I know theres a lot of interesting and high quality stuff out there but I do NOT want YT recommending things to my kids without going through me first.

Grayjay looks like it may be a solution!
the evals are the question/answers, ARC-AGI doesn't share the questions and answers for a portion so that models can't be trained on them, the public ones... the public knows the questions so theres a chance they could have been at least partially been trained on the question (if not the actual answer).

Thats how i understand it
"Hang up, look up, call back"
Still it's comparing average human level performance with best AI performance. Examples of things o3 failed at are insanely easy for humans.
Besides higher scores - is there any improvements for a general use? Like asking to help setup home assistant etc etc?
As a network admin I have found that whitelisting only US address space for my companies IPs drastically reduces how many attacks we get.
I'm not sure why the need to move the goalposts but I'll bite.

>And MacOS had Spaces 6 years before Windows had anything similar and Exposé for 3 years before they came out with a crappy not-as-good equivalent, and the current task view still sucks by comparison

So what? On Windows and Linux I never needed that feature because they always had proper window management, nor do I use that feature now. You're comparing Apples to Oranges. A Dodge RAM has a tow hitch, a Ferrari doesn't have a tow hitch. Is one better than the other, or are they better at different scenarios?

>But touch input drivers on both platforms still suck, so I don't really care what their Window management is like when I can't interact with them without a hand cramp.

All touchpads give me cramps and carpal tunnel, that's why I use an angled mouse. Again, moot and off topic point. What's the point of a better touchpad if it's never gonna beat an ergonomic mouse?
3 to 5 years, max. Traditional coding is going to be dead in the water. Optimistically, the junior SWE job will evolve but more realistically dedicated AI-based programming agents will end demand for Junior SWEs
I am typically eating about half to two-thirds less. For example, yesterday, I didn't have anything to eat until dinner and then consumed only about a thousand calories. Today, I had all I could do to get down about 200 g of whole-fat yogurt with a scant handful of granola and pecans.

At this eating level, I need to supplement with fiber and focus on high-nutrient-density foods, including leafy greens. My doctor also suggested eating by the clock, planning small meals, and adding a good-quality multivitamin to help compensate for the deficiencies.
Similar to comments above there's a difference between poly and open. I've not tried either but I've multiple good friends who are in "monogamish" relationships and it seems to work pretty well. For them the non-monogomy is just fun they have with others, but ultimately their partnership comes first. Otherwise it's very similar to the monogamy you describe but with agreed exceptions to sexual exclusivity.

It's not for everyone and it takes a lot communication (and low levels of jealousy) but it seems to work well at providing the structure and stability of marriage without forcing the full sexual exclusivity that some find constricting.
What kind of preparation are you suggesting?
If you've never seen things in this way, you should start.

I entertained that way of seeing things at one point, actually.

But I got over it in my teenage years.
YouTube has become especially horrific. It seems a couple years ago they gave up on video search- after 5 videos it will suddenly start recommending random videos under “you may like”. If I watch one UFC video I am flooded with recommendations of Joe Rogan, despite my subscriptions all being unrelated.
I understand your point, and your totally valid concern about nihilism, but I disagree.

Nihilism is "nothing really matters, science can't define good or bad, so who cares?"

Whereas my view is, "Being good is the most important thing, but we have no conceivable way to measure if we are making progress, either empirically or theoretically. We simply have to lead by example, and fight the eternal battles against dishonesty, cowardice, sociopathy, deception, hatred, etc."

It's in that sense that I say that technical progress is impossible. Of course, if everyone agreed with my view, and lived by it, I'd consider that a form of progress, but only in the sense that "better ideas seem to be winning right now," rather than in any technical sense of absolute progress.
This emphasizes persons and a self-conceived victory narrative over the ground truth.

Models have regularly made progress on it, this is not new with the o-series.

Doing astoundingly well on it, and having a mutually shared PR interest with OpenAI in this instance, doesn't mean a pile of visual puzzles is actually AGI or some well thought out and designed benchmark of True Intelligence(tm). It's one type of visual puzzle.

I don't mean to be negative, but to inject a memento mori. Real story is some guys get together and ride off Chollet's name with some visual puzzles from ye olde IQ test, and the deal was Chollet then gets to show up and say it proves program synthesis is required for True Intelligence.

Getting this score is extremely impressive but I don't assign more signal to it than any other benchmark with some thought to it.
Probably an interesting bit of the discussion about the US will be the switch in perception from the conscript to all-volunteer army, and the ability to absorb small constant wars without most of us civilians actually noticing much, except for the slightly worse tax:services trade.
Spotify Wrapped for Twitter Bookmarks
Yeah, but next year they'll come out with a faster GPU, and the year after that another still faster one, and so on. Compute costs are a temporary problem.
Great results. However, let's all just admit it.

It has well replaced journalists, artists and on its way to replace nearly both junior and senior engineers. The ultimate intention of "AGI" is that it is going to replace tens of millions of jobs. That is it and you know it.

It will only accelerate and we need to stop pretending and coping. Instead lets discuss solutions for those lost jobs.

So what is the replacement for these lost jobs? (It is not UBI or "better jobs" without defining them.)
This is the type of comment that makes you look either like a privileged elite that is part of Big Tech, or just a clueless moron whose day at the barrel is yet to come.

Do you really need a list of ways how Big Tech has harmed society? If things like "Surveillance Capitalism" is not enough, maybe:

- the collapse of quality journalism, because SEO and content farms made impossible to maintain a financially sustainable team of independent reporters?

- The absolute destruction of people's ability to read a piece of text for longer than 15 seconds?

- The mental health crisis in teens and even young adults caused by social media?

- Planned obsolescence and the removal of our right to repair things on our own?

- The normalization of the "gig economy" not just for young kids who are looking for some extra cash, but as the main source of income for grown up adults, with actual families to support?

- (Google and Facebook mostly) adopting the absolutely anti-competitive practice of "when we get a competitor, we buy them out as early as possible or just keep offering our stuff for free until they eventually run out of money"?

- Apple outright refusing to let people install alternative app stores, because they know that without this artificial scarcity they would not be worth 1/10th of what they are today?

Seriously, get out of SV bubble.
The open source version is a bit different from the hosted one: the open source code involves running the polling script, then building a static site (which is how I run the site for several months as a single-user project).

I am planning to move the polling changes upstream soon and then figure out a plan for open sourcing the full project.
Yeah, exactly! No reason for it to collapse into ashes like the Wordpress “I dream of ruling an ecosystem by refusing to charge money” plans will, even if certainly as an old thing it’s old.
I’m super curious as to whether this technology completely destroys the middle class, or if everyone becomes better off because productivity is going to skyrocket.
Jabber and AIM and ICQ and MSN messenger...
Sorry, I couldn't comment on the related thread so doing it here. I just saw your post here: https://news.ycombinator.com/item?id=41208146

1. I was wondering if you happen to have it and can upload it on WeTransfer again?
2. I don't know Chinese. How can I register an account on 52pojie.cn ? Any help is appreciated.
How do they identify their marks? A random firefighter seems like an odd target.
Hopefully someone will release a music ML model to just generate it locally.
>How does this do on SWE Bench?

71.7%
The Strangeness of Gift Card Economics
Let's just define AI as "whatever computers still can't do." That'll show those dumb statistical parrots!
It is not on my head, it is what I can see on browsers today across desktop and mobile devices, outside streaming native rendering, or ShaderToy demos.

The PS2 remark could as well be Flash 3D games, given what is available.
FreeBSD on Firecracker (2023)
It doesn't use any API (at least the YouTube plugin). So they are (according to their lawyers) not bound to any TOS. All it does is open the page (like a browser) and grab it and only show stuff to the user that's "relevant".

You can check it yourself, while it is not "open-source" or "free" in the usual sense its source is available.

More details from Rossmann himself: https://www.youtube.com/watch?v=dqTYg6vnQvw

edit: TOS not API
The window management thing is really overblown in my opinion. On macOS I just keep two monitors with separate virtual desktops enabled on both with apps assigned to specific desktops which reduces management to almost nothing, which is even easier and lower effort than a Win9x-paradigm desktop or tiling setup (which I’ve found requires a surprising amount of micromanagement to keep usable).
There was this iOS game which died which I wanted to recreate:

https://web.archive.org/web/20161020010853/http://www.82apps...

But I have 0 knowledge of game development. Maybe this could make my job easier? Or maybe somebody else who know how to write game can do it? Please?
What’s interesting is it might be very close to human intelligence than some “alien” intelligence, because after all it is a LLM and trained on human made text, which kind of represents human intelligence.
At 6,670$/task? I hope there's a jump
You can't give a definite no to that because, since gravitons have stress-energy and are non-perturbative, a field theory advance that worked for them could also help with the strong force.
The formation of contract cults around relationships is the basis of all law. Every sort of state flows from that. Every limitation of a society in that department ,every ability grows from this. A judge looks like a priest for a reason . The masses call for moral constraints in times of crisis because of this.
Handle with care for culture makes and brraks these things .
Reminds me of ghost restaurants where a kitchen would be used to prep food for dozens of virtual restaurants on food delivery platforms like DoorDash, grubhub, etc. They would artificially create what looked to be an array of choices, but in fact just a single kitchen taking on multiple brands. It's really evident when you look at these food delivery apps late at night.
As a person who had to deal with clients, I have found whitelisting to only "US address space" lead to lots of clients being unable to access the services until they were whitelisted.

As a person who had to deal with other associates, I also found whitelisting only US address space led to a number of people being unable to connect from their homes.

As a person who had this happen to them, I had quite a lot of frustrations with services insisting they couldn't provide me service because Texas is in Canada apparently.
ML is quite good at understanding and forecasting patterns when you train on the data you want to forecast. LLMs manage to do so much because we just decided to train on everything on the internet and hope that it included everything we ever wanted to know.

This tries to create patterns that are intentionally not in the data and see if a system can generalize to them, which o3 super impressively does!
Just to note, dumping the waste in the ocean makes it considerably more inaccessible than burying it deep in solid rock, and it's easier to do.

> should we proactively mine out all natural radioactive material on Earth and rebury in proper containment? Just in case someone starts mining uranium in the year 15000 and doesn't know what it is, they could be hurt by that.

This isn't even something to be concerned about. It already happened, to us. We got over it.
> Reading constant comments about LLMs can't be general intelligence or lack reasoning etc, to me seems like people witnessing the airplane and complaining that it isn't "real flying" because it isn't a bird flapping its wings (a large portion of the population held that point of view back then).

That is a natural reaction to the incessant techbro, AIbro, marketing, and corporate lies that "AI" (or worse AGI) is a real thing, and can be directly compared to real humans.

There are people on this very thread saying it's better at reasoning than real humans (LOL) because it scored higher on some benchmark than humans... Yet this technology still can't reliably determine what number is circled, if two lines intersect, or count the letters in a word. (That said behaviour may have been somewhat finetuned out of newer models only reinforces the fact that the technology inherently not capable of understanding anything.)
Same. I tried woodworking for a year. Made 100+ sales on Etsy and made a living but it was barely paycheck to paycheck and went back to full time. It was so much work for so little money but I loved every minute of that year.
Actually prefer new geminis too. 2.0 experimental especially.
" it's complete hubris to conflate ARC or any benchmark with truly general intelligence."

Maybe it would help to include some human results in the AI ranking.

I think we'd find that Humans score lower?
Do you follow Jack Clark? I noticed he's been on the road a lot talking to governments and policy makers, and not just in the "AI is coming" way he used to talk.
What is wrong with some people?!
Compute costs on AI with the same roughly the same capabilities have been halving every ~7 months.

That makes something like this competitive in ~3 years
Sure happy to give my point of view.

Top-level response: I think Instant is very cool and I have a lot of respect for that team and their work. I've tried to be accurate below, but I know the instant folks frequent HN so maybe they can chime in too and correct anything I've gotten wrong.

1. Instant is a full database, including the backend. Zero is not - it connects to some separate authoritative backend db. Currently only Postgres is supported, but our intent is to support other DBs like MySQL, Mongo, Cockroach, and in the fullness of time even custom distributed systems. Zero's "BYODB" approach has some advantages:

* You don't have to trust us to build a correct backend database (nothing Zero can do can corrupt your data - it's just a fancy cache)

* If you end up not liking Zero you can easily move to anything else that can run on top of PG.

* You can adopt Zero incrementally in an existing project by just moving features over to Zero one-by-one.

* Any code, library, or project that works with PG likely already works with Zero.

* Zero can coexist with other types of PG users. If some non-Zero client changes PG, Zero clients will see it update live. If Zero clients change PG, other clients will see it when they next read PG.

* You don't have to wait for us to build features. Admin UI? Use any of the great PG ones. Data export? It's just PG. Backups? Triggers? FKs? Constraints? Schemas? Migrations? Use all the normal PG stuff.

On the flip side this is a more complicated way to build the system and some of that complexity does leak out into Zero's DX. We're trying to minimize it as best we can, but Zero can probably never be quite as 'sleek' an experience as Instant.

2. Instant uses a datalog/triple style data model and a custom query system. Zero's data model is just relational data, and it uses a SQL-style query system. In practice the API that instant exposes is very relational-like, but I still think that if you know SQL already there's less to learn with Zero.

3. Zero is based on Incremental View Maintenance. When data that affects a Zero query changes, Zero does only a small amount of work to reflect the change. To my knowledge, Instant doesn't do this and re-runs the query (correct me if I'm wrong here Instant folks). This was a specific design choice in Zero because ...

4. Zero was designed primarily to support 'the linear use case': storing dozens of MB of data client-side and keeping it up to date with permissions and partial sync. We did not want to have to run these huge queries over and over.

5. Zero is very focused on just being a sync engine. Instant appears to be aiming to take on more of the suite of features Firebase offers like login, email, blob storage, etc.

6. Instant already has a SaaS live, Zero doesn't.
From the statement where - this is a pretty tough test where AI scores low vs humans just last year, and AI can do it as good as humans may not be AGI which I agree, but it means something with all caps
That depends on the company. There is precedent of large companies keeping unprofitable projects alive because they can make up for it in other ways, or it's good for marketing, etc. I.e. the razor and blades business model.

Perhaps Echo/Alexa entice users to become Prime members, and they're not meant to be market leaders. We can only speculate as outsiders.

My point is that claiming that a product of one the richest companies on Earth is not as subjectively good as the competition because of financial reasons is far-fetched.
I remember hearing Tesla trying to automate all of production but some things just couldn’t , like the wiring which humans still had to do.
To fill this out, I find o1-pro (and -preview when it was live) to be pretty good at filling in blindspots/spotting holistic bugs. I use Claude for day to day, and when Claude is spinning, o1 often can point out why. It's too slow for AI coding, and I agree that at default its responses aren't always satisfying.

That said, I think its code style is arguably better, more concise and has better patterns -- Claude needs a fair amount of prompting and oversight to not put out semi-shitty code in terms of structure and architecture.

In my mind: going from Slowest to Fastest, and Best Holistically to Worst, the list is:

1. o1-pro
2. Claude 3.5
3. Gemini 2 Flash

Flash is so fast, that it's tempting to use more, but it really needs to be kept to specific work on strong codebases without complex interactions.
> My skeptical impression: it's complete hubris to conflate ARC or any benchmark with truly general intelligence.

But isn’t it interesting to have several benchmarks? Even if it’s not about passing the Turing test, benchmarks serve a purpose—similar to how we measure microprocessors or other devices. Intelligence may be more elusive, but even if we had an oracle delivering the ultimate intelligence benchmark, we'd still argue about its limitations. Perhaps we'd claim it doesn't measure creativity well, and we'd find ourselves revisiting the same debates about different kinds of intelligences.
> the other is that there was an approach that made the task easier than we expected.

from reading Dennett's philosophy, I'm convinced that that's how human intelligence works - for each task that "only a human could do that", there's a trick that makes it easier than it seems. We are bags of tricks.
My experience with home assistance voice pipeline is nothing works and stt is terrible. I'll have to wait and see the reviews.
It isn't bizarre.

The UK has many policies in place that are designed to limit output. These policies are not only not unpopular, they are wildly popular and are basically impossible to change.

Housing is one, infrastructure is another. Like people say we aren't choosing to poor...HS2 is the most expensive rail project ever per mile, double the cost of the outrageously expensive one in California. Why? Because our system gives unlimited power to lawyers, consultants...we were building bat tunnels (literally tunnels for bats) that cost £100m.

And it isn't limited to this. Look at the last Budget: we are in the middle of fiscal collapse. Tens of billions for green energy projects that add to the cost of bills, huge pay rises for the public sector (where productivity is at the same level as 1997), on and on.

How can you not think this stuff is intentional? There is no reason for almost everything we are doing, it makes absolutely no sense but we are being driven off the cliff by politicians, civil servants, lawyers, media/PR, consultants who control this country...to rephrase that: you are saying that there was no reason 11th century Britain couldn't become very rich when it was funnelling all the money to monasteries that were producing nothing but fat monks? The intention of the system isn't to make Britain rich, it is make people inside the system rich...which it is doing (again, HS2 cost £1bn for a railway that didn't get built...where do you think that money goes? there is no railway but there were tens of thousands of consultants...).
I thought so too when I started using the android version.
I was surprised when GrayJay's Youtube plugin was promptly updated the same day Youtube broke it. NewPipe needed a few days to work again.
It's an upgrade mostly because putting on a headset to talk to an assistant means it's not worth using the assistant.
I don't believe AGI at that level has any commercial value.
City Hall is absurd in both it's appearance outside and the impracticality of the design and interior. Rooms with giant concrete columns that cut off sight lines, rampant maintenance problems from elevating form over function , and the comfort of a supraterrestrial civil defense shelter.
I think it was a fad that caught on among people who had been writing code for a few weeks.
Large portions of existing wealth are inherited, most estimates putting it somewhere in the 30-60% range of all private wealth in the US

e: not sure why this gets a downvote
https://www.washingtonpost.com/us-policy/2019/02/06/people-l...