MurphyA/hacker-news huggingface dataset:
by pcf | 2026-02-06 18:24:05+00:00
Below are my test results after running local LLMs on two machines.

I'm using LM Studio now for ease of use and simple logging/viewing of previous conversations. Later I'm gonna use my own custom local LLM system on the Mac Studio, probably orchestrated by LangChain and running models with llama.cpp.

My goal has all the time been to use them in ensembles in order to reduce model biases. The same principle has just now been introduced as a feature called "model council" in Perplexity Max: https://www.perplexity.ai/hub/blog/introducing-model-council

Chats will be stored in and recalled from a PostgreSQL database with extensions for vectors (pgvector) and graph (Apache AGE).

For both sets of tests below, MLX was used when available, but ultimately ran at almost the same speed as GGUF.

I hope this information helps someone!

/////////

Mac Studio M3 Ultra (default w/96 GB RAM, 1 TB SSD, 28C CPU, 60C GPU):

• Gemma 3 27B (Q4_K_M): ~30 tok/s, TTFT ~0.52 s

• GPT-OSS 20B: ~150 tok/s

• GPT-OSS 120B: ~23 tok/s, TTFT ~2.3 s

• Qwen3 14B (Q6_K): ~47 tok/s, TTFT ~0.35 s

(GPT-OSS quants and 20B TTFT info not available anymore)

//////////

MacBook Pro M1 Max 16.2" (64 GB RAM, 2 TB SSD, 10C CPU, 32C GPU):

• Gemma 3 1B (Q4_K): ~85.7 tok/s, TTFT ~0.39 s

• Gemma 3 27B (Q8_0): ~7.5 tok/s, TTFT ~3.11 s

• GPT-OSS 20B (8bit): ~38.4 tok/s, TTFT ~21.15 s

• LFM2 1.2B: ~119.9 tok/s, TTFT ~0.57 s

• LFM2 2.6B (Q6_K): ~69.3 tok/s, TTFT ~0.14 s

• Olmo 3 32B Think: ~11.0 tok/s, TTFT ~22.12 s
by tacostakohashi | 2026-02-06 18:24:08+00:00
This is how BigCo works. They are optimized for resilience and providing predictable cashflows for investors, not efficiency as such. If they had, say, 2 "10x" engineers who were brilliant and could do everything with no red tape or inefficiency, then one or both of them could leave, or demand pay raises, and the company would be screwed - it would be a very brittle, unsustainable period of efficiency.

So, it's better to have 20 1x engineers, with significant slack in the system, who are all interchangeable cogs in a machine that takes tickets in one end and pushes mediocre software out the other end. That way, if 5 or 10 of them leave, they can be replaced, and nobody will tell the difference. If there's a lean quarter, you can lay off half of them, and then rehire a bunch of average randos off the street a few months later, and again, nobody will be able to tell the difference.

Also, the mayor will visit the grand opening of the new office, and the media will write a lovely story about how many jobs have been "created", and the company will be able to negotiate some tax breaks for creating so many mediocre jobs.

You might find things are better at a mom & pop, or startup, or maybe outside of a big city.
by observationist | 2026-02-06 18:25:04+00:00
I wonder, how much was gatekeeping, keeping things hard on purpose, how much waas inertia, "that's just the way things are done", and how much was a kind of despairing "holy shit, it'd be so much work to have to go through and recopy everything in the new format, literally decades of effort, and there's other things we want to do with our lives".

The whole context of written words had so much implicit process and knowledge and institutional memory, compared to now when we have petabytes of throwaway logs and trivial scratchpads for software running on a "just in case I might need to figure something out" basis. I'd love to see a written word graph over time, starting ~4k BC to now. And the complexity and diversity of those automated words are going up like crazy since LLMs.
by dbcurtis | 2026-02-06 18:25:16+00:00
No, I don't think that will be successful. Consider a day where the temperature and humidity is just right to make tail pipe exhaust form dense fog clouds. That will be opaque or nearly so to a camera, transparent to a radar, and I would assume something in between to a lidar. Multi-modal sensor fusion is always going to be more reliable at classifying some kinds of challenging scene segments. It doesn't take long to imagine many other scenarios where fusing the returns of multiple sensors is going to greatly increase classification accuracy.
by danielvf | 2026-02-06 18:25:38+00:00
The report to the government about a more than 50% fraud rate was from six years ago. The Minnesota government was not serious about dealing with problem. Most businesses would not last that long with a 50% customer fraud rate.

Yes, there were some investigations and convictions, but nothing to on a scale that would deal with problem, nor any systematic change to a level paying huge amounts of money to scammers.
by stef25 | 2026-02-06 18:25:43+00:00
Drugs in clinical trails like this have made it past the animal testing stage and the healthy volunteers testing stage. Efficacy wise, yes they are unproven.

To be the devil's advocate, it can be difficult to explain informed consent in the case of mental incapacity or whatever. In that case, a responsible adult can sign.

> Answer me honestly: Did that same billionaire (Bill Gates) and his organization (Bill and Melinda Gates Foundation) do the same exact trials in his home country (USA)? "clinical trials of unproven vaccines on thousands of poor minor girls, without consent of then and their parents"

As far as I know not so yes that's correct.

I said before they might have gone to those regions in India to bypass strict ethical committees in the west. And yes, that's definitely questionable.

The thing you completely ignore is that none of the deaths were because of the vaccine.

Yes, there have been problems with FDA. But modern medicine is mostly completely safe, so if the whole system was riddled by fraud this wouldn't be possible.

One day you or someone close to you may need life saving treatments and then you'll be thankful for the pharma industry.
by hazrmard | 2026-02-06 18:25:49+00:00
cue the bell curve meme for learning autonomy:

____.----.____
______/ \______
_____/ \_____
________________________________________

(simulations) (real world data) (simulations)

Seems like it, no?

We started with physics-based simulators for training policies. Then put them in the real world using modular perception/prediction/planning systems. Once enough data was collected, we went back to making simulators. This time, they're physics "informed" deep learning models.
by eszed | 2026-02-06 18:25:54+00:00
Apologies for inserting myself into this exchange, but I'd like to point out something that both your primary interlocuter seem to be overlooking.

> They took that decision voluntarily

Doesn't really describe the experience of the woman in the original article. She took a job in "data classification" which was initially boring but benign. Then her job assignments changed to reviewing NSFW and NSFL content that she herself recognized as psychologically harmful, without a pay increase, or affordance for her discomfort. In fact, the altered nature of her job was callously dismissed: "it's still data classification"!

I could probably agree with you that there's a market-clearing price where reviewing disturbing material becomes a worthwhile sacrifice for some to take, or even an actual opportunity for people psychologically suited to the work, but an informed, freely-taken choice is not the situation described. That's the exploitation that I see in this story.
by neiljohnson | 2026-02-06 18:25:58+00:00
When Element X first launched, the goal was for it to cover the personal messenger use case. This worked just fine for some people, but for many, feature parity with the old apps and parity with the web experience was a hard blocker.

Both Spaces and Threads are about to land, and there are other lower-profile features that also need rounding out. We would expect full parity by April this year. At which point migration should be an obvious choice.
by ineedasername | 2026-02-06 18:26:57+00:00
>"You'll always need to make sure the program does what you want, rather than what you said."

Yes, making sure the program does what you want. Which is already part of the existing software development life cycle. Just as using natural language to specify work already is: It's where things start and return to over and over throughout any project. Further: LLM's frequently understand what I want better than other developers. Sure, lots of times they don't. But they're a lot better at it than they were 6 months ago, and a year ago they barely did so at all save for scripts of a few dozen lines.
by AlienRobot | 2026-02-06 18:27:41+00:00
I'm pretty sure the only ad that would work on me would be an ad for an indie game, but indie game developers don't buy ads, they buy blue checkmarks on twitter then they try to game the algorithm. Even if I did see an ad for an indie game, I would probably not click on it, but just google its name instead.

What I mean to say is that there is a type of person that will never click on an ad, even if they want to buy the product. Worse yet, most of the time I do click on an ad, it's a misclick.

But I don't see this as a failure of the ad industry. I just think I'm the edge case.
by graemep | 2026-02-06 18:27:46+00:00
Yes, very unlike him to write something that bad.

I would guess he might have misunderstanding the politics - you can get an exaggerated sense of how much difference a Conservative rather than Labour government makes from the media. Maybe also taking a short term view - the prime minister changed the following year, and Labour won last year's election.

The odd thing is that he became a British citizen when the UK had a Conservative government and lived in London for another five years before deciding to move.

I even agree with some of his criticisms of London and how it has developed, but a lot of his reasoning just does not make sense to me
by borroka | 2026-02-06 18:27:58+00:00
Architects went from drawing everything on paper to using CAD, not over a generation, but over a few years, after CAD and computers got good enough.

It therefore depends on where we place the discovery/availability of the product. If we place it at the time of prototype production (in the early 1960s for CAD), it took a generation (20-30 years), since by the early and mid-1990s, all professionals were already using CAD.

But if we place it at the time when CAD and personal computers became available to the general public (e.g., mid-1980s), it took no more than 5-10 years. I attended a technical school in the 1990s, and we started with hand drawing in the first two years and used CAD systems in the remaining three years of school.

The same can be said for AI. If we place the beginning of AI in the mid-1980s, the wider adoption of AI took more than a generation. If we place it at the time OpenAI developed GPT, it took 5-10 years.
by tfehring | 2026-02-06 18:28:16+00:00
No, but if you run a shadow or offline camera-only model in parallel with a camera + LIDAR model, you can (1) measure how much worse the camera-only model is so you can decide when (if ever) it's safe enough to stop installing LIDAR, and (2) look at the specific inputs for which the models diverge and focus on improving the camera-only model in those situations.
by fragmede | 2026-02-06 18:28:17+00:00
On that specific count, not really. There's a skate park north end of the Mission, and Stevenson St is a two way road that borders it, but it's narrow enough that you need to drive up on the curb to get two vehicles side by side on the street. Waymo's can't handle that on a regular basis. Being San Francisco and not London, you can just skip that road, but if you find yourself in a Waymo on that street and are unlucky to have other traffic on it, the Waymo will just have to back up the entire street. Hope there's no one behind you as well as in front of you!

Anyway, we'll see how the London rollout goes, but I get the impression London's got a lot more of those kinds of roads.
by andai | 2026-02-06 18:28:30+00:00
That depth and shading on the player controls is really satisfying to me.

I saw an old screenshot of Reaper 2.0 yesterday with a similar style. Slightly skeumorphic, slightly stylized. I don't know what the style is called (I associate it with Windows XP?) but it looks way more friendly and engaging than anything I've seen in the last 15 years.

Also, this website has a sister: https://507movements.com/
by kreco | 2026-02-06 18:28:45+00:00
The mental overhead is pretty significant.

You need to do weird string operations, you have certainly a class somewhere that needs to append a zero to then end of a buffer, and exclusively use the class for thw filename.
You can't just toss a contiguous number of bytes you to convert it first.

Every single piece of software that need to interact with the file system needs to deal with this.

I'm not asking about a new string type. I'm asking to be able to be free from null terminating string.

You only need to provide a length.
by kmacdough | 2026-02-06 18:29:06+00:00
What are we testing here?

It feels like a very odd test because it's such an unreasonable way to answer this with an LLM. Nothing about the task requires more than a very localized understanding. It's not like a codebase or corporate documentation, where there's a lot of interconectedness and context that's important. It also doesn't seem to poke at the gap between human and AI intelligence.

Why are people excited? What am I missing?
by raw_anon_1111 | 2026-02-06 18:29:07+00:00
I agree, in my original comment, I went out of the way to say “C” in my hypothetical argument.

But even with C, it’s still not completely deterministic with out of order and predictive branching, cache hits vs misses etc. Didn’t exactly this cause some of the worse processor level security issues we had seen in years?
by lambda-lollipop | 2026-02-06 18:29:14+00:00
cf. Dijkstra "On the foolishness of "natural language programming"
https://www.cs.utexas.edu/~EWD/transcriptions/EWD06xx/EWD667...

>From one gut feeling I derive much consolation: I suspect that machines to be programmed in our native tongues —be it Dutch, English, American, French, German, or Swahili— are as damned difficult to make as they would be to use.
by icedchai | 2026-02-06 18:29:19+00:00
mmap/msync is behavior is also very platform specific. On some systems (like AIX, at least older versions), even without msync, memory mapped data is synced back to disk periodically.

I worked on a code base that was portable between Linux, AIX, and some other Unix flavors. mmap/msync was a source of bugs. Just imagine your system running for days, never syncing any data to disk... then someone pulls the plug. Where'd my data go? Even worse, it happened "in production" at a beta site. Fortunately we had a way to recover data from a log.
by toomuchtodo | 2026-02-06 18:29:42+00:00
'Excuses are over': Stellantis tells dealers sales must grow this year - https://www.detroitnews.com/story/business/autos/chrysler/20... | https://archive.today/y16BG - February 5th, 2026

> This is the year that Stellantis NV's U.S. vehicle sales must start growing again, after seven straight annual declines and prior promises that a recovery was just around the corner.

> That was the blunt takeaway from a packed closed-door meeting on Wednesday between the automaker's senior executives and much of its 2,400-member dealer body at the National Automobile Dealers Association annual convention.

> "2026 is the year of execution, and we're counting on our dealers to deliver," Jeff Kommor, who leads U.S. sales for Stellantis, told The Detroit News after the meeting. "We've given them all the tools that they need. Excuses are over. There are no more excuses."

> Stellantis U.S. market share has hovered around 8% the last two years, a steep decline from its 12.5% or so share as recently as 2020 under its predecessor company.

Cooked.
by elmerfud | 2026-02-06 18:29:49+00:00
Not sure if this is trolling or if this is serious. It's certainly not written like any kind of reasonable academic study or paper on the subject. I got to this and just had to laugh about the lack of data.

"It’s common to see men abandoning their families because they can’t handle the responsibilities of providing and parenting."

Because what they fail to see is that child outcomes for single parent men are better than child outcomes for single parent women. So when you're measuring outcomes who can't handle the responsibility?

It also doesn't factor in that women are the only people who can choose to abandon their responsibility before that responsibility becomes realized as a responsibility. I bet if you factored in those numbers, which people don't like to do, you would find the female abandonment rate much higher.

Along these same lines they also fail at acknowledging the absolute epidemic level of men paying for children that aren't theirs. Especially in these situations where the parents aren't together.

Maybe this was posted for rage bait or something but it is so comically silly and childish and poorly written that who would get angry at the nonsense.
by ytpete | 2026-02-06 18:29:53+00:00
But in this case, isn't the whole pitch that the agent has access to all your data (and the network!) so it can fluidly perform any task you ask of it?

Either the agent needs to be a superuser, with all the attendant risks... or you go the Windows Vista route and constantly prompt users to approve every single access need, which we've all seen how that turns out.
by stef25 | 2026-02-06 18:30:02+00:00
Did you even read what you posted ? Talking about the 7 deaths:

> Five were evidently unrelated to the vaccine: One girl drowned in a quarry; another died from a snake bite; two committed suicide by ingesting pesticides; and one died from complications of malaria. The causes of death for the other two girls were less certain: one possibly from pyrexia, or high fever, and a second from a suspected cerebral hemorrhage. Government investigators concluded that pyrexia was "very unlikely" to be related to the vaccine, and likewise they considered a link between stroke and the vaccine as "unlikely."

End of discussion.
by itsdesmond | 2026-02-06 18:30:30+00:00
They could not be held accountable to warn her if they had not done the analysis. They did. Their organizational conclusion was that it was potentially an unsafe trip. Shit, they could have just cancelled the ride dynamically and re-assigned her. Why wouldn’t they do that? It’d probably be more expensive. Maybe they’d get more cancelled rides. Maybe this woman wouldn’t have been raped by an agent of Uber selected for and sent to her by them.
by docjay | 2026-02-06 18:31:06+00:00
You might benefit from a different mental approach to prompting, and models in general. Also, be careful what you wish for because the closer they get to humans the worse they’ll be. You can’t have “far beyond the realm of human capabilities” and “just like Gary” in the same box.

They can chain events together as a sequence, but they don’t have temporal coherence. For those that are born with dimensional privilege “Do X, discuss, then do Y” implies time passing between events, but to a model it’s all a singular event at t=0. The system pressed “3 +” on a calculator and your input presses a number and “=“. If you see the silliness in telling it “BRB” then you’ll see the silliness in foreshadowing ill-defined temporal steps. If it CAN happen in a single response then it very well might happen.

“

Agenda for today at 12pm:

1. Read junk.py

2. Talk about it for 20 minutes

3. Eat lunch for an hour

4. Decide on deleting junk.py

“

<response>

12:00 - I just read junk.py.

12:00-12:20 - Oh wow it looks like junk, that’s for sure.

12:20-1:20 - I’m eating lunch now. Yum.

1:20 - I’ve decided to delete it, as you instructed.
{delete junk.py}

</response>

Because of course, right? What does “talk about it” mean beyond “put some tokens here too”?

If you want it to stop reliably you have to make it output tokens whose next most probable token is EOS (end). Meaning you need it to say what you want, then say something else where the next most probable token after it is <null>.

I’ve tested well over 1,000 prompts on Opus 4.0-4.5 for the exact issue you’re experiencing. The test criteria was having it read a Python file that desperately needs a hero, but without having it immediately volunteer as tribute and run off chasing a squirrel() into the woods.

With thinking enabled the temperature is 1.0, so randomness is maximized, and that makes it easy to find something that always sometimes works unless it doesn’t. “Read X and describe what you see.” - That worked very well with Opus 4.0. Not “tell me what you see”, “explain it”, “describe it”, “then stop”, “then end your response”, or any of hundreds of others. “Describe what you see” worked particularly well at aligning read file->word tokens->EOS… in 176/200 repetitions of the exact same prompt.

What worked 200/200 on all models and all generations? “Read X then halt for further instructions.” The reason that works has nothing to do with the model excitedly waiting for my next utterance, but rather that the typical response tokens for that step are “Awaiting instructions.” and the next most probable token after that is: nothing. EOS.
by Edman274 | 2026-02-06 18:31:22+00:00
What incentive would there be for a gig company like Uber to not deliberately hire criminals if Uber isn't liable, but other companies could be? Reputational damage isn't enough to hurt the bottom line and to change behavior - if it were, they would've already done more, but they didn't because they were operating under the assumption that they were legally insulated.
by cogman10 | 2026-02-06 18:31:28+00:00
> those are fixable problems.

They are fixable problems that very clearly are not being fixed here.

I might have a different attitude if new bus routes or highways were being built in response to the new housing that's gone in, but like I've said, we've failed to build infrastructure for the massive expansion we've seen in the last 10 years.

Why should I think it's a good thing to build another 1000 units of housing when none of the infrastructure is able to handle the current population? It's not a case of "busses to nowhere" it's a case of "we are filled to the gill and they want to add even more people".

My kid's school, for example, has started paving over the playground and installing trailers in order to accommodate the kids coming in. Instead of building a new school for all the new housing, we have exactly the same schools and school buildings that we had when I first moved here.

And I should say, we have even more housing planned and in construction right now all around me. That's all been approved yet I've not heard or seen a peep about adding another school, bus, etc.

That's why I have a hard time seeing it as NIMBY.