MurphyA/hacker-news huggingface dataset:
by oxcabe | 2025-08-18 13:54:16+00:00
It'll get better over time. Or, at least, it should.

The biggest concern to me is that most public-facing LLM integrations follow product roadmaps that often focus in shipping more capable, more usable versions of the tool, instead of limiting the product scope based on the perceived maturity of the underlying technology.

There's a worrying amount of LLM-based services and agents in development by engineering teams that haven't still considered the massive threat surface they're exposing, mainly because a lot of them aren't even aware of how LLM security/safety testing even looks like.
by barbazoo | 2025-08-18 13:54:33+00:00
> the pub campaigners and the council won: the China Hall was ordered to remain as a pub. But it was too late for Norris. The fight had taken it out of him, and his health deteriorated rapidly. He died on 22 June 2023, aged 74. Some 250 people turned up to his funeral in Honor Oak.

Sounds like a class act.

As long as there are no negative consequences for billionaires to behave like this they will continue to do so. Only a matter of time until people take matters into their hands.
Show HN: Stateful LLM inference (no cost for input tokens, not prompt-caching)
by arkonrad | 2025-08-18 13:54:56+00:00
Hi HN,

I’ve been frustrated for a while with how LLM inference works in the cloud today. Every API call starts from scratch: you resend your entire prompt + conversation history, and you’re charged for every input token, even if the model has already “seen” that context before.

This leads to two big problems:

Performance & cost – constantly resending input tokens is wasteful.

Quality loss – because the state is rebuilt on a new GPU each time, the model loses a lot of internal context beyond just your text.

Most “optimizations” offered in the industry are really just prompt-caching. That’s useful for cutting repeated input costs, but we’ve all seen the side-effects: outputs that don’t match subtle variations in the prompt, or the model confidently “jumping” to the wrong cached response because it thought your query was a near-duplicate.

We’re taking a different approach with ark-labs.cloud:

True stateful inference – when you start a session, all requests are processed on the same set of GPUs, and the full internal state of the model (prompt, history, reasoning traces) is preserved between calls.

Zero input token cost – because the model doesn’t need you to resend your input on each request. You pay only for generated output.

Better responses, not just cheaper ones – maintaining the internal state can improve consistency and reasoning quality, not just save money.

From a developer perspective, it’s simple: enable cookies, and the API will keep a session alive (ark_session_id). No SDK magic, no hacks. Sessions do expire after inactivity to free resources, but while they’re active, you’re talking to a model that actually remembers internally, not just through string concatenation of prompts.

Docs https://ark-labs.cloud/documentation/

We’d love your thoughts — especially from those who’ve wrestled with the “why am I paying 10x for tokens I already sent” problem, or who’ve hit caching systems that mismatched prompts to outputs. Does this approach make sense to you?
by raspasov | 2025-08-18 13:54:59+00:00
I agree.

Swift is quite good. I assume the tooling is catching up to Objective-C. It has been a couple of years since I had to solve something with Swift.

Any reason, apart from outside requirements, to pick the .NET CLR over the JVM as a runtime in your experience? Outside of library/framework support, which I've heard is good with the CLR.

How's the garbage collector with the CLR?
by resters | 2025-08-18 13:55:05+00:00
AI will become a commodity -- see Deepseek. The handwriting is on the wall and the open source models and practices to get to Claude 4.1 or GPT-5 are all in the public domain.

Apple could simply sell earpods with an AI voice interface, the UI/UX and solution space is evolving too quickly for a company like Apple to sensibly try to define how it will use the technology yet.

See Google and Microsoft's failed integrations of AI with search for an example of how it should not be done.

The more I use AI the more I think I don't need a laptop and would settle for a comfortable VR setup as I do far less typing of symbols.
by dahart | 2025-08-18 13:55:33+00:00
That’s not good evidence at all, you’re making massive assumptions that don’t hold up. I did already provide some hard evidence you ignored: several other countries are already paying for education for all interested citizens and are doing better than the US by economic measures, not worse.

My salary is not my GDP. The financial cost of a loan is not equal to the financial value education provides to society. I’m asked to pay back my loan very early in my career in my 20s, before I have the chance to build a career and accumulate any savings. On top of that, the financial cost of education has risen faster than inflation for a few decades due to incentives that wouldn’t exist if education was provided.

According to the St Louis Fed, among other sources, income taxes collected on college grads is more than 2x the taxes collected on people without degrees, and the lifetime total collected for college grads is many multiples of what college costs even today. Think about the taxes a little harder and it should become obvious that it’s a waste of tax money to not ensure that everyone who wants a degree should get one without having a financial burden. We won’t spend more tax money providing free education, we will collect more tax money.
by regnull | 2025-08-18 13:55:54+00:00
I agree that the context is important. However, there is still a problem here:

- The user name already shows in green, which means a new account. Thus, your comment does not give any additional context. - If your goal is to provide context, I'm sure you do not fail to provide it when an account with a long history and a tons of karma makes a comment that goes contrary to what you want to believe, right?
by browningstreet | 2025-08-18 13:55:55+00:00
I have found it better to have stronger scope for 2nd and 3rd iteration feature sets in mind.. refactoring because you didn't think you'd be adding a certain kind of feature or filter or database scope is worse than knowing ahead of time that's where you were going.

A little different than "spec", but one-shotting things works great if that's going to get you as far as you want to go. If you're adding neat-o features after that, it can get a little messy because the initial design doesn't bend to the new idea.

Even something like adding anti-DDOS libraries towards the end, and then having to scope those down from admin features. Much better to spec that stuff at the outset.
by bgwalter | 2025-08-18 13:56:20+00:00
"MCP" is the new "webscale". It can be used to write philosophical papers about LLMs orchestrating the obliquely owned ontologies of industrial systems, including SCADA systems:

https://arxiv.org/html/2506.11180v1

SCADA systems got famous, because they previously required STUXNET to be hacked. In the future you can just vibe hack them.
by zarzavat | 2025-08-18 13:56:37+00:00
I asked GPT-5 to OCR a table for me the other day, it hallucinated perhaps 10% of the values. This was a screenshot of a spreadsheet, with large font, not challenging except for the layout.

What's interesting is that I asked it to also read the background colors of the cells and it did much worse on that task.

I believe these models could be useful for a first pass if you are willing to manually review everything they output, but the failure mode is unsettling.
by mg | 2025-08-18 13:56:48+00:00
Apple does not need to develop AI software itself in order to remain successful.

We more and more turn into cyborgs, wearing all kinds of processors and sensors on our bodies. And we need this hardware and the software that runs on it to be trustworthy.

Being the hardware producer and gatekeeper for trustworthy software to run on it is probably big enough of a market for Apple.

Even more so if their business of getting 15% to 30% of the revenue apps generate on the iPhone continues.

It has yet to be seen what type of company becomes most valuable in the AI stack. It could very well be that it does not operate LLMs. Similar to how the most valuable company in the hospitality industry does not operate hotels. It just operates a website on which you book hotels.
by troupo | 2025-08-18 13:57:04+00:00
> I've been HN'd before on a very small VPS but since my blog is now all static content it doesn't even notice... even when it was making 4 or 5 DB reads per page it didn't notice.

And even then you can have a default Cloudflare setup that will just cache most of the stuff.

I once had two articles hit the top spot on HN. Meh https://x.com/dmitriid/status/1944765925162471619

:)
by 0xfedcafe | 2025-08-18 13:57:05+00:00
Yeah. With OpenRC or runit, the idea is you just layer the security on yourself since the base is so minimal. Honestly, the best place to start for any system is Madaidan’s Linux Hardening Guide. It’s super thorough and works for pretty much anything. From there, you can add other tools. The Gentoo Hardened setup with SELinux is an option, but it’s a ton of work. AppArmor is way easier for just locking down specific services and apps, it’s what Alpine uses and it’s pretty effective. And for sandboxing random apps, Firejail is perfect. You can just wrap it around your browser or anything else you don’t fully trust to keep it contained. Gives you a lot of control.

https://madaidans-insecurities.github.io/guides/linux-harden...

https://discuss.privacyguides.net/t/add-gentoo-linux-void-li...

https://github.com/gentoo/hardened-refpolicy

https://krython.com/post/hardening-alpine-linux-system-secur...
by andsoitis | 2025-08-18 13:57:27+00:00
> USA has made laws, say, that owning most explosives without a tax stamp is illegal

I think you're referring to the National Firearms Act (NFA) of 1934 and its treatment of pre-existing explosive devices and destructive devices. It is an interesting example of how retroactive tax laws can affect previously legal property ownership.

What I will say is that retroactive compliance requirements, while controversial, have generally been upheld by courts when applied to dangerous items affecting public safety. The explosives/tax stamp example demonstrates the tension between property rights, retroactive legislation, and public safety regulation.

I don't know that your overall argument that all new building requirements should be applied to all existing properties. Not only would it be incredibly expensive (and probably having an even worse impact on people with less means), but also highly impractical in some instances. Does that make sense?
by anovikov | 2025-08-18 13:57:41+00:00
Thing is, for it to truly stop an incentive has to be removed. It shouldn't be a profitable idea. A business open in a particular place has to be the most profitable business possible there. What's the problem if it's not the pub? Drinking rates are nosediving in UK, and that's a good thing, a generation ago half the country was spending their life sloshed days long.
by ericmay | 2025-08-18 13:58:16+00:00
> But now there’s a new paradigm shift. The iPhone was perfect for the mobile era, which is why it hasn’t changed much over the last decade.

> AI unlocks what seems to be the future: dynamic, context-dependent generative UIs or something similar. Why couldn’t my watch and glasses be everything I need?

https://www.apple.com/watch/ https://www.apple.com/apple-vision-pro/

> The other problem is that at its core, AI is two things: 1) software and 2) extremely fast-moving/evolving, two things Apple is bad at.

Idk my MacBook Pro is pretty great and runs well. Fast moving here implies that as soon as you release something there's like this big paradigm shift or change that means you need to move even faster to catch up, but I don't think that's the case, and where it is the case the new software (LLM) still need to be distributed to end users and devices so for a company like Apple they pay money and build functionality to be the distributor of the latest models and it doesn't really matter how fast they're created. Apple's real threat is a category shift in devices, which AI may or may not necessarily be part of.

I'm less certain about Amazon but unless (insert AI company) wants to take on all the business risk of hosting governments and corporations and hospitals on a cloud platform I think Amazon can just publish their own models, buy someone else's, or integrate with multiple leading AI model publishers.
by haberman | 2025-08-18 13:58:31+00:00
As someone who had perfect vision until 40 but now must wear reading glasses, I am super intrigued to hear about lens exchange!

When I heard that LASIK is not a solution to farsightedness, I specifically asked my eye doctor if there are other solutions for this. The only one mentioned was monovision (getting two different prescriptions for different eyes).

> Do note though that artificial lenses, while incredibly advanced, still cannot accommodate as well as the real deal as of now.

Cannot accommodate what as well?
by mackopes | 2025-08-18 13:58:38+00:00
For some time I have a feeling that Apple actually IS playing the hardware game in the age of AI. Even though they are not actively innovating on the AI software or shipping products with AI, their hardware (especially the unified memory) is great for running large models locally.

You can't get a consumer-grade GPU with enough VRAM to run a large model, but you can do so with macbooks.

I wonder if doubling down on that and shipping devices that let you run third party AI models locally and privately will be their path.

If only they made their unified memory faster as that seems to be the biggest bottleneck regarding LLMs and their tk/s performance.
by pc86 | 2025-08-18 13:59:28+00:00
There is one side of the political spectrum that feels that the penalty for a crime should be set irrespective of the perpetrator because that's fair. Two people that commit the same infraction pay the same absolute amount.

There is another side that feels the penalty should "hurt" the same amount because that's fair. Two people that commit the same infraction feel the same amount of pain (theoretically), roughly corresponding to paying the same relative amount.

IMO this falls apart when you accept the almost tautological fact that these laws are enforced selectively, so "fairness" goes out the window almost immediately. Enforcement is used as political pressure and as punishment. Under that view, the second option above feels much worse than the first.
by GuB-42 | 2025-08-18 13:59:37+00:00
About urgency, there is a simple way to tell what is really urgent and what is "urgent".

If your boss tells you it is urgent, it is probably not.

If people working in the field call you directly, now you have a real emergency.

The reason is simple. If it comes from your boss, it probably went up the ladder, showed up in red in some report made to the top management who then got all worked up, started shouting orders that got down the corporate ladder until it hit you. In reality, it may have taken weeks between the time the problem happened and the time it came back to you. It can wait until you finish your current task.

People stuck on the field are not going to wait that long, they want a solution now and if they can't do it by themselves, they will focus all of their energy into finding people who can and contact them directly, instead of just writing a memo to whoever wants to read it.
by Agraillo | 2025-08-18 13:59:44+00:00
> I've tried to get ChatGPT to generate original fairy tales and whatever plot prompt I give it, it spits out what is essentially the same dull story every time.

Not a universal solution, but a working method to get at least sometimes interesting results. You should use it as a co-authoring tool by following these hints: treat this as a dialogue ("let’s create interactively, you and me…", "create a first sentence of a fictional story", ...), where you act like a semaphore for the continuation—judging the current output and either correcting it or suggesting the next step (which can be brief and expanded later by the LLM). Finally, try to suggest unexpected constraints. This can be effective because when your constraint contains a set of words rarely seen together in training data, the output becomes somewhat random but still at least partially grounded in reality.

An example from one of my old conversations with Llama 3.1:

> User: Create a sentence from a fictional book containing the words crazy, cowboy, and gadget.

> Llama: In the wild west town of Crazy Horse, a notorious cowboy named Buckshot Bob unveiled his latest gadget — a mechanical horse that could gallop at breakneck speed.
by jakobedding | 2025-08-18 13:59:54+00:00
Shameless plug: I wrote a user script a while ago that removes everything from the Instagram explore tab when using Instagram in the browser. Confirmed to work on iOS Safari. Requires an app to handle user scripts (e.g. "Userscripts" by Justin Wasack).

https://gist.github.com/jkbe/f362514f99765ac7a9dc343acfe6918...
by kevindamm | 2025-08-18 14:00:01+00:00
Maybe the zeroth tip is "never go full vibe coder."

It can be tempting, but there's so much impact that even small changes to the code can have, and often in subtle ways, that it should at least be scanned and read carefully in certain critical parts. Especially as you near the point where hosting it on AWS is practical.

Even in Karpathy's original quote that you referenced he says "It's not too bad for throwaway weekend projects, but still quite amusing. I'm building a project or webapp, but it's not really coding." Maybe it should have been called vibe prompting.
by amanaplanacanal | 2025-08-18 14:00:25+00:00
Not exactly the same thing.

Upzoning allows the owner to build more than one residence on what was a single family property. This might include removing an existing home to build a duplex or triplex, dividing a house into a duplex, or building an accessory dwelling unit on the property.

Urban renewal was typically the government using eminent domain to raze whole neighborhoods to build low income apartment buildings or some such. This also might include using the "Tower in a park" architecture that was all the rage at the time, but a terrible urban form.
by delusional | 2025-08-18 14:00:28+00:00
Nitpick and title correction: The proper spelling of systemd is systemd, not SystemD. According to their brand page:

Yes, it is written systemd, not system D or System D, or even SystemD. And it isn't system d either. Why? Because it's a system daemon, and under Unix/Linux those are in lower case, and get suffixed with a lower case d. And since systemd manages the system, it's called systemd.
by mikewarot | 2025-08-18 14:00:37+00:00
Microsoft Windows 2000 server, with Microsoft Office 2000 Professional and Delphi represented the best UI and place to build programs, for me. If I could, I'd run that forever on my desktop PC.

Everything was in a logical place, it used existing hardware well, and you could do almost anything with it.

It didn't have that weird thing where it would "snap" to the corners, or have strange mouse effects to try to dock things all the time. Clippy wasn't trying to sell my data, and was easily disabled, permanently. Remote Desktop made it possible to work remotely, even over a slower connection. All awesome stuff.
by mikeocool | 2025-08-18 14:00:41+00:00
https://radar.weather.gov/ridge/standard/ -- I think this is every NWS radar station with a 30 minute animated gif loop, along with the individual frames that make up that loop.

I know it used to be possible to get these same images -- but with the actual radar imagery separated from the base map, didn't have time to find those, but I'd guess they're still around somewhere.

Edit: a bunch of different radar-imagery only layers from each station over a longer time period: https://mrms.ncep.noaa.gov/RIDGEII/L3/
by the_af | 2025-08-18 14:00:43+00:00
> "Warning

Never blindly trust code generated by AI assistants. Always:

- Thoroughly review and understand the generated code

- Verify all dependencies

- Perform necessary security checks."

This of course makes sense, but is not vibe coding.

I suppose we'll see an effort to steer people away from vibe coding nonsense by redefining the term, which makes sense.
by reactordev | 2025-08-18 14:01:28+00:00
Not to mention developer hardware. As more and more AI eats the world, more and more developers will become developers and they need machines capable of at least running quantized models. While it’s not as good as having your very own A20 or H100, the M4 Max is above all else on the desktop save the RTX5090 w/ a beast ryzen.

It’s also an opportunity to disrupt… build hardware specifically for ai tasks and reduce it down to just an asic.
by masfuerte | 2025-08-18 14:01:44+00:00
This article [1] has a little more information about the font. Supposedly it first appeared in "Intel's Hi-Flex BIOS".

The source for the font appears here [2] with an Intel copyright.

[1]: https://wiki.softhistory.org/wiki/PhoenixBIOS_4.0_Release_6....

[2]: https://github.com/tianocore/edk2-codereview/blob/0a5f23c06d...
by nobody9 | 2025-08-18 14:03:16+00:00
Nearly all of this is false news. Virtually all browser-focused companies have had layoffs, but none of them have crippled Firefox. Indeed Firefox has the Zen project to thank for leading the way to a safer post-Chrome-is-for-sale world on PCs. Hopefully a similar project will arise for phones and for an even safer Deno framework.
by thechao | 2025-08-18 14:03:22+00:00
While I hate the current housing gridlock, these laws represent a classic Chesterton fence. They were enacted precisely because "upzoning" fell heaviest on the poor, minorities, the elderly, and other functionally disenfranchised people.

Since I like sortition, here's a goofy idea... eminent domain should be of two sorts: adverse and voluntary. Voluntary is bought-and-done. Adverse means we pick some other property in a different part of the jurisdiction, at random, and also adversely posses it. To drive the point home, I'd bias the selection to be directly proportional to value, ie, the more valuable, the more likely to be selected. The lock up in the adverse possession should be no less than, say, 25 years, or the lockup on the original possession, whichever is longer.
by Twirrim | 2025-08-18 14:03:44+00:00
At OCI, our VM shapes are all single NUMA node by default. We only relatively recently added support for cross-NUMA instances, precisely because of the complications that NUMA introduces.

There are so many performance quirks, and so much software doesn't account for it yet (in part, I'd bet, because most development environments don't have multiple NUMA domains.)

Here's a fun example we found a few years ago, not sure if work has happened in the upstream kernel since: the Linux page cache wasn't fully NUMA aware, and spans NUMA nodes. Someone at work was specifically looking at NUMA performance, and chose to benchmark databases on different NUMA nodes, trying the client on the same NUMA node, and then cross NUMA node, using numactl to pin. After a bunch of tests it looked like with client and server in NUMA 0 it was appreciably faster than client and server in NUMA 1. After a reboot, and re running tests, it had flipped. NUMA 1 faster than NUMA 0. Eventually they worked out that the fast NUMA was whichever one was benchmarked first after a reboot, and from there figured out that when you ran fresh, the database client library ended up in the page cache in that NUMA domain. So if they benchmarked with server in 0, client in 1, and then benchmarked with server in 0, client in 0, that clients access to the client library ended up reaching across to the page cached version in 1, paying a nice latency penalty over and over. His solution was to run the client in a NUMA pinned docker container so that it was a unique file to the OS.