MurphyA/hacker-news huggingface dataset:
by jychang | 2025-10-21 05:28:01+00:00
That's only if you're expecting 10 GPUs in use. They're dealing with ~1 GPU in use for a model, just sitting there. Alibaba has a very long tail of old models that barely anyone uses anymore, and yet they still serve.

Here's a quote from the paper above:

> Given a list of M models to be served, our goal is to minimize the number of GPU instances N required to meet the SLOs for all models through auto-scaling, thus maximizing resource usage. The strawman strategy, i.e., no auto-scaling at all, reserves at least one dedicated instance for each model, leading to N = O(M)

For example, Qwen2 72b is rarely used these days. And yet it will take up 2 of their H20 gpus (with 96GB VRAM) to serve, at the bare minimum, assuming that they don't quantize the BF16 down to FP8 (and I don't think they would, although other providers probably would). And then there's other older models, like the Qwen 2.5, Qwen 2, Qwen 1.5, and Qwen 1 series models. They all take up VRAM if the endpoint is active!

Alibaba cannot easily just timeout these models from VRAM, even if they only get 1 request per hour.

That's the issue. Their backlog of models take up a large amount of VRAM, and yet get ZERO compute most of the time! You can easily use an easing function to scale up from 2 gpus to 200 gpus, but you cannot ever timeout the last 2 gpus that's serving the model.

If you read the paper linked above, it's actually quite interesting how Alibaba goes and solves this problem.

Meanwhile on the other hand, Deepseek solves the issue by just saying "fuck you, we're serving only our latest model and you can deal with it". They're pretty pragmatic about it at least.
by LorenPechtel | 2025-10-21 05:28:03+00:00
#1 is one of the things they typically get wrong in stories.

Climbing the cable is a nightmare, especially as it gets thicker as you go up. Thus do not climb the cable! Rather, when the cable is built a whole bunch of anchors are built into it. You are not climbing the cable, you are climbing a track on the side of the cable. The cable's job is to support the track plus any load on it.
by intended | 2025-10-21 05:28:55+00:00
I’m a pro-market solution person, but markets are a tool.

This is the kind of capitalistic behavior that is repugnant to our idea of how things should work.

This is not what the commons is for - taking the work of creators, repackaging it, and using platform capability to re-sell it.

At this point, I am coming around to the argument that governments should make their own local/national AI.
by hawthorns | 2025-10-21 05:29:05+00:00
The main point didn't get hit on by the responses. Re-ranking is just a mini-LLM (for latency/cost reasons) that does a double heck. Embedding model finds the closest M documents in R^N space. Re-ranker picks the top K documents from the M documents. In theory, if we just used Gemini 2.5 Pro or GPT 5 as the re-ranker, the performance would even be better than whatever small re-ranker people choose to use.
Show HN: An open-source S3 GUI for faster browsing and zero tracking
by maziweiss | 2025-10-21 05:29:22+00:00
I was frustrated with the options for S3 GUIs, so I built one myself. nicebucket is focused on great UX, performance through the use of Tauri and privacy. We do not track anything that you do and its code is completely open-source.
by Eridrus | 2025-10-21 05:29:52+00:00
This was a major issue, but it wasn't a total failure of the region.

Our stuff is all in us-east-1, ops was a total shitshow today (mostly because many 3rd party services besides aws were down/slow), but our prod service was largely "ok", a total of <5% of customers were significantly impacted because existing instances got to keep running.

I think we got a bit lucky, but no actual SLAs were violated. I tagged the postmortem as Low impact despite the stress this caused internally.

We definitely learnt something here about both our software and our 3rd party dependencies.
by nickff | 2025-10-21 05:31:05+00:00
If a company retains earnings, it has to pay taxes on them (as profits), but the money is still at risk (from a shareholder’s point of view) if something bad happens to the company (lawsuit or market problem). Shareholders usually want to receive whatever money the company has saved up, to safeguard it from being lost for no reason, and so that they (the shareholder) can put it to use elsewhere. This would change if the government stopped taxing retained earnings.
by bigstrat2003 | 2025-10-21 05:31:06+00:00
> It's hard for me to imagine wanting to use a phone for anything other than making calls or sending SMS

Not even listening to music in the car? That is probably my #1 phone use case by far outside of the communications functions you mentioned. I run a Navidrome server at home, and while on the go my phone can stream any music I like from the home server (so I don't need to load it in advance). In theory one might store the music on one's phone of course, but I have more music than my phone will hold and it's very nice to be able to access whatever I want to listen to at will.
by kragen | 2025-10-21 05:32:36+00:00
You seem to be suggesting that doctors should not suggest any health precautions until controlled experiments have found them effective. That is the position taken by the highly-cited paper "Parachute use to prevent death and major trauma related to gravitational challenge: systematic review of randomised controlled trials", which you must read immediately, because in a peculiar way it is a paper about you: https://pmc.ncbi.nlm.nih.gov/articles/PMC300808/
by 8organicbits | 2025-10-21 05:32:37+00:00
Author here. I think you missed the nuance I was going for.

I use YouTube and AWS as example since they both have implementations that are vulnerable to IDOR, but I think they made the right call. Sometimes usability takes preference over security. Sometimes 'obfuscation' is better than proper authorization.

> There are use cases where the effort needed to individually grant users access outweighs the risk of using unlisted. Not everyone is dealing in highly sensitive content, after all.
by epaga | 2025-10-21 05:34:17+00:00
I’ve always wondered why spam and scam emails have been so…dumb and obvious… 99.9% of the time.

It does seem like AI may change this and if even the tech savvier ones among us are able to be duped, then I’m getting worried for people like my parents or less tech savvy friends… we may be in for a scammy next few years.
by dash2 | 2025-10-21 05:34:41+00:00
I think there's more to it. When you're dominant, you make money whatever. Think of Amazon et al. as huge spigots of money. Now, it becomes optimal to fight for more of that money coming your way. It's like the resource curse for countries. Nobody gains from growing the pie; they gain from stealing the pie. At some point, parasites and parasitic behaviours invade.
by logifail | 2025-10-21 05:34:47+00:00
> There was a period of a few decades (I guess still ongoing, really) where parents sheltered their kids from everything

Not just parents sheltering kids. Take a look at this (in)famous tweet https://x.com/d_spiegel/status/1271696043739172864 from *June 2020* ...

"[eg] women aged 30–34, around 1 in 70,000 died from Covid over peak 9 weeks of epidemic. Over 80% pre-existing medical conditions, so if healthy less than 1 in 350,000, 1/4 of normal accidental risk"
by LorenPechtel | 2025-10-21 05:35:16+00:00
Have you ever seen a megavolt power line? Note how far apart the wires are. They are actually a bit farther apart than they really need to be because it is designed to tolerate a large bird with spread wings, but they still need quite a bit of distance. I believe you can tolerate a closer spacing once you're out in space and have no possibility of a plasma arc.
by intended | 2025-10-21 05:35:25+00:00
The warning sign is not traffic for ads, although this will result in a drop in donations eventually.

It means that now, people are paying for their AI subscriptions, while they don’t see Wikipedia at all.

The primary source is being intermediated - which is the opposite of what the net was supposed to achieve.

This is the piracy argument, except this time its not little old ladies doing it, but massive for profit firms.
by Lerc | 2025-10-21 05:35:32+00:00
Do you know if the panels can be bodged to be non square? There shouldn't be a lot of fancy wiring to screw up if it's all WS2812. Can you (delicately) chop a few LEDs out and bridge the connections?

(hoping I have seeded this idea, so I'm not the first one to attempt this)
by JumpCrisscross | 2025-10-21 05:35:56+00:00
> “native Americans who could be descendants of the founding fathers” is rich with humor

Yes.

Though I did consider, until noting the context, that they might be referring to descendants of both the founding fathers and Native Americans. Chilling, actually. To think that a good number of one branch of our founding fathers' descendants may have been exterminated by another.
by rtpg | 2025-10-21 05:36:26+00:00
"What doesn't kill you makes you stronger" makes for a fun little statement. It's not actual natural law though, right? I feel like it's fairly well documented that good hygiene is a win for humanity as a whole, so I have some skepticism for generally saying "well let the kids eat dirt". We did that for centuries already!

The thing I'm a bit curious about is how the research on peanut allergies leading to the sort of uhhh... cynic's common sense take ("expose em early and they'll be fine") is something that we only got to in 2015. Various allergies are a decently big thing in many parts of the world, and it feels almost anticlimactic that the dumb guy take here just applied, and we didn't get to that.

Maybe someone has some more details about any basis for the original guidelines
by baobabKoodaa | 2025-10-21 05:37:34+00:00
This looks awesome! I've been wondering what to do with Insomnia since its enshittification.

One idea: since you are doing good-faith licenses anyway, maybe you could add in the possibility to pay for some kind of one-time license? I don't particularly need or want updates from my API tool, I just want it to work and not break. I would be fine with paying a one time commercial license that gives non expiring right to use a particular version.
by kanjun | 2025-10-21 05:37:37+00:00
Hey, Kanjun from Imbue here! This is exactly why we built Sculptor (https://imbue.com/sculptor), a desktop UI for Claude Code.

Each agent has its own isolated container. With Pairing Mode, you can sync the agent's code and git state directly into your local Cursor/any IDE so you can instantly validate its work. The sync is bidirectional so your local changes flow back to the agent in realtime.

Happy to answer any questions - I think you'll really like the tight feedback loop :)
by rmunn | 2025-10-21 05:39:50+00:00
It would seem logical, until you learn what allergies are. They are the body's immune system overreacting to something that would normally be harmless, and acting as if it's an invading pathogen. Once you learn that, then realizing "hey, expose the body to this thing early on, and the body's immune system will treat it as normal" is a logical step.

If this theory (that early exposure teaches the immune system not to overreact) is right, then another logical consequence would be that kids who play outside in their early years would have fewer pollen allergies than kids who mostly play indoors and are exposed to far less pollen than the outdoors-playing kids. I don't know where to look for studies to prove or disprove that thesis; anyone have any pointers?
by president_zippy | 2025-10-21 05:40:53+00:00
Something about this just reminds me of when I did a literature review in my anatomy class to address the question: "Is running bad for your knees?"

I had to decide which of two sets of peer-reviewed publications that contradict each other was least guilty using the data to support the conclusion rather than letting the data speak for itself and making an honest conclusion.

Compared to PhDs, MDs hate designing an experiment and would rather just extrapolate a different conclusion from the same longitudinal study by cherry-picking a different set of variables. The only articles I bother reading from the NEJM anymore are case studies because they're the only publications that consist of mostly-original information.
by sgentle | 2025-10-21 05:42:27+00:00
I think you're not getting his key point, or you are but you're being coy about it. He did say skin colour, in the form of "native Brits". How do you know that? Because of the article he linked, defining the terms he was using. The article is called "Ethnic groups in London", not "Cultural groups in London". He quotes statistics about "native Brits" that match the article's demographics for "White British". There is zero ambiguity here.

If I say "I love a [sweet treat](wikipedia.org/wiki/ice_cream)! It's so refreshingly cold on a nice hot day", there's just no intellectually honest way to claim maybe I meant apple pie. Do you understand? He's not talking about Russian immigrants because they're white. He is talking about Pakistani immigrants because they're brown. He's literally telling you what he means and you're choosing to ignore it. Why?

Perhaps there are, in fact, reasons to not say skin colour even when that's what you mean.
by fnordpiglet | 2025-10-21 05:44:13+00:00
With cbell gone and ajassy promoted and the misery inducing litany of morale self inflicted wounds it’s not surprising reliability is regressing. There’s no head of engineering like Charlie and Garman is a strong engineering leader, but coming after a sales guy and taking over a battered workforce, it’s not clear to me he can turn things around easily. Everyone I know worth a hill of salt left aws already - and the ones left - meh. That’s how attrition through misery works.
by stevenhuang | 2025-10-21 05:46:02+00:00
All of that can can still be seen as a linear sequence of actions from the perspective of human I/O with the environment.

What happens in the black box of the human mind to determine the next word to write/say is exactly made irrelevant in this level of abstraction, as regardless how, it would still result in a linear sequence of actions as observed by the environment.
by renewiltord | 2025-10-21 05:46:10+00:00
Hindsight is 20/20. The fact is that thousands of children were dying and public health officials were set to task to identify interventions that help.

They know that skin and mucosa sensitization can occur in response to allergens.

A reasonable hypothesis is that there’s some boot-up process with the immune system that needs to occur before anything happens. The kids are dying today. “Avoid the thing that can cause sensitization” is a conservative position.

It is unusual that it should have been opposite and that oral exposure induces tolerance. It’s the fog of war.

The standard conservative intervention has helped in the past: I’m pretty sure seatbelts didn’t have strong mortality data before they were implemented. If it had turned out that more people were killed by seatbelts that trapped them in vehicles it would make for a similar story. I think they also got rid of all blood from donors who were men who have sex with men during the initial stages of the HIV pandemic (no evidence at the time).

Edit for response to comment below since rate-limited:

Wait, I thought it was on the order of ~150/year people dying from food anaphylaxis though I didn’t research that strongly. It was off my head. If you’re right, the conservative advice seems definitely far too much of an intervention and I agree entirely.
by pjmlp | 2025-10-21 05:47:31+00:00
Likewise, I am yet to see such extensions for C being used in the wild, especially as they require extensions that no one is using unless their boss tells them so.

However the big difference is that WG21, at least is making something about it.

On C land, radio silence and worse, clever ideas like VLAs on the stack, naturally also without bounds checking.
by generuso | 2025-10-21 05:47:42+00:00
The author uses "real time sampling" to acquire evolution of light intensity for one pixel at 2 GSps rate. The signal is collected for approximately one microsecond at each firing of the laser, and corresponding digital data is sent from the oscilloscope to the computer.

"Equivalent time sampling" is a different technique which involves sliding the sampling point across the signal to rebuild the complete picture over multiple repetitions of the signal.

https://www.tek.com/en/documents/application-note/real-time-...
by slavik81 | 2025-10-21 05:48:46+00:00
One of the difficult parts of this advice for me was that my daughter wasn't eating food at the time when we were supposed to introduce it. In those cases, you're supposed to add peanut butter to the milk, which we did a few times. We let it slip for a few weeks, because it was one more thing in a pile of many things. We got her back eating peanut butter once she started eating food, but it was too late. She had developed a peanut allergy.

After going through the desensitization program at an allergist, we're on a maintenance routine of two peanuts a day. It's like pulling teeth to get her to eat them. She hates peanut M&Ms, hates salted peanuts, hates honey rusted peanuts, hates plain peanuts, hates chocolate covered peanuts, hates peanut butter cookies, and will only eat six Bamba sticks if we spend 30 minutes making a game out of it.

I highly recommend being very rigorous about giving them the peanut exposure every single day. It would have saved us a lot of time.
by generuso | 2025-10-21 05:51:40+00:00
The author explained that he originally attempted to pulse the laser at 30 KHz, but for the actual experiment used a slower rate of 3 KHz. The rate at which the digital data can be read out from the oscilloscope to the computer seems to be the main bottleneck limiting the throughput of the system.

Overall, recording one frame took approximately an hour.
by fritzo | 2025-10-21 05:52:39+00:00
Afra Wang's article:

> in this piece, i trace the intellectual map of china’s tech founders by asking a simple question: what books have shaped their worldview?

> what emerged is that the “china tech canon” shares deep roots with the “silicon valley canon” ... works by paul graham, jim collins, peter thiel, and biographies of elon musk (and many others) circulate widely. but the chinese canon also branches into its own distinct traditions: what i call the red canon, the grey canon, and the fanstasy canon. alongside the western playbook of disruption and ambition, chinese entrepreneurs also draw from maoist texts, confucian ethics, martial-arts fantasies, and liu cixin's ruthless universe.
by kragen | 2025-10-21 05:53:58+00:00
Hey, this is great! Thanks!

It does look a lot like what I was thinking would be necessary. About 9 of the 19 lines are concerned with splitting the input into words. Also, I think you have omitted the secondary key sort (alphabetical ascending), although that's only about one more line of code, something like

#'(lambda (a b) (or (< (car a) (car b)) (and (= (car a) (car b)) (string> (cadr a) (cadr b)))))

Because the lines of code are longer, it's about 3× as much code as the verbose Perl version.

In SBCL on my phone it's consistently slower than Perl on my test file (the King James Bible), but only slightly: 2.11 seconds to Perl's 2.05–2.07. It's pretty surprising that they are so close.
by Lumoscore | 2025-10-21 05:54:21+00:00
That sounds totally ominous! It's like the moment the AI finally shows up to take over the corner office.

But I think it misses the bigger picture, which you hit on: Robots are helpful, but they're still just tools. An AI can crunch data, find opportunities, and trade faster than any human ever could. It's an incredible helper!

However, humans are the ones controlling them. We decide what they trade, and we build the secure systems they rely on. An AI millionaire is still relying on infrastructure that humans have to build to be fast, cheap, and totally stable. If the foundation is shaky, the AI's complex trades fall apart.

That reality is what makes me ignore the AI hype and focus entirely on infrastructure. The smart developers know that the long game is building utility assets on robust foundations.

They're moving to systems that are super fast and near-zero cost because AI requires zero friction. They're also demanding global market reach so the assets they create aren't trapped anywhere.
by renewiltord | 2025-10-21 05:54:25+00:00
Well, I mean, did you know that skin exposure can sensitize and oral exposure builds tolerance? I certainly didn’t. That’s a subtlety of the exposure game that I did not know.

E.g. from age 27 weeks my daughter has played in a little herb garden full of mud and grass I built for her. She grabs and eats leaves from the herb plants (the basil is entirely denuded so that’s a complete loss). At first I just wanted her to play in the garden out of the same naïve exposure to tolerance model. I never would have considered that skin exposure is different from oral exposure. As it so happened she ate the plant leaves and it doesn’t matter either way since this part of immunity (to microbes here) doesn’t work in the same way as peanuts anyway.
by a85 | 2025-10-21 05:55:29+00:00
Yes. The post is misleading and we have more detail on what we do here.

https://blog.postman.com/engineering/postman-free-is-secure-...

Postman allows for turning off history, keeping variables local, setting up a local vault all in the free product and in more advanced plans, there are secret scanning capabilities for IT and security teams.

https://blog.postman.com/choose-the-right-postman-plan-for-y...

These issues are not unique to Postman and apply to all cloud products like GitHub as an instance. Products that are “offline” just shift the burden to the user.
by theturtlemoves | 2025-10-21 05:55:46+00:00
I once read the hypothesis that if you're spamming, scamming and phishing, you're trying to trick people who aren't paying attention, are inexperienced and are curious. For that target group, the exact text doesn't matter. In fact, the more you do your best to make the email look professional, the sooner the people who are good at filtering signal and noise, will call you out. There might be an advantage to looking like an inept predator: the real watchmen will shrug and think "who would fall for that?"
by ycombinete | 2025-10-21 05:58:00+00:00
Bad advice that has a very long return on investment is quite sticky.

For instance the "cry it out method" did massive amounts of psychological damage to more than one generation, but it seemed to work in the short term as the babies eventually learned to "self-soothe".

Even now I still see parents and grandparents suggesting it in parenting groups; and taking extreme umbrage at the idea that it might have damaged them/their children.