MurphyA/hacker-news huggingface dataset:
by vshah1016 | 2026-03-12 18:52:36+00:00
Hey HN — I’m Veer and my cofounder is Suryaa. We're building Cumulus Labs (YC W26), and we're releasing our latest product IonRouter (https://ionrouter.io/), an inference API for open-source and fine tuned models. You swap in our base URL, keep your existing OpenAI client code, and get access to any model (open source or finetuned to you) running on our own inference engine.

The problem we kept running into: every inference provider is either fast-but-expensive (Together, Fireworks — you pay for always-on GPUs) or cheap-but-DIY (Modal, RunPod — you configure vLLM yourself and deal with slow cold starts). Neither felt right for teams that just want to ship.

Suryaa spent years building GPU orchestration infrastructure at TensorDock and production systems at Palantir. I led ML infrastructure and Linux kernel development for Space Force and NASA contracts where the stack had to actually work under pressure. When we started building AI products ourselves, we kept hitting the same wall: GPU infrastructure was either too expensive or too much work.

So we built IonAttention — a C++ inference runtime designed specifically around the GH200's memory architecture. Most inference stacks treat GH200 as a compatibility target (make sure vLLM runs, use CPU memory as overflow). We took a different approach and built around what makes the hardware actually interesting: a 900 GB/s coherent CPU-GPU link, 452GB of LPDDR5X sitting right next to the accelerator, and 72 ARM cores you can actually use.

Three things came out of that that we think are novel: (1) using hardware cache coherence to make CUDA graphs behave as if they have dynamic parameters at zero per-step cost — something that only works on GH200-class hardware; (2) eager KV block writeback driven by immutability rather than memory pressure, which drops eviction stalls from 10ms+ to under 0.25ms; (3) phantom-tile attention scheduling at small batch sizes that cuts attention time by over 60% in the worst-affected regimes. We wrote up the details at cumulus.blog/ionattention.

On multimodal pipelines we get better performance than big players (588 tok/s vs. Together AI's 298 on the same VLM workload). We're honest that p50 latency is currently worse (~1.46s vs. 0.74s) — that's the tradeoff we're actively working on.

Pricing is per token, no idle costs: GPT-OSS-120B is $0.02 in / $0.095 out, Qwen3.5-122B is $0.20 in / $1.60 out. Full model list and pricing at https://ionrouter.io.

You can try the playground at https://ionrouter.io/playground right now, no signup required, or drop your API key in and swap the base URL — it's one line. We built this so teams can see the power of our engine and eventually come to us for their finetuned model needs using the same solution.

We're curious what you think, especially if you're running finetuned or custom models — that's the use case we've invested the most in. What's broken, what would make this actually useful for you?
by Sohcahtoa82 | 2026-03-12 18:52:50+00:00
> They key is to do it by setting up the right structure or end up with it naturally

This is extremely hand-wavy.

Can you be more concrete in what you think this looks like?

The way I see it, we're only 5-10 years away from having general purpose robots and AI that can basically do anything. If the prices for that automation is low enough, there will be massive layoffs as workers are replaced.

There's no way to "naturally" solve the problem of skyrocketing unemployment without government involvement.
by IAmBroom | 2026-03-12 18:52:54+00:00
You'd obviously have to use false-color, as most modern astronomy pictures do (even the ones that use visible tend to pump the saturation UP!).

However, the amount of light from the sun drops off exponentially away from the peak at green-blue (yellow-green, after atmospheric filtering). You'd also have to really fake the dynamic range a lot to get it to look any different from IR+Vis+NUV. (If there was 0.001% as much x-ray light as there is, say, red light, DNA could only exist in the lightless depths of the ocean.)

So, it would look like an IR+Vis photo (light falls off pretty fast in the UV, too), except the ones you've seen oversell the IR.

So it would look like a Vis-light photo, with slightly shinier objects in it.

Sorry.
by anigbrowl | 2026-03-12 18:53:03+00:00
Sorry, I feel no need to accept your premise that Iran simply cannot be allowed to have one.

India (which also has nukes) may hate that Pakistan has that capability, but there's nothing they can do about it. I'd say Pakistan is considerably more secure with than without. And despite being an Islamic country with a nexus to terrorism they haven't blown up any western countries.
by indsocial | 2026-03-12 18:53:23+00:00
In this day and age, we believe that genuine connections, in the B2B sass space, not an algorithm to be gamified for outreach and engagement, are how businesses should collaborate.

For that, we're working on Industry Social, a social network that helps foster these connections.

It is under development and would be available shortly, but we'd love it if you could have a look at it and be a part of our waitlist so that you can be a part of the beta program and help shape how businesses connect with each other.
by jamal-kumar | 2026-03-12 18:53:41+00:00
https://www.youtube.com/watch?v=rI5Qlo2Y6Jg

Nice pick! Above that same song but not compressed to hell

I like this one for amen stuff. Heavyweight Vol.4 - Untitled 7

https://www.youtube.com/watch?v=dfyHx7SCn3g
by wenc | 2026-03-12 18:53:47+00:00
Rehashing my comment from before:

I use Kiro IDE (≠ Kiro CLI) primarily as a spec generator.
In my experience, it's high-quality for creating and iterating on specs. Tools like Cursor are optimized for human-driven vibing -- they have great autocomplete, etc. Kiro, by contrast, is optimized around spec, which ironically has been the most effective approach I've found for driving agents.

I'd argue that Cursor, Antigravity, and similar tools are optimized for human steering, which explains their popularity, while Kiro is optimized for agent harnesses. That's also why it’s underused: it's quite opinionated, but very effective. Vibe-coding culture isn't sold on spec driven development (they think it's waterfall and summarily dismiss it -- even Yegge has this bias), so people tend to underrate it.

Kiro writes specs using structured formats like EARS and INCOSE (which is the spc format used in places like Boeing for engineering reqs). It performs automated reasoning to check for consistency, then generates a design document and task list from the spec -- similar to what Beads does. I usually spend a significant amount of time pressure-testing the spec before implementing (often hours to days), and it pays off. Writing a good, consistent spec is essentially the computer equivalent of "writing as a tool of thought" in practice.

Once the spec is tight, implementation tends to follow it closely. Kiro also generates property-based tests (PBTs) using Hypothesis in Python, inspired by Haskell's QuickCheck. These tests sweep the input domain and, when combined with traditional scenario-based unit tests, tend to produce code that adheres closely to the spec. I also add a small instruction "do red/green TDD" (I learned this from Simon Willison) and that one line alone improved the quality of all my tests.
Kiro can technically implement the task list itself, but this is where agents come in. With the spec in hand, I use multiple headless CLI agents in tmux (e.g., Kiro CLI, Claude Code) for implementation. The results have been very good. With a solid Kiro spec and task list, agents usually implement everything end-to-end without stopping -- I haven’t found a need for Ralph loops. (agents sometimes tend to stop mid way on Claude plans, but I've never had that happen with Kiro, not sure why, maybe it's the checklist, which includes PBT tests as gates).

didn't have the strongest start, but the Kiro IDE is one of the best spec generators I've used, and it integrates extremely well with agent-driven workflows.
by repstosb | 2026-03-12 18:54:08+00:00
So are Cygwin and WSL, though, for those who don't already have the luxury of being on Linux or UNIX (incl. MacOS). I'm sure there are uses for running full-system emulators inside a browser, but access to bash and sed and gawk doesn't seem like one of them. Seriously, if that's the best way to get access to good text manipulation tools, why aren't you ditching your entire OS?
by lxgr | 2026-03-12 18:54:36+00:00
Which IPv6 “gratuitious” features (i.e. anything other than the decision to make a breaking change to address formats and accordingly require adapters) would you argue made adoption more difficult?

IPv6 gets a lot of hate for all the bells and whistles, but on closer examination, the only one that really matters is always “it’s a second network and needs me to touch all my hosts and networking stack”.

Don’t like SLAAC? Don’t use it! Want to keep using DHCP instead? Use DHCPv6! Love manual address configuration? Go right ahead! It even makes the addresses much shorter. None of that stuff is essential to IPv6.

In fact, in my view TFA makes a very poor case for a counterfactual IPv4+ world. The only thing it really simplifies is address space assignment.
by tinier_subsets | 2026-03-12 18:54:49+00:00
The “wife giving birth” exception for speeding is always so amusing to me.

In the U.S., the average distance from a hospital is 10 miles (in a rural area). Assuming 55 mph speed limits, that means most people are 11 minutes from a hospital. Realistically, “speeding” in this scenario probably means something like 80 mph, so you cut your travel time to 7.5 minutes.

In other words, you just significantly increased your chances of killing your about to be born kid, your wife, yourself, and innocent bystanders just to potentially arrive at a hospital 210 seconds sooner.

Edit: the rushing someone to an ER scenario is possibly more ridiculous, since you can’t teleport yourself, and if the 3.5 minutes in the above scenario would make a difference, then driving someone to the ER is a significantly worse option than starting first aid while waiting for EMTs to arrive.
by cweagans | 2026-03-12 18:54:50+00:00
This is the second time I've seen somebody use the word "clankers" in the last couple days to refer to AI. Is that a thing now? Where'd that come from?

Gonna be honest, it has taken away from the message both times I've seen it. It feels a bit like you're LARPing your favorite humans vs robots tv show.
by bayes-song | 2026-03-12 18:54:51+00:00
That sounds like a good idea. During the use of a skill, if the agent finds something unclear, it could proactively ask the user for clarification and update the skill accordingly. This seems like a very worthwhile direction to explore.

In the current system, I have implemented a periodic sweep over all sessions to identify completed tasks, cluster those tasks, and summarize the different solution paths within each cluster to extract a common path and proactively add it as a new skill. However, so far this process only adds new skills and does not update existing ones. Updating skills based on this feedback loop seems like something worth pursuing.
by mcherm | 2026-03-12 18:55:01+00:00
No one who understands the first thing about this topic could possibly have read that web page and not realized that it was satire.

"Those maintainers worked for free—why should they get credit?"

"Your shareholders didn't invest in your company so you could help strangers."

"For the first time, a way to avoid giving that pesky credit to maintainers."

"Full legal indemnification [...] through our offshore subsidiary in a jurisdiction that doesn't recognize software copyright"
Show HN: Mozzie – a local desktop orchestrator for AI coding agents
by zacharykapank | 2026-03-12 18:55:14+00:00
Mozzie started as a tool I built for my own workflow.

I like working on multiple things at once, but most development tools split the workflow across different places: tickets live in issue trackers, execution happens in terminals, and context gets lost between them. I wanted my work items and their context right next to the place where the work actually happens.

Mozzie is a local desktop workspace where each work item can spawn its own terminal or coding agent. The idea is that tasks become the primary interface — each one holds its context and can run commands or agents independently.

This makes it easier to work on many tasks in parallel without constantly switching between tools.

It’s still early, but I’ve been using it daily and it fits how I like to work.

Curious if anyone else prefers working this way or has tried something similar.
by sweetjuly | 2026-03-12 18:55:27+00:00
This has also been a common theme in recent decades with respect to privacy.

In the US, the police do not generally need a warrant to tail you as you go around town, but it is phenomenally expensive and difficult to do so. Cellphone location records, despite largely providing the same information, do require warrants because it provides extremely cheap, scalable tracking of anyone. In other words, we allow the government to acquire certain information through difficult means in hopes that it forces them to be very selective about how they use it. When the costs changed, what was allowed also had to change.
by Dannylopez | 2026-03-12 18:55:39+00:00
We use to lease our IPs from "Amin Golestan" who runs Braveway, Aventice, Micfo, Altus Communications among other shell companies.

Their sister also runs the same operation under Azadeh Golestan Parast trading as Virtual Dedicated Datacenter Services

https://bgp.he.net/AS46261#_prefixes
https://bgp.he.net/AS9009#_prefixes

We then found out he was scamming people like his brother, Amir Golestan and subleasing IPs from even Cogent communications to us by falsifying their actual location.

You can see most of the Cogent IPs on AS46261 and his bogus swip info which ARIN can not even enforce.

#ARIN
#Cogent
#RIPE
by djoldman | 2026-03-12 18:55:46+00:00
As an aside, I'm always perplexed by these statements:

> There are as many as 12 million species of fungi, yet there are just 155,000 or so known species, leaving vast numbers undescribed.

"There are as many as 12 million species of fungi, yet there are just 155,000 or so known species..."

The second number makes sense: it's how many species we've identified. But the first number... how can we know how many we don't know?

This kind of thing pops up all the time (X number of crimes go "unreported"... if they're unreported how can we say that?).

I get that they may be estimates. If so, it's pretty important that that estimation process is described.

Might as well say there are as many as 12 trillion species of fungi.
by CobrastanJorji | 2026-03-12 18:55:50+00:00
That's not really the case. Things often fail to work out for them after everyone gets bored and wanders off. Like when he tried to dunk of the law firms. Sure, lots of them capitulated immediately, but the ones who stuck it out and sued had slam dunk cases that they easily won. This may be fine for Trump and co, after all their goal is usually headline and spur-of-the-moment decision, and they don't face any penalties when it falls apart later, but it does mean that folks often do beat them just by sticking with it for long enough.
by ProllyInfamous | 2026-03-12 18:56:03+00:00
My state does not allow certain confusing characters, but I'm part of an organization which issues plates in specific violation of aforementioned character restrictions (as an added bonus the plate/organization is emblazzened with `EMERGENCY` across the bottom). ALPR camerae mis-read the plate, having applied state interpretation rules — no human has ever read it correctly, either [0].

But of course since you cannot even see it anymore it is definitely unscannable. I can drive by speed camera without issue (i.e. no citations received).

[0] I have only been pulled over once in the past decade (back when plate displayed normally), after traveling behind a cop for miles going 100mph+ through Dade County mountains. Cop: "I have no clue what agency you're with — you're plate didn't scan — but you need to slow the fuck down. You're lucky I have somewhere else to be!"
by cyberax | 2026-03-12 18:56:11+00:00
> Most of those unmanned narcosubs are cut-down speedboats hulls, to my knowledge.

Some are now fully submersible: https://insightcrime.org/news/under-radar-what-hundreds-ofna...

I think it is indeed more likely that they used a low-profile boat, but I won't discount a full submersible. Or maybe a combination: a low-profile boat that uses a regular outboard gas engine to get close to the target, and then dives and attacks like a torpedo.

> If Iran does have fully submersable UUVs, I'd expect them to be saved for a direct confrontation with the US Navy, not tankers.

I don't think they can do serious damage to large US Navy vessels.
by adrian_b | 2026-03-12 18:56:15+00:00
In my opinion the redesign of IPv6 was perfectly fine. The IPv6 headers are significantly simpler that those of IPv4 and much easier to process at great speed.

There was only 1 mistake, but it was huge and all backwards compatibility problems come from it. The IPv4 32-bit address space should have been included in the IPv6 address space, instead of having 2 separate address spaces.

IPv6 added very few features, but it mostly removed or simplified the IPv4 features that were useless.
by xorcist | 2026-03-12 18:56:42+00:00
> everything in v4x that happens to have the last 96 bits unset

That's pretty much identical to 6in4 and similar proposals.

The Internet really needs a variant of the "So, you have an anti spam proposal" meme that used to be popular. Yes, it kill fresh ideas in the bud sometimes, but it also helps establish a cultural baseline for what is constructive discussion.

Nobody needs to hear about the same old ideas that were subsumed by IPv6 because they required a flag day, delayed address exhaustion only about six months, or exploded routing tables to impossible sizes.

If you have new ideas, let's hear them, but the discussion around v6 has been on constant repeat since before it was finalized and that's not useful to anyone.
by alwa | 2026-03-12 18:57:08+00:00
More subtly, what is an education? What is care? The LLMs are (or probably will become) perfectly good at the measurable parts of those services, not least because they’re trained against them.

But how many of us have a reminiscence that starts “the most life-changing part of my primary or secondary education was ________,” where the blank is a person, not a curriculum module? How many doctors operate on hunches, on totalities of perception that they can’t fully put into words?

I’m reminded of the recent account of homebound elderly Japanese people relying on the Yakult delivery lady partly for tiny yoghurt drinks, but mainly for a glimmer of human contact [0].

Some of the value is in the measurable outcome (bacterial infection? Antibiotic!), but different means create different collections of value that don’t fully overlap (fine, I’ll actually lay off the wine because the doctor put the fear of the lord in me).

[0] https://news.ycombinator.com/item?id=47287344
by repstosb | 2026-03-12 18:57:20+00:00
I guess I enjoy solving problems, and recognize that the devil is always in the details, so I don't get much satisfaction until I see the whole stack working in concert. I never had much esteem for "architects" who sketch some blobs on the whiteboard and then disappear. I certainly wouldn't want to be "that guy" for anyone else, and I'm not even sure I could do it to an LLM.
by pear01 | 2026-03-12 18:57:44+00:00
What an amazing standard of proof you operate under.

Luckily our legal system more often than not makes it literally illegal to operate under your standard. How many were victims of people like you before they had to codify that principle I wonder. Truly stunning. If only the same level of rigor were enforced for presidents of the United States taking the nation to war. Think of how many more countless lives could be saved.
by angiolillo | 2026-03-12 18:58:04+00:00
The country as a whole may be "rich" in terms of GDP but school districts are funded locally and many towns are struggling or underwater in terms of finances.

I lived in a working class town with a school district that built up a great reputation, especially for special needs students, due to the hard work of some amazing teachers. Ultimately the district had to scale back many programs dramatically because the number of students, especially special needs students, started growing much faster than the tax base and risked bankrupting the town. Most of that was an increase in the ratio of families moving to town for the schools, but there were some fraud cases as well.

A better solution would have been to fund education more equitably at the state level, but that was not a lever that the school district had at the time.
by pibaker | 2026-03-12 18:58:53+00:00
> I disagree heartily with Biden and the deeper US intelligence communities assessments, like you do.

Maybe if they were actually competent they wouldn't have made the mistake then?

> Biden did not lose, Kamala Harris lost.

Harris had no choice but to carry the Biden administration's poor approval on her back. Furthermore if Biden knew he would be unelectable in 2024 earlier he could have dropped out earlier and allow Harris (or other Democrats) more time to campaign. But he chose to stay until a disastrous televised debate forced him out, out of… what, exactly?

> but he was successfully portrayed as incompetent by applying a very different standard to Biden than to Trump 45.

Biden defenders always bring up how we shouldn't criticize him because Trump is worse. Ok. But you realize that's an absurdly low bar to clear, no? We are not upset that Biden is worse than Trump, we are upset that Biden is worse than what we expect from a someone with a letter D next to his name.
by ajkjk | 2026-03-12 18:58:57+00:00
personal theory: I think there's going to turn out to be a parallel development of math that is basically strictly finitist and never contends with the concept of an infinite set, much less the axiom of choice or any of its ilk. Which would require the foundation being something other than set theory. You basically do away with referring to the real numbers or the set of all natural numbers or anything like that, and skip all the parts of math that require them. I suspect that for any real-world purpose you basically don't lose anything. (This is a stance that I keep finding reinforced as a learn more math, but I don't really feel like I can defend it... it's a hunch I guess.)