MurphyA/hacker-news huggingface dataset:
Show HN: Inworld Runtime – A C++ graph-based runtime for production AI apps
by rogilop | 2025-08-13 16:00:04+00:00
Hey HN, this is Igor, one of the engineers behind Inworld Runtime, which we're releasing today in public preview.

We built it to solve the common problem we and our customers had: engineers spend more time on AI ops and plumbing than on actual feature development. This was often due to the challenge of using Python for I/O-bound, high-concurrency workloads and complexity maintaining pipelines with streams that use always-changing ML models.

Our solution is a high-performance runtime written in C++ with the core idea of defining AI logic as graphs. For instance, a basic voice-to-voice agent consists of STT → LLM → TTS nodes, while the connecting edges stream data and enforce conditions. This graph engine is portable (Linux, Windows, macOS) and can run on-device.

We built a few key features on top of this C++ core:

- Extensions. Runtime architecture decouples graph definition from implementation. If a pre-built component doesn't exist, you can register your own custom node/code and reuse it in any graph without writing any glue code.

- Routers. You can dynamically select models/settings on the per-node basis depending on the traffic as well as configure policies for fallbacks and retries to get the app ready for production.

- The Portal. A web-based control plane UI to deploy graphs, push config changes instantly, run A/B tests on live traffic, and monitor your app with logs, traces, and metrics.

- Unified API. Use our optimized models or route to providers like OpenAI, Anthropic, and Google through a single, consistent interface and one API key.

We have a Node.js SDK out now, with Python, Unity, Unreal, and native C++ coming soon. We plan to open-source the SDKs, starting with Node.js.

The docs are here: https://docs.inworld.ai/docs/runtime/overview

We're eager for feedback from fellow engineers and builders. What do you think?
by quesera | 2025-08-13 16:00:07+00:00
I think there's some truth to this. There's lots of room in the middle of the pack.

But that would be a serious, violent, downgrade from the American self-image. We are bred on American Exceptionalism. If this myth is destroyed, we don't have a replacement ideology.

The ROW can decide that Americans are silly people who should get over themselves. But that will not convince Americans to accept the change calmly. And when Americans are not calm, the ROW suffers too. One way or another.
by michaeldoron | 2025-08-13 16:00:25+00:00
Interesting! In the story itself, the word "go up" exists multiple times in that verse before the youths mock him, writing that Elisha goes up to Beit El and goes up the road, so I wouldn't go back to the beginning of the chapter to search for context that is found right there in those verses, but I like the connection you're making.

As for mob or thugs, the literal translation will be "little teenagers", so mob or thugs will be stretching it a bit; more likely that the Arabic contemporary use of "Shabab" for troublesome youth is the best translation. Religious scholars have been criticizing Elisha for generations after for his sending bears at babies, so I think it's safe to assume the story meant actual kids and not organized crime.
by chasing | 2025-08-13 16:00:26+00:00
I think a lot of AI-generated stuff will soon be seem as cheap schlock, fake plastic knock-offs, the WalMart of ideas. Some people will use it well. Most people won’t.

The question to me is whether we will lets these companies do completely undermine the financial side of the marketplace of ideas that people simple stop spending time writing (if everything’s just going to get chewed to hell by a monster our corporation) or Will writing and create content only in very private and possible purely offline scenarios that these AI companies have less access to.

In a sane world, I would expect guidance and legislation that would bridge the gap and attempt to create an equitable solution so we could have amazing AI tools without crushing by original creators. But we do not live in a sane world.
by phatfish | 2025-08-13 16:00:28+00:00
The best part of Brexit is that the EU protected us from the worst of destitute economic migrants. The southern EU countries were dealing with most of them, we just had to give them some cash to help. France also was more willing to deal with them for us.

We got internal migration from other EU countries (eastern Europe, Spain, Italy mostly) with much higher living standards. EU migrants are much more likely to return to their home countries after a period saving some cash and practising English.

But even that was too much for the poor old Brits.

Now we have people from African war zones and Indian villages and they are NEVER going back voluntarily. France isn't bothered any more because we behaved like spoiled children during Brexit, they wave them off on the Normandy beaches.

After burning bridges with Europe the only solution for the illegals is to go full Nazi and sink their boats in the channel like Farage wants to. Even if he somehow became PM I don't see that happening.

Anyway, legal migration is by far the biggest source, and those are mostly Indian villagers that are happy to have an inside toilet and not be fried by 40c+ heat most of the year. They are here forever too. BTW, a lot of Indians in the UK at the time were really happy about Brexit, i wonder why...
by david38 | 2025-08-13 16:00:39+00:00
I haven’t seen this. There are more smaller companies than larger ones. At my company, as a manager, I encourage the use of AI because it appears to make developers about 10% more efficient, helps kickstart new projects, and improves job satisfaction by automating away some of the boring parts of development.

Perhaps at call centers and such you are correct, but your comment is as disingenuous as saying the compiler is about getting a stronger position over labor, or the expansion of included libraries, or faster microprocessors, or modern IDEs before AI. The march towards automation, efficiency, and automation in engineering never stops.

Every so often there is a massive leap which results in significant job losses, but that doesn’t mean it’s about labor. Was the release of AWS about labor? It destroyed many Silicon Valley companies as you could now do with $5k what previously took $200k.
by nickpsecurity | 2025-08-13 16:00:54+00:00
It's not dead but will take a huge hit. I still use DuckDuckGo since I get good answers, good discovery, taken right to the sources (whom I can cite), and the search indexes are legal vs all the copyright infringement in AI training.

If AI training becomes totally legal, I will definitely start using them more in place of or to supplement search. Right now, I don't even use the AI answers.
by smoe | 2025-08-13 16:01:08+00:00
I agree that Gemini is overly enthusiastic, but at least in my limited testing, 2.5 Pro was also the only model that sometimes does say “no.”

Recently I tested both Claude and Gemini by discussing data modeling questions with them. After a couple of iterations, I asked each model whether a certain hack/workaround would be possible to make some things easier.

Claude’s response: “This is a great idea!”, followed by instructions on how to do it.

Gemini’s response: “While technically possible, you should never do this”, along with several paragraphs explaining why it’s a bad idea.

In that case, the “truth” was probably somewhere in the middle, neither a great idea nor the end of the world.

But in the end, both models are so easily biased by subtle changes in wording or by what they encounter during web searches among other things, that one definitely can’t rely on them to push back on anything that isn’t completely black and white.
by StefanBatory | 2025-08-13 16:01:17+00:00
If you don't mind, I have a genuine question. (as in, I'm not looking for a fight and I won't comment furthermore even if I can't agree.)

But genuinely, what do you define by saying that American culture has shifted hard to the left and what do you define by left.

I am really not looking into fight, but that's not a take I've heard often and I want to hear you out.
by lillecarl | 2025-08-13 16:01:20+00:00
It means we can run higher compression in our engines without engine knock, which means we can run our turbos and timing harder on a smaller dispacement engine without ruining it, meaning more efficient engines.

Cleetus McFarland ran a car on brake-clean which has really low octane rating so sure anything works if you care about nothing. https://youtu.be/0hYOgGYQ_c8

American big block naturally aspirated engines will be tuned for crap fuel, if you've got a modern efficient turbo engine you should buy premium fuel to not ruin your engine.
by bell-cot | 2025-08-13 16:01:24+00:00
Depends on how organized and secure your physical properties and possessions are. If you've got creepy housemates or relatives, who might dig through your obviously-personal stuff? Yeah, that makes everything 100X harder. But they might also try an Evil Maid Attack, to get your online stuff.

Do you have any trusted, well-organized relative or friend with a decently secure property?

Do local banking regulations allow for access to safe deposit boxes when the owner is not present or deceased?

Could you park the documents in a manila envelope, in the secure file cabinets of the lawyer who drafted your will?

And if you're an Epic-level Ditz, who might (say) accidentally throw $700M of bitcoin in the trash? At some point, you need to have a competent person handle your affairs for you.
by benjiro | 2025-08-13 16:01:32+00:00
Here is another offender "VanceAI" ...

Try deleting your account with the delete button. Nothing happens. Everything on the site perfect, just that Delete button is broken (and the request times out).

But wait, you can send a ticket. Get response days later that it is marked as resolved.

You go back to the site ... O, i am still logged in with my old session.

Then you see your email: deleted_2544642405_blabla@gmail.com

So fake "delete" by simply putting a deleted and some timestamp before your email address, while keeping your other data.

O and the Delete button is also not fixed ;)

Companies really only seem to learn with some hefty GDPR fines.
by teleforce | 2025-08-13 16:01:40+00:00
>LLMs are not "compelled" by the training algorithms to learn symbolic logic.

I think "compell" is such a unique human trait that machine will never replicate to the T.

The article did mention specifically about this very issue:

"And of course people can be like that, too - eg much better at the big O notation and complexity analysis in interviews than on the job. But I guarantee you that if you put a gun to their head or offer them a million dollar bonus for getting it right, they will do well enough on the job, too. And with 200 billion thrown at LLM hardware last year, the thing can't complain that it wasn't incentivized to perform."

If it's not already evident that in itself LLM is a limited stochastic AI tool by definition and its distant cousins are the deterministic logic, optimization and constraint programming [1],[2],[3]. Perhaps one of the two breakthroughs that the author was predicting will be in this deterministic domain in order to assist LLM, and it will be the hybrid approach rather than purely LLM.

[1] Logic, Optimization, and Constraint Programming: A Fruitful Collaboration - John Hooker - CMU (2023) [video]:

https://www.youtube.com/live/TknN8fCQvRk

[2] "We Really Don't Know How to Compute!" - Gerald Sussman - MIT (2011) [video]:

https://youtube.com/watch?v=HB5TrK7A4pI

[3] Google OR-Tools:

https://developers.google.com/optimization

[4] MiniZinc:

https://www.minizinc.org/
by sugarpimpdorsey | 2025-08-13 16:01:41+00:00
> You expect hackers to be like, "we love capitalism! We love strong hierarchies!"?

You should ask the old-schoolers, if they can hear you over the roar of the air conditioning in their cushy corporate offices and the engines of their Volvos.

When all you have left is petty political bitching, the conference has lost its meaning, it's just a Reddit meetup at that point.
by smeej | 2025-08-13 16:01:46+00:00
I think the developers want these AI tools to be likable a heck of a lot more than they want them to be useful--and as a marketing strategy, that's exactly the right approach.

Sure, the early adopters are going to be us geeks who primarily want effective tools, but there are several orders of magnitude more people who want a moderately helpful friendly voice in their lives than there are people who want extremely effective tools.

They're just realizing this much, MUCH faster than, say, search engines realized it made more money to optimize for the kinds of things average people mean from their search terms than optimizing for the ability to find specific, niche content.
by sodimel | 2025-08-13 16:01:52+00:00
> Personal experience however shows me that when I look at a recipe site I will first have to skip through the entire backstory to the recipe and then try to parse it inbetween annoying ads in a bloated wordpress page

That's when money comes into view. People were putting time and effort to offer something for free, then some companies told them they could actually earn money from their content. So they put on ads because who don't like some money for already-done work?

Then the same companies told them that they will make less money, and if they wanted to still earn the same amount as before, they will need to put more ads, and to have more visits (so invest heavily in seo).

Those people had already organized themselves (or stopped updating their websites), and had created companies to handle money generated from their websites. In order to keep the companies sustainable, they needed to add more ads on the websites.

Then some people thought that maybe they could buy the companies making the recipes website, and put a bunch more ads to earn even more money.

I think you're thinking about those websites owned by big companies whose only goal is to make money, but author is writing about real websites made by real people who don't show ads on websites they made because they care about their visitors, and not about making money.
by jghn | 2025-08-13 16:01:55+00:00
Sure, but it doesn't really. Or at least I don't see how it's possible to do it correctly.

Such an analysis would need to: a) prove that such outliers are caused by cheating, b) prove *which* form of cheating led to those outliers, c) prove that each individual outlier *was* taking part in that form of cheating, etc. And even then all that manages to capture are outliers. It doesn't capture the hordes of players who weren't outliers, rather they were only in the league because they were using whatever form of cheating to help make the cut.

In other words, the strong anti-cheating stances when applied to historical players is just as handwavey as the let it go philosophy I espoused earlier.
by gus_massa | 2025-08-13 16:01:55+00:00
Welcome! Take a look at https://news.ycombinator.com/newswelcome.html

As a general recommendation, try to avoid comments that are too short and has no info. Try to make them longer and info heavy.

It's not a hard rule, so you may learn when to break it from time to time, but 99% of the time avoid very short comments.
by lclc | 2025-08-13 16:02:03+00:00
Yes, how horrible when people get to have a say. Where will this end? In the case of Switzerland, it's ending up as one of the wealthiest countries, with a median wealth of $182,248 per adult.

Also, since when is a political ruling class known for long-term thinking?

Besides, cars are already taxed based on weight/power (what you considered common sense).
by newfocogi | 2025-08-13 16:02:12+00:00
My (non-AI) Summary:

- "TAR-200 is a miniature, pretzel-shaped drug-device duo containing a chemotherapy drug, gemcitabine, which is inserted into the bladder through a catheter. Once inside the bladder, the TAR-200 slowly and consistently releases the gemcitabine into the organ for three weeks per treatment cycle."

- Phase 2 Clinical Trial

- 85 patients with high-risk non-muscle-invasive bladder cancer

- "treated patients with TAR-200 every three weeks for six months, and then four times a year for the next two years"

- 70/85 patients—the cancer disappeared and still gone 1yr later in almost 50% patients

- FDA granted TAR-200 a New Drug Application Priority Review

- Johnson & Johnson manufactures TAR-200
by mockingloris | 2025-08-13 16:02:33+00:00
> This website could have been written by an LLM. Real life is for humans, because you can verify that people you have shaken hands with are not AI. Even if people you've shaken hands with are AI-assisted, they're the editor/director/auteur, nothing gets out without their approval, so it's their speech.

100% Agree.

│

└── Dey well; Be well
by iLemming | 2025-08-13 16:02:42+00:00
I do a similar thing when I walk my dog. I have this primitive audio recorder app on my Android phone - the only requirement I had years ago when I found it was to be able to record directly into mp3 files, but that is no longer relevant. Anyway, I would just walk and talk into my phone. It records. I have collected numerous such recordings over the years, but they were pretty much useless. Until relatively recently. These days I have Resilio (for a stupid reason, not Syncthing, which is also a viable and perhaps better alternative) to sync my audio notes, and then I have a script with whisper.cpp hooked up. The script simply turns that into text - technically, it creates a subs file. Why subs file? With the .srt file I can not only grep through those notes, I can play them karaoke style in my editor - Emacs has subed mode that allows you do that. I can also easily hide timestamps and other metadata to focus purely on the text. I can correct wrong text recognitions, add my own comments, etc.
by zerolayers | 2025-08-13 16:02:55+00:00
Spotify published an AI-generated song on a dead country singer's official page—complete with fake vocals and a photo of someone who looks nothing like the original artist. Meanwhile, 31% of workers are actively sabotaging their companies' AI initiatives. Separately, researchers have created AI that replicates human decision-making by training on 10 million psychological experiments. When machines can resurrect the dead and predict human behavior better than we can explain it ourselves, what does authenticity even mean anymore?
by TimorousBestie | 2025-08-13 16:03:33+00:00
> There's balancing that needs to be done - does the safety benefit of a world in which nobody can be out of contact of emergency services, and the economic benefit of having reasonably high speed internet available everywhere, outweigh the loss of radio astronomy potential.

If this balancing argument is merely based on short-term economics, then of course the corporation always wins. Every commons becomes a tragedy in that world.
by xp84 | 2025-08-13 16:03:50+00:00
> unconfigured system

Does this mean:

1. a system which believes it has an accurate idea what the current UTC time is, but doesn't know where it is on Earth (or where its operator conceptually wants it to pretend it is)?

2. Or a system which has had its clock set manually, but its TZ has never been set (therefore it has no idea what the UTC time is, and therefore cannot reliably generate or store a valid time with offset.

3. Or a system which knows both its clock and its TZ have never been set?

For the first one, it seems silly, since as long as you're recording correct timestamps, fixing the display timezone later is easy and nondestructive. For 2 it seems like the OS should require setting TZ to set a time. For 3, I suppose this is actually mildly useful, since it's easy for an OS to detect if you have inited the RTC from its original starting point, and specially flagging datetimes stored while it's in that state could help to clean them up later when the correct time is known.
by ferguess_k | 2025-08-13 16:04:11+00:00
> OK, imma just say the quiet part out loud here: There would be less need for daily transportation commutes if companies allowed 100% WFH wehre applicable and the government would force/incentivise this on companies for the positions that can be done remotely in order to save the environment.

Exactly. On the contrary, the politicians everywhere are pushing for return to office, or at least not promoting WFH. And then some people on HN just complain that private cars are enemies of the public service.
by lucb1e | 2025-08-13 16:04:16+00:00
> a lot of people in a lot of places have no other choice. Not everyone lives in a developed European country

Then let's start with the people from developed European countries who can afford this and built it out from there. "I have no choice but to pollute your planet" is a bit of a thin argument to me, surely we can (as a society) find a way to make that not necessary. Collect funds, build the system we want, use it. That's the point of a government, it doesn't exist just because we like to pay taxes
by badmonster | 2025-08-13 16:04:43+00:00
Hi I've been working on adding multi-vector support natively in cocoindex for multi-modal RAG at scale. I wrote blog to help understand the concept of multi-vector and how it works underneath.

The framework itself automatically infers types, so when defining a flow, we don’t need to explicitly specify any types. Felt these concept are fundamental to multimodal data processing so just wanted to share. This unlocks at scale: images, text, audio, video — all can be represented as structured multi-vectors that preserve the unique semantics of each modality.

breakdown + Python examples: https://cocoindex.io/blogs/multi-vector/ Star GitHub if you like it! https://github.com/cocoindex-io/cocoindex
by rastignack | 2025-08-13 16:04:44+00:00
Maybe then you should have considered this file system as truly experimental and expected your end users to make frequent backups. And advertise it as such. You could also have some kind of dkms bleeding edge module for your users to test fixes before they reach the kernel.

This way you wouldn’t be so preoccupied about getting code as fast as possible in the kernel.
by bluefirebrand | 2025-08-13 16:04:59+00:00
Scammers only work because they know some percentage of the population is going to fall for it

Can't we have some empathy for people just trying to do their best in a world where so many people are trying to take advantage of them?

Their victims are often the vulnerable ones in our society too. The elderly, the infirm, the mentally ill. It's not just "stupid people fall for scams" it takes one lapse of judgement over a lifetime of being targeted. Come on
by cnst | 2025-08-13 16:05:06+00:00
Between the lines — what has necessitated AI summaries are the endless SEO search-engine optimisations and the endless ad rolls and endless page element reloads to refresh the ads and endless scrolling and endless JavaScript frameworks with endless special effects that noone wants to waste their time on.

How can the publishers and the website owners fault the visitors for not wanting to waste their time on all of that?

Even before the influx of AI, there's already entire websites with artificial "review" content that do nothing more than simply rehash the existing content without adding anything of value.
by TMWNN | 2025-08-13 16:05:26+00:00
>which will then lead to a big interest in anti-satellite weapons since these will become major targets in a hot war

If anything, the other way around. Were Starlink a traditional satellite constellation, with a few in geosynchronous orbit, they would be very appealing targets. But there are thousands, and soon tens of thousands, of Starlink satellites, which makes any sort of weapon against them other than maybe a laser impractical.

>The end result here is going to be huge quantities of space junk

... the Starlink portion of which naturally falls back to earth within five years.