MurphyA/hacker-news huggingface dataset:
Show HN: LLMKube – Kubernetes for Local LLMs with GPU Acceleration
by defilan | 2025-11-18 16:47:49+00:00
Hi HN! I built LLMKube, a Kubernetes operator for deploying GPU-accelerated LLMs in production. One command gets you from zero to inference with full observability.

Why this exists: Regulated industries (healthcare, defense, finance) need air-gapped LLM deployments, but existing tools are either single-node only (Ollama) or lack GPU optimization and SLO enforcement. LLMKube bridges the gap.

What's working:

- 17x speedup with NVIDIA GPUs (64 tok/s on Llama 3.2 3B vs 4.6 tok/s CPU)

- One command: llmkube deploy llama-3b --gpu (auto CUDA setup, scheduling, layer offloading)

- Production observability: Prometheus + Grafana + DCGM GPU metrics out of the box

- OpenAI-compatible API endpoints

- Terraform configs for GKE GPU clusters with auto-scale to zero

Tech: Kubernetes CRDs, llama.cpp with CUDA, NVIDIA GPU Operator, cost-optimized spot instances (~$50-150/mo dev workloads).

Status: v0.2.0 production-ready for single-GPU deployments on standard K8s clusters. Multi-GPU and multi-node model sharding on the roadmap.

Apache 2.0 licensed. Would love feedback from anyone running LLMs in production!

Website: https://llmkube.com

GitHub: https://github.com/Defilan/LLMKube
by tylervigen | 2025-11-18 16:48:12+00:00
I am personally impressed by the continued improvement in ARC-AGI-2, where Gemini 3 got 31.1% (vs ChatGPT 5.1's 17.6%). To me this is the kind of problem that does not lend itself well to LLMs - many of the puzzles test the kind of thing that humans intuit because of millions of years of evolution, but these concepts do not necessarily appear in written form (or when they do, it's not clear how they connect to specific ARC puzzles).

The fact that these models can keep getting better at this task given the setup of training is mind-boggling to me.

The ARC puzzles in question: https://arcprize.org/arc-agi/2/
by greedo | 2025-11-18 16:48:38+00:00
It's a huge design space but the sea is a harsh mistress. Look at sonobuoys for example; some are passive, just using a hydrophone and relaying any signals via UHF/VHF and others are active where they ping and then relay signals. Generally, they're good for about eight hours. And they have no propulsion system, they just float.

Now you want to add a solar array (without being visible). And easily communicating with satellites will rapidly eat into your power budget, even without worrying about propulsion.

Yes, sensors can be tethered. We've done that since the early 80's, and let our SOSUS systems deteriorate since the fall of the USSR. But these aren't drones, aren't anything like a swarm of drones.

Let's not shift the goalposts away from the original argument.
by mr_00ff00 | 2025-11-18 16:48:45+00:00
“non-addictive at prescribed doses”

Less likely to be addictive, definitely not non-addictive.

https://talbottcampus.com/resources/how-adderall-addiction-s...

This has the same energy as the common incorrect statement “marijuana isn’t addictive”. I assume made by frequent users who want to downplay negatives.
by robot-wrangler | 2025-11-18 16:48:51+00:00
> Extremely difficult for no reason whatsoever. Terrible book.

Many people believe this is the mythical "Great American Novel" we've been arguing about and/or anticipating forever. Strong argument for that because it's actually very Hollywood, isn't it? It's an absurdly action-packed cowboy-horror mashup that's full of gratuitous violence and manifest destiny.

I know several people that thought it was "extremely gory for no reason whatsoever" and did not finish for that reason, but none that thought it was difficult. I was surprised TFA mentioned it in that light, because I remember Child of God being more of a slog and BM being a page-turner.

https://en.wikipedia.org/wiki/Great_American_Novel
by basscomm | 2025-11-18 16:49:02+00:00
Using the technology and opting in to telemetry, feedback forums, user surveys, newsgroups, letter writing, email campaigns, telnet into a BBS, grass-roots websites, semaphore, Morse code, teletype, fax, etc.

Anything is better than nothing, if anyone actually listens to the feedback they get instead of taking it and ignoring it.
by somenameforme | 2025-11-18 16:49:05+00:00
I think you're creating a false dichotomy here - either some massive interconnected, and relatively singular, society - or people living literally alone. If you're at all into video games, the game Kingdom Come Deliverance, is unique in that it's not only based on real 15th century European (Bohemia - present day Czech Republic) locations but engaged in extensive research to create as accurate a physical representation of these places as possible.

So it can give you a tremendous feel for how "society" in the past might have felt in terms of scale and layout. And a decent sized city, would typically be smaller than a large suburban neighborhood now a days, in spite of there being hundreds of millions of humans alive at the time. And so I wouldn't view stuff as like 'society vs outsider', but rather large numbers of mostly self sufficient societies.

----

The channel discussion is really interesting! The original Primitive Technology channel [1] is 100% authentic and an amazing channel. But its growing popularity spawned a bunch of imitators including the Cambodian one (or 10) you're referencing. The imitators began doing ever more elaborate stuff for clicks, except it pretty much begin being obviously faked at some point - like multi-story spring fed swimming pools with crystal clear water, all constructed with extensive cuts and editing that was the video version of this meme. [2]

For the original you can watch him do stuff in real time, with no cuts or editing. And it's very doable yourself. Townsends uses edits and cuts, but again there's nothing like 'zomg how could they possibly do that' - it's just historical recreations, like building a log cabin, blacksmithing, and so on. All the stuff that would have been carried out in beginning one of these many little autonomous 'mini societies.'

[1] - https://www.youtube.com/@primitivetechnology9550

[2] - https://s3.amazonaws.com/marquee-test-akiaisur2rgicbmpehea/w...
by random3 | 2025-11-18 16:49:15+00:00
Your definition is off in a few ways:

Middlemen are brokers, intermediaries. Almost every job is in the middle of something including the ones labeled “real” - e.g. manufacturing uses some things to produce others. Some of the jobs you refer to as middle, are not actually middle - e.g. accounting.

You probably wanted to refer to white collar jobs or maybe just services.

Middleman are not what you think and your argument sounds off from the bat just because you use that word.
by gregsadetsky | 2025-11-18 16:49:34+00:00
I asked a semi related question in a different thread [0] -- is the basic idea behind your benchmark that you specifically keep it secret to use it as an "actually real" test that was definitely withheld from training new LLMs?

I've been thinking about making/publishing a new eval - if it's not public, presumably LLMs would never get better at them. But is your fear that generally speaking, LLMs tend to (I don't want to say cheat but) overfit on known problems, but then do (generally speaking) poorly on anything they haven't seen?

Thanks

[0] https://news.ycombinator.com/item?id=45968665
by chihuahua | 2025-11-18 16:49:54+00:00
People on HN seem to hate it whenever someone criticizes Ruby. But the language is a sad joke that's gone on for too long. I totally agree with your points and have many more I could mention (lack of proper debugger support and shitty tooling in general - these things exist, but they break every week)

The 4.0.0 release notes (TFA) are like a joke. Here are the language changes in their entirety:

Language changes: *nil no longer calls nil.to_a

That's it.
by sedawkgrep | 2025-11-18 16:50:07+00:00
> pop out a more specific BGP prefix from a backup path or secondary router so you can pull production away from the burning IP.

This won't help against carpet bombing.

The only workable solution for enterprises is a combination of on-prem and cloud mitigation. Cloud to get all the big swaths of mitigation and to keep your pipe flowing, and on-prem to mitigate specific attack vectors like state exhaustion.
by meetpateltech | 2025-11-18 16:50:52+00:00
Put this in your browser console to force default scrolling

var css = 'body { height: auto !important; overflow: auto !important; } .smooth-scroll-wrapper { transform: none !important; position: static !important; } div[style*="position: fixed"] { position: static !important; overflow: visible !important; inset: auto !important; }'; var style = document.createElement('style'); style.innerHTML = css; document.head.appendChild(style); console.log("Default scroll forced.");
by JohnMakin | 2025-11-18 16:51:12+00:00
> Most of these sites are not even that big. I expect maybe a few thousand visitors per month.

> This demonstrates again a simple fact: if you put your site behind a centralized service, then this service is a single point of failure. Even large established companies make mistakes and can go down.

I'm guessing sites with a few thousand visitors a month don't much care about single points of failure. Seems like kind of a circular argument - if they're too small to care about needing a proxy in front of their service, then they are also probably too small to care about the handful of events that cause it to go down every so often.

People talk about "single points of failure" like invoking that phrase in and of itself means something is bad. There are many areas where avoiding single points of failure is essentially impossible. It's about how much risk and impact you are willing to tolerate with those points of failure.
by phantasmish | 2025-11-18 16:51:37+00:00
Google likes to fuck with basic browser functionality for some reason. Scrolling, sometimes also how “click” intents through touch are triggered (that is, using js listeners for touch events instead of watching for the browser to communicate a “click” on an element; this does usability-killing shit like make a touch-to-stop-scrolling get interpreted as a click on whatever happens to be under your finger). I have no idea why they do this, but they do it a lot, so it must be a cultural thing.

And I don’t mean like some designers will highjack scroll to deliver a different experience like slide-like transitions or something (which may or may not be, differently, awful) but they’ll override it just to give you ordinary scrolling, except much worse (as on this page).

Seems like a lot of work to do just to make something shittier, but what do I know, I probably can’t implement a* on a whiteboard from memory or whatever.
by walletdrainer | 2025-11-18 16:52:05+00:00
I think we broadly agree, Adderall does not make anyone smarter.

I would hazard to suggest that it can make many people much more productive though. This topic has been studied extensively since before anyone cared about ADHD, and the answer is broadly “yes, for some tasks”.

> Nobody has really looked at these drugs used as work enhancers

I would strongly disagree with this bit, this was one of the primary purposes people have studied stimulants for. They’ve been successfully used for this in the past and continue to be used anriun the world, especially by various militaries.

Anyway, unfortunately I can’t comment here on personal experience given that I have been twice diagnosed and once undiagnosed with ADHD. Adderall makes me more productive and more prone to tunnel vision, but certainly not smarter.

The historical and continued use by various militaries of stimulants seems to suggest that at least many very highly motivated big spenders seem to expect the same to apply to the general population.
by ProllyInfamous | 2025-11-18 16:52:51+00:00
About five years, for myself.

>Not sure if I'll ever be able to go back to ... meetings.

It's with the wisdom of age that I now understand why HR discriminates against gaps in employment history... mostly because I don't know how I could ever be employable, again.

Monk-mode is such a cheap way to exist. Highly recommend it.
by thewebguyd | 2025-11-18 16:52:54+00:00
> Usually industries that stick to very old system did so because they didn't want to invest resources in the migration.

That can be the case, but there's also a lot of instance where it's not a matter of not wanting to invest, but that being stuck on an older system is the only option until a larger component also goes EOL or dies and cannot be repaired.

I see this all the time in manufacturing. User control interfaces that run on Windows XP or 2k. Machine is still great, can still get parts & repair it, but the software has long ago since stopped being supported. The manufacturer isn't going to spend 6 figures to replace a machine that hasn't fully depreciated yet.

In these instances, you just air gap it off and you're fine.
by crazygringo | 2025-11-18 16:53:06+00:00
>> You think kids aren't running across the street at night out in the country? Chasing a soccer ball?

> Only in well light areas, usually with a low speed limit too.

It would certainly be safer if that were true, but it's not. Kids play in front yards with zero street lighting all the time. And drivers speed.

>> People, deer, fallen branches, large roadkill, garbage cans blown into the road by the wind, the list goes on and on.

> Of those only people are at all common, and not on large roads.

I think there are a lot of places you haven't driven. In parts of the US, deer are everywhere. And who is limiting the subject to "large roads"? Headlights are used on all roads.

Also, we drive defensively because of the uncommon things we encounter. It only takes one collision to potentially kill you or someone else. Over a lifetime of driving, "uncommon" things have an unfortunate tendency to still happen at some point.
by fatbird | 2025-11-18 16:53:26+00:00
what would have come of the Vietnam era if people could be individually and effortlessly targeted in their daily lives for going against it?

Nothing. The U.S. lost Vietnam, not because it lost battles, but because it offered no governing alternative to Ho Chi Minh that the Vietnamese accepted. Millions of Vietnamese died and still they rejected every colonial gov't the French and then the U.S. tried to prop up.

The U.S.'s power coming from its ability to project organized violence is really a statement about the limits of its power. It can blow up anyone it wants to. It still can't remake other countries as it wishes.
by iso1631 | 2025-11-18 16:54:00+00:00
Which will increase demand

Driving can push up the low points (charge cars overnight), but heating would put a lot of demand in winter months, meaning a day time cold day in January with no wind will require a lot of dispatchable electricity, at night time in September with a gale blowing wind will be providing almost all the demand.

Nuclear doesn't really help as it's more expensive than the wind when it's windy and demand is low, and its impossible to build enough to cover the peak January demand unless you spread the fixed cost over the entire year, which means getting rid of every other form of electric production, and you'd still end up paying more per kWh than you would with other forms of storage.

Nuclear can't survive in a free market. It can't scale up to provide for areas of high demand, low supply, and it can't scale down to be affordable when there's high supply and low demand.
by gregsadetsky | 2025-11-18 16:54:22+00:00
I just tried "analyze this audio file recording of a meeting and notes along with a transcript labeling all the speakers" (using the language from the parent's comment) and indeed Gemini 3 was significantly better than 2.5 Pro.

3 created a great "Executive Summary", identified the speakers' names, and then gave me a second by second transcript:

[00:00] Greg: Hello. [00:01] X: You great? [00:02] Greg: Hi. [00:03] X: I'm X. [00:04] Y: I'm Y. ...

Super impressive!
by ProllyInfamous | 2025-11-18 16:54:47+00:00
>By the time I admitted to myself that I wasn't much of an entrepreneur and needed to go work for someone else

This took me about two decades and two companies to discover, about myself.

Good timing and luck have also given me a much longer runway than I ever anticipated having. Mostly just need to work for my sanity and health benefits (at this point).
by ComplexSystems | 2025-11-18 16:55:11+00:00
This article was written weirdly:

> For decades, Google has developed privacy-enhancing technologies (PETs) to improve a wide range of AI-related use cases.

They introduce this random "PETs" acronym after a random string of three words and then never use it. In general this article makes some weird stylistic choices (WSCs).
by recitedropper | 2025-11-18 16:56:10+00:00
I definitely believe it--I'm not a total AI hater. The jump on the screen usage benchmark is really exciting in that it might substantially help computer-use agentic workflows.

That said, I think there is too much a pattern with recent model releases around what appears to me to be astroturfing to get to HN front page. Of course that doesn't preclude many organic comments that are excited too!

A bit of both always happens. But given how important these model releases are to justify the capex and levels of investment, I think it is pretty clear the various "front pages" of our internet are manipulated. The incentive is just too strong not to.
by dontwannahearit | 2025-11-18 16:56:26+00:00
And it can also be a burden. If you are born on US soil to non-US nationals and therefore become an accidental American you are subject to US tax laws on worldwide income.

In the UK at least banks will not sell you financial products with tax implications (pensions, tax exempt savings schemas (ISA's to the locals)) because of the US reporting requirements.

And getting your citizenship revoked requires lawyering so its a PITA.

I know some Americans will find it hard to believe but there are people who want out of this system and feel trapped in it.
by hkh | 2025-11-18 16:56:34+00:00
Hi all, Hassan here - one of the founders of Infracost.

Infracost sits in Github / GitLab etc, and when an engineer makes a infrastructure code change, we show them how much the code will cost to run on cloud before they merge it. It also shows them how they can optimize their code for costs.

Cloud costs are very unfair in the way they are priced - we track prices from AWS, Azure and GCP, and from these three we track 4 million price points!! Why do we expect engineers will just know the cost of cloud resources? We need tools!

Would love your feedback, that's the only way we can keep building in the right direction. <3
by LoganDark | 2025-11-18 16:56:42+00:00
I usually drive with only the DRLs even at night. My vision is good enough that there's no reason to blind other drivers. I only use the beams at all when there's bad weather that fucks with visibility, or when the road has no retroreflectors. Also ever since a collision repair the headlight beams have been misaligned and that's extremely distracting/infuriating so I hate using them anyway.
by fschuett | 2025-11-18 16:56:58+00:00
Update VSCode to the latest version and click the small "Chat" button at the top bar. GitHub gives you like $20 for free per month and I think they have a deal with the larger vendors because their pricing is insanely cheap. One week of vibe-coding costs me like $15, only downside to Copilot is that you can't work on multiple projects at the same time because of rate-limiting.
by hombre_fatal | 2025-11-18 16:57:13+00:00
My dad’s small town ISP called him to say his household connection recently started saturating the link 24/7 and to look into whether a device had been compromised.

(Turns out some raspi reseller shipped a product with empty uname/password)

While a cute story, how do you scale that? And what about all the users that would be incapable of troubleshooting it, like if their laptop, roku, or smart lightbulb were compromised? They just lose internet?

And what about a botnet that doesn’t saturate your connection, how does your ISP even know? They get full access to your traffic for heuristics? What if it’s just one curl request per N seconds?

Not many good answers available if any.
by _jzlw | 2025-11-18 16:57:28+00:00
> have refused a copyright request to stop using this content without following the license

Of course they have. They're a company profiting off of people's work as a means to promote their service. Companies get away with this sort of thing all the time because they know that most of the time, just like in this instance, no one's going to actually enforce their license and sue them.

That said all they really need to do is copy the license text. Kindof strange they didn't bother to do that. They're already automating copying readmes off GitHub; skipping the license file seems like it puts them at unnecessary risk.
by ivansavz | 2025-11-18 16:58:15+00:00
See also announce blog post: https://news.ycombinator.com/item?id=45543069

Direct links to previews PDFs: - Part 1: https://minireference.com/static/excerpts/noBSstats_part1_pr... [223pp, 9MB] - Part 2: https://minireference.com/static/excerpts/noBSstats_part2_pr... [191pp, 16MB]

Concept maps: https://minireference.com/static/conceptmaps/statistics_conc...

Would love to hear your feedback.
by ajross | 2025-11-18 16:58:39+00:00
Sigh. "Irrelevant" except in the sense that the code used to build and now it doesn't after a gcc upgrade, you mean. This is an attitude shared (c.f. "greenfield" comments elsewhere in this tree) among a bunch of people who do intensive development and maintenance on active products all the time.

That use case is probably less than 20% of all the C++ development cycles out there. This is a 40 year old language that the bulk of the industry has decided to abandon for new work. The large majority of people doing work on this code are doing minimal-change updates, and nonsense like this is how you end up with rules like "We have to deploy on Ubuntu 20.04 still because the AbandonWare 4.7 library doesn't work on later version".

And it's avoidable, but not if you run around lying to people and yourself about what a breaking change is. Again, look at how C does this. The C standard writers actually know that they're updating a legacy environment and care deeply about full backwards compatibility.
by waffletower | 2025-11-18 16:59:15+00:00
I lived well outside of Tokyo and most supermarkets were eki-mae (near train stations) and did not have parking lots. I did go to markets by car, and the practice I mentioned, shopping carts used exclusively within the store, was practiced. There very well may be exceptions, but as I noted, the cultural practice even extends to Japanese markets in the United States.
by cortesoft | 2025-11-18 16:59:19+00:00
I am suggesting you host your website on your own server somewhere, and then you put it behind cloudflare. You still have your own host, just the same as you would without cloudflare. You are still providing your non-cloudflare host with the same revenue you would if you didn't use cloudflare, so I am not sure how that would hurt the ecosystem.

The 'Invasive species destroy ecosystems' quote sounds good, but what exactly does it mean in this case? What is the species, and what is it invading?
by npteljes | 2025-11-18 16:59:33+00:00
For one, CD Projekt would have been sued if this was the case. If there ever was a broken game release, Cyberpunk 2077 was one, with a staggering amount of players complaining about game breaking bugs. And those didn't go away for a good while too.

The only thing that happened is that the investors sued the company. As in, the only ones in a proper legal relationship with the company. None of this nonsense of software support / warranty that OP asserts.