MurphyA/hacker-news huggingface dataset:
Modular LLM framework inspired by Linux – aiming for a one-GPU future
by openkame | 2025-08-26 14:20:20+00:00
I want to share a concept I've been thinking about, which I call *AI-Kernel*.

The idea is to manage large language models (LLMs) like we manage the Linux kernel: - A *stable, long-term maintained base model* (the "kernel") - Modular fine-tuned components (LoRA) as "patches/extensions" - A public registry of LoRA modules, with ratings and metadata - Flexible loaders (Ollama, llama.cpp, vLLM) to run the kernel + LoRAs - A unified frontend (React/JS or CLI) to interact with the system - Fully local or cloud, depending on user choice

---

### Why?

LLMs are growing in size, cost, and opacity. Instead of bigger and bigger models, what if we focused on *efficiency, modularity, and sustainability*?

This proposal suggests a benchmark for AI sustainability:

> If GPT-5 runs on 10,000 GPUs in 2025, > then GPT-4 should run (with all features intact) on a *single GPU in 2026* – even if slower. > In 2027, GPT-5 should become the single-GPU target.

Always *one generation behind, but fully local and sovereign*.

---

### How it works

[ AI-Kernel (base LLM) ] |

+----------+----------+ \| | | \[ LoRA A ] \[ LoRA B ] \[ LoRA C ] ← Modular specialization | \[ Loader (Ollama / llama.cpp / vLLM) ] | \[ Frontend UI (web / desktop) ] | User

LoRAs are small, stackable, and don't alter the base model. Like VS Code extensions, they can be published, rated, shared, and combined.

---

### Transparency

I’m *a self-taught developer*, not an AI researcher. This is not a working product or codebase — just a structured idea for discussion.

Maybe others already thought of it. Maybe I’ve missed limits or blockers. But I wanted to write it down clearly and let more qualified people refine or challenge it.

This draft was co-written with GPT, in full transparency. The vision is mine; the wording was assisted.

---

### What this is NOT

- Not a fork or fight against existing projects - Not an implementation with code (yet) - Not claiming novelty or exclusive ownership

It’s simply a *direction to consider*: A modular, open, kernel-like model for AI that is sustainable and private.

---

### Call to action

If this resonates with you: - Improve it - Challenge it - Build loaders, registries, or LoRA modules - Or just ignore it if you think it’s irrelevant

We don’t need dozens of forks of LLMs. We need *one clean foundation, and thousands of flexible adaptations*.

Let’s build it — together. ```
by yvdriess | 2025-08-26 14:20:35+00:00
That's most of the work performed by a marking GC.

How much a GC is of total cpu cost totally depends on the application, the GC implementation and the language. It's famously hard to measure what the memory management overhead is, GC in production is anywhere between 7-82% (Cai ISPASS2022). I measured about 19% geomean overhead in accurate simulation by ignoring instructions involved in GC/MM in python's pyperf benchmarks.
by xnorswap | 2025-08-26 14:21:00+00:00
Just extending the timeline won't help, as you suggest, if anything it'll make the problem even worse, by further bedding in the helpless.

What typically does work for this kind of thing, is finding a hook to artificially rather than technically necessitate it, while not breaking legacy.

For example, while I hate the monopoly that Google has on search, it was incredibly effective when they down-ranked HTTP sites in favour of HTTPs sites.

( In 2014: See https://developers.google.com/search/blog/2014/08/https-as-r... )

Almost overnight, organisations that never gave a shit, suddenly found themselves rushing through the any required tech debt to get SSL certs and HTTPs in place.

It was only after that drove up HTTPs to a critical mass did Google have the confidence to further nudge through bigger warnings in Chrome. ( 2018 ).

Perhaps ChatGPT and has impacted Google's monopoly too much to try again, but they could easily rank results based on certificate validity length and try the same trick again.
by quesera | 2025-08-26 14:21:31+00:00
Exactly!

Both Python and Ruby are screwdrivers.

In my highly opinionated opinion, the parallels are:

- Flat head: Perl. Functional, and revolutionary at the time! But awkward to work with. - Phillips head: Python. Awesome improvement, much easier to work with. But still annoying in frustrating ways. - JIS: Ruby. A further refinement that resolves the last annoying 5% of work. (Well, OK, resolves 4 of the last 5%) ... (Also Japanese, coincidentally?)

... and in the real world, when you don't get to choose, you almost always find Phillips/Python. Better is good enough. :)
by mbix77 | 2025-08-26 14:21:35+00:00
One can only hope a company like Framework, Nothing, or Fairphone actually can produce and maintain some flagship devices running GrapheneOS or similar. The only reason I have been using Android is because of the freedom I have in my apps, customization, alternative app stores,... I hope the EU fights this with all their might. It also seems like a major geopolitical risk too.
by compumike | 2025-08-26 14:21:57+00:00
Just thinking out loud here: an ACME DNS-01 challenge requires a specific DNS TXT record to be set on _acme-challenge.<YOUR_DOMAIN> as a way of verifying ownership. Currently this is a periodic check every 45 or 90 or 365 days or whatever, which is what everyone's talking about.

Why not encode that TXT record value into the CA-signed certificate metadata? And then at runtime, when a browser requests the page, the browser can verify the TXT record as well, and cache that result for an hour or whatever you like?

Or another set of TXT records for revocation, TXT _acme-challenge-revoked.<YOUR_DOMAIN> etc?

It's not perfect, DNS is not at all secure / relatively easy to spoof for a single client on your LAN, I know that. But realistically, if someone has control of your DNS, they can just issue themselves a legit certificate anyway.
by chasil | 2025-08-26 14:22:19+00:00
I had not realized that Apple did not implement any of the 32-bit ARM environment, but that cuts the legs out of this argument in the article:

"In Anandtech’s interview, Jim Keller noted that both x86 and ARM both added features over time as software demands evolved. Both got cleaned up a bit when they went 64-bit, but remain old instruction sets that have seen years of iteration."

I still say that x86 must run two FPUs all the time, and that has to cost some power (AMD must run three - it also has 3dNow).

Intel really couldn't resist adding instructions with each new chip (MMX, PAE for 32-bit, many more on this shorthand list that I don't know), which are now mostly baggage.
by Cthulhu_ | 2025-08-26 14:23:23+00:00
I'll point to Windows Vista that went all in on this kind of security, even giving you a big warning if you tried to change your background. The computer magazines quickly published guides on how to change a slider or registry setting to reduce the amount of stupid warnings, and the people were quickly trained to ignore and just hit OK on these screens.

Anyway, Apple already does this with unknown apps downloaded from the internet, you need to go to security settings and hit a button there.
by andyjohnson0 | 2025-08-26 14:23:23+00:00
I use an old iPad as a digital photo frame. Sits on a horizontal cupboard top in £3 Ikea wooden phone stand, powered by a right-angle Lightning cable from ebay. Selfie camera is covered with a glossy black privacy sticker, also from ebay. It works tolerably well.

https://www.techradar.com/how-to/how-to-turn-your-ipad-into-...
by general1726 | 2025-08-26 14:23:39+00:00
Russia is running on Windows too and did not collapsed. It turns out that companies wants to make money and are willing to jump through hoops, sanctions or not.

Also you can just use cracked OS (illegal, but if Microsoft is out, it will become abandonware) and create alternative API for cloud services. How hard do you think it would be to create i.e. S3 compatible API? Wait that already exists - https://github.com/jchristn/S3Server

And you could continue with whatever Azure, AWS etc offers. In the end, it is just some variation of a REST server.
by BurningFrog | 2025-08-26 14:23:58+00:00
If your police force solves 100% of crimes, you have a point, but rape is a tough crime to solve and prosecute and never gets close to that.

In the UK case, the police actually has systematically ignored rape in the name of "community relations". I wish I made this up.

> Anyone can take advantage of that

Sure, but a population that is very keen on recreational rape will do a lot more damage than one who finds it abhorrent.
by matt-attack | 2025-08-26 14:24:05+00:00
Your premise to lower (temporal) detail his automatically worse is a naïve view. I’m certain you’re aware that impressionism is a valid, quite successful form of art. Do you think there are any critics who say a Monet painting would be far better if it, just had more detail? Oh if only Van Gough used a smaller brush his paintings would have been so much better! It needs “more k!”.

Film making at 24fps (while originally selected for pragmatic reasons having to do with film cost and sound fidelity) turned out to be a happy accident. It produces an Impressionistic Effect entirely similar to a money painting. 24fps is absolutely not reality. Our brains know it too. The same way they know that those giant brush strokes in a Van Gough painting are also NOT REALITY. Turns out our brains like to be toyed with. Art is just always “trying to document precisely what our senses would have experienced if we were there”.

That is just a false premise and one they misunderstands art in general.
by potato3732842 | 2025-08-26 14:24:06+00:00
While my day job is not an arborist I deal in logs and tree felling for one of my side gigs.

The weight is comparable but the electric saw has less speed/power than the same weight gas saw the battery capacity for a given amount of work output costs you a lot of weight. A gatorade bottle of gas shoved in my pocket weighs a lot less than a 40v battery.

Don't get me wrong, electric saws are great, but I wouldn't want to bring one into a tree. The couple times I've had to climb a tree I've used an electric saw but it is because I value the other factors despite the performance hit.

The difference between gas and electric is being able to hear your buddy yell at you when you're running the saw. While this is not necessarily useful for felling a singular perfect tree in the middle of a field as you crank up the complexity and/or stupidity of the situation in which you are working it becomes more valuable. If an electric saw cracks 100db it's only just barely, gas is categorically louder and everyone who's used both one knows it.

I own a wide variety of mid size saws in both homeowner and "pro" at this point, pretty much all bought used. While power and features vary I mostly discriminate based on chain/bar condition and running condition, they all do the job well enough. I have one tiny saw and huge saw that I only own in "chinese clone of a real brand" quality so I can't compare to high end saws in those classes. Chainsaws are fairly maintenance intensive high strung power equipment and electric is just easier, even if it's heavier. Homeowners who only need to maintain their property and may only run a chainsaw 1-2x per yea would be well advised to get a 40+ volt electric saw of whatever brand makes the most sense in the context of their other tool needs.
by pjmlp | 2025-08-26 14:24:59+00:00
I am usually a big critic of Go's design, but if the option is between C or Go, I would rather put up with Go.

F# has suffered from Microsoft not really caring that much, it almost feels that management has repented to have added into Visual Studio 2010, and now mostly carries it around, based on the work of volunteers, with a rather small team.

Even the release notes aren't part of .NET proper,

While VB folks document directly what is changing,

https://github.com/dotnet/core/blob/main/release-notes/10.0/...

F# notes tell readers to click into yet another link to the F# repo,

https://github.com/dotnet/core/blob/main/release-notes/10.0/...

https://fsharp.github.io/fsharp-compiler-docs/release-notes/...
by tpoacher | 2025-08-26 14:25:05+00:00
Nice website, but the "vs" is a bit misleading here. Unless I'm missing the point?

I clicked in the hope that it would tell me something about how CAs can be 'trained' and 'used' to make useful predictions somehow.

Instead, I got a neural network which is trained to predict the t+3 step of a CA based on an initial state.

Am I missing something?
by ecb_penguin | 2025-08-26 14:25:24+00:00
> but that sounds quite literally as "skill issue". Not in you personally, but in the environment you work in.

You have no idea the environment they work in. The "skill issue" here is you thinking your basic knowledge of Vault matters.

> Software like Vault from hashicorp (it's FIPS compliant, too: https://developer.hashicorp.com/vault/docs/enterprise/fips) let you create a cryptographically-strong CA and build the automation you need.

They didn't tell you their needs, but you're convinced this vendor product solves it.

Are you a non-technical CTO by chance?

> there are equivalents for mac os and gnu/linux i guess

You guess? I'm sensing a skill issue. Why would you say it's solved for their environment, "I guess??"

> Quite the contrary: it means that the process is technically so trivial the masses can do it in an afternoon and live off it for years with little to no maintenance.

I'm sensing you work in a low skill environment if you think "home lab trivial" translates to enterprise and defense.

> Hence, if a large organization is not able to implement that, the issue is in the organization, not in the technology.

Absolutely meaningless statement.
by const_cast | 2025-08-26 14:25:35+00:00
Meta has been shown to be malicious, up to an including violating permission controls to exfiltrate cookies from the browser with the facilitation of an android app.

The only reason, and it is the only reason, you do not view Meta as a malicious actor is because they've told you many times they are not.

Most Meta and Google products could be described as keyloggers or spyware. Many break permissions expectations - for example, Google apps have special privileges that allow them to circumvent some permissions on Android.

In addition, both Meta and Google products are primarily ad driven, with the majority of ads being scams. Again, virtually identical to other malicious apps.

Is any of this legal? Maybe, maybe not, you signed a EULA. But if all it takes is a EULA, then most android malware is not malware, and we're back at square one: play protect will not do anything.

And, to be clear, this is intentional. It is not Googles intention to squander malware because they rely on malware. No malware on Android and they go bankrupt.

It is their intention to further extract value out of the Google play store by leveraging their mandatory 30% cut. As well as making Android a more locked down platform and thereby more attractive to advertisers and DRM distributors.
by 9dev | 2025-08-26 14:26:14+00:00
Icarus is flying high this time of year, it seems. Don't forget that some of these traditional business minds have seen the Soviet's planned economy crumble in real-time not too long ago. They may also have taken note how virtually all human-managed funds tend to do worse over time than market-driven index funds.

Make of that what you will; the arrogance of some people to assume they know better than anyone else sure is stunning.
by ocdtrekkie | 2025-08-26 14:26:21+00:00
> What would it look like for the CA/B to "not survive that change"?

I suspect when companies who are members actually realize what happened, CA/B members will be told to reverse the 47 day lifetime or be fired and replaced by people who will. This is a group of people incredibly detached from reality, but that reality is going to come crashing through to their employers as 2029 approaches.

> Good.

You may assume that most organizations will implement private CAs in these scenarios. I suspect the use of encryption internally will just fall. And it will be far easier for attackers to move around inside a network, and take over the handful of fancy auto-renewing public-facing servers with PKI anyways.
by RianAtheer | 2025-08-26 14:27:02+00:00
That’s a solid breakdown of how crypto can actually work for you instead of just sitting in your wallet. In 2025, staking and lending feel like the safest entry points for most people, while yield farming is great if you’re comfortable with higher risk. The key is research, diversification, and only using reputable platforms. Personally, I like the idea of staking ETH or using liquid staking so I can stay flexible while earning rewards. You can read more on Finance Gossips webiste
by benrutter | 2025-08-26 14:27:41+00:00
> If you don't like a language simply don't use it, there are hundreds of alternatives. If your employer is making you write in that language you should hate your employer, not the language.

I think this is tricky. I work in the world of data and, although I like python fine, I'd find it very hard to find a role in my field that doesn't involve, if not working in python, then at least integrating very closely with work data-scientists produce that's in python.

Some languages just have a big dominance in their field. Python has that for data, and javascript for front-end.
by baq | 2025-08-26 14:27:42+00:00
Counterexample: AMD almost died and see where they're now.

Intel needs a major shakeup, it has been brewing for a long time, but coffers were too full. Cushion is gone now, urgency is now understood by everyone; now it takes a visionary and some successful execution, for once.

If you say corruption is the difference, maybe - but I wouldn't be so pessimistic... yet.
by pm90 | 2025-08-26 14:27:50+00:00
So sorry to hear this happened to you; thanks for sharing and glad to hear everything turned out ok. Ive heard of similar situations where a friend ended up in a house that was the scene of a crime but was charged with multiple felonies even though he was there after the crime had occurred and was the one to call the cops. Most people just don’t understand cops; most of them are trying to minimize the work they need to do and as soon as they have established a narrative they will just go with it. Especially for lower class neighborhoods and especially when dealing with people who have “priors”, regardless of how minor they might be.

Most people’s experience of the law is through television/movies and its just so inaccurate.
by righthand | 2025-08-26 14:28:05+00:00
> So I think the US government should take equity interests in companies they bail out rather than just giving them gifts or even loans.

The US government never gave bailout and gifts to Intel. The original agreement was profit-sharing with Intel through the CHIPS act is standard with any business wanting the funds. All Trump did specifically for Intel was alter the deal to be an equity stake instead, which will still only be beneficial is Intel is profitable.

Your entire comment is faulting on this premise. Please stop spreading this lie.
by archvile | 2025-08-26 14:28:30+00:00
Less and less of AOSP is being updated also, as Google rolls most of its new features and updates behind the Play Services system. Install Graphene and you will see what I am talking about - the SMS app for example hasn't been updated in probably a decade and looks and functions like it did back in Android 4 (KitKat). Same with the other built-in apps. While I used Graphene myself for a solid 6 months, the features you have to give up on using or find some obtuse workaround for aren't appealing to the "normies" who just want their phone to do what they want, no matter the unseen ethical cost (in this case, sacrificing the ability to freely install 3rd party apps). Someone on another forum said it very well - people like "us" were Google's foot in the door, now along with Apple they have such a stranglehold on the mobile OS space that a 3rd viable and comparable contestant becomes less and less likely by the day. Throw in how Google starting with Android 16 is not releasing updated drivers with AOSP and Graphene probably doesn't have much life left in it, either.
by Fluorescence | 2025-08-26 14:29:05+00:00
Their "main benchmark"? Stop making things up. It's no more than tragic fanboy addled fraud at this point.

That three-year old press-release refers to SINGLE CORE Geekbench and not the defective multicore version that doesn't scale with core counts. Given AMD's main USP is core counts it would be an... unusual choice.

AMD marketing uses every other product under the sun too (no doubt whatever gives the better looking numbers)... including Passmark e.g. it's on this Halo Strix page:

https://www.amd.com/en/products/processors/ai-pc-portfolio-l...

So I guess that means Passmark is "endorsed" by AMD too eh? Neat.
by gnagatomo | 2025-08-26 14:29:13+00:00
That's mostly prevalent in third-world countries like Brazil. I work for a fintech-turned-bank here and the biggest problem we have to deal with is fraudulent actions made by scammers who got access to users' accounts via social engineering. Outsiders don't know how prevalent scamming is in Brazil and how much is spent/lost trying to fight them and how that shapes the security vs convenience landscape. For example:

- I can't transfer a single cent if I didn't had my face and documents scanned after installing the bank app.

- I can't have the same bank account logged in two of my devices at the same time, all banks require you to use an account on a "verified" device (previous point).

- If I want to use a desktop to access my bank account, I have to either install a desktop client provided by the bank or be limited to just checking my balance. Some banks doesn't even allow you to log in if you don't have a "verified" device for doing 2FA.

I am very sure my higher ups are cheering with these news, even though it solves none of the problems.
by slightwinder | 2025-08-26 14:29:33+00:00
> First of all they can make it easier option for OEMs go for Windows/XBox handhelds and thus push SteamDeck out of market, by making it a niche device only a minority cares about, netbooks attack plan style, which they are starting now.

Steamdeck is already a niche device, and they have direct competition since years now. Optimizing the software and interface won't probably make it much worse for Valve.

> They can also introduce Windows/DirectX APIs that Proton will have a hard time copying, by requiring additional hardware or subsystem features not easily copyable.

Seems unrealistic that games will adapt a new restricted API, which at the same will be a longterm hazzle for Wine/Proton, and will survive that court-battles. At best, it's just some annoying money-sink, with Microsoft playing on time to make it worse for everyone without gaining any real advantage.

> Finally, companies don't last forever, and I am betting as the 2nd most valuable company in the planet, Microsoft will outlive Steam's current management and eventually deal with the problem in another way.

That's actually realistic, but there is also the chance that valve will be outliving Windows and has to battle with whatever will follow.
by RianAtheer | 2025-08-26 14:29:56+00:00
That sounds interesting! I’d love to hear more about what the Visual AI flow manager does and how testers can get involved. Passive Income with Crypto in 2025 isn’t just about “buy low, sell high” anymore. Investors are staking, lending, farming, and exploring DeFi tools to earn steady returns—even in sideways or bearish markets. With traditional yields low and inflation still a concern, crypto offers higher potential rewards. Read more on financegossips website