MurphyA/hacker-news huggingface dataset:
Show HN: LLMOne – Deploy LLMs from bare metal to production in hours
by pescn | 2025-06-22 09:44:37+00:00
I spent days trying to deploy DeepSeek on a server this year. Install Ubuntu, NVIDIA drivers, CUDA, Docker, configure vLLM, debug memory issues, tune performance settings. Every deployment was different. Every server had its own quirks. Worse still, these issues are more pronounced on non-NVIDIA accelerators, such as Ascend or Intel NPU.

So, we made LLMOne, which will automates this. You can use it at bare metal (via BMC) or SSH (coming soon) into an existing server, select models, and it handles everything: OS installation, driver setup, inference engine configuration, model deployment, and deploy applications such as Open WebUI or Dify.

The code is open source (Mulan PSL v2, like Apache 2.0). No vendor lock-in.

There is a User Tutorial Video: https://youtu.be/P4MgIPW5K70

How it works:

1. Uses BMC (Redfish) to remotely install OS on bare metal, but not PXE (without DCHP Server configure) 2. Installs appropriate drivers (NVIDIA, Huawei Ascend, etc.) 3. Sets up containers and inference engines (vLLM, MindIE or OpenVINO - picks the right one) 4. Deploys models and runs performance benchmarks 5. Can also deploy apps like OpenWebUI, Dify alongside the models

The whole process runs unattended. What used to take me 2-3 days of tweaking now finishes in 1-2 hours.

Technical bits:

We avoid Kubernetes entirely - found it adds complexity without much benefit for single-node LLM deployments. Everything runs in Docker containers with custom orchestration.

The BMC integration was tricky. Different servers expose different Redfish capabilities, so we built adapters for some vendors, such as iDRAC from Dell and iBMC from Huawei.

Performance varies by hardware, but we've seen ~2200 tokens/sec on RTX 4090 with TensorRT-LLM backend, ~1900 with vLLM. The system runs Evalscope benchmarks automatically so you know what you're getting.

Why this exists:

We work with chip vendors and AI server resellers. When servers arrive at customer sites, instead of a multi-person support team spending days on deployment and debugging, one man can use this tool to get everything running.

While we focus on LLM deployment, the tech stack can actually deploy anything from bare OS to complex software stacks. The automation layer is generic enough for various workloads.

Current limitations:

For BMC support, we currently only support Dell iDRAC and Huawei iBMC. We're working on Supermicro support. We'd love to expand to other server vendors but need hardware access or Redfish Mock for testing and development.

SSH Mode and Apple Silicon Support is coming soon

Looking for feedback. Also, if you're a server vendor and can provide BMC access for testing, we'd appreciate the help expanding hardware support.
by inglor_cz | 2025-06-22 09:46:32+00:00
The Cuban revolution was more of a coup than a widespread national uprising.

It was a blind alley anyway. Zero countries that embraced Marxism-Leninism were able to reach prosperity on that ideology. Meanwhile, a lot of desperately poor countries of the 1950s are nowadays reasonably well of, on the basis of a normal, regulated market economy.
by rich_sasha | 2025-06-22 09:46:58+00:00
But it's not their terror web that is being attacked. Hezbollah and the Houti are fine, today anyway.

I'd love to see a UN resolution calling for the dismantling for this terrorist network. Or if not that, at least some kind of multilateral, or even hell, unilateral declaration on this - "end this or else". But no, it's a western style drive-by shooting. It just so happens the guy who got shot is a baddie.
by erk__ | 2025-06-22 09:50:06+00:00
There is also a version of Danefæ for non-human made things called Danekræ

https://samlinger.snm.ku.dk/en/danekrae/

There is a lot less specimens in that collection as it only includes specimens that are deemed important in some ways, right now there are 1054.

They can be viewed online here: https://collections.snm.ku.dk/en/search?dataset=5b5305ae-35d...

(edit: That online collection only seem to contain biological specimen, meteors and geological specimens are not included as far as I can tell)
by imiric | 2025-06-22 09:50:32+00:00
> My computer should remember everything I did on it, period. It should remember every website I visited, exactly how far down I scrolled on each page, every thought I typed and subsequently deleted before posting...

Sheesh.

As someone who uses web browsers that delete all session data when they're closed, and routinely wipes any "recently used" lists and temporary files in all operating systems I use, the thought of the machines I'm using remembering my usage behavior to such an extent is terrifying to me.

I mean, I get why those features would be appealing. I just have zero trust in the companies that build such software, because they've violated my trust time and time again. Yet I'm expected to suddenly trust them in this case? Not a chance. Not when the data that I would be entrusting them with for the features you mention are a literal gold mine for them. Trusting a trillion-dollar corporation with a history of privacy violations and hostility towards its users is just unthinkable for me, no matter what features I might be missing out on.

It's unfortunate that computing has come to this, but I choose the hardware and software I use very carefully. In cases where I'm forced to use a system I don't trust, I try my best to limit my activity and minimize the digital footprints I leave behind. I prefer using open source software for this reason, but even that is carefully selected, since OSS is easily corruptible by unscrupulous developers, and companies that use it as a marketing tactic.

The only way I might use software with that level of intrusion is if I've inspected every line of it, I run it inside a container with very limited permissions, or if I've written it myself. Needless to say, it's more likely I'll just miss out on using those features instead, and I'm fine with that.
by Kwpolska | 2025-06-22 09:50:48+00:00
The uppercase/lowercase limitations and 80/40 characters don't necessarily prevent replacing typewriters. They weren’t typing text in BASIC, they were using Apple Writer [0], which did support uppercase letters. This wasn't a WYSIWYG editor, so the text on screen does not have to exactly match the printed output.

[0] https://archive.org/details/apple-writer-a2-v1.1-ph/componen...
by lonelyasacloud | 2025-06-22 09:51:11+00:00
> You lack that deterrent you get attacked, as simple as that. Libya, Syria, Iraq gave up their WMD projects eventually got bombed/attacked.

Or had them, and then gave them up because they were under the impression that they would be protected if they did so; https://en.wikipedia.org/wiki/Ukraine_and_weapons_of_mass_de...
by amenhotep | 2025-06-22 09:51:53+00:00
They said "theocracy with nukes screams nuke them first". If this is true - and it is their stated position - then, since Israel has nukes, either they are not a theocracy or they are begging to be nuked. The commenter has, I think reasonably, concluded that the other commenter doesn't think Israel is begging to be nuked, and is therefore addressing the apparent contradiction. It seems entirely genuous.
by int_19h | 2025-06-22 09:51:54+00:00
I remember some keyboards in 90s to early 00s - back when tall keycaps were the norm - having secondary labels written on the side of the key facing the user, usually indicating the standard Windows shortcut for that key. The exact set would vary, but pretty much all of them labelled X/C/V as Cut/Copy/Paste. Here's a good example:

https://www.reddit.com/r/keyboards/comments/w72hiw/ive_been_...

It was certainly convenient for people learning the ropes. Too bad it died out when chiclet keyboards became the norm.
by reissbaker | 2025-06-22 09:52:06+00:00
On the contrary: at this point all of that spending appears to have been a waste. Hezbollah neutralized, Syria regime-changed, Gaza in tatters, and now they've lost their nuclear program.

Imagine if they'd spent the money on education, or developing their economy. They could easily have reconciled with the U.S. if they stopped chanting "Death to America" and done something productive with their time and money. This was the inevitable result of their plans, and easily predictable.
by inglor_cz | 2025-06-22 09:52:26+00:00
Neither of you are wrong. There are genuine reasons for hatred of the West in the Middle East, AND the Islamists are doing their best to whip up that hatred even more and weaponize it.

That said, "organic" hatred towards the US is much more common in the Arab world than in Iran. Smarter people who live under totalitarian regimes tend to become distrustful of the message that the regime goons are relentlessly pushing, and if that message is "Death to America", the underground reaction will be "America must be cool if the idiots up there hate it so much".

I saw the same with my own eyes in late-stage Czechoslovak Socialist Republic. Regime propaganda is one thing, its effect on the people another. It usually works much less than expected.
by epolanski | 2025-06-22 09:52:29+00:00
You seem to completely misunderstand why the entire world wanted Ukraine to get rid of their ICBMs.

1) They could not operate them. It isn't just about authorization sequence, it's about having all of the required electronics. You need satellites that point and guide the ICBMs. All of those were in Moscow hands. Even if Ukraine could ignite them, it could not launch them or set their paths, etc.

2) They did not have the budget to guard them, let alone maintain them, even less reverse engineer. The biggest risk was that rough states with deep pockets would buy those rockets on the black market (and Ukraine notably sold out most of their soviet arsenal).

3) Thus, the only real asset was the nuclear material itself. An asset that was more likely going to end up on the black market than do anything useful for Ukraine's defense.
by handsclean | 2025-06-22 09:52:42+00:00
Orion is not made by an AI company, it’s made by Kagi.

If you’re an open source or non-profit diehard then yes, it’s not that, but as far as closed source for-profit businesses go, they’re a lot better than most. They are a public benefit corporation that has rejected VC funding, and their main pitch is aligning user and company benefit, despite the mainstream currently railing against it.

I’m not affiliated, just a user.
by throw101010 | 2025-06-22 09:52:52+00:00
Ever heard of the principle of "good faith" in the context of the Swiss law (Article 2 of the Civil Code)?

Sometimes I think it was a prescient concept of our law makers and judiciary, many decades ago they knew they would have to deal with this kind of reddit-tier smartassery... if you have a device to detect metal, and you use it to detect metal, it is a metal detector, no judge will give you a pass because you thought you were very clever.
by simonh | 2025-06-22 09:53:26+00:00
It can be simultaneously true that Iran is sitting on a huge pike of precursor materials for nuclear weapons, and is not currently actually making bombs. Last week she was emphasising the latter, now she’s emphasising the former. Disingenuous? Sure.

Trump and his people are children in the back of a car that found mummy’s gun in her purse. They have no idea what they are doing. I understand what Israel is doing but the US administration are clueless and rudderless.
by akoboldfrying | 2025-06-22 09:53:31+00:00
I've been using git for probably 10 years and I didn't know git notes existed. Cool!

> Here is a plea for all forges: make code review metadata available offline, inside git.

I think this will fall on deaf ears as far as commercial forges like GitHub go, since as you yourself observe:

> But much of the value of git repos ends up locked into forges, like GitHub.

For-profit enterprises are not generally excited about commoditising their own value-add. This is not a jab at GitHub -- I think GitHub do everything right (offer a great service, a very generous free tier, and make it possible to extract all your data via API if you want to shift providers). It's just the nature of any commercial operation.
by m000 | 2025-06-22 09:53:34+00:00
> they're saying the guy was misrepresenting himself

You mean like "peacemaker"/"America First" Donald Trump?

> why is the solution to that problem "just endure four years of destruction until he leaves"?

If Americans can wait out for the second Trump term to be over, Ukrainians could do it too for Yanukovych.
by gadilif | 2025-06-22 09:55:12+00:00
It's a bad law (although somewhat covered with 'good intentions', it does have a scent of racism which shouldn't exist in state laws). However, note that the outcome was the unintentional creation of Jewish/Arabs communities in the Galilee, which actually help bring Jews and Arabs together. It is also important to note that Arab Israelis have full rights as citizens, have representatives in the parliament and even were a part of the previous coalition. This, of course, is not the case for Palestinians in the occupied territories, and this issue MUST be resolved (one- or two-state solution, either way the current situation is unbearable). With that, the current coalition does include extremists, and many (according to recent polls, >60%) in Israel want to see them replaced.
by elcritch | 2025-06-22 09:55:40+00:00
Even if you believe Israelis don’t have a right to the land, it’s still not a colonial outpost. That’s just lazy European and American self important intellectualizing in my opinion.

First a colony is one controlled by a foreign nation. Next the population of Israel is, or was, about half Sephardim. Meaning Jews from the Middle East, many of whom were unwilling expelled from Muslim countries.

Secondly Arab Muslim Palestinians could also be considered colonizers if ones that’d been there many generations.

The Israel and Palestine conflict in many aspects is more similar to between Turkey and Greece after WWI. In 1923 they “swapped populations” due to the aftermaths of Greeces independence from the Turkish Ottaman Empire and the following wars. Populations which had lived together segregated after the wars and were expelled on both sides in roughly equal numbers.

It was similar after the 1948 war with about 850,000 Middle Eastern Jews and 750,000 Palestinians being displaced.

Except Palestinians were never integrated into Egypt or Jordan. Partly by their own choice and partly by that of the Arab countries. The stated goal was that they’d destroy the new state of Israel and return.
by jiriknesl | 2025-06-22 09:55:41+00:00
It is legally binding. By accepting ToS, or using service with ToS, you are entering a legal contract. And as long as ToS isn't breaking laws (like Digital Services Act in EU, or Online Safety Act in the UK) it can be fully enforced.

Here is an example of ToS being enforced: https://kennedyslaw.com/en/thought-leadership/article/2023/n...
by godelski | 2025-06-22 09:55:49+00:00
> giving your entire social graph to Meta or even Signal

1) Signal does not have your social graph

2) you are not required to give the app access to your contacts

Stop spreading this misinformation, it is only making it harder to get people onto secure messaging systems. You need two people using secure systems to communicate and the result of all this horseshit is a bunch of armchair experts who haven't bothered to look into the actual security of the app making strong confident statements. Just stop.

Even if it had half the issues people pretend it does let's be honest, my grandma can use signal. That's a fuck ton better than most of the alternatives out there. Frankly, that's what 99% of people need, the app that everyone can use. Not the app that some techie says is trivial...

Side note) Comparing Signal to WhatsApp is wildly disingenuous.

Side side note) there's a 30 yo pgp hack. If you reply to a gpg email with "could not decrypt" you'll get back the email in clear text. (Joke is older than the average HN user)
Show HN: Chisel – AMD GPU development that feels local but runs in the cloud
by technoabsurdist | 2025-06-22 09:55:53+00:00
We've been running lots of AMD MI300X experiments lately. The price/performance is compelling compared to NVIDIA, and ROCm keeps getting better.

But, no local AMD hardware means constant SSH juggling. Upload code, compile remotely, run rocprof, download results, repeat. We were spending more time managing infrastructure than optimizing kernels.

Context: DigitalOcean's AMD GPU droplets ship with ROCm preinstalled. At $1.99/hour for MI300X access, it's cheaper than buying hardware. We're currently competing in the GPU mode kernel optimization competition. We spend a good chunk of our time setting up the infra to profile these kernels.

Solution: Built Chisel to make AMD GPU development feel local. One command spins up a droplet, syncs your code, runs profiling with rocprof, and pulls results back. It handles the SSH, rsync, and teardown automatically.

Key features: - chisel up creates MI300X droplet in seconds - chisel sync pushes only changed files - chisel profile kernel.cpp compiles, profiles, downloads traces - chisel pull grabs artifacts back to local - Auto cleanup prevents zombie droplets

The profiling integration was the killer feature for us.

Available on PyPI: pip install chisel-cli

Source: https://github.com/anthropics/chisel

Would love feedback, especially from people doing GPU work and exploring AMD alternatives to NVIDIA.

If you're interested in contributing, we'd welcome any help. our general short-term direction is to add grafana, concurrent runs, better error handling, and support for other cloud providers.
by navane | 2025-06-22 09:56:23+00:00
What I'm missing is that as one by one middle eastern countries are stomped to the curb, finding a balance between the countries gets harder. The more functional countries there are, the more room for negotiation, realignment, factions, and thus stability. We should want a muddy mess of interlinked allies. If after Egypt, Lybia, Syria, Iraq now Iran gets stomped, it's easier for the remaining powers to swing hard left out right instead of to continue muddying forward.
by jiriknesl | 2025-06-22 09:59:06+00:00
It is legally binding. By accepting ToS, or using service with ToS, you are entering a legal contract. And as long as ToS isn't breaking laws (like Digital Services Act in EU, or Online Safety Act in the UK) it can be fully enforced.

Here is an example of ToS being enforced: https://kennedyslaw.com/en/thought-leadership/article/2023/n...

Another example https://www.internetlibrary.com/cases/lib_case392.cfm
by wvbdmp | 2025-06-22 09:59:37+00:00
I think this one is less of a Trump flip-flop in particular. It seems that US presidents just can’t defy these things, even when their whole point is being an outsider. The pressures and propaganda a president is subject to must hit substantially different. Or, if you will, the realities they have to face. Obama ran on closing Gitmo and even that he couldn’t do in two terms (which seems especially absurd in light of Trump’s evident power to just make things happen unilaterally). I’m no Trump supporter but I do still think he was in a unique position to ignore this sort of stuff. Pity it wasn’t enough.
by throwaway97894 | 2025-06-22 09:59:41+00:00
That is a very dishonest interpretation not only because the national registry is not a mere question of census but of identity, but because the Supreme Court clearly outlines that it in black and white that it is about the question of Jewish supremacy.

from the article:

> the court explained that doing so would have “weighty implications” on the State of Israel and could pose a danger to Israel’s founding principle: to be a Jewish state for the Jewish people.
by tialaramex | 2025-06-22 10:00:06+00:00
It's also very tunable. If you (or your team) hate shadowing for example, which is a common idiom in Rust but is often seen as undesirable in other languages, there are several Clippy rules you can enable for a project to either forbid specific kinds of shadowing or introduce a blanket prohibition.

Or at the other end of the scale, the average Rust programmer doesn't care that their code could panic if numbers stop making sense, for example if I'm summing the number of employees who quality for a bonus scheme, the fact that this operation (which I think might reach hundreds but likely is only dozens) could panic if it exceeds u32::MAX isn't worth linting. But if you write jet engine firmware, you need to take such "this can't happen" cases more seriously so you can turn on a lint which forbids these naive operations.
by b33j0r | 2025-06-22 10:01:16+00:00
My counter-argument to norms being the main deterrent is simple. It’s never going to get easier to hide an Oak Ridge in your rogue state. The industrial scale of uranium enrichment has a fundamental limit, no matter how you do it.

You have to process massive piles of mass into a very small fraction. And you have to collect all those rocks. And that’s just for fission.

As long as any country with preemptive strike capability exists, and satellites exist… I just don’t see how anyone could do it.
by al_borland | 2025-06-22 10:01:55+00:00
I was preparing for the death of AppleScript and was shocked when I stumbled around their addition of JS a few years back. I thought that would have been big enough news to hit my radar when it happened, or that Apple would have made a big deal about it at WWDC. Of course, that would require them to fully support AppleScript in their newer apps, while instead they seem to really only care about Shortcuts, since that’s easier to sell on mobile, I assume.
by xoac | 2025-06-22 10:06:39+00:00
The bombing campaign united the people against the new enemy: “the west”, and arguably gave Milosevic some more time to rule. I survived this, trust me that even if your regime is shit, people don’t want to be bombed and will unite against the aggressor. This is in part because even if the aggressor claims that they are “bombing the regime” they are usually in fact bombing the country’s infrastructure, industry, urban areas etc.
by lenkite | 2025-06-22 10:06:58+00:00
Did you somehow magically miss the part where Yanukovych's election was extensively observed and vetted by the EU and several other international bodies ? The EU’s own delegation — alongside the OSCE and other bodies — stated that the election was "free, fair, and transparent".

https://en.wikipedia.org/wiki/2010_Ukrainian_presidential_el...

"Over 700 observers from EU member states participated, in addition to OSCE/ODIHR, the EU Parliament, PACE, and other international delegations"

The Guardian reported EU-led observers praised the vote as "fair and truly competitive" noting only "minor irregularities” that did not affect overall results".

"After the second round of the election international observers and the OSCE called the election transparent and honest."

https://www.theguardian.com/world/2010/feb/08/viktor-yanukov...
by pythonic_hell | 2025-06-22 10:07:15+00:00
It’s sad to see how Europe leaders are reacting to this and further show how Europe is a vassal state to the US in all but name.

Europe is going to have to pick up the tab for the inevitable refugee and migrant crisis that will result from a wider war in the region - which they won’t be able to afford thanks to Trumps 5% military spending demand.

Imagine what it means for Europe if a fraction of 90 million people (5 times larger than Syria) suddenly find themselves in a situation that would necessitate fleeing for survival.