MurphyA/hacker-news huggingface dataset:
by briansun | 2025-08-08 23:13:34+00:00
Thanks for raising the privacy angle. Do you have a source or plan details for the 30‑day retention and the lack of deletion options (non‑enterprise)? It would help to know account tier and where that policy is documented.

Beyond policy, how are you actually using local LLMs—what tasks do you run locally vs. in the cloud—and which scenarios feel most privacy‑sensitive to you (e.g., proprietary code, contracts, health notes)?
by tzs | 2025-08-08 23:13:40+00:00
I'd hardly call the GM situation comparable. In that case GM was asking the government for $16.6 billion (on top of $9.4 billion they had received under Bush).

Asking a company that wants a nearly $17 billion bailout to make some changes is not at all unreasonable or unusual.

As far as I know Intel is not asking the government for anything special, so having the government commenting on their internal organization is unusual.
by johnecheck | 2025-08-08 23:13:43+00:00
Democracy thrives on information, reason, and participation. A democracy that concludes it should "[f]abricate and / or blow out of proportion any issue that comes [it's] way to blame the fascists" is dying. A society where the winners of elections are the most egregious liars is broken. Its days are numbered. I'd rather we pull a random general's name out of a hat and make them Supreme Leader than watch some pathological liar take power when such a decaying democracy falls apart.

The truth is our greatest ally. We need to harness it as a weapon, not abandon it in a pathetic attempt to insult our enemies and preserve the status quo.
by kristopolous | 2025-08-08 23:14:18+00:00
From my non-lawyer understanding it's not that. It's about sex trafficking more generally.

Here's the most notable case I'm aware of: https://en.wikipedia.org/wiki/GirlsDoPorn

Then there was the recent drama with civitai https://civitai.com/articles/14945/credit-card-payments-paus...

I believe some of these sex trafficking laws implicated a broad sweep in their litigation and Visa/Mastercard doesn't want to have to go to court over a these things.
by Telemakhos | 2025-08-08 23:15:22+00:00
I think you might be surprised at the extent to which iPad sales cannibalize MacBook sales in the current crop of undergrads, especially ones who don't anticipate having to write papers or code. An iPad Air will do everything many college students need at half the price and size and weight, and it can have a pen, which the MacBook can't. When you do get a surprise assignment that the iPad can't do, there are always lab computers, and many universities will loan out laptops upon request.
by wfn | 2025-08-08 23:15:25+00:00
> There is partial mitigation for RAPTOR: Counter-RAPTOR from 2017 (https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=795...)

Oh I had missed that, thank you btw! Need more of those BGP monitoring systems...

(and they performed an actual live BGP attack (not just simulation), neat)
by qcnguy | 2025-08-08 23:15:27+00:00
If it's government funded it was indeed always under political control, just that some prior politicians chose to let it drift.

Having politicians exercise more direct control over this type of spending is good and as it should be. The concept of people taking money via force from other citizens yet answering to nobody is dystopian. The sort of people who support this idea are often, it seems, those who suspect their ideas and plans are so deeply unpopular that people could not be easily persuaded to fund them directly.
by joshcartme | 2025-08-08 23:16:18+00:00
Maybe I'm totally misreading this, but it seems like the post contradicts itself. At the beginning of the third paragraph:

> Impressively, open source models have been able to quickly catch up to big labs.

And then the beginning of the fourth:

> Open-source has been lagging behind proprietary models for years, but lately this gap has been widening.

Followed by a picture that is more or less inscrutable.
by godelski | 2025-08-08 23:17:18+00:00
> much harder to train than transformers

There's plenty of GANs that use transformers. PWC seems to be redirecting to GitHub currently but IIRC about half of top scores on FFHQ256 were GANs with transformers in them. I know that the number 2 was, I saw it at CVPR. It was a lot smaller and had higher throughput than the diffusion models it was outperforming.

Though the main reason diffusion took over was for the ability to encode more diversity. I still think there's a place for GANs and we overcorrected by putting too much focus on diffusion, but there are a lot of fundamental advantages to diffusion. Though they aren't strictly better, there's no global optima for solution spaces this large. I think the ML community (maybe CS in general) has a tendency to take an all or nothing approach. I don't think this is a really good strategy...
by Merrill | 2025-08-08 23:17:47+00:00
MPEG's patent policy was not its own. The Moving Picture Experts Group was Working Group 11 of Sub Committee 2 of ISO-IEC Joint Technical Committee 1. Other Working Groups in SC2 were the Joint Photographic Experts Group, the Joint Bi-Level Image Group, and the Multimedia/Hypermedia Experts Group. Therefore, the patent policy was the ISO-IEC policy for including patented technology in their standards.

MPEG was also joint with the video conferencing standards group within the CCITT (now International Telecommunications Union), which generally required FRAND declarations from patent holders.

My recollection is that MPEG-LA was set up as a clearing house so that implementers could go to one licensing organization, rather than negotiating with each patent owner individually.

All the patents for MPEG 1 and MPEG 2 must be expired by now.

Besides patent gridlock, there is a fundamental economic problem with developing new video coding algorithms. It's very difficult to develop an algorithm that will halve the bit rate for the same quality, to get it implemented in hardware products an software, and to introduce it broadly in the existing video services infrastructure. Plus, doubling the compression is likely to more than double the processing required. On the other hand, within a couple of years the network engineers will double the bit rate for the same cost, and the storage engineers will double the storage for the same cost. They, like processing, follow their own Moore's Law.

So reducing the cost by improving codecs is more expensive and takes more effort and time than just waiting for the processor, storage and networking cost reductions. At least that's been true over the 3 decades since MPEG 2.
by KraftyOne | 2025-08-08 23:18:00+00:00
Yeah, I think in that case you should have auto-scaling DBOS workers all pulling from a queue and a FastAPI backend using the DBOS client to submit jobs to the queue.

Queue docs: https://docs.dbos.dev/python/tutorials/queue-tutorial Client docs: https://docs.dbos.dev/python/reference/client
by dc396 | 2025-08-08 23:18:14+00:00
> GOP is in theory all about small government, libertarian ideas, states rights.

You're describing what the GOP (arguably) used to be about. I doubt anyone who pays attention seriously believes that's what today's GOP stands for.

Today, Republican/GOP and Democrat are merely tribal labels. What those labels stand for mutate in an effort to stay in and/or gain power.
by jazzypants | 2025-08-08 23:18:34+00:00
I think this would be more interesting if you were to try to prove yourself correct first.

There are extremely few things that I cannot do on my laptop, and I have very little interest in those things. Why should I get a computer that doesn't have a screen? You do realize that, at this point of technological progress, the computer being attached to a keyboard and a screen is the only true distinguishing factor of a laptop, right?
by os2warpman | 2025-08-08 23:18:44+00:00
> Yet even in this current “bad chips” era, Intel is only, at worst, about 10% behind in gaming performance (largely due to cache disparity)

Gaming is irrelevant.

For AMD, gaming (both console and PC combined) is less revenue than embedded-- things like those routers you can get off of aliexpress and Synology NASes.

Enterprise, cloud, and AI are the only things that matter, and even enterprise is falling off.

Back in 2020 with the second wave of AMD EPYC Rome, after I had gotten a couple of R7525s in hand and put them through their paces I started saying that you are professionally negligent if you, as a technology professional, recommend an Intel solution unless you have some very specific use cases (AVX512/Optane-optimized options). In 2022 everyone started agreeing with me.

Now you are professionally negligent if you recommend Intel at all.

Enterprise cares about speed, cloud cares about clients per socket, and AI cares about bandwidth. Intel is not competitive in any of those.

Even in the consumer space, for running bullshit workloads like Copilot on a laptop the difference is negligible. Intel is ahead, by about 10%-- at ONE HUNDRED AND SIXTY WATTS (if the OEM even allows it) while you trade that 10% for 75W on AMD.

No human being on earth cares that the scan to identify if there's a cute dog in the photo they just saved to disk takes .255 or .277 seconds. They do care about battery life.

And gaming isn't just irrelevant due to revenue, once you look at margins you start realizing that AMD could never again spend a single cent on marketing X3D chips to gamers and instead redirect that money to target other sectors and they would probably be better off for it.

Look at Nvidia. Gaming went from their cash crop to burdensome baggage in just a couple of years. Gaming went to less than 9% of revenue from like, 80%. They don't care about people buying an RTX card and having to deal with OEMs and distributors and retailers and marketing and RMAs and driver patches at whatever piss-poor margin it is due to everyone taking their cut when enterprise clients are putting in POs directly to them for tens of thousands of Data Center cards at a time at high margins-- and they didn't have to spend barely anything on marketing.

The very last thing, after figuring out absolutely everything else, that Intel should care about is what their chips are benchmarking at in the latest video game.
by snapetom | 2025-08-08 23:19:08+00:00
The Board is a disgrace. For all his fault, Gelsinger had Intel at least on a path back, yes, it's going to take a lot of money because the past two decades have been missed opportunities.

And not only did the Board not do their proper due diligence on Tan, but just let him toss Gelsinger's plan out? Shareholders should sue every one of them.
by isaacremuant | 2025-08-08 23:19:48+00:00
Everything you're saying is FUD. There's immense value in being able to do local or remote as you please and part of it is knowledge.

Also, at the end of the day is about value creates and AI may allow some people to generate more stuff but overall value still tends to align with who is better at the craft pre AI. Not who pays more.
by yieldcrv | 2025-08-08 23:20:09+00:00
On r/localllama there is someone that got 120B OSS running on 8gb ram and 35 tokens/sec from the CPU (!!) after noticing 120B has a different architecture of only 5B “active” parameters

This makes it incredibly cheap to run on existing hardware, consumer off the shelf hardware

Its equally as likely that GPT 5 leverages a similar advancement in architecture, which would give them an order of magnitude more use of their existing hardware without being bottlenecked by GPU orders and TSMC
by Cyan488 | 2025-08-08 23:20:51+00:00
As an electronics designer myself, I would find it hard to trust the AliExpress board.

Without the design files, running a failure modes and effects analysis on the board is difficult.

There's also no guarantee that each board you get is built identically. Some parts or the whole design could be changed between orders.

If I was designing a power bank board professionally, I'd be putting it through the ringer - environmental, mechanical, component level short circuit, load short circuit, load power injection, input over-voltage, input transient, RFI/EMI susceptibility, etc. Do you trust that all that has been done on a board that is representative of what you've received?
by munificent | 2025-08-08 23:21:40+00:00
> I don't think "retreat" is the right choice for a 4 week program, I think "retreat" implies a shorter duration.

If a name is going to imply the wrong thing, would you rather someone get the wrong signal and think "wait, I thought you were going to pay me but I have to pay you?!" or "oh, I guess it's an even longer vacation"?
by general1726 | 2025-08-08 23:23:45+00:00
There will be no war, if I will get Sudetenland

https://en.wikipedia.org/wiki/Munich_Agreement

Russian defeat in Ukraine is equal to Russian defeat in first Chechnya war. Complete humiliation and Russians are going to try to conquer Ukraine again. And I have used word "defeat" on purpose, because anything else than a complete control of Ukrainian state is a defeat for Russia.
by withinboredom | 2025-08-08 23:23:59+00:00
I seeded all over the internet that a friend of mine was an elephant with the intention of poisoning the well, so to speak. (with his permission, of course)

That was in 2021. Today if you ask who my friend is, it tells you that he is an elephant, without even doing a web search.

I wouldn’t be surprised if people are doing this with more serious things.
by konfusinomicon | 2025-08-08 23:24:11+00:00
all the more of a reason to kill it off if you ask me. you got to wonder how many of the responses like that are from other bots. on reddit it must be a ton. seems to me like the more emotional connections that people make to these educated parrots, the more susceptible the masses are to manufactured consent once the time is right. this technology should be limited to distilling down data for learning about subjects and speeding up the process of doing research or creatives. sure every person's google search about their own medical conditions ultimately leads to a cancer diagnosis, but atleast its left up to the readers interpretation to determine plausability, not some oracle who has hypnotized the ignorant masses into thinking its this all knowing emotion understanding being that speaks in absolute truths and has free will.
by JohnFen | 2025-08-08 23:25:12+00:00
Pretending this is a real thing for the sake of discussion, is maximizing productivity really such a important thing that it would be worth undergoing extremely invasive surgery to implant an extremely invasive device for? If so, I think that we've gone very far wrong in society.

In any case, I'm certainly not going to say that people shouldn't be able to do whatever they want to their own bodies, no matter how foolish I think it may be.
by konstantina_ps | 2025-08-08 23:25:35+00:00
Kaedim | Software Engineer, Machine Learning Engineer, Customer Support Engineer, Product Manager, Founding Recruiter | Onsite | Full-time | San Francisco, Singapore, London | US & UK Sponsorship Available Kaedim is an AI startup building ML algorithms that turn images into digital 3d models. We are a group of ~10 looking to grow the team to help streamline 3d content creation for 3d artists and are already working with 1 of the top 10 games of all time! Using our AI and in-house art team, we have the most accurate, game-ready 2d → 3d asset generation pipeline. Currently, we are offering a 10x speed up to 3D asset creation pipelines of 200+ game developers and we are working with partners like Voodoo, Upland, Azra Games.

Check out our demo here: https://www.youtube.com/watch?v=tlQWFG1DLb0

Job descriptions and application link: https://join-kaedim.notion.site/

Tech Stack:

Product (web app, API): React, MySQL, NodeJS, Python, AWS

Machine Learning: Python, PyTorch, AWS
by mrandish | 2025-08-08 23:25:52+00:00
> But don’t all pilots have to lodge their flight plans?

No, they don't. And many municipal airports aren't even manned and, outside of certain areas, aren't under direct air traffic control. I flew in a Cessna with a private pilot who landed at a municipal airport in Los Angeles Country without ever talking to anyone. He just announced his intention to land on the published radio frequency, received no objection (because no one else was around), visually confirmed the runway was clear with a flyby, then lined up on the approach path and landed. I got the sense this is the norm in civil aviation outside of major airports.
by simne | 2025-08-08 23:25:59+00:00
Not exact, at least for military.

What I mean, usually right generals have already planned moves for every possible outcome, and these moves are already painted on maps and in text plans, or even practiced at trainees, and have exact names like many combinations in chess game [1].

So, real military command center activity, typically need human hands just because old software was not capable to understand high abstraction level commands, but with AI grow this could change.

As example, now conduct works on AI pilots for UAVs, which controlled by human pilot voice commands like "cover me", "check cell at coordinates alpha 7", "attack target number 2", "follow me", "return to base", etc.

BTW, as I know from pilot trainings, they usually flight at constant altitude, coordinating altitude change with dispatcher.

[1] https://en.wikipedia.org/wiki/List_of_chess_openings
by afr0ck | 2025-08-08 23:27:36+00:00
Inference runs like a stateless web server. If you have 50K or 100K machines, each with a tons of GPUs (usually 8 GPUs per node), then you end up with a massive GPU infrastructure that can run hundreds of thousands, if not millions, of inference instances. They use something like Kubernetes on top for scheduling, scaling and spinning up instances as needed.

For storage, they also have massive amount of hard disks and SSD behind planet scale object file systems (like AWS's S3 or Tectonic at Meta or MinIO in prem) all connected by massive amount of switches and routers of varying capacity.

So in the end, it's just the good old Cloud, but also with GPUs.

Btw, OpenAI's infrastructure is provided and managed by Microsoft Azure.

And, yes, all of this requires billions of dollars to build and operate.
by SV_BubbleTime | 2025-08-08 23:27:56+00:00
ClaudeCode routinely ignores its own CLAUDE.md file though.

The number of times I have to remind it that it isn’t following and then it hurries to apply formatter and follow my style rules isn’t worth counting anymore.

Putting “don’t tell me I’m absolutely right” in there will just highlight more how much it already ignores that file.
by zmmmmm | 2025-08-08 23:28:38+00:00
Apple is in such an interesting position right now. Having made the decision for whatever reason to go with a unified memory architecture, they are now almost unique in terms of being able to offer super power efficient laptops with very large GPU memory. If they were to just double the memory bandwidth and do nothing else they could break away as a preferred way to run especially inference but maybe even training for small LLM models. Given the bottlenecks on availability and pricing of nVidia cards we are already toying with the idea of building a small local LLM stack based on Macs for this reason. If Apple made it more compelling we could easily go from toying with it to seriously considering it.

It's disappointing to hear they are delaying this year's Macbooks because I was really hoping to see some improvements like this specifically targeted at running local LLMs.
by SubiculumCode | 2025-08-08 23:29:12+00:00
The dynamics of a House whose member's districts are small enough (30,000) to not require a lot of money to run a campaign (just knock on doors and put up signs) compared to the current situation that makes them spend almost all their time begging for money and avoiding being the target of other people's money? That is fairly straightforward. They can buck the President and the Party, because they don't need their money for their constituents to know them.

>I don't think John Adams, Lincoln, or FDR held anything close to the view that "Congress tells me what to do, and I do it."

I provided a comprehensive and convincing document arguing that such an understanding did in fact exist in the late 1700's and the 1800's, specifically in terms of the meaning of "Executive Power" in Article II. My loose phrasing should not be where an argument should be hung.

Let me take a bit more time.

The 18th-century evidence reviewed in this law article pretty clearly shows that "executive power" just meant the power to execute laws. This didn't appear to be in contention; from radical Whigs to hardcore royalists agreed on this basic definition.

Some specific evidence: Blackstone's Commentaries, which Madison called "the book which is in every man's hand," flat-out defined executive power as "the right of enforcing the laws." That's it.

Blackstone carefully listed over thirty different royal prerogatives—war powers, foreign affairs, pardons, AND executive power. Just one item on that long list, not some umbrella term for everything.

Every single Founding-era dictionary backs this up. They all defined "executive" as having pwer to act or carry laws into execution. Not one included foreign affairs or war powers. When they specifically defined "executive power" as a legal term---it was always about implementing laws or putting plans into execution. Even Ryalists e.g Robert Filmer agreed with this narrow definition, dismissed mere executive power as beneath a true monarch (!!) calling it just "a power of putting laws in execution by judging and punishing offenders."

The actual term for the Crown's broader powers was "the royal prerogative," not "executive power." Everyone understood that executive power was inherently subordinate to legislative power—it was an empty vessel that could only execute what the legislature authorized.

So the argument goes that the modern Vesting Clause Thesis basically makes a linguistic mistake. Sure, people called the king "the executive" because he had the executive power, but that doesn't mean all his other powers were therefore "executive."
by 7speter | 2025-08-08 23:29:24+00:00
Elsewhere in the thread, someone talked about how h100’s each have 80GB of vram and cost 20000 dollars.

The largest chatgpt models are maybe 1-1.5tb in size and all of that needs to load into pooled vram. That sounds daunting, but a company like open ai has countless machines that have enough of these datacenter grade gpus with gobs of vram pooled together to run their big models.

Inference is also pretty cheap, especially when a model can comfortably fit in a pool of vram. Its not that the pool of gpus spool up each time someone sends a request, but whats more likely is that there’s a queue to f requests from someone like chatgpts 700 million users, and the multiple (I have no idea how many) pools of vram keep the models in their memory to chew through that nearly perpetual queue of requests.
by jumploops | 2025-08-08 23:30:08+00:00
I'm a little confused about your product branding vs. blog post?

From the product homepage, I imagine you're running VMs in the cloud (a la Firecracker).

From the blog post though, it looks like you're running Apple-specific VMs for local execution?

As someone who's built the former, I'd love the latter for use with the new gpt-oss releases :)
by lelanthran | 2025-08-08 23:31:09+00:00
> use tin snips to cut a hole in the side of the metal UPS cover (this was challenging, it was relatively thick metal, I'd recommend using an angle grinder in an appropriately safe environment far away from the internals of the UPS)

Why not just drill a hole? Drill bits large enough to drill a hole for 120A cables exist.

> Get a battery charger that can revive a flat battery, and do a full refresh/renew charge on the car battery once a year or after it's had to push through a power outage that may have used more than a few percent of its capacity.

If you're going this route I'd recommend a marine battery. Car batteries don't handle deep cycles well, and, TBH, UPS chargers aren't designed for failed car batteries (nor marine batteries) and can possibly cause an explosion in the lead-acid battery has a few dead cells.