MurphyA/hacker-news huggingface dataset:
by mvieira38 | 2025-08-28 14:28:19+00:00
Doesn't he have an incentive to make it look like that, though? The way he phrased it, that they are losing money because people use it so much, makes it seem like Pro subscribers are some super power-users. As long as inference has a nonnegative, nonzero cost, then this case will lose money, so Sam isn't admitting that the business model is flawed or anything
by JCM9 | 2025-08-28 14:28:39+00:00
Don’t disagree it’s what investors want. Point is just that we’re approaching a point from an economics standpoint where the credibility of the “it’s ok because we’re investing in R&D” argument is rapidly wearing thin.

WeWork’s investors didn’t want them to focus on business fundamentals either and kept pumping money elsewhere. That didn’t turn out so well.
by sailingparrot | 2025-08-28 14:28:58+00:00
Not during prefill, i.e. the very first token generated in a new conversation. During this forward pass, all tokens in the context are all processed at the same time, and then attention's KV are cached, you still generate a single token, but you need to compute attention from all tokens to all tokens.

From that point on every subsequent tokens is processed sequentially in autoregressive way, but because we have the KV cache, this becomes O(N) (1 token query to all tokens) and not O(N^2)
by ozmodiar | 2025-08-28 14:28:58+00:00
I like the idea behind https://oasis-ai.org/ where you can actually try to take advantage of the 'dream logic' inconsistency of each frame being procedurally generated based on the last one. For example, instead of building a house, build the corner of a house, look at that, then look back up and check if it hallucinated the rest of your ephemeral house for you. Of course that uses AI as the entire gameplay loop and not just a graphics filter. It's also... not great, but an interesting concept that I could see producing a fun dream logic game in the future.
by gnabgib | 2025-08-28 14:29:01+00:00
Related:

Defending against account takeovers with passkeys and DBSC (11 points, 1 month ago) https://news.ycombinator.com/item?id=44725402

Chrome Origin Trial: Device Bound Session Credentials (85 points, 4 months ago, 80 comments) https://news.ycombinator.com/item?id=43865379

Device Bound Session Credentials Explainer (14 points, 2024, 5 comments) https://news.ycombinator.com/item?id=39926961
by wongarsu | 2025-08-28 14:29:02+00:00
But they don't have to be retained frequently at great cost. Right now they are retrained frequently because everyone is frequently coming out with new models and nobody wants to fall behind. But if investment for AI were to dry up everyone would stop throwing so much money at R&D, and if everyone else isn't investing in new models you don't have to either. The models are powerful as they are, most of the knowledge in them isn't going to rapidly obsolete, and where that is a concern you can paper over it with RAG or MCP servers. If everyone runs out of money for R&D at the same time we could easily cut back to a situation where we get an updated version of the same model every 3 years instead of a bigger/better model twice a year.

And whether companies can survive in that scenario depends almost entirely on their unit economics of inference, ignoring current R&D costs
by nradov | 2025-08-28 14:29:16+00:00
You've got to be kidding. Have you ever even gone hiking in those hills? Much of the terrain doesn't allow for heavy equipment use. The areas where the wildfires spread fastest are so rough and steep that even doing it by manual labor is extremely challenging. The state and local governments simply don't have that many workers (or goats), or the budget to pay for the work. The scale of the problem is immense.
by teekert | 2025-08-28 14:29:44+00:00
Paradoxes don't exist in reality (they do in hypothetical situations), so there is indeed no paradox as you correctly observe. Instead, most people answer this wrongly, for some reason. And for some reason we call situations where this happens "a paradox". Though I agree that we shouldn't.

Edit, ok, there are things like "This statement is false.", but we should perhaps stick to "self-referential problems" with those.

I think paradoxes just exist in our theories, languages, and formal systems when we make flawed assumptions or create inconsistent frameworks. But physical reality itself just is what it is - no contradictions, just phenomena we sometimes struggle to describe accurately.

If contradictions (paradoxes) can exist, then anything becomes possible through the principle of "explosion in logic". From a contradiction, any statement can be "proven" true. The whole foundation of rational thought would be undermined. Right?
by step2 | 2025-08-28 14:30:03+00:00
I built this simple command line tool that lists all the commands Claude Code ran in a session. Analogous to how the `history` command lists the commands you ran in your standard interactive shell. Instead of pulling the commands from the ~/.zsh_history file it parses the commands from the JSON formatted conversation log files in ~/.claude/projects. There's also some logic around locating the project from the current working dir for convenience.
by jasonjmcghee | 2025-08-28 14:30:50+00:00
I've built terminal applications and when not using a dedicated alternate buffer, things like multiline text input and navigation are so easy to screw up. Not to mention when you have to do all the tricks to properly detect key strokes, pastes, etc. It's a mess of printing special codes and carriage returns.

I'm guessing they're using abstraction of some sort, but imo they've done a lot of great features and definitely usable.

That being said- they could just build / use something more like a jupyter notebook and have a wildly more stable and rich experience. Or a classic tui app, but pros and cons.
by kstrauser | 2025-08-28 14:30:54+00:00
The same Dell sold me a new monitor through their Amazon store, and when it broke a few months later — as that model became infamous for — Dell refused to replace it because their inventory system claimed I wasn’t the first owner: https://honeypot.net/2021/02/19/dell-doesnt-honor.html

Funny how experiences with the same company can be so drastically different. You got white glove service. I got service so bad that I used my veto power to keep an employer from ever spending a single penny with them.
by aDyslecticCrow | 2025-08-28 14:31:03+00:00
GAN is not a architecture its a training method. As the models themselves change underneath, GAN remain relevant. (Just as you see autoencoder still being used as a term in new published works, which is even older.)

Though if you can rephrase the problem into a diffusion it seems to be prefered these days. (Less prone to mode collapse)

Gan is famously used for generative usecases, but has wide uses for creating useful latent spaces with limited data, and show up in few-shot-learning-papers. (Im actually not that up to speed on the state of art in few-shot so mabie they have something clever that replace it)
by scrollaway | 2025-08-28 14:31:39+00:00
> claude code was completely unsustainable and therefore a flash in the pan and devs aren't at risk

How can you possibly say this if you know anything about the evolution of costs in the past year?

Inference costs are going down constantly, and as models get better they make less mistakes which means less cycles = less inference to actually subsidize.

This is without even looking at potential fundamental improvements in LLMs and AI in general. And with all the trillions in funding going into this sector, you can't possibly think we're anywhere near the technological peak.

Speaking as a founder managing multiple companies: Claude Code's value is in the thousands per month /per person/ (with the proper training). This isn't a flash in the pan, this isn't even a "prediction" - the game HAS changed and anyone telling you it hasn't is trying to cover their head with highly volatile sand.
by petralithic | 2025-08-28 14:31:56+00:00
Have you read these articles by DHH, of Ruby on Rails and Basecamp fame? He's also based in the EU so it might be helpful to read.

https://world.hey.com/dhh/why-we-re-leaving-the-cloud-654b47...

https://world.hey.com/dhh/we-have-left-the-cloud-251760fb

https://world.hey.com/dhh/our-switch-to-kamal-is-complete-8e...
by sho_hn | 2025-08-28 14:32:03+00:00
> I do not get the point of this at all

Dunno, this seems like an avenue definitely worth exploring.

Plenty of game applications today already have a render path of input -> pass through AI model -> final image. That's what the AI-based scaling and frame interpolation features like DLSS and FSR are.

In those cases, you have a very high-fidelity input doing most of the heavy lifting, and the AI pass filling in gaps.

Experiments like the OP's are about moving that boundary and "prompting" with a lower-fidelity input and having the model do more.

Depending on how well you can tune and steer the model, and where you place the boundary line, this might well be a compelling and efficient compute path for some applications, especially as HW acceleration for model workloads improves.

No doubt we will see games do variations of this theme, just like games have thoroughly explored other technology to generate assets from lower-fidelity seeds, e.g. classical proc gen. This is all super in the wheelhouse of game development.

Some kind of AI-first demoscene would be a pretty cool thing too. What's a trained model if not another fancy compressor?
by ninetyninenine | 2025-08-28 14:33:05+00:00
I upvoted it because it aligns most closely with my own perspective. I have a strong dislike for AI and everything associated with it, so my judgment is shaped by that bias. If a post sounds realistic or complex, I have no interest in examining its nuance. I am not concerned with practical reality and prefer to accept it without thinking, so I support ideas that match my personal viewpoint.

I don’t understand why people like you have to call this stuff out? Like most of HN thinks the way I do and that’s why the post was upvoted. Why be a contrarian? There’s really no point.
by toddmorey | 2025-08-28 14:33:13+00:00
Yes that's right. The inference costs in isolation are interesting because that speaks to the unit economics of this business: R&D / model training aside, can the service itself be scaled to operate at a profit? Because that's the only hope of all the R&D eventually paying dividends.

One thing that makes me suspect inference costs are coming down is how chatty the models have become lately, often appending encouragement to a checklist like "You can check off each item as you complete them!" Maybe I'm wrong, but I feel if inference was killing them, the responses would become more terse rather than more verbose.
by drcongo | 2025-08-28 14:33:31+00:00
I was reading along with great sympathy until I got to this bit...

Schizoaffective disorder carries stigma that depression and anxiety don't. People can relate to feeling sad or worried; they cannot relate to experiencing reality differently.

Depression is not "feeling sad" and very much is experiencing reality differently. Flippantly calling something so horrifically painful "feeling sad" is exactly the kind of thing he's accusing everyone else of.
by mothballed | 2025-08-28 14:33:44+00:00
In this particular case, as crazy as it sounds, I think early attempts by both the parent and school to make reasonable accommodation for in-person students with IBS to take a lot of extra bathroom breaks would have at least tilted the scales a little bit. It looks like the kid was shifted to remote school after he got IBS and some people at school weren't understanding of his situation. This put him on the path where he was staying up all night "doing remote school" but also had a nearly full-worknight amount of unfettered time with suicide-AI for months on end with no daytime obligations, sleeping in and not seeing his parents in the morning, and losing contact with peers.

Of course this is a hindsight analysis, but there's not much evidence that more contact with family and peers would make the situation worse.

I think from my prior comment it's obvious I'd like to prevent a lot of isolating policies on low-risk groups from happening again during another pandemic, so I don't think I need to go over that again.

For broader society, I suppose the concrete action item is if you see a young family or friend, we should aspire to reach out to them and see how to integrate them in something we might like to do with them.
by OtherShrezzing | 2025-08-28 14:33:56+00:00
This is a great article, but it doesn't appear to model H100 downtime in the $2/hr costs. It assumes that OpenAI and Anthropic can match demand for inference to their supply of H100s perfectly, 24/7, in all regions. Maybe you could argue that the idle H100s are being used for model training - but that's different to the article's argument that inference is economically sustainable in isolation.
by tikimcfee | 2025-08-28 14:34:38+00:00
This might seem a bit silly, but this is probably the first easily accessible and open iOS backup format extraction tool I've seen in many years. Maybe I've missed the good ones, or the hidden ones. But I find it quite fun that I can backup my device and run its output through this exploit analyzer to (a) determine if I have something to worry about and (b) stop fiddling with 3rd party hackaround software for file backup viewing. Cheers to the authors and the team that put this together, helping keep a rather closed OS at least somewhat safer, and sharing the tools to do so.
by IlikeKitties | 2025-08-28 14:35:00+00:00
Yes it absolutely is and will be used as such, this is EXACTLY how google play remote attestation works and a necessary building block for doing it in the browser. It is the exact reason why microsoft and google are pushing for tpms in windows 11 and it's already a reality on android and every grapheneos user knows the pain[0] and is the absolutely logical next step.

[0] https://grapheneos.org/articles/attestation-compatibility-gu...
by BiteCode_dev | 2025-08-28 14:35:10+00:00
uv uses very agressive caching (https://docs.astral.sh/uv/concepts/cache/) but pytorch has many, many different combinations of packages for the same release.

It's not uncommon to have to download pytorch many times, because some lib may specify one slightly different version than another: https://docs.astral.sh/uv/guides/integration/pytorch/#config...

pytorch causes many headaches in the ecosystem, and a better handling of it is one thing their commercial offering, pyx, wants to fix: https://astral.sh/blog/introducing-pyx
by gchadwick | 2025-08-28 14:35:14+00:00
Whilst it's maybe not worth studying them in detail I'd say being aware of their existence and roughly how they work is still useful. Seeing the many varied ways people have done things with neural networks can be useful inspiration for your own ideas and perhaps the ideas and techniques behind GANs will find a new life or a new purpose.

Yes you can just concentrate on the latest models but if you want a better grounding in the field some understanding of the past is important. In particular reusing ideas from the past in a new way and/or with better software/hardware/datasets is a common source of new developments!
by churchill | 2025-08-28 14:35:35+00:00
And if you ever stop/step off the treadmill and jack up prices to reach profitability, a new upstart without your sunk costs will immediately create a 99% solution and start competing with you. Or more like hundreds of competitors. Like we've seen with Karpathy & Murati, any engineer with pedigree working on the frontline models can easily raise billions to compete with them.

Expect the trend to pick up as the pool of engineers who can create usable LLMs from scratch increases through knowledge/talent diffusion.
by deadbabe | 2025-08-28 14:35:39+00:00
It is more than sufficient. The law doesn’t care about “Mississippi IPs”, the spirit of the law is if a person is accessing your website from Mississippi, you must verify their age, regardless of what path they are taking to reach it. Can’t verify where they are from? Then you just verify them anyway, you don’t get to just be lazy because you don’t know your user. If you don’t, there is a case that you are being negligent.
by jorvi | 2025-08-28 14:35:40+00:00
CoCs suck because the newly empowered people often wield it like a blunt hammer to bludgeon everyone they don't like. They're almost always applied arbitrarily and unfairly. They have the noble goal of equalization but they're really just a co-opting of power by a new in-group.

This blog post is nothing like that. They're not asking you to silence Kenneth, or ignore him, or oust him from anything. They're just laying down the facts. The post isn't even asking you to stop interacting with, it's just a heads-up for anyone who does.
by rwl | 2025-08-28 14:36:21+00:00
Yes, that's what's going on: job titles are typically gendered in German, which leads to job ads being written in an awkward way to express gender neutrality. For example, "engineer" has both a masculine form "Ingenieur" and a feminine form "Ingenieurin", so a job ad might say something like "Ingenieur*in (m/w/d)" to mean "an engineer of any gender".
by blitzar | 2025-08-28 14:36:30+00:00
Why alter it when you can call it fake news and fire the person who published it and hire a new person who is commited to "Fair and Balanced" data*

*data is for 'entertainment' purposes only - Names, characters, places, and incidents either are the product of the author's imagination or are used fictitiously, and any resemblance to actual persons, living or dead, or actual data is entirely coincidental.
by scrollaway | 2025-08-28 14:36:56+00:00
Serving static files off highly efficient, distributed CDNs is a solved problem. There's no "4K blu-rays per second" when you're talking about gzipped, highly cacheable text data.

If github has a million users visiting it per day on a FRESH cache, and all of them have to download at least 10 megabytes of text data (both of these numbers are far too high), you are at ... 0.015 "4k blurays per second". Yeah I think MS's datacenters will survive.
Show HN: I built a Chrome extension–export Facebook birthdays to text reminders
by samfeldman | 2025-08-28 14:36:58+00:00
A few years ago I bought the birthdays.app domain, and decided to make a birthday reminder app based only on text reminders—SMS in the US, WhatsApp outside the US.

This year, I've focused on improving the app's importing options. Previously, it only supported adding friends manually or via text.

Earlier in the year, I built a Google Calendar sync flow (using OAuth), and just recently, made a Chrome extension to import Facebook friends' birthdays.

The flow is—install the extension, pull Facebook birthdays, select friends, then import to birthdays.app (using an import code from the web app).

I'm unsure how many people still use Facebook, but suspect many mainly use it for birthdays nowadays (and may prefer text reminders instead).

I built this with a text-reminder-first mindset (over push notifications, calendar format, etc) because of the simplicity. I'd actually built my own makeshift solution a few years prior to building birthdays.app (using Google Sheets + Zapier SMS), and found the solution to work well.

To me, the text app feels like the social home of the phone (for real friends, at least), and it feels right for the birthday reminders to show up there.

Thanks for reading, and open to any thoughts around the Chrome extension or the birthday reminders in general :)
by pfortuny | 2025-08-28 14:36:59+00:00
> This document specifies a way to create a stateful session with Hypertext Transfer Protocol (HTTP) requests and responses. It describes three new headers, Cookie, Cookie2, and Set-Cookie2, which carry state information between participating origin servers and user agents. The method described here differs from Netscape's Cookie proposal [Netscape], but it can interoperate with HTTP/1.0 user agents that use Netscape's method. (See the HISTORICAL section.)

RFC 2965, make of it what you want but I agree with you. Actually, RFC 2109 is even older (1997) and says more or less the same.
by jasonlotito | 2025-08-28 14:37:15+00:00
"This is very unfortunate and I'm sorry to hear that the author has been excluded and is suffering to this extent."

I can't stop seeing this LLM verbiage everywhere I look. I feel like once you recognize the repeated syntax that got RLHF'd into all of these models you never stop seeing it. Maybe everyone is learning those patterns from reading AI-generated language now too.
by alexjplant | 2025-08-28 14:37:15+00:00
Just wait until you find an AI-generated page [1] made from one of your own forum posts [2]... it's an odd sensation of flattery that evolves into disgust as you realize that an LLM has no taste so you can't even derive satisfaction from another person finding you good enough to rip off.

[1] https://bikermtb.com/kilo-bicycles-2/

[2] https://www.bikeforums.net/general-cycling-discussion/129598...
by energy123 | 2025-08-28 14:37:38+00:00
You've got to put them behind a remote, narrowly-scoped, async interface. Basically hire them as a remote consultant, with 1 point of contact, and send them non-urgent tasks that they can complete whenever. It can work like this, I've seen it. Eventually they blow up, but the interface prevents any negative side-effects, and in the interim it was a win-win arrangement.
by CubsFan1060 | 2025-08-28 14:38:00+00:00
The main question as always is price. I was also interested in things like Chainguard and Docker secure images until I had a sales call with them and found out the price.

I can’t seem to find the price anywhere on your site… I assume the reason for that is that it’s also nearly impossible for a non-fortune 500 to afford?
by JohnFen | 2025-08-28 14:38:01+00:00
I very much don't want my stuff to be used in training genAI models, and if even a single crawler finds its way to being able to get my data then it's game over because there's no way to get it excluded after the fact.

> Especially when there's services/tools like Cloudflare and Anubis that solve that.

They don't solve it. They offer some help, but it's far from good enough.

The exact reason why I don't want my stuff included isn't really relevant to the topic, honestly ("I don't like it" is plenty sufficient reason, after all), but I will say there are multiple reasons. The main issue is that if it happens, there's no way to correct for that.

IP violation is one of them, but not the main one -- but it does illustrate the point: in the case of more traditional IP "theft", there is technically a way to resolve the problem after it happens. Not so with genAI crawlers.