MurphyA/hacker-news huggingface dataset:
by samwillis | 2025-06-06 06:56:41+00:00
Awesome work Wey! Love that you're building this!

I work on PGlite, we have an experimental WASI build that can run in a WASI runtime, it should enable dropping the Node requirement. It lacks error handling at the moment (WASM has no long jump, and Postgres uses that for error handling - Emscripten has hacks that fix this via JS), and so we haven't yet pushed it far.

Do ping me on our Discord and I can point you towards it.

Happy to answers any PGlite questions while I'm here!
by rcarmo | 2025-06-06 06:57:11+00:00
The trouble with these things is that “on a budget” doesn’t deliver much when most interesting and truly useful models are creeping beyond the 16GB VRAM limit and/or require a lot of wattage. Even a Mac mini with enough RAM is starting to look like an expensive proposition, and the AMD Stryx Halo APUs (the SKUs that matter, like the Framework Desktop at 128GB) are around $2K.

As someone who built a period-equivalent rig (with a 12GB 3060 and 128GB RAM) a few years ago, I am not overly optimistic that local models will keep being a cheap alternative (never mind the geopolitics). And yeah, there are vey cheap ways to run inference, but hey become pointless - I can run Qwen and Phi4 locally on an ARM chip like the RK3588, but it is still dog slow.
by that_was_good | 2025-06-06 06:57:21+00:00
Except all users can opt out. Am I missing something?

It says here:

> If you are on a ChatGPT Plus, ChatGPT Pro or ChatGPT Free plan on a personal workspace, data sharing is enabled for you by default, however, you can opt out of using the data for training.

Enterprise is just opt out by default...

https://help.openai.com/en/articles/8983130-what-if-i-want-t...
by shakna | 2025-06-06 06:58:19+00:00
Yeah, I don't think downloading my paid-for books, from an illegal sharing site, to scrape and make use of, is in any way fair use.

From the decision in 1841, in the US (Folsom vs Marsh):

> reviewer may fairly cite largely from the original work, if his design be really and truly to use the passages for the purposes of fair and reasonable criticism. On the other hand, it is as clear, that if he thus cites the most important parts of the work, with a view, not to criticize, but to supersede the use of the original work, and substitute the review for it, such a use will be deemed in law a piracy

Further, to be "transformative", it is required that the new work is for a new purpose. It has to be done in such a way that it basically is not competing with the original at all.

Using my creative works, to create creative works, is rather clearly an act of piracy. And the methods engaged, to enable to do so, are also clearly piracy.

Where would training a model here, possibly be fair use?
by blamazon | 2025-06-06 06:58:31+00:00
It's a constellation of tools that have the suffix "arr" - a winking nod to what a stereotypical pirate says, because they are commonly used for media piracy. Some examples are Radarr, Sonarr and Prowlarr, but there's lots of other ones. They all kind of fit together nicely into a stack that can be used to self host your own automatic media downloading and streaming platform.
by hardwaresofton | 2025-06-06 07:00:10+00:00
That's fine IMO! Content creation is a really top heavy thing anyway -- it seems like anyone can just be replaced with anyone else, but if that were true we wouldn't have such outsized discrepancies between successful creators who are able to monetize and those that can't.

It's a power law distribution. In fact, companies know this so they do sneaky stuff to keep high value creators on their platforms, have heard some stories (try to find some stuff on the Twitch vs Mixer saga).
by dmos62 | 2025-06-06 07:01:06+00:00
What helped me when I was grieving is to remember the feeling of the loved one's presence. At first it's subtle, then as you start enjoying the visualization it becomes more pronounced. Like imagine you're sitting alone and then that person walks in, and that "changes the room", probably in a different way than if any other person walked in. That wonderful feeling that comes over you when you remember the person's presence allows you to maintain a connection even when the person is not there physically. Or, at least, it did for me. This developed in me the sense that the person is still with me and always will be.

I'm pleasantly surprised that this thread has multiple threads about loved ones and grieving.
by genewitch | 2025-06-06 07:01:28+00:00
> A phone number needs 8 bytes

a phone number is not a 64 bit integer, like, just off the top of my head, a phone number can start with "0"

{ "message_id": "b72f9a6c-34d2-4ef9-89a5-623c1d7b890a", "timestamp_sent": "2025-06-05T23:57:34Z", "timestamp_received": "2025-06-05T23:57:35Z", "sender": { "phone_number": "+1-318-555-1234", "carrier": "AT&T", "device_id": "IMEI-354812345678901", "location": { "cell_tower_id": "LA5321", "latitude": 32.5385, "longitude": -92.9222 } }, "receiver": { "phone_number": "+1-225-555-5678", "carrier": "Verizon", "device_id": "IMEI-869712345678902", "location": { "cell_tower_id": "LA6723", "latitude": 30.4515, "longitude": -91.1871 } }, "network": { "protocol": "GSM", "message_type": "SMS", "message_size": "160 bytes", "sms_center": "+1-800-555-9876", "routing_path": [ "Cell Tower LA5321", "Switching Center AT&T Baton Rouge", "SMS Center", "Switching Center Verizon New Orleans", "Cell Tower LA6723" ] }, "status": "Delivered" }

and again - if you use clever tricks to reduce this, you increase the overhead to actually use the data.

get a celltower snooper on your phone and watch the data it shows - that's the metadata for your phone. SMS dragnet would need that for both phones, plus the message itself.
by zppln | 2025-06-06 07:01:31+00:00
We use C++ at my shop for Level A and of course we very much restrict it. But the restrictions are more due to reducing the scope of what you need to show for your compiler.

> or just malloc everything all at once?

Yes! But here's the thing: this isn't done due to the footguns associated with memory management, it is done because you want as little dynamic behavior as possible. For Level A software you need to show that your software has both bounded execution time and memory usage, and be robust against all inputs. Achieving that is so much easier without dynamic memory management.

Also, another thing to keep in mind is that DO-178 has you show that your software requirements are traceable to system requirements, your software design to your software requirements, your source code to your software design and your object code to your source code. But testing should be requirements based. So if your compiler inserts a bounds check now you have object code not traceable to source code and for which you won't have coverage because your requirement mention it. But what if you mention it in your requirements? Well, then you'd have to implement it manually in source code to uphold traceability anyway...

I will caveat the above by saying that other players may interpret things differently or have found ways to do things more cleverly.
by aziaziazi | 2025-06-06 07:01:58+00:00
I had the same question reading your post:

> (problem description) your agent […] makes confident assumptions

> (solution description) when it’s unsure

I read this as a contradiction: in one sentence you describe the problem as an agent being confident while hallucinating and in the next phrase the solution is that the agent can ask you if it’s unsure.

You tool is interesting but you may consider rephrasing that part.
by defrost | 2025-06-06 07:02:28+00:00
It's entirely possible to populate a media tree of movies and shows with stub zero length files, just the formally named movie or tv episode names, and have Kodi and other other media managers download all the meta data (posters, descriptions, cast, etc) to sideload in the media tree or maintain in their own internal databases.

It's useful for testing and debugging media software in addition to being a great way to browse through all the films with ActorX or all the movies in a genre or a year.

You get the same visuals flipping through Kodi with and only lack something happening when you press play (unless you populate with named files that all hardlink to that Rick Astley music video).
by rl3 | 2025-06-06 07:03:03+00:00
>Of course it's backdoored, you can't even begin to try proving me wrong.

On the contrary.

>Maybe I'm alone, but a pinkie-promise from Sam Altman does not confer any assurances about my data to me.

I think you're being unduly paranoid. /s

https://www.theverge.com/2024/6/13/24178079/openai-board-pau...

https://www.wsj.com/tech/ai/the-real-story-behind-sam-altman...
by lynx97 | 2025-06-06 07:03:43+00:00
> a movie or TV show

Any movie or TV show recommendations from the past 10 years that is actually enjoyable?

I am pretty much done with movies. I don't even remember the last one I really enjoyed. Sunshine, Interstellar, Hateful Eight, Once Upon a time in Hollywood... Nothing notable in the past 5 years though.

TV shows? Most require a subscription, which I am not willing to do for just a show or two.
by g42gregory | 2025-06-06 07:03:56+00:00
As I recall, it all started as the so called "Trump exception". The laws temporarily did not apply. I remember reading a letter by Stanford Journalism Professor in the Economist, saying that situation was exceptional and journalists not only do not have to tell the truth, but almost have a duty to say whatever is necessary to rectify the results of 2016 elections.

It was just the beginning. Next was the "Covid exception". Then "HCQ exception", then "Ivermectin exception", then "Covid origin exception", then "Israel exception", then ... Always for a good cause.

And now we finally got to the "self-hosted media" exception. Congratulations.
by yial | 2025-06-06 07:04:43+00:00
I don't agree with "strictly" illegal.

1 - it depends on what you're distilling.

https://www.distillate.org/laws/list

2 - while federally illegal to just get a still and start churning out spirits, ... https://www.ttb.gov/regulated-commodities/beverage-alcohol/d... a free permit and some paperwork (okay a lot of paperwork) lets you.

Disclaimer: I don't hold any licenses or permits related to alcohol, but as a holder of a half dozen other ones, I believe it would be surmountable to do this legally if you really want to.
by lelanthran | 2025-06-06 07:05:38+00:00
> So the courts should start ordering all ISPs, browsers, and OSs to log all browsing and chat activity going forward, so they can find out which people are doing bad things on the internet.

Not "all", just the ones involved in a current suit. They already routinely do this anway (Party A is involved in a suit and is ordered to retain any and all evidence for the duration of the trial, starting from the first knowledge that Party A had of the trial).

You are mischaracterising what happens; you are presenting it as "Any court, at any time can order any party who is not involved in any suit in that sourt to forever hold user data"

That is not what is happening.
by sh34r | 2025-06-06 07:07:07+00:00
I feel like this is a rite of passage for all engineers: messing around with things like Lucene long enough to realize that search-for-humans is a relatively hard problem, even at small scale.

Improving your simple website's search function will take days or weeks, not hours. If you make your own search engine, it's almost guaranteed to be worse than ElasticSearch.
by protocolture | 2025-06-06 07:08:54+00:00
>Yes, just like you gain the land rent from the land you own every year.

But we arent discussing a renter, right? You know that? The example was som

If your "solution" is for the land owner who cant afford his massive tax bill on his land (a tax bill that he incurred because of a subjective valuation) your solution is that he moves off his land, somehow pays to make it suitable for the rental market and then rent it out? And then what? Rents a place himself? How is this desirable?

>My broker doesn't care about my income one bit when they lend me money: they lend against my stock portfolio. Similar, here you could lend against the real estate. Why would the lender care about income?

No one lends money without an expectation of a return. Yes you can lend on collateral. That works once unless it is paid back. That "paid back" needs to be accounted for in your analysis.

>No, not at all. That's a common misconception, especially prevalent amongst fans of LVT.

So we have struck down at least one of the touted benefits of LVT. Thats something. Thats a small amount of progress.
by ajuc | 2025-06-06 07:10:03+00:00
The debate shouldn't be "to remove or not". The debate should be "who should decide what to remove".

We've had media laws for decades. Internet is underregulated to a crazy degree, so the people who make the decisions are unaccountable and even unknowable. It would be much saner if the people deciding this were judges and elected officials.

The way we allow a few oligarchs to decide what information 99% of the world consume for hours every day, and just let them do whatever they want, and don't even tax them in practice - it's just absurd.

Free speech is for people not for corporations. And it's certainly not for corporations to enforce.

People defending hacker ethos and free internet pretend internet is still like in 90s. If you do have your own self-hosted blog - sure - be a free hacker.

But if you have million customers - you're not a free-spirited hacker. You're a media mogul abusing unregulated loophole. States should act accordingly.
by MindSpunk | 2025-06-06 07:10:05+00:00
I think they're just a media collector. I do the same thing. I have 48TB of storage in a ZFS pool for my media rips. I couldn't share them even if I wanted to, my 4K bluray rips are like 80GB a pop. My internet isn't that good.

Heaven forbid someone want to put their media collection onto redundant storage instead of cheap plastic discs with a questionable shelf life.
by politelemon | 2025-06-06 07:10:11+00:00
If the author is reading this I'll point out that the cuda toolkit you find in the repositories is generally older. You can find the latest versions straight from Nvidia: https://developer.nvidia.com/cuda-downloads?target_os=Linux&...

The caveat is that sometimes a library might be expecting an older version of cuda.

The vram on the GPU does make a difference, so it would at some point be worth looking at another GPU or increasing your system ram if you start running into limits.

However I wouldn't worry too much right away, it's more important to get started and get an understanding of how these local LLMs operate and take advantage of the optimisations that the community is making to make it more accessible. Not everyone has a 5090, and if LLMs remain in the realms of high end hardware, it's not worth the time.
by lelanthran | 2025-06-06 07:11:00+00:00
> I think that some of the people here dislike (or are alarmed by) the way that the court can compel parties to retain data which would otherwise have vanished into the ether.

Maybe so, but this has always been the case for hundreds of years.

After all, how on earth do you propose having getting fair hearing if the other party is allowed to destroy the evidence you asked for in your papers?

Because this is what would happen:

You: Your Honour, please ask the other party to turn over all their invoices for the period in question

Other Party: We will turn over only those invoices we have

*Other party goes back to the office and deletes everything.

The thing is, once a party in a suit asks for a certain piece of evidence, the other party can't turn around and say "Our policy is to delete everything, and our policy trumps the orders of this court".
by consumer451 | 2025-06-06 07:11:02+00:00
> Earlier this week, Windsurf said that Anthropic cut its direct access to Claude 3.5 Sonnet and Claude 3.7 Sonnet, two of the more popular AI models for coding, forcing the startup to find third-party computing providers on relatively short notice. Windsurf said it was disappointed in Anthropic’s decision and that it might cause short-term instability for users trying to access Claude via Windsurf.

As a Windsurf user, maybe Sonnet 3.x models are slower right now, but they don't require BYOK like 4 does. So this is a bit of an exaggeration, isn't it? Anthropic did not cut them off, they seem to have continued honoring existing quota on previous agreements.

What did Windsurf think was going to happen with this particular exit? Also, how embarrassing is this for OpenAI that it's even a big deal?
by bawolff | 2025-06-06 07:12:38+00:00
> No, a preflight (OPTIONS) request is sent by the browser first prior to sending the request initiated by the application.

Note: preflight is not required for any type of request that browser js was capable of making prior to CORS being introduced. (Except for local network)

So a simple GET or POST does not require OPTIONS, but if you set a header it might require OPTIONS (unless its a header you could set in the pre-cors world)
by Lio | 2025-06-06 07:12:58+00:00
Don’t be silly.

The UK may not be perfect but no one’s going to complain if you compare the Prime Minister or the King to a cartoon bear.

Or you talk openly about a government fuck up. Or about one part of the country maybe deciding to become independent.

You just can’t shout fire in a crowded cinema and you can’t say “let’s all meet at the local hotel at 3.30 and burn the immigrants to death” during a riot.

I’m ok with that.
by figassis | 2025-06-06 07:13:07+00:00
Process simplification should always be part of business continuity planning. I think SAP would not have such a moat if businesses stuck to basics when scaling. Really, if you're selling steel, that is just what you're doing, selling steel. Why does your ERP need to be so complex? Because you make it complex, with your HR processes, your procurement processes, your CRM processes, sales, taxes, compliance, etc. But I think there is immense value in iterating multiple times towards simplification before implementing any IT project, and maybe listening less to software vendors, and more to your technical staff about solutions.

I build on AWS, and I always run away from their recommended architectures. It's always a lambda here, a beanstalk there, a cloud formation, a service account, a special access policy. No. Give me some EC2 machines and maybe a k8s cluster that I can operate like every other cluster in the world.
by rl3 | 2025-06-06 07:13:38+00:00
>However, legal protections against directly spying on the actual decrypted content of Americans are at least in theory stronger.

Yeah, because the definition of collection was redefined to mean accessing the full content already stored on their systems, post-interception. It wasn't considered collected until an analyst views it. Metadata was a laughable dog and pony show that was part of the same legal shell games at the time, over a decade ago now.

That said, from an outsider's perspective it sounded like the IC did collectively erect robust guard rails such that access to information was generally controlled and audited. I felt like this broke down a bit once sharing 702 data with other federal agencies was expanded around the same time period.

These days, those guard rails might be the only thing standing in the way of democracy as we know it ending in the US. AI processing applied to full-take collection is terrifying, just ask the Chinese.
by Dylan16807 | 2025-06-06 07:14:28+00:00
> a phone number is not a 64 bit integer

It's not an integer. But you can store it inside 64 bits. You can split it into country code and then number, or you can use 60 bits to store 18 digits and then use the top 4 bits to say how many leading 0s to keep/remove. Or other things. A 64 bit integer is enough bits to store variable length numbers up to 19 digits while remembering how many leading zeros they have.

If you want really simple and extremely fast to decode you can use BCD to store up to 16 digits and pad it with F nibbles.

> JSON

Most of this is unimportant. Routing path, really? And we don't need to store the location of a cell tower ten million times, we can have a central listing of cell towers.

I don't think we really need both phone number and IMEI but fine let's add it. Two IMEI means another 16 bytes. And two timestamps sure.

Phone number, IMEI, timestamp, cell tower ID, all times two. That's still well under 100 bytes if we put even the slightest effort into using a binary format.

> and again - if you use clever tricks to reduce this, you increase the overhead to actually use the data.

No no no. Most of the things I would do are faster than JSON.
by DidYaWipe | 2025-06-06 07:14:47+00:00
Thus my point. If everyone's answer is "just read the plain text," then why have the junk in it at all?

And I don't want an extra "preview" pane. That was the specific complaint. Nor do I want these docs in my IDE at all. I want all the available space in my IDE for code.

Again, why have this format all over the place when there are vanishingly few VIEWERS for it? Or vice versa?
by rafaelmn | 2025-06-06 07:15:00+00:00
> and even here on HN a lot of people get very annoyed by the application of the "open source" label to model weights that don't have the source disclosure the EU calls for.

That's because they are obviously trained on copyrighted content but nobody wants to admit it openly because that opens them to even more legal trouble. Meanwhile China has no problem violating copyright or IP so they will gladly gobble up whatever they can.

I don't think you can really compete in this space with the EU mindset, US is playing it smart and leaving this to play out before regulating. This is why EU is not the place for these kinds of innovations, the bureaucrats and the people aren't willing to tolerate disruption.
by ajuc | 2025-06-06 07:15:03+00:00
And still it's the "free-speech" USA that deports students for protesting against Israel war in Gaza and not UK.

There's the wording of the law, and then there's the practice of the government. Most communist regimes in Eastern Europe had pretty nice constitutions. It's just that everybody knew it doesn't matter what the constitution says - you complain = you're off to the national variety of a KGB prison.

When your government ignores courts and laws and just deport people as it sees fit for their protesting or their tatoos - you do not have free speech. No matter what your laws say.

BTW - USA arguably didn't have free speech for majority of its existence. If you were a slave you certainly didn't.
The Global Rise of AI Tools: What It Means for Work and Creativity in 2025
by deepmistry | 2025-06-06 07:15:34+00:00
Artificial Intelligence is no longer a distant concept — it’s reshaping how we work, create, and even think every single day. From automated content generation to AI-driven design and coding assistants, the tools emerging in 2025 are changing industries at lightning speed.

Everyone from freelancers to large enterprises is grappling with questions: How do we harness AI to boost productivity without losing the human touch? What jobs are most at risk, and which new roles will emerge? How do we balance innovation with ethical concerns around data privacy and bias?

We’re seeing AI-powered platforms democratize access to complex skills — making it easier for people worldwide to build websites, write articles, create art, or analyze data without years of specialized training.

At the same time, debates continue about AI’s impact on creativity. Can machines truly innovate? Or will AI only augment human ideas?

With governments and regulators stepping in to draft policies on AI usage, and companies racing to implement these technologies, 2025 feels like a pivotal year in this digital transformation.

For those navigating this shift, what’s your experience so far? Are you using AI tools in your work or personal projects? How do you see AI shaping the future of your industry?

Let’s discuss the opportunities, challenges, and what the next wave of AI innovation might bring globally.