MurphyA/hacker-news huggingface dataset:
by EliteGadget | 2025-11-25 09:41:10+00:00
They said Bluray and DVD.

Some of us have quite a few DVD/Blurays that we could rip. A lot of good stuff can be found in bargain bins and closing down sales (I got all the 9 series of the X-files for next to nothing). I am personally not bothering to rip them and download them instead, but I am not paying like 5 times for the same movie/tv series that I have already paid for.

A lot of films have been re-released now like on different media formats, with several different "cuts" which normally have maybe a few extra minutes of dialogue.
by hagbard_c | 2025-11-25 09:41:13+00:00
> But is it doing one thing, and doing it well, to use `cat – concatenate and print files` to open a file?

Yes, it 'prints' the file to stdout which is consumed by the pipe and turned into the input for the next command in the pipeline. It doesn't matter whether you're only 'printing' a single file or a bunch of them.
by jdprgm | 2025-11-25 09:41:36+00:00
I wonder if it would be in the governments interest to heavily subsidize streaming services. Considering virtually everything seems to be getting hopelessly more expensive and no real progress on economic inequality seems likely outside a slim AI path - dollar for dollar free or cheap entertainment provides a lot of utility and can help keep the poor masses complacent.

$30 a month makes a hell of a lot more of a dent in entertainment affordability than it does in healthcare. No clue on how accurate these estimates are but it seems like the combined budget of most shows and movies in a given year is somewhere around the 40-50 Billion range which in the context of all the other shit in the federal budget is kind of nothing.
by psychoslave | 2025-11-25 09:42:09+00:00
There are some major differences though. Without using these tools, individual are pretty limited in how much bullshit they can output for many reasons, including they are not mere digital puppet without need to survive in society.

It’s clear pro-slavery-minded elitists are happy to sell the speech that people should become "good complement to AI", that is even more disposable as this puppets. But unlike this mindless entities, people have will to survive deeply engraved as primary behavior.
by SCdF | 2025-11-25 09:42:23+00:00
I really like it, but for the cost of a cup of coffee you could try it for a month as well. I highly suggest you just do that: commit to spending a month using it, and if you don't like it at the end cancel. Maybe it won't work for the way you use search, maybe it will, the only way to find out is to try.
by forgotoldacc | 2025-11-25 09:42:51+00:00
Not sure where you're getting "secretly" from since there was no secret and they were openly obedient to Japan. There's nothing outside of CCP sources, and particularly no historical sources, that could even remotely claim otherwise.

And even if you goalpost shift to the Meiji Restoration, 1872 is still well before any period where Japan was required to give up any territory as a result of WW2 imperialism.
by pu_pe | 2025-11-25 09:43:21+00:00
The perception of Kagi at HN is extremely positive, but in my personal experience the search quality reminds me more of Bing than Google, with Kagi sometimes surfacing puzzling results first. Also, I wasn't thrilled about giving them access to all my search data. As flawed as Google may be, I still believe they have better privacy standards than Kagi.
by srean | 2025-11-25 09:43:39+00:00
That's true. Bose is also the source of Marconi's radio component and he developed junction based electronics way before it's time. Bose was quite fiercely anti-patent. Marconi patented the coherer in his name.

It is only recently that Bose's contributions in radio and electronics are being acknowledged (colonialism doing what it does) although these were quite well known in Bengal.

https://en.wikipedia.org/wiki/Jagadish_Chandra_Bose#Microwav...
by novoreorx | 2025-11-25 09:43:47+00:00
Great article! I always feel that the choice of embedding model is quite important, but it's seldom mentioned. Most tutorials about RAG just tell you to use a common model like OpenAI's text embedding, making it seem as though it's okay to use anything else. But even though I'm somewhat aware of this, I lack the knowledge and methods to determine which model is best suited for my scenario. Can you give some suggestions on how to evaluate that? Besides, I'm wondering what you think about some open-source embedding models like embeddinggemma-300m or e5-large.
by jack_tripper | 2025-11-25 09:44:00+00:00
>Because it was synthesized using Chinese and Indian sourced "Active Pharmaceutical Ingredients" (APIs) [0], both of whom synthesize around 80% of all APIs required by European pharma manufacturers.

And the EU pharma companies package it, slap their logos on it and make mega profits selling domestically.

>EU member states simply does not do the same for electronics.

Why do you think that is? Surely with a war next door and China not guaranteed be a cooperator all the time, that would be a priority.
by GCUMstlyHarmls | 2025-11-25 09:44:00+00:00
> The grand artificers of the Unseen University—those who insist on calling themselves “makers” despite mostly making trouble—gave up on the old Floating Gate enchantments ages ago. Too fiddly, too explosive, and prone to drifting off when no one was looking. Now they use Charge Trapping. Same idea in principle: coax a few errant lightning-spirits into doing something useful. But instead of perching them on a precariously insulated sigil like nervous pigeons, the wizards now shove the little blighters into a quiet, rubbery pocket of reality where they can’t conduct, escape, or start a small civil war. Everyone agrees it’s much safer, except for the pocket.

~ Terry Pratchett's Disklessworld, book 8. (Re: Any sufficiently advanced technology is indistinguishable from magic)
by xandrius | 2025-11-25 09:44:23+00:00
Yeah but think of any other piece of media and how people might be forced to start a brand new subscription just to see it.

It's not about Mickey Mouse but it's about you wanting to watch the next season of something and having to make a choice: either submit to the monopoly or skip.

Consumer protection should be there to prevent this kind of abuse of IP.

Imagine if every single individual piece of art was in its own individual subscription-based location in the world ran by a different owner, being the only way to enjoy it. That'd be ridiculous, wouldn't it?
by adrian_b | 2025-11-25 09:44:42+00:00
This is true, but nevertheless you cannot place your trust only in the manufacturer of the SSD/HDD, as I have seen enough cases when the SSD/HDD reports no errors, but nonetheless it returns corrupted data.

For any important data you should have your own file hashes, for corruption detection, and you should add some form of redundancy for file repair, either with a specialized tool or simply by duplicating the file on separate storage media.

A database with file hashes can also serve other purposes than corruption detection, e.g. it can be used to find duplicate data without physically accessing the archival storage media.
by contrarian1234 | 2025-11-25 09:45:19+00:00
I mean.. if Netflix offered Disney more money then they wouldn't have felt it necessary to launch their own service. I think they simply underpayed or overplayed their cards. It's hard to imagine Disney with it's own service is getting the same amount of people viewing its content.

Having the services fractured just ends up with everyone making less money. Both the streaming services and the IP holders

Its possible Disney just completely overestimates how much they can make on their own - but market forces should correct for that eventually. We aren't privy to the accounting that went in to the decisions. They currently are making some amount of money off of their streaming service. If Netflix could offer substantially more than that amount (and more customers this way), then I don't see why they wouldn't shut it down
by arcade79 | 2025-11-25 09:45:37+00:00
> and it's not too difficult to make an opinionated and challenging chatbot

Funnily enough, I've saved instructions for ChatGPT to always challenge my opinions with at least 2 opposing views; and never to agree with me if it seems that I'm wrong. I've also saved instructions for it to cut down on pleasantries and compliments.

Works quite well. I still have to slap it around for being too supportive / agreeing from time to time - but in general it's good at digging up opposing views and telling me when I'm wrong.
by suddenlybananas | 2025-11-25 09:46:03+00:00
People have been saying that we "focus too much on memorization" for as long as I have been alive. To be honest, I don't really think that is true, if anything we don't focus enough on memorization nowadays since people leave school without knowing basic things about the world whether in science or in history. Knowing things allows one to make connections and see things in a different way that you simply cannot get if you rely on the internet or LLMs or whatever to look everything up.
by lloeki | 2025-11-25 09:46:34+00:00
Even the much-maligned raid5/6 is basically fine†.

If you're concerned about the write hole, use -m DUP/raid1/raid1c2 instead of -m raid5. Plus raid-stripe-tree†† is coming - didn't check the status of it recently.

Many horror stories are because, while btrfs is fine, the operational model and tooling have some footguns which can cause either straight up data loss (due to operator error, but arguably that's really due to bad UX) or possible-but-hard-to-get-out-of situations.

I use btrfs because using zfs has been painful for me, for two reasons:

- btrfs can "shapeshift": I progressively moved _live_ from 2hdd raid1 to 5hdd raid5 data + raid1c2 meta with varying experiments in between. Probably five or six rebalance to change its shape over the years.

- the zfs module situation: when I tried it, the module silently failed to build properly and this resulted in a broken system til I fixed it; this happened twice over six months. Luckily I anticipated this failure mode and only the data array (not the root fs) was zfs, so I could still boot and login into a full system to fix.

Compared to zfs, btrfs is slow to scrub and rebalance though.

† https://unixdigest.com/articles/battle-testing-zfs-btrfs-and...

†† https://lore.kernel.org/linux-btrfs/cover.1698679287.git.dst...
by dhx | 2025-11-25 09:46:52+00:00
I agree that Curve25519 and other "safer" algorithms are far from immune to side channel attacks in their implementation. For example, [1] is a single trace EM side channel key recovery attack against Curve25519 implemented in MbedTLS on an ARM Cortex-M4. This implementation had the benefit of a constant-time Montgomery ladder algorithm that NIST P curve implementations have traditionally not had a similar approach for, but nonetheless failed due to a conditional swap instruction that leaked secret state via EM.

The question is generally, could a standard in 2025 build upon decades of research and implementation failures to specify side channel resistant algorithms to address conditional jumps, processor optimisations for math functions, etc which might leak secret state via timing, power or EM signals. See for example section VI of [1] which proposed a new side channel countermeasure that ended up being implemented in MbedTLS to mitigate the conditional swap instruction leak. Could such countermeasures be added to the standard in the first instance, rather than left to implementers to figure out based on their review of IACR papers?

One could argue that standards are simply following interests of standards proposers and organisations who might not care about cryptography implementations on smart cards, TPMs, etc, or side channel attacks between different containers on the same host. Instead, perhaps standards proposers and organisations only care about side channel resistance across remote networks with high noise floors for timing signals, where attacks such as [2] (300ns timing signal) are not considered feasible. If this is the case, I would argue that the standards should still state their security model more clearly, for example:

* Is the standard assuming the implementation has a noise floor of 300ns for timing signals, 1ms, etc? Are there any particular cryptographic primitives that implementers must use to avoid particular types of side channel attack (particularly timing)?

* Implementation fingerprinting resistance/avoidance: how many choices can an implementation make that may allow a cryptosystem party to be deanonymised by the specific version of a crypto library in use?[3] Does the standard provide any guarantee for fingerprinting resistance/avoidance?

[1] Template Attacks against ECC: practical implementation against Curve25519, https://cea.hal.science/cea-03157323/document

[2] CVE-2024-13176 openssl Timing side-channel in ECDSA signature computation, https://openssl-library.org/news/vulnerabilities/index.html#...

[3] Table 2, pyecsca: Reverse engineering black-box ellipticcurve cryptography via side-channel analysis, https://tches.iacr.org/index.php/TCHES/article/view/11796/11...
by sigmoid10 | 2025-11-25 09:46:56+00:00
You apparently misunderstood the issue. I fundamentally don't expect Google and co. to offer me privacy. And certainly not by fighting subpoenas or gag orders. I would simply never use it for something that is extremely sensitive. The problem with VPN providers is that the basic reason to use their service is privacy - including from the government in case you are a journalist or a minority supporter in a dictatorship for example. All VPN providers use something along those lines to market their services. But they fundamentally can't deliver on this basic promise because of the very nature of domestic law.
by simonask | 2025-11-25 09:47:05+00:00
Mutex doesn't promise to uphold any more invariants than `&mut T` does. If the state can be corrupted by a panic while holding `&mut T`, I don't think there's any good reason to expect that obtaining it through `MutexGuard` should make any difference.

Panic propagation is typically handled much better at thread `join()` boundaries.
by ad_hockey | 2025-11-25 09:47:13+00:00
That first example is an unintended closure, since the err at the top level actually has nothing to do with the errs in the goroutines. I have seen that sometimes, although the use of = rather than := normally makes it obvious that something dodgy is going on.

As to whether it's a common pattern, I see closures on WaitGroups or ErrGroups quite often:

workerCount := 5 var wg sync.WaitGroup wg.Add(workerCount) for range workerCount { go func() { // Do work wg.Done() }() } wg.Wait()

You can avoid the closure by making the worker func take a *sync.WaitGroup and passing in &wg, but it doesn't really have any benefit over just using the closure for convenience.
by teekert | 2025-11-25 09:47:16+00:00
Yeah, this, but also as an adult; When you are a non-native speaker and you use AI to make things more concise and correct. The detector will go off. People may find some wording "AI-ish" (even though I replaced em-dashes with commas and told it to "avoid American waiter-like enthusiasm"). My reaction is: Ok. you want my original? Which is much harder to read and uses 2x the amount of words? Fine.

I mean, what is the problem? It's my report! I know all the ins and outs, I take full responsibility for it. I'm the one taking this to the board of directors who will grill me on all the details. I'm up for it. So why is this so "not done"? Why do you assume I let the AI do the "thinking"? I'm appalled by your lack of trust in me.
by AnthonyMouse | 2025-11-25 09:47:30+00:00
There isn't that much demand for that on Linux because the apps aren't adversarial. If you install Facebook on your phone, you want it locked in a jail where it can't suck up everything on your device and send it to Meta. If you install the Signal desktop app on Linux, it's open source and doesn't do that. And to the extent that you use the likes of Facebook it's the web version.

Meanwhile per-app isolation is a pain. You download a picture in a browser, crop it in a photo editor and attach it to an email. All three apps need access to the same picture. Your backup app needs access to everything. Your password manager is filling in fields in other apps.

You do want to be able to isolate something questionable, but the usual way to do this for sophisticated users is virtual machines or containers. Maybe that could use a coat of paint to make it easier for unsophisticated users to use it, but maybe unsophisticated users should just stick to the system package manager anyway.
by jraph | 2025-11-25 09:48:03+00:00
You can keep the order of things even if you want to avoid using cat:

< something filter step 1|filter step 2|filter step 3

(just pointing this out in the hope it can be of interest to someone reading the thread, I don't personally care that much about UUOC - "useless" is quite subjective, one can still reasonably find the cat version more readable).
by moffkalast | 2025-11-25 09:48:19+00:00
Reminds me of that thing Olmo3 has in the web demo, where it shows you a trace for a selected sentence generated by the LLM and points you at the exact document in the training data it comes from verbatim. If they all had that it would be really trivial to verify sources, and more or less does that exact exercise for you at a press of a button.
by yetihehe | 2025-11-25 09:48:21+00:00
For a demonstration of Kolmogorov complexity, it's good to watch "A mind is born"[0] by lftkryo. It's only 256 bytes, but can generate over 2 minutes of complex music and video. Also, the name is appropriate for this topic :D

[0] https://www.youtube.com/watch?v=sWblpsLZ-O8
by zerosizedweasle | 2025-11-25 09:48:31+00:00
Meta owns 20%, and funds managed by Blue Owl own the other 80%. Last month, a holding company called Beignet Investor, which owns the Blue Owl portion, sold a then-record $27.3 billion of bonds to investors, mostly to Pimco. Meta said it won’t be consolidating the joint venture, meaning the venture’s assets and liabilities will remain off Meta’s balance sheet. Instead Meta will rent the data center for as long as 20 years, beginning in 2029. But it will start with a four-year lease term, with options to renew every four years.

This lease structure minimizes the lease liabilities and related assets Meta will recognize, and enables Meta to use “operating lease,” rather than “finance lease,” treatment. If Meta used the latter, it would look more like Meta owns the asset and is financing it with debt.

The favorable accounting outcome hinges on some convenient assumptions. Some appear implausible, while others are in tension with one another, making the off-balance-sheet treatment look questionable.

https://www.wsj.com/tech/meta-ai-data-center-finances-d3a6b4...
by qcnguy | 2025-11-25 09:48:31+00:00
Nope, can't all agree. DOGE was great and you should expect to see a lot more of it in future, even more systematized.

Look at it like this:

> About half of the rehires, Kamarck estimated, “appear to have been mandated by the courts.”

So of the employees the government actually wanted back, there were maybe 10,000 - according to Ars which is an enemy of DOGE and Musk. Probably far fewer in reality.

But this was always the plan, it's what worked at Twitter too. The theory is that you can't easily know if you can cut more until you start finding that you needed people. And the US Gov is in so much debt, drastic measures are absolutely required. Any argument to the contrary ignores the fiscal situation.
by bimmbash | 2025-11-25 09:48:32+00:00
The author is obviously an overcompensating French speaker naively going for the more English-sounding word, i.e. "learnings" instead of "lesson", in this instance an overly literal translation of French "enseignements" as in "tirer des enseignements" meaning "learn a lesson", but since you can also say "tirer des leçons" in French with the same meaning and root, it's just a case of choosing the wrong side haphazardly on the Anglo-Saxon/Latin-Norman-French divide of the English vocabulary, sheep/mutton ox/beef pairs and the like.
by r00f | 2025-11-25 09:49:40+00:00
Not an OP but I have similar experience with ZFS. Over 22 years of maintaining servers, I have had serious issues exclusively with ZFS. My pool is there, but it doesnt want to mount no matter what amount of IRC/reddit/SO/general googling I apply to try and help it boot. After it happened for the second time, I removed ZFS from the list of technologies I want to work with (I still have to, due to Proxmox, but without being fascinated).
by 0xEF | 2025-11-25 09:49:52+00:00
It's probable that LLMs are already operating on the real HN, agentically or driven by users who want to create intelligent-sounding comments for the sake of upvotes.

Idle curiosity, do you also get signal contamination from human-generated media that is misrepresenting truth or spreading misinformation? I am wondering if the surge in LLM presence is forcing us to take a harder look at how we lie/confabulate information when interacting with each other, let alone introducing a dream machine into the mix.
by post_below | 2025-11-25 09:50:00+00:00
The problem with this, unless I'm misunderstanding what you're saying, is that the model's responses go into the context. So if it has to reinvent the wheel every session by writing bash scripts (or similar) you're clogging up the context and lowering the quality/focus of the session while also making it more expensive. When you could instead be offloading to a tool whose code never comes into the context, the model only has to handle the tool's output rather than its codebase.

I do agree that better tools, rather than more tools, is the way to go. But any situation where the model has to write its own tools is unlikely to be better.
by exceptione | 2025-11-25 09:52:38+00:00
Interesting, I had to look up what EDN is. Important to note that EDN doesn't have a concept of a schema like JSON Schema.

This is a `map`, which bears semblence with a Json object. The following might look like an incorrect paylood, but will actually parse as valid EDN:

{:a 1, "foo" :bar, [1 2 3] four} // Note that keys and values can be elements of any type. // The use of commas above is optional, as they are parsed as whitespace.

If one wants to exchange complex data structures, Aterm is also an option: https://homepages.cwi.nl/~daybuild/daily-books/technology/at...

Some projects in Haskell use Aterms, as it is suitable for exchanging Sum and Product types.
by dlt713705 | 2025-11-25 09:53:15+00:00
> Just recent months they introduced another bug to GNOME which probably will not be resolved in years. No big company wants to invest in desktop Linux and without investments it's just not good.

Classic straw man: a single GNOME bug doesn’t mean all of desktop Linux isn’t worth investing in.

Developers have been writing Linux desktop apps successfully for decades. Moreover, who cares about polished desktop apps when most apps are just web apps that look the same on all platforms?

For the record, I despise web apps.
by Dylan16807 | 2025-11-25 09:54:06+00:00
> when their light-mode GUI suddenly turns grey as a part of it becomes 10x the brightness of what used to be white

I don't know why you're asking me about examples that violate the rules I proposed. No I don't want that.

And obviously boosting the brightness of a screen capture is bad. It would look bad in SDR too. I don't know why you're even bringing it up. I am aware that HDR can be done wrong...

But for HDR videos where the HDR actually makes sense, yeah it's fine for highlights in the video to be a little brighter than the GUI around them, or for tiny little blips to be significantly brighter. Not enough to make it look gray like the misbehavior you linked.