MurphyA/hacker-news huggingface dataset:
by deliciousturkey | 2025-12-13 19:58:19+00:00
Highly dependent on what you are training. "Shuffling within a buffer" still results in your sampling being dependent on the data storage order. PyTorch DataLoader does not handle this for you. High level libraries like DALI do, but this is the exact coupling I wanted to say to avoid. These libraries have specific use cases in mind, and therefore have restrictions that may or may not suit your needs.

AI training is a bandwidth problem, not a latency problem. GPUs need to be fed at 10GB/s+. Making millions of small HTTP requests introduces massive overhead (headers, SSL handshakes, TTFB) that kills bandwidth. Even if the storage engine has 0ms latency, the network stack does not.

Agree that throughput is more of an issue than latency, as you can queue data to CPU memory. Small object throughput is definitely an issue though, which is what I was talking about. Also, there's no need to use HTTP for your requests, so HTTP or TLS overheads are more of self-induced problems of the storage system itself.

You can fetch specific byte ranges from a large blob without "coupling" the storage layout significantly.

This has exact same throughput problems as small objects though.
by neonbrain | 2025-12-13 19:58:37+00:00
This isn't a good approach because it assumes there are no market makers on trading venues, and that they (as well as exchanges) do not compete for order flow. Also, maybe you haven't noticed, but stocks are often frozen during news announcements by regulatory request, so such pauses are already in place and are designed to maintain market integrity, not disrupt it with arbitrary fills.
by stefan_ | 2025-12-13 19:59:01+00:00
4GiB oh no we gave it Raspberry Pi memory?

This is truly one of the dumbest outcomes of the whole "resume driven cloud deployment" era. Clouds "market segmenting" with laughable memory, resume engineers want their line but not the recurring cost, engineers waste weeks investigating and working around out of memory issues that are purely some guy provisioning services with 2003 levels of memory. It's all a giant waste of time.
by spicyusername | 2025-12-13 20:00:47+00:00
I have been paying for JetBrains for years, but, as many have pointed out in this thread, between the performance issues and agentic IDEs like Cursor, it's getting harder and harder to justify.

JetBrains, just focus on improving the existing IDEs and naturally embedding access to third party LLM agents in them and you're good to go.
by cebert | 2025-12-13 20:00:59+00:00
> More than 9mn US student loan holders have missed at least one payment this year, as delinquencies in the $1.7tn market soar following the end of the Biden administration’s post-pandemic payments holiday.

The title made me initially assume 9M borrowers missed payments this month, but the missed at least one payment the past year. Still not great, but not as bad as I expected from the headline.
by benjiro | 2025-12-13 20:01:01+00:00
And if you want to go even cheaper, check out Hetzner their EX63 (go to custom) > 4x 7.68TB drives for like 140 Euro.

Not counting the fact that Netcup is raided (also Netcup is limited to 8TB on a VPS).

That is like 4.7 Euro /TB. That is like 4$/TB. 6 Euro / TB in a raid 5 setup.

I do not understand why they are not using this new pricing model on their older servers. There the best you can get is like 10 Euro /TB (for the single 15TB U.2).
by blobbers | 2025-12-13 20:01:21+00:00
Given that we're not great at communicating with animals, what level of reward would be considered justifiable for participating in the study?

As in they could get a reward for starting the study...

Also, isn't this sort of "voluntary" testing a little unethical in itself? For example, testing an addictive drug on a rat, they don't know the downstream consequences since there is limited communication, but the immediate effects might be incredibly gratifying. It would lead to high "volunteer" rates but still expose them to massive harm.
by nyrikki | 2025-12-13 20:01:43+00:00
IMHO there are some serious problems here that won't relate to many situations, and is not really "waste" in the way claimed and will actually probably result in greater spends.

> Memory waste: request - actual usage [0]

Memory "requests" are hints to the kube-scheduler for placement, not a target for expected usage.

> # Memory over-provisioning: limit > 2x request [1]

Memory limits are for enforcement, typically when to call the OOM killer

Niether placement nor oomkilling limits should have anything to do with normal operating parameters.

> The memory request is mainly used during (Kubernetes) Pod scheduling. On a node that uses cgroups v2, the container runtime might use the memory request as a hint to set memory.min and memory.lo [2]

By choosing to label the delta between these two as "waste" you will absolutely suffer from Goodhart's law and you will teach your dev team to not just request, but allocate memory and don't free it so that they can fit inside this invalid metric's assumptions.

It is going to work against the more reasonable goals of having developers set their limits as low as possible without negative effects, while also protecting the node and pod from memory leaks, while still gaining the advantages of over-provisioning, which is where the big gains are to be made.

[0] https://github.com/WozzHQ/wozz/blob/main/scripts/wozz-audit.... [1] https://github.com/WozzHQ/wozz/blob/main/scripts/wozz-audit.... [2] https://kubernetes.io/docs/concepts/configuration/manage-res...
by grahamjperrin | 2025-12-13 20:02:12+00:00
The current expectation is that the desktop script, which was originally scheduled for inclusion with FreeBSD Installer for 15.0, will be included with 15.1.

A blocker, although this bug was not the reason for rescheduling:

https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=290024
by m3047 | 2025-12-13 20:02:14+00:00
I'm sorry for your loss, but this sounds like an antipattern. Hundreds of emails between co-workers and it was all contemporaneously related to work in progress or cat pictures of your own cats, didn't contain PII or proprietary information of your employer or unaware third parties? And you want it back? From far enough away (that I might as well be in orbit) this seems preferable to an unencrypted drive ending up in somebody's hands for "refurbishment" (cough printers with hard drives).

No one is innocent. I refuse to use LE and operate my own CA instead, and as a consequence of scareware browser warnings I publish http: links instead of https: (if anyone cares, you know to add the "s" don't you?). I run my own mailserver which opportunistically encrypts, and at least when it gets to me it's on hardware which I own and somebody needs a search warrant to access.. as opposed to y'all and your gmail accounts. I do have a PGP key, but I don't include it on the first email with every new correspondent because too many times it's been flagged as a "virus" or "malicious".

Clearly we live in a world only barely removed from crystals and ouija boards.
by anonymousiam | 2025-12-13 20:02:14+00:00
Does this link now work for LG TVs again? I rooted mine about four years go, so no annoying AI firmware updates, but I remember there was an update to the LG webOS that prevented the exploit that allowed rootmy.tv to work.

If rootmy.tv is working again for modern LG TVs, I'll run out and buy another one.
by ErroneousBosh | 2025-12-13 20:02:51+00:00
Not only was it microcoded, but it was sufficiently divorced from the assumptions of the 68000 instruction set that IBM were able to have Motorola make custom "68000-based" chips that ran S/370 code directly.

Want a different architecture? Sure, just draw it with a different ROM. Simple (if you've got IBM money to throw around).
by evanelias | 2025-12-13 20:03:10+00:00
I'm not blaming anyone; I just find it surprising that this detail wasn't mentioned or explained. Its omission makes the article less trustworthy to me.

People are fast to pull out pitchforks in response to outrage-bait posts like this, but (generally speaking) a nontrivial percentage of such posts are intentionally omitting details which can help explain the other side's actions.

Also I genuinely wasn't familiar with this specific use-case for gift cards. At least in the US, you can buy general-purpose prepaid debit cards for this type of thing instead, or use various services which generate virtual cards e.g. privacy.com. To me that seems infinitely more normal than buying a large-value "gift card" for yourself, but I'm admittedly not familiar with the options in other countries.
by rvnx | 2025-12-13 20:03:35+00:00
Sounds like we don't live in the same EU. Banks are required to use Strong Customer Authentication, and they consider apps to be safer alternative than SMS. Revolut, N26 and co, are real banks, like any bank in the EU. In many countries, you cannot pay with small coins the bus driver. Shops can refuse cash. https://fullfact.org/online/UK-not-only-europe-country-legal... etc

If you want to use the Tesla supercharger network (one of, if not, the largest in Europe, so rather useful), you need the app. https://www.reddit.com/r/Polestar/comments/1hrzidy/do_i_need...

In Northern Europe it's very common not to have cash at all or to have it rejected. In Estonia, you can choose to login to services using... your mobile phone OR (if you are lucky and this is supported) a physical ID card reader, so realistically you want to have a mobile phone. Some services don't even have alternative. It's more like a German / Swiss thing to have cash everywhere.
by ViewTrick1002 | 2025-12-13 20:03:41+00:00
I think this take is too shallow, and based on hindsight.

Germany has had fossil gas ties to Russia since the Soviet time.

https://dw.com/en/russian-gas-in-germany-a-complicated-50-ye...

When the iron curtain fell pretty much all of Central Europe liberalized and democratized. The sole exceptions being Belarus and Russia.

Thinking they wouldn’t choose the same path is revisionist.

I remember growing up and gaming online thinking of Russians as nothing strange compared to anyone else. This changed with first Georgia and then very much Crimea.
by kindly-software | 2025-12-13 20:03:46+00:00
Hi HN,

I used to work in law. When I started teaching myself to code, I was horrified by the state of modern web development. To run a simple reliable service, I was told I needed Nginx, a backend, a database, a cache, Docker, and a cloud provider to glue it all together.

To me, this wasn't just "complexity." It was a trap.

The Context: I spent the last 7 years in a toxic relationship that stripped me of my autonomy. When I finally broke free and hit reset on my life, I developed a zero-tolerance policy for dependency. I refused to be vulnerable to external factors—whether in my life or in my server rack.

I wasn't going to escape one hell just to build another one out of node_modules and microservices.

So I spent the last year in my parents' basement building the antidote.

Kindly is a single-binary backend written in Rust.

No External Database: It replaces SQLite with KindlyDB, a custom in-memory engine designed for my specific logic. Integrated Caching: It replaces Redis with an internal caching layer, so there is no network overhead for hot data. Legal-Grade Audit: Because of my legal background, I prioritized proof. Every state change generates an immutable hash-chained audit trail.

I built this to be a "Sovereign Monolith"—drop the binary on a bare metal server, and it runs until the hardware dies. It relies on nothing but the kernel.

I am selling 250 lifetime licenses to fund my transition to full independence and get my own apartment.

Happy to answer questions about the transition from Law to Rust, or the "Sovereign Architecture."
by clemiclemen | 2025-12-13 20:03:57+00:00
The ISP named Free in France also did this a while ago.

It was fairly well implemented I think: separated from your network, bandwidth was limited (to avoid impacting the host), you could opt-out (which meant opting out of using the guest network), joining the wifi was automatic if you had a cellphone with the same ISP and it was the same "guest" network for all routers so in big cities, you could rely only on this to access Internet.

It was stopped a few years ago when they deemed cellular network was reliable enough to not need the guest network.
Ask HN: How do you handle release notes for multiple audiences?
by glidr_dev | 2025-12-13 20:04:26+00:00
For those of you who ship often, when you release updates, do you typically write one set of release notes, or do you end up rewriting them for different audiences?

For example: • technical version for developers • simplified version for end users • something more high-level for stakeholders etc…

In my current position I’ve seen a plethora of different ways teams, and even the company I currently work for, go about this.

What I’ve seen: 1. paste raw GitHub changelogs into customer emails (highly wouldn’t recommend if you’re currently doing this ) 2. manually rewrite the same update multiple times for each audience 3. skip release notes entirely because it’s too much work

So I guess my question is: How do you or your company currently go about handling more than one set of release notes, and do you feel like more than one set is needed?

Would love to hear what’s working (or not working) for you, and if you found any tools that help mitigate this issue.
by kelnos | 2025-12-13 20:04:52+00:00
If an author wants, they can leave out the "or any future version" verbiage. If the author does not, then they are explicitly saying that they want their software to be part of whatever future manifesto the FSF puts forth, including the anti-locked-bootloader manifesto present in the GPLv3.

And that's why Torvalds left out "or any future version" when licensing Linux. So I'm not sure why he's "very mad" (I doubt he actually is?); his software remains on GPLv2 like he wanted.

> The point is, nobody should be compelling you to make your products hackable.

If you want to use my GPLv3 software on your product, then yes, I am requiring that you make it hackable. If you don't want to do that, tough shit. Either do so, or freeload off someone else's software.
by XenophileJKO | 2025-12-13 20:05:11+00:00
With the current generation of model, it really isn't necessary to restart every time you don't like something. Certainly this depends on the model. Most of my recent experience is with Claude Sonnet/Opus and Gpt-5.x.

I very often, when reviewing code, think of better abstractions or enhancements and just continue asking for refactors inline. Very very rarely does the model fall off the rails.

I suppose if your unit of work was very large you might have more issues perhaps? Generally though, large units of work have other issues as well.
by mmooss | 2025-12-13 20:05:54+00:00
PGP email doesn't match Signal security:

* PGP doesn't encrypt email metadata, so the attacker gets a record of every senders, receiver, time, date, and subject line, for free, with PGP actually working at its best.

* Email usually isn't usable without storing it server-side (for multi-client access), and without being able to search it. That requires your email to be in clear text on the server. That's solved with an on-prem mail server, but not many people have that - very few end users can operate one.

* Email endpoints generally aren't secure, so even if you somehow secure your personal mail store, possibly nothing is secure except your draft messages. Every email is sent to or received from other people, so your messages are subject to their security practices.
by karolist | 2025-12-13 20:08:03+00:00
My old BMW GS (motorcycle) engine jumped timing chain for whatever reason and completely gave up the ghost on a busy highway in Poland, a random motorcyclist on a streetbike saw the white smoke cloud and understood what happened to me as I coasted to the side of the road, he stopped, asked a few details and said "get on your bike, I'll push you to the nearest shop". I didn't speak Polish and his English was not great too, but we managed to understand each other. To this day I do not know how he managed, but he was able to control the gas on his bike, align himself to the back and off the side of my bike and kept giving me these push impulses so I could keep moving, and moving we were, we travelled ~6 miles to safety doing ~30mph, I thanked him and we went out separate ways. This experience feels surreal, I literally didn't spend any time in danger lingering on a busy road side or waiting for a trailer, which can take hours.
by justatdotin | 2025-12-13 20:08:21+00:00
what really got me moving was dusting off some old text about cognitive styles and team work. Learning to treat agents like a new team-member with extreme tendencies. Learning to observe both my practices and the agents' in order to understand one another's strengths and weaknesses, indicating how we might work better together.

I think this perspective also goes a long way to understanding the very different results different devs get from these tools.

my main approach to quality is to focus agent power on all that code which I do not care about the beauty of: problems with verifiable solutions, experiments, disposable computation. eg my current projects are build/deploy tools, and I need sample projects to build/deploy. I never even reviewed the sample projects' code: so long as they hit the points we are testing.

svelte does not really resonate with me, so I don't know it well, but I suspect there should be good opportunities for TDD in this rewrite. not the project unit tests, just disposable test scripts that guide and constrain new dev work.

you are right to notice that it is not working for you, and at this stage sometimes the correct way to get in sync with the agents is to start again, without previous missteps to poison the workspace. There's good advice in this thread, you might like to experiment with good advice on a clean slate.
by ssl-3 | 2025-12-13 20:09:12+00:00
It's not necessary for a display to have an operating system.

They make fixed-function chips in factories every day that do stuff like convert video signals from one format to another (including formats that LCD panels can deal with).

Like the TFP401. For illustration, here is one on a board, ready to plug into an LCD panel and use for whatever: https://www.adafruit.com/product/2218

It doesn't run an OS. It's barely even programmable, and the programmability it does have relates only to configuring pre-defined hardware functions. It doesn't have an instruction set. It can't add 1+1.

But it can bridge the gap between a consumer device that produces video and a fairly bare LCD panel. It's a very much a single-tasker.

(Do any of the current crop of consumer-oriented televisions and computer monitors use this kind of simple pathway? Most assuredly not, which is the complaint that brought us here to begin with.

But these pathways exist anyway. It's completely possible to to create an entire video display and house it in a nice-looking package, put it in a retail box, and sell it on store shelves without involving an operating system. It's not a technological limitation.)
by toomuchtodo | 2025-12-13 20:09:15+00:00
‘We were all wrong’: how Germany got hooked on Russian energy - https://www.theguardian.com/world/2022/jun/02/germany-depend... - June 2nd, 2022

> An arrangement that began as a peacetime opening to a former foe has turned into an instrument of aggression. Germany is now funding Russia’s war. In the first two months after the start of Russia’s assault on Ukraine, Germany is estimated to have paid nearly €8.3bn for Russian energy – money used by Moscow to prop up the rouble and buy the artillery shells firing at Ukrainian positions in Donetsk. In that time, EU countries are estimated to have paid a total of €39bn for Russian energy, more than double the sum they have given to help Ukraine defend itself. The irony is painful. “For thirty years, Germans lectured Ukrainians about fascism,” the historian Timothy Snyder wrote recently. “When fascism actually arrived, Germans funded it, and Ukrainians died fighting it.”

> When Putin invaded Ukraine in February, Germany faced a particular problem. Its rejection of nuclear power and its transition away from coal meant that Germany had very few alternatives to Russian gas. Berlin has been forced to accept that it was a cataclysmic error to have made itself so dependent on Russian energy – whatever the motives behind it. The foreign minister, Annalena Baerbock, says Germany failed to listen to the warnings from countries that had once suffered under Russia’s occupation, such as Poland and the Baltic states. For Norbert Röttgen, a former environment minister and member of Angela Merkel’s Christian Democrat Union (CDU), the German government bowed to industry forces pressing for cheap gas “all too easily”, while “completely ignoring the geopolitical risks”.

> In February this year, German Green economic affairs and climate action minister Robert Habeck said that gas storage facilities owned by Gazprom in Germany had been “systematically emptied” over the winter, to drive up prices and exert political pressure. It was a staggering admission of Russia’s power to disrupt energy supplies.

> “I was wrong,” the former German finance minister, Wolfgang Schäuble, says, simply. “We were all wrong.”

We win or we learn.
by EvanAnderson | 2025-12-13 20:10:29+00:00
Concert and theatre venues in the US, mostly locked into exclusive agreements with Ticketmaster, practically require a smartphone running the Ticketmaster app. You can load the tickets into the Apple and Google "wallet" apps but you have to have the Ticketmaster app to do that. In the past year I've had to pretend to be a confused elderly person and beg box offices to get me printed tickets because I don't want to load the Ticketmaster app. Eventually I'll have to buy a burner device, assuming I still want to attend live events.
by eigenspace | 2025-12-13 20:10:36+00:00
Yeah, both Switzerland and the Netherlands have distributed networks like Germany, but their relatively small size means that they don't need to design around speed, and can focus more on synchrony.

That said, this doesn't mean it's impossible the fix Germany's trains. Germany's network did work quite well before, and it can again. The fixes are happening right now, but it's going to get worse before it gets better, because all the construction that needs to be done interferes with the network.
by lysace | 2025-12-13 20:11:49+00:00
See also: Gazprom, Gerhard Schröder (”Putin’s man in Germany” according to NYT) and the German nuclear power shutdown.

https://atomicinsights.com/gazprom-profiting-mightily-from-g...

https://www.nytimes.com/2022/04/23/world/europe/schroder-ger...
by Gabrys1 | 2025-12-13 20:11:59+00:00
1. The prepaid Visa or Mastercard come with an extra fee (like 5-6 dollars per card if I recall correctly?)

2. I didn't see the prepaid cards in stores outside the US, so they are probably not that popular outside.

Sometimes you also want to shift your spending, like if you spend 500 USD this month at this store, you'll get some good % cashback. So you end up buying a gift card that you know you'll definitely use next month.

I think this is irrelevant, TBH.
by lukan | 2025-12-13 20:12:04+00:00
Ah yes, I kind of grew up with the expectations bank people are supposed to always rip you of, so they cannot really be kind, only pretend nice to get money from you. So when I was a poor backpacker in australia wanting to cash in the small check from fruit picking work, I was suprised to find out, that there were normaly quite some fees involved to get the cash, but the bank person just smiled and said, it is ok in my case and I got all the cash with no fees.