MurphyA/hacker-news huggingface dataset:
by BrenBarn | 2025-08-30 05:42:53+00:00
The thing is that rhinoceroses aren't well-behaved. Even if some small fraction of them in theory might be well-behaved, the effort of trying to account for that is too small to bother. If 99% of rhinoceroses aren't well-behaved, the simple and correct response is to ban them all, and then maybe the nice ones can ask for a special permit. You switch from allow-by-default to block-by-default.

Similarly it doesn't make sense to talk about what happens if AI bots were well-behaved. If they are, then maybe that would be okay, but they aren't, so we're not talking about some theoretical (or past) situation where bots were well-behaved and scraped in a non-disruptive fashion. We're talking about the present reality in which there actually are enormous numbers of badly-behaved bots.

Incidentally, I see that in a lot of your responses on this thread you keep suggesting that people's problem is "not with AI" but with something else. But look at your comment that I initially replied to:

> Blocking AI training bots is not free and open for all.

We're not talking about "AI". We're talking about AI training bots. If people want to develop AI as a theoretical construct and train it on datasets they download separately in a non-disruptive way, great. (Well, actually it's still terrible, but for other reason. :-) ) But that's not what people are responding to in this thread. They're talking about AI training bots that scrape websites in a way that is objectively more harmful than previous generations of scrapers.
by morpheos137 | 2025-08-30 05:43:45+00:00
You seem unable to communicate clearly what it is you are trying to say. Honestly i would be interested but I can't follow you. Your use of words is non standard. You say words are about social interelations, e.g. domninance, exchange, etc but then you also say that words don't communicate information. Of course thought is fundamentally non-verbal but since telepathy doesn't exist we use symbols, i.e. words to communicate with oth ers. Nobody thinks words ard thoughts. The represent thoughts. Your part about words being deception is one of many use cases. Honestly, and with all due respect, your comment fits the style of a person in an altered state of mind be it drugs, psychosis or something else. Why write words in a public forum with your weird little idiosyncratic meanings nobody else understands.
by cmertayak | 2025-08-30 05:43:47+00:00
It nails the value of keeping things simple, and I think the link to cognitive load deserves even more emphasis. In most of the cases, simplifying means reducing the cognitive load. Sometimes consolidating pieces with DRY, sometimes using design patterns, sometimes decomposing things into services...

Every extra details or workaround increases the number of things you need to keep in your head, not just when building the system, but every time you come back to maintain or extend it. "Simple systems have fewer 'moving pieces': fewer things you have to think about when you're working with them."

Simplicity isn't just about getting the job done quickly; it's about making sure future you (or someone else) can actually understand and safely change the system later. Reducing cognitive load with simplicity pays off long after the job is done.
by smsm42 | 2025-08-30 05:46:20+00:00
If it's trivial to build images yourself, then just build it and be thankful for all the utility you earned by deferring doing the task till later - time is money, very literally, the whole point of credit is time-shifting money. You were allowed to time-shift work, and for free. But the expectation you could time-shift it forever is not based on any promise - they were always free to revoke the option, and now they did. If it's a trivial task, make your own one - you could even do the society a service and put it up on the docker repo.
by cookiengineer | 2025-08-30 05:46:32+00:00
How can I get to the top of the leaderboard?

Is the amount of em dashes counted or the comments that have at least one em dash inside them?

You know, I am asking for...science(?).

I also wanted to point out that these could be Kantonese/Mandarin/Japanese/SouthEast Asian users that use their local keymapping software because a lot of them use the idiom symbols (e.g. the dot character, too) when they switch to the English keymaps.

Check out how laptops usually look like over there, a lot of manufacturers build that right into the firmware.
by RobSm | 2025-08-30 05:46:55+00:00
You can always stop bots. Add login/password. But people want their content to be accessible to as large audience as possible, but at the same time they don't want that data to be accessible to the same audience via other channels. logic. Bots are not consuming your data - humans are. At the end of the day humans will eventually read it and take actions. For example chatgpt will mention your site, the user will visit it.

And no, nothing was different before 2022. Just look at google, the largest bot scraping network in the world. Since 1996.
by layoric | 2025-08-30 05:47:17+00:00
Yup. If you want something to plumb some pretty low volume events, sure serverless like Lambda can be useful. Anything which would be considered high levels of compute, you are just wayyy over paying. Hell, even EC2 on spot instance is expensive compute. I do like some AWS services, but yeah they come at a premium that is just getting more and more expensive.
by cinntaile | 2025-08-30 05:50:24+00:00
While I think the west is a huge generalization, I don't think the west thinks children are capable of nothing. It's more about letting children be children and play. Rather than forcing them to "work" almost constantly from a very young age.

I don't really envy the school systems that force kids to work very hard from an early age to get into a fancy university. From what I understand it's usually school systems with a heavy focus on rote memorization as well and that takes up quite a bit of time with diminishing results.
by RossBencina | 2025-08-30 05:50:37+00:00
I have seen enough confusion in hardware specs that I would only trust the IEEE spec.

In gPTP there is one hardware clock, yes. The Local Clock. PTP time is not a hardware clock, it is a virtual clock. The Local Clock is not synchronised to PTP time. Do you have a copy of 802.1AS-2020 there? Here are a few quick quotes resulting from searching for "local clock":

"3.16 local clock: A free-running clock, embedded in a respective entity (e.g., PTP Instance, CSN node), that provides a common time to that entity relative to an arbitrary epoch." (p. 21)

"Each PTP Instance measures, at each PTP Port, the ratio of the frequency of the PTP Instance at the other end of the link attached to that PTP Port to the frequency of its own clock. The cumulative ratio of the Grandmaster Clock frequency to the local clock frequency is accumulated in a standard organizational type, length, value (TLV) attached to the Follow_Up message (or the Sync message if the optional one-step processing is enabled). The frequency ratio of the Grandmaster Clock relative to the local clock is used in computing synchronized time, and the frequency ratio of the neighbor relative to the local clock is used in correcting the propagation time measurement." (p. 44)

"10.1.2.1 LocalClock entity The LocalClock entity is a free-running local clock (see 3.16) that provides a common time to the PTP Instance, relative to an arbitrary epoch. A PTP Instance contains a LocalClock entity. The requirements for the LocalClock entity are specified in B.1. All timestamps are taken relative to the LocalClock entity (see 8.4.3). The LocalClock entity also provides the value of currentTime (see 10.2.4.12), which is used in the state machines to specify the various timers.

NOTE—The epoch for the LocalClock entity can be the time that the PTP Instance is powered on. " (p.66)

Need I continue?

I may be mistaken, but I thought in this sub-thread we were talking about the PTP clock and the system clock (e.g. the x86 tsc). Only one of these is relevant to PTP but the system clock is the only one available to timestamp software events and so you may want to be able to convert between tsc time, NIC local clock time, or PTP time. If you want to schedule GPIO events on the NIC, given a PTP time you can compute the corresponding local clock time, and schedule the event on the GPIO. This does not require disciplining the NIC clock (i.e. the PTP local clock, as defined in my quotes above) to PTP time.
by wakawaka28 | 2025-08-30 05:51:17+00:00
You have misrepresented my claims. The CDC and Biden tried to force vaccination. The DOD thing is another, similar issue. The DOD mandate DID get enforced though, and many military personnel left over it or were forced to quit. In the end, I believe they sued and won some compensation as well as got rehired.

>Very interesting that once you unpack an anti-vaxxers alarmist arguments, you're left with a completely different understanding of reality with nuance and all.

Very interesting that you cannot comprehend the nuance of someone like me who supports reasonable voluntary use of proven safe and effective vaccines, who opposes forcing proven ineffective and experimental vaccine technology on the entire public without reservation, under threat of exile from society. I'm not taking bullshit from big pharma or government so that must make me an anti-vax simpleton, eh? Gtfo
by simianwords | 2025-08-30 05:51:31+00:00
A good heuristic for a test is: how many times you are having to fix it when you change real code.

If every small change in the code base causes you to go back and fix the tests then your tests are bad. They should not get in the way so often. There should be a concept of “test maintenance overhead” that is weighted against the number of bugs it catches. You could also think of it as false positives vs true positives.
by Shank | 2025-08-30 05:51:31+00:00
> How about you fix the flakey tests?

Often times a flakey test is not flakey because it was well-written and something else strange is failing. Often times the test reveals something about the system that is somewhat non-deterministic, but not non-deterministic in a detrimental way. When you have multiple levels of abstraction and parallelization and interdependent behavior, fixing a single test becomes a time consuming process that is difficult to work with (because it's flakey, you can't always replicate the failure).

If a test fails in CI and the traceback is unclear, many people will re-run once and let it continue to flake. Obvious flakes around time and other dependencies are much easier to spot and fix, so they are. It's only the weird ones that lead to pain and regret.
by savolai | 2025-08-30 05:52:16+00:00
As this was briefly flagged I’ll extrapolate as I was considering doing this myself as thought experiment.

I wondered could this be the architecture i’m looking for since I want something that is offline first but works online. Hyperclay removes a lot of the architectural heft of traditional web apps. But of course now the data is in the dom. So xslt could in theory be used to bring it back into an actually-structural format.

I.e. treat the DOM as a view and use XSLT as the lossless bridge back to structured, declarative and deterministic config. Round-trips are doable. One stylesheet renders config → HTML editor. Another extracts edited DOM → config.

Of course, if downstream systems expected JSON, transforming DOM→JSON via JS might be simpler. My previous backend is sqlite though.
by koliber | 2025-08-30 05:52:48+00:00
These are great points.

However, I don’t think these companies provision capacity for peak usage and let it idle during off peak. I think they provision it at something a bit above average, and aim at 100% utilization for the max number of hours in the day. When there is not enough capacity to meet demand they utilize various service degradation methods and/or load shedding.
by throwaway2037 | 2025-08-30 05:53:02+00:00
Wow... that PDF is 2,750 pages! There must be an army of technical writers behind it. That is an incredible technical achievement.

Real question: Why do you think Intel does this? Does it guarantee a very strong foothold into data center NICs? I am sure competitors would argue two different angles: (1) this PDF shares too much info; some should be hidden behind an NDA, (2) it's too hard to write (and maintain) this PDF.
by jiggawatts | 2025-08-30 05:54:18+00:00
Use an off-the-shelf parser that handles namespaces. And escapes. And CData. And everything else you haven't thought of: https://stackoverflow.com/questions/701166/can-you-provide-s...

This avoids the endless whack-a-mole that you get with a partial solution such as "assume namespaces are superflous", which you almost certainly will eventually discover weren't optional.

Or some other hapless person using your terrible code will discover at 2am at night sitting alone in the office building while desperately trying to do something mission critical such as using a "simple" XML export tool to cut over ten thousand users from one Novel system to another so that the citizens of the state have a functioning government in the morning.

Ask me how I know that kind of "probably won't happen" thing will, actually, happen.
by eru | 2025-08-30 05:54:50+00:00
You make a good argument, but let me take the other side:

What you describe is probably necessary for getting _fast_ Linux compatibility. However, if you are willing to take the overhead of a few layers of indirection, you can probably sandbox the Linux land somewhere, and not have it impact the rest of your design much.

Most hardware access doesn't have to be particularly efficient. And, yes, for the few pieces of hardware that you do want to support efficiently (eg your storage devices or networking, whatever you want to concentrate on in your design) these you can handle natively.

Btw, I would suggest that most people these days should write their toy operating systems to run as a VM on a hypervisor like Xen or similar. The surface to the outside world is smaller that way.
by necovek | 2025-08-30 05:55:05+00:00
Looking at https://en.wikipedia.org/wiki/List_of_countries_by_medal_cou..., it seems that many neighbouring countries who had similar schooling systems perform similarly or better "per capita" (Hungary with <10M people, placed 5th; Romania 19M at 6th; Bulgaria with <7M at 8th; Serbia at 30th with <8M, Croatia at 42nd with <5M people — two of which should probably get some share of Yugoslavia's medals at 39th — there's also Serbia and Montenegro separately).

So, Romania is at the sweet spot of high selectivity and population size to really pop out in these types of competitions, but it seem it's not really that unique as it's being suggested.
by iTokio | 2025-08-30 05:56:04+00:00
Yes I wonder if with the current trend, solar might become the real alternative, less expensive, less risky.

But to be fair, you have to consider your « aside », because nuclear has the tremendous advantage of working when it’s cloudy, dark and you need the energy the most in the winter.

I do not think that we can just compare the prices, or maybe we should also add the cost of storage (that is going down too) for solar.

But currently a mix is probably the pragmatic approach.
by eru | 2025-08-30 05:56:24+00:00
> I don't like Meta, but there used to be a time where big corp used to spend 30% of its budget on R&D. It's how we got all the toys we have now, R&D labs of big Bell and others.

Just because you spend a lot of your money on R&D, doesn't mean that each R&D project is automatically a good one. You still have to make choices between them.
by RHSeeger | 2025-08-30 05:58:34+00:00
I'll go with a bank account, because that was one of the initial examples for automated testing.

I would write integration/system (different, but similar, imo) to test that the black box integrations with the system work as expected. Generally closer to the "user story" end of things.

I would write integration tests for smaller, targeted thing. Like making sure the sort method works in various cases, etc. Individual methods, especially ones that don't interact with data outside what is passed into them (functional methods), are good for unit testing.
by rkomorn | 2025-08-30 05:58:39+00:00
I've found that well-written unit tests help me narrow down problems faster during development (eg one unit test failing for a function would show that a change or refactor missed an edge case).

I've found that well-written integration tests help me catch workflow-level issues (eg something changed in a dependency that might be mocked in unit tests).

So while I think good integration tests are the best way to make sure things should ship, I see a lot of value in good unit tests for day-to-day velocity, particularly in code that's being maintained or updated instead of new code.
by cperciva | 2025-08-30 05:59:14+00:00
There are several advantages to using spiped rather than tunneling via ssh:

* Reduced attack surface: The spiped protocol (and implementation) is orders of magnitude simpler than ssh.

* spiped opens a separate transport layer connection for each pipe, mitigating "noisy neighbour" effects where one busy connection tunneled over ssh can bottleneck other connections tunneled over the same ssh connection. (This is not perfect, since spiped is single-threaded: A connection which is busy enough will end up starving you for CPU time for the crypto. But you'll typically hit that limit with traffic orders of magnitude higher than you'd need to create a bottleneck if everything goes over the same TCP connection.)

* spiped has no persistent connection, so there's nothing to be interrupted if your network drops (or if you move between networks). Every connection is a new connection; spiped is effectively transparent.
by 9dev | 2025-08-30 05:59:45+00:00
Looking at science fiction sets, I always wonder why they have to look so "spacey"; Foundation is a good concurrent example of this, but even my highly regarded Expanse, which avoids a lot of inaccuracies usually, is not innocent here. Irregularly shaped doors, flashy lights in useless places, patterned backgrounds, round halls, windows on spaceships, and so on.

I mean, I get it, I watch a space opera, it’s set in space. But why do the designers have to shove it in your face that much? My guess would be that the future rather features sublime technology that disappears into the background when not needed, environments designed for efficiency, not wasted space—especially on vessels.
by not_your_vase | 2025-08-30 05:59:50+00:00
Excellent. So we have the bug-infested btrfs which just lost its main maintainer, and the unfinished bcachefs, which just lost its maintainer, not exclusively due to the main btrfs maintainer.

ext4 has been legacy for 25 years... and apparently it's here to stay for another 25.
by kristopolous | 2025-08-30 06:01:29+00:00
It's going to be solar + wind + battery. That's where the economics are at. Sodium batteries are just coming online now https://en.m.wikipedia.org/wiki/Sodium-ion_battery - lithium is getting phased out.

Nuclear can't compete. https://en.m.wikipedia.org/wiki/Levelized_cost_of_electricit...

Maybe in some far off future nuclear will have a role... But the global energy investment markets paint a very clear picture: solar + wind + battery is the way.
by refurb | 2025-08-30 06:01:57+00:00
> Where in Asia? When was the last time in China? Are you comparing Shenzhen to Bangkok? Or lower tier cities to lower tier cities in Thailand?

Maybe you misunderstood? Clearly Shanghai is nicer than Bangkok, but China is not 1.4B people living in Shanghai, you need to include the people living on a few dollars per days in rural Chinese areas.

> What do you think is the trend for Thailand and China in the next 10 years?

I have no idea, but even if China continues to grow at 5% per year (if they're lucky), in a decade they might have a per capita GDP of what? $20,000? That puts them on par with Panama or Uraguay?

> Do you think Americans can afford cutting edge health care

Absolutely. Just look at things like CAR-T adoption, it's the highest in the world. Far exceeding Europe and Europe exceeds China.

> In China, they have universal health care where basic health care is cheap. If you want private health care in China, it's expensive. So you tell me which is better.

Cheap healthcare in China is just that - cheap. I've been to Chinese hospitals. I've seen doctors prescribe antibiotics for viral infections. I've seen them recommend "hot water" as a cure.

It may be convenient and cheap, but quality is terrible unless you get to the high end private hospitals and guess what? CAR-T therapy cost hundreds of thousands everywhere in the world.

> I think a ton of people make the mistake of comparing average China to average US and then say "see! I told you China is bad".

Why would you not compare averages? Or would you prefer to compare Shanghai to say the top 10% of income earners in the US? We could do that too if you'd like.

The truth is that China, while making great strides, is still about as rich as Thailand on average. They need decades are very strong economic growth to even match the US, let alone exceed it.

All while facing a massive debt overhang and demographic changes that will only slow economic growth.
by blueplanet200 | 2025-08-30 06:02:18+00:00
The axiom of choice is debated as a matter of if its inclusion into our mathematics produces useful math.

I don't think it's debated on the ground of if it's true or not.

And I was imprecise with language, but by saying "math is math" I meant that there are things that logically follow from the ZFC axioms. That is hard to debate or be skeptical of. The point I was driving was that it's strange to be skeptical of an axiom. You either accept it or not. Same as the parallel postulate in geometry, where you get flat geometry if you take it, and you get other geometries if you don't, like spherical or hyperbolic ones...

To give what I would consider to be a good counterargument, if one could produce an actual inconsistency with ZFC set theory that would be strong evidence that it is "wrong" to accept it.
by riffraff | 2025-08-30 06:03:00+00:00
Tibet was a theocracy with a religious leader for a while until recent times.

Also I think the Albanian plan is more on the lines of Mount Athos: it is technically an in independent administration with independent (monastic) government but still part of the Greek state

https://en.m.wikipedia.org/wiki/Monastic_community_of_Mount_...
by petesergeant | 2025-08-30 06:03:21+00:00
The British monarchy and the Aga Khan have very strong associations. Weird trivia: the right for the Aga Khan to call himself "His Highness" is by title granted by the British monarchy, like some kind of weird accreditation.

https://www.royal.uk/news-and-activity/2025-02-10/the-king-i...
by fruitplants | 2025-08-30 06:06:04+00:00
I agree with thinking a few steps ahead. It is particularly useful in case of complex problems or foundational systems.

Also maybe simplicity is sometimes achieved AFTER complexity, anyway. I think the article means a solution that works now... target good enough rather than perfect. And the C2 wiki (1) has a subtitle '(if you're not sure what to do yet)'. In a related C2 wiki entry (2) Ward Cunningham says: Do the easiest thing that could possibly work, and then pound it into the simplest thing that could possibly work.

IME a lot of complexity is due to integration (in addition to things like scalability, availability, ease of operations, etc.) If I can keep interfaces and data exchange formats simple (independent, minimal, etc.) then I can refactor individual systems separately.

1. https://wiki.c2.com/?DoTheSimplestThingThatCouldPossiblyWork

2. https://wiki.c2.com/?SimplestOrEasiest