MurphyA/hacker-news huggingface dataset:
by gmuslera | 2025-08-29 21:46:23+00:00
In some way, the meaning of publish is to make something public, give the people and agents accessing that content some freedom to get and what do with it. And that what decide to do with that freedom may benefit you (i.e. making your site visible) or not. Google is a big player, and most of those content publishers may have been benefited by previous Google decisions, but it should be assumed that new decisions (like the AI summaries) will keep being made.
by danudey | 2025-08-29 21:46:59+00:00
> I don't see why anyone would bother trying to distinguish humans from AI.

Because a hundred thousand people reading a blog post is more beneficial to the world than an AI scraper bot fetching my (unchanged) blog post a hundred thousand times just in case it's changed in the last hour.

If AI bots were well-behaved, maintained a consistent user agent, used consistent IP subnets, and respected robots.txt, I wouldn't have a problem with them. You could manage your content filtering however you want (or not at all) and that would be that. Unfortunately at the moment, AI bots do everything they can to bypass any restrictions or blocks or rate limits you put on them; they behave as though they're completely entitled to overload your servers in their quest to train their AI bots so they can make billions of dollars on the new AI craze while giving nothing back to the people whose content they're misappropriating.
by m_fayer | 2025-08-29 21:47:03+00:00
It’s simply that our collective memory fades over a few generations, becomes a ramble of dry facts of little consequence that most people don’t know or care about. Israel had built itself as a veritable temple of memory culture, and even that hasn’t lasted all that long.

How this trait mixes with 20th and 21st century technology and its weapons? It seems quite dark to me. We’ve dodged a few bullets but I’m not at all convinced we’ll stop firing or keep successfully dodging.
by chairmansteve | 2025-08-29 21:47:25+00:00
From the article....

"real mastery often involves learning when to do less, not more. The fight between an ambitious novice and an old master is a well-worn cliche in martial arts movies: the novice is a blur of motion, flipping and spinning. The master is mostly still. But somehow the novice’s attacks never seem to quite connect, and the master’s eventual attack is decisive".
by runarberg | 2025-08-29 21:47:46+00:00
I‘m thinking further about this argument, and it makes even less sense. Judaism doesn’t have a single spiritual leader like Catholicism or Tibetan Buddhism (the Pope and the Dalai Lama respectively). This is like saying that anti-Tibetan racism can be absolved if Yan Jinhai (the chairman of Tibet Autonomous region) or Gombojavyn Zandanshatar (the prime minister of Mongolia) has said nice things about the racist because most Tibetan Buddhists live in Tibet or Mongolia.
by phil21 | 2025-08-29 21:48:37+00:00
Murder may be down, but every other “minor” visible crime is up. Reporting it is useless.

Just this week about a dozen contractor vans in the neighborhood were broken into (windows smashed) by a professional crew caught on camera looking for valuables to steal. Zero of those contractors reported it since they know it’s a pointless waste of time with the local police department. Not even worth reporting to insurance since rates will more than make up for the claim in a short period of time and they expect it to happen a few times a year. The stats will report a perfect week of zero property crime.

This is a neighborhood where the cheapest property is over seven figures.

Shoplifting is effectively legalized these days. No one is enabled to stop it like we did 30 years ago when I worked a retail job. And no one wants to talk about the corrosive effect this has on society via second and third order effects. Just the liability fairy and “don’t get paid enough to deal with that”. Again, only a small percentage of such theft is ever reported these days when before it was a policy to detain and call the police for booking every single time you caught someone in the act.

So sure, violent crime is down. Misdemeanors are effectively legal where I’m at. Traffic laws more or less no longer exist on top of it all. Armed carjackings went from basically unheard of to a weekly occurrence in my neighborhood.

But all the stats state otherwise, other than perhaps the carjacking one.

It’s also a large reason folks are losing faith with institutions and experts. When the stats and “studies” match absolutely no one’s lived experience people eventually start to question things for good reason. Only so many times you can be told by wealthy suburbanites that crime is down until you tune them out.

We are rapidly moving from a high trust society to a low trust one and I think many people are being caught flat footed in the new reality.

That said, I don’t believe it’s really a government problem. It’s societal one.
by orwin | 2025-08-29 21:48:56+00:00
In the end, politicians, in a democracy, do not make the law, people do, else you're at best in a representative democracy, at worst in an oligarchy. The fact that capital is so, so tied to power (over who work or don't, who get paid, who produce what and where) have nothing to do with democracy. Allow workers to vote on board decisions (give them like 30% of votes), over CEO pay and strategic decisions (like off-shoring some production or not, new product, selling part of a company... or stopping wage growth for a year or two if the time are tough), i guarantee you we would not have been so deep in authoritarianism.
by bsder | 2025-08-29 21:48:57+00:00
1) Excess calorie consumption has only been true since about 1990. Up until that point, average heights were still increasing, so that meant that a significant chunk of the population were still undernourished. We are only about one generation from that mark, so people's social habits still haven't moved on from scarcity.

2) Nicotine, in particular, is quite good for appetite suppression. Unfortunately, the delivery system most people choose (smoking) causes more problems that the obesity it suppresses.

3) How easily people lose weight on GLP-1 agonists shows that obesity isn't just lack of willpower. The human body has a lot of systems encouraging you to hoard calories metabolically and very few systems telling you to stop. It is quite impressive that a single drug can somehow flip those metabolic systems completely in the other direction.
by Wytwwww | 2025-08-29 21:49:47+00:00
> The difference is this, some try to impose their opinions on society

So literally Musk and his pals?

> society’s well-being should stop meddling.

So again, Musk et al.? I'm really confused... what are you trying to say. That only some people are allowed to meddle while everyone else should shut up and mind their own business? How do you determine that? Wealth? Political opinions? Class? Race?
by int_19h | 2025-08-29 21:49:55+00:00
Most gun designs that included N-round burst have eventually abandoned it because full auto with operator in control of burst length turns out to be superior, while at the same time the mechanism needed to force the burst is an extra point of failure and negatively affects trigger pull .

Most recently, it was Russia dropping 2-round burst on AK-12 after experience with it in Ukraine. M4 is another famous historical example.
by danudey | 2025-08-29 21:50:07+00:00
Not only are they scraping without sending traffic, they're doing so much more aggressively than Google ever did; Google, at least, respected robots.txt and kept to the same user-agent. They didn't want to index something that a server didn't want indexed. AI bots, on the other hand, want to index every possible thing regardless of what anyone else says.
by ForHackernews | 2025-08-29 21:50:20+00:00
Arguably the distinction you're pointing at is macroinvention (the transistor) vs microinvention (a better VR headset): one is a refinement of something that exists, another is transformative opening up whole new worlds of possibility. https://www.antonhowes.com/blog/macroinvention-vs-microinven...
by righthand | 2025-08-29 21:50:23+00:00
I’m not making an argument for quotas, just explaining why they usually are included. It’s a cheap way to add “market” value to something aka scarcity.

The issue would occur in the suggested system when ICANN decides to one day stop creating 250 domain names down to 25 domain names or some such change that increases the value of the gtlds to ridiculous numbers only the wealthy/well-connected can afford.
by mikhmha | 2025-08-29 21:50:54+00:00
I'm finding that dedicating yourself to working on your own game can be a detriment to finding an actual job in the industry? It feels like employers are wary about your intentions and whether or not you will stick around.

Employers also don't seem to take home-grown experience seriously? Even if you know more about the niche side of things like networking, graphics, AI programming. If you don't have exact experience in whatever tools/framework they use (UE blueprints, Unity, etc), they think you won't be a good fit. Even though tools are just tools and concepts are more important.
by ViewTrick1002 | 2025-08-29 21:51:19+00:00
Please stop guessing and making stuff up?

Anti subsidy reports in 2019 [1] landed on a what was seen as a worryingly large €10B for the entire Swedish market based subsidy system over the period from 2003 to 2045. 2018 the actual costs landed on €300m.

In 2021 the price of the system went to zero and was subsequently phased out for new producers. You know; market based subsidies.

In other words, much less than €10B will ever be spent on it.

Please stop making stuff up because you can’t bring yourself to accept how horrifyingly expensive new built nuclear power is.

Are suggesting that we should build peaking nuclear power plants to solve firming? Because that is Sweden’s problem. Managing a January cold spell coupled with low wind is what is used to calculate the resiliency.

What capsize factor should we calculate? 20%? That is way higher than a January cold spell but let’s go for it.

Running Vogtle at a 20% capacity factor leads to 80 cents per kWh electricity.

What you are suggesting is completely batshit insane when actually putting a number on it.

Who cares if the final bit of firming is fossil based with possibility to be decarbonized through synfuels, biofuels or hydrogen when we still have large portions of the economy to deal with?

Don’t let imaginary perfect be the enemy of good enough.

[1]: https://timbro.se/miljo/ny-rapport-subventioner-till-fornyba...
by nashashmi | 2025-08-29 21:51:58+00:00
There is a nice hype campaign scavenger hunt being put up right now.

Sadly, leaked images were posted killing the buzz: https://imgur.com/a/exclusive-leak-remarkables-paper-pro-mov...

Firs clue: https://www.reddit.com/r/RemarkableTablet/comments/1n39n0e/t...
by Richard_Damge | 2025-08-29 21:52:39+00:00
False Positives can be mostly mitigated using historical data. If the child is consistently meeting alert criteria at a specific time (ie. Mon-Fri at 1300-1330 for Recess), alert is logged but no notification sent, unless toggled otherwise. The real challenge is the power consumption. Consistent monitoring burns a lot of power, someone smarter than me should figure it out.
by danudey | 2025-08-29 21:53:25+00:00
Yes, because a top hacker news post takes your server down because a large number of actual humans are looking to gain actual value from your posts. Meanwhile, you stand to benefit from the HN discussion by learning new things and perspectives from the community.

The AI bot assault, on the other hand, is one company (or a few companies) re-fetching the same data over and over again, constantly, in perpetuity, just in case it's changed, all so they can incorporate it into their training set and make money off of it while giving you zero credit and providing zero feedback.
by hinkley | 2025-08-29 21:53:40+00:00
The worst case of this I ran into, the “maintenance” team discovered some of the interactions were demo stubs. Nothing actually happened except the test data looked like the state transition worked.

Those are the worst because you don’t have done criteria you can reasonably write down. It’s whenever QA stops finding fakes in the code, plus a couple months for stragglers you might have missed.
by 1718627440 | 2025-08-29 21:53:48+00:00
> Says who?

Because I think we haven't even started. Where is the proof based system able to invent every possible thought paradigm of humans a priori? I think we are so far away from anything like this, we can't even describe the limits. Maybe we will never have and never do.

> you can't just assume limitless resources

I assumed that, because the resource limits of a very rich human (meaning for whom money is never the limit) and the one true AI system are not different in my opinion.

> comprehension

Comprehension is already the result. But I don't think this is a sound definable concept, so maybe I should stop defending this.
by RaftPeople | 2025-08-29 21:54:02+00:00
> This isn't a failure of PowerPoint.

Agree and was going to say the same thing. Messages need to be created for a specific audience.

When I'm sending an email to non-tech mgrs that has a bunch of tech details like that slide, I typically separate more detailed stuff from the conceptual message:

Summary:

System performance is not good enough for go live.

Working on a few possible solutions.

Details (for those interested):

System x is connected to ...blah blah blah...
by tremon | 2025-08-29 21:54:09+00:00
Actually, I don't think there's a good argument to add either U+1FAC3 PREGNANT MAN or U+1FAC4 PREGNANT PERSON: expressing gender can already be done with a modifier like how skin/hair color and professions are also expressed, and we already have U+1F930 PREGNANT WOMAN.

For example, this is the unicode sequence for bearded lady:

U+1F9D4 person with beard U+200D zero width joiner U+2640 female sign

So a pregnant man could simply be this expression:

U+1F930 pregnant person (woman is implied by lack of modifier) U+200D zero width joiner U+2642 male sign

But no, instead we must have this combinatorial explosion of compositions because Unicode can't decide if it wants to be a symbol library or an expression library. So now, we have duplicates like U+1F40F ram and U+1F411 ewe, U+1F404 cow and U+1F402 bull, U+1F9D2 child and U+1F466 boy and U+1F467 girl (but a baby boy must be expressed as U+1F476 U+200D U+2642), U+1F468 man and U+1F469 woman and U+1F9D1 person, and U+1F385 Santa Claus and U+1F936 Mrs Claus but also U+1F9D1 U+200D U+1F384 non-gendered Claus.
by melenaboija | 2025-08-29 21:54:29+00:00
Yes, and when it’s time to implement something by default, you always choose "your optimal". If you have two options that solve the problem equally well, you always choose the simplest, among other things because it’s shorter.

What you really learn over time and it’s more useful, is to think along these lines: don’t try to solve problems that don’t exist yet.

This is a mantraic, cool headline but useless. The article doesn't develop it properly either in my opinion.
by daxfohl | 2025-08-29 21:54:32+00:00
Though in my previous job, a huge amount of complexity was due to failed, abandoned, or incomplete attempts to refactor/improve systems, and I frequently wondered, if such things had been disallowed, how much simpler the systems we inherited would have been.

This isn't to say you should never try to refactor or improve things, but make sure that it's going to work for 100% of your use cases, that you're budgeted to finish what you start, and that it can be done iteratively with the result of each step being an improvement on the previous.
by estearum | 2025-08-29 21:54:33+00:00
https://thejns.org/view/journals/j-neurosurg/113/3/article-p...

Alzheimer's isn't in the set they're looking at here, but a curious data point is that neurosurgeons die of Alzheimer's at ~2.5x the rate of the general public.

There's definitely a live hypothesis that it's caused by some type of transmissible infection.
by fcarraldo | 2025-08-29 21:54:43+00:00
I don’t agree with the phrasing, but there is certainly a ton of complexity introduced because of engineers who are trying to be promoted or otherwise maintain their image of being capable of solving complex problems (through complex solutions).

It’s not the same as introducing complexity to keep yourself employed, but the result is the same and so is the cause - incentive structures aren’t aligned at most companies to solve problems simply and move on.
by faxmeyourcode | 2025-08-29 21:55:09+00:00
This is insane to read as a data engineer who actually builds software. These sound like amateurs, not experienced data engineers to be perfectly honest.

There are plenty of us out here with many repos, dozens of contributors, and thousands of lines of terraform, python, custom GitHub actions, k8s deployments running airflow and internal full stack web apps that we're building, EMR spark clusters, etc. All living in our own Snowflake/AWS accounts that we manage ourselves.

The data scientists that we service use notebooks extensively, but it's my teams job to clean it up and make it testable and efficient. You can't develop real software in a notebook, it sounds like they need to upskill into a real orchestration platform like airflow and run everything through it.

Unit test the utility functions and helpers, data quality test the data flowing in and out. Build diff reports for understanding big swings in the data to sign off changes.

My email is in my profile I'm happy to discuss further! :-)
by danudey | 2025-08-29 21:55:22+00:00
You realize this entire thread is about a pitch from a CDN company trying to solve an issue that has presented itself at such a scale that this is the best option they can think of to keep the web alive, right?

"Use a CDN" is not sufficient when these bots are so incredibly poorly behaved, because you're still paying for that CDN and this bad behavior is going to cost you a fortune in CDN costs (or cost the CDN a fortune instead, which is why Cloudflare is suggesting this).
by talbuilds | 2025-08-29 21:55:33+00:00
A couple of extra notes I didn’t fit in the main post:

– The firewall runs entirely client-side, so no data ever leaves your environment.

– It focuses on *retrieval-time* risks, not output moderation — so the LLM never sees poisoned chunks in the first place.

– Policies are YAML: you can choose to deny, allow, or just re-rank risky docs (based on recency, provenance, relevance).

– Overhead is low: scanners are regex/heuristic, so for ~5–20 chunks it adds only a few ms.

I’d love feedback on two things in particular:

1. Do you think retrieval-time filtering belongs in the pipeline, or should it all be done at ingest/output?

2. If you’ve got prompt injection payloads or edge cases you use to test your own RAG stacks, I’d love to try them against this.

Thanks for taking a look — always happy to hear critique, especially from folks running LangChain/LlamaIndex in production.
by jiggawatts | 2025-08-29 21:55:52+00:00
Yes, of course this is tongue in cheek, but it’s the “ha-ha… but serious” type of humour.

Just look at this map: https://en.m.wikipedia.org/wiki/List_of_date_formats_by_coun...

You’re almost entirely alone in these backwards practices!

Well, not entirely alone, you also have Liberia following your “standards”! There’s two of you! Must be nice.

PS: If Trump actually wanted to make US exports competitive on the world market, step one would be to adopt world standards like metric.
by gouggoug | 2025-08-29 21:55:58+00:00
I think it's fair to say that the software itself could/does facilitate illegal uses cases. But with that line of argumentation, then all software facilitates illegal use-cases just by existing.

The statement "We do not endorse, promote, or facilitate copyright infringement, illegal streaming, or piracy in any form", might be poorly written with regards to the fact that just by existing this torrent streaming program _does_ facilitate piracy, but I don't think this was your original argument.
by like_any_other | 2025-08-29 21:56:10+00:00
> campguards, gas chamber operators and gestapo

Right, it's either open borders or gas chambers, no in-between. Meanwhile most countries manage to enforce their borders without committing genocide, and most Slavic countries even split apart into ethnic enclaves (called "fall of the Soviet union", "Balkanization", and the Czech-Slovak split), and now manage to coexist peacefully, save for those trying to reverse those splits (i.e. Russia).

The root question is: do you support the right to national self-determination, or not? Do you support the continued existence of distinct nations, or not? If you demand open borders, regardless of a people's preference, then you fundamentally oppose both of those.
by gitaarik | 2025-08-29 21:56:18+00:00
When I'm sitting next to a sober driver, I generally expect I can trust the driver and don't necessarily need to pay attention all the time and call for attention when necessary.

Are you saying you would sit in a Tesla without paying much attention, in the same way you're sitting next to someone you trust driving the car? Would you go do phone stuff or look for stuff in your bag while your Tesla is driving you?

I mean I guess people are doing that, but with all the reports and stories I hear, it seems to me it's quite tricky, and you better just watch the road.

So I wouldn't really call that fully self driving. It's kind of like an LLM, it does great most of the time, but occasionally it does something disastrous. And therefore a human needs to be there to correct it. If you would let it all go on it's own it's not gonna end well. That's not fully self driving. That's human assisted driving.
by CodinM | 2025-08-29 21:56:22+00:00
The last bit - don’t tell people. Statistically most won’t reach their end goals, the few that do have reasonable chances of mental breakdowns and or other mental anguishes since - as the philosphers nailed a long time ago - the journey is actually what matters, the destination isn’t.

(Got where I wanted, the fact that I didn’t want enough and could re-set goals helped but still not great to reach the self imposed dream goal.)
by worble | 2025-08-29 21:57:21+00:00
> Of course, only the beeping Internet Archive totally ignored it and scraped my site. And now, despite me trying many times, they won't remove it.

In all honestly, if you're hosting it on the internet, why is this a problem? If you didn't want it to backed up, why is it publicly accessible at all? I'm glad the internet archive will keep hosting this content even when the original is long gone.

Let's say I'd read your website and wanted to look it up one day in the far future, only to find many years later the domain had expired, I'd be damn glad at least one organization had kept it readable.
by mikhmha | 2025-08-29 21:58:01+00:00
My game is both "small" and "large" in scope at the same time. Its large in the sense that its a Multiplayer Online Game. But the scope of the gameplay is rather limited. I'm not trying to make a full-out MMORPG with all the content expected of one. And that was never my intention. Its an MMO in the sense that the server architecture can support a lot of players and AI units in the world.

Yet I feel like I get wrongly misjudged as a delusional person trying to make a full-out MMORPG. No my game doesn't have a focus on questing, professions, or theme-park areas and raids. People in this industry are too quick to Pidgeon-hole you into existing game genres when you may be trying to do something new entirely.

I have a playable demo, some interested players who provide feedback in discord, etc. The game mechanics started simple but have gotten more complex with each update. A lot of work is spent in improving the AI and making them behave "smartly". I pay for server hosting and manage the servers. Its just me. But it feels like I don't even get my resume looked at when I'm applying to jobs in the industry. Because I don't have any prior experience?