MurphyA/hacker-news huggingface dataset:
by ericmay | 2026-01-13 23:26:23+00:00
> Trump stopped it entirely.

Factually incorrect.

> Second, Trump is very much helping Russia, literally taking Russian positions in negotiations and pressuring only on Ukraine - into bad deals.

Again, factually incorrect. No deals between Russia and Ukraine have been made, the US continues to sanction Russia and Russian allies including seizure of tankers that are evading sanctions, and the US continues to provide arms, weapons sales, and intelligence to Ukraine including targeting intelligence for striking targets in Russia.

I understand having a different opinion early last year, but the tide has shifted significantly. You are behind the times.

Meanwhile China supplies Russia, India buys their weapons and oil, Iran supplies them with drones, Venezuela/Cuba and all of those shenanigans, Brazil is pro-Russia/neutral, and other countries throughout Latin America and Africa and elsewhere think that NATO started the war!

So no, America didn’t switch sides. The negotiation rhetoric and tactics did, but the end result has not changed. This is not up for debate.
by accrual | 2026-01-13 23:26:32+00:00
I feel like early "AI PCs" will be just that - early. 10 years from now people will be trying to run interesting models on anemic processors to see what they can do, meanwhile contemporary systems will fly through modern quantized models.

There's basically nothing in the way except high memory prices, and I hope the intense demand ignites new memory factories.

It's just another evolution of PC technology. First it was all about the CPU and cache, then later memory and disk and other I/O (network), and now it will be all about parallel token processing.
by garganzol | 2026-01-13 23:26:40+00:00
Nowadays people complain about AI scrapers with the same vain as they complained about search indexers a way back when. Just a few years later, people had stopped caring too much about storage access and bandwidth, and started begging search engines to visit their websites. Every trick on the planet Earth, SEO optimization, etc.

Looking forward to the time when everybody suddenly starts to embrace AI indexers and welcome them. History does not repeat itself but it rhymes.
by jmward01 | 2026-01-13 23:26:43+00:00
Bummer. I have used them a lot when I was ripping my cds. Anonymity is a massive value of the web (at least the appearance of anonymity). I wonder if there is a way to have a central anonymous system that just relays trust, not identity.

So maybe something like you can get a token but its trust is very nearly zero until you combine it with other tokens. Combining tokens combines their trust and their consequences. If one token is abused that abuse reflects on the whole token chain. The connection can be revoked for a token but trust takes time to rebuild so it would take a time for their token trust value to go up. Sort of the 'word of mouth' effect but in electronic form. 'I vouch for 2345asdf334t324sda. That's a great user agent!'

A bit (a lot) elaborate but maybe there is a beginning of an idea there, maybe. Definitely I don't want to loose anonymity (or the perception there of) for services like musicbrainz but at the same point they need some mechanism that gives them trust and right now I just don't know of a good one that doesn't have identity attached.
by testacc74 | 2026-01-13 23:26:47+00:00
You do aware of being best in sport and what I just said are hella two different things right?
I wish my kids aware that *hell is other people*. Otherwise being a porn star or being a sport star makes not so much difference. Both can give you mental struggles and physical injuries.
I think the another comment articulate it well too.

Edit: And sure It's concerning that the society being shallow but OF and porn are just consequences not the cause. Without them we would have something else to turn important human experience(ie sex) into a commercial show and twisted it. Turn humans into tradable goods. Body commodification is just moral decay and the end of civilization! I think we already have such a thing called ... sports?
Edit: professional sports
by toast0 | 2026-01-13 23:27:06+00:00
Intel does make direct to consumer computers from time to time (NUC and compute sticks come to mind), but something like this would be competing with their customers, so that's a big conflict.

There's also nothing in this that really needs Intel to do it, an OEM could easily push a SteamBox. I'm not an OEM, but there's no real hard work here afaik. Make good choices in hardware, test and confirm, put in good antennas so that wireless controllers (that are already in the marketplace) are rock solid. Do some support work, etc.
by TeMPOraL | 2026-01-13 23:27:14+00:00
There isn't. There never was one, because vast majority of websites are actually selfish with respect to data, even when that's entirely pointless. You can see this even here, with how some people complain LLMs made them stop writing their blogs: turns out plenty of people say they write for others to read, but they care more about tracking and controlling the audience.

Anyway, all that means there was never a critical mass of sites large enough for a default bulk data dump discovery to become established. This means even the most well-intentioned scrappers cannot reliably determine if such mechanism exist, and have to scrap per-page anyway.
by falloutx | 2026-01-13 23:27:39+00:00
I am an AI-skeptic but I would agree this looks impressive from certain angles, especially if you're an early startup (maybe) or you are very high up the chain and just want to focus on cutting costs. On the other hand, if you are about to be unemployed, this is less impressive. Can it replace a human? I would say no its still long way to go, but a good salesman can convince executives that it does and thats all that matters.
by venndeezl | 2026-01-13 23:27:40+00:00
I suspect he means as a trillion dollar corporation led endeavor.

I trained a small neural net on pics of a cat I had in the 00s (RIP George, you were a good cat).

Mounted a webcam I had gotten for free from somewhere, above the cat door, in the exterior of the house.

If the neural net recognized my cat it switched off an electromagnetic holding the pet door locked. Worked perfectly until I moved out of the rental.

Neural nets are, end of the day, pretty cool. It's the data center business that's the problem. Just more landlords, wannabe oligarchs, claiming ownership over anything they can get the politicians to give them.
by 4k0hz | 2026-01-13 23:27:45+00:00
It's barely a value-add when agents can scrape the docs themselves and browsers have the reading tools built in.

>I would ask if you've started a real business but it's clear you haven't.

I wouldn't speak so authoritatively about this stuff if I didn't know anything about running a business. My lemonade stand was extremely successful in the geographic area it was marketed in (~10 blocks around my house). I was planning on going public but unexpected regulatory issues (end of 4th grade summer break) forced me to reevaluate. Though these new agentic lemon beverage developments seem like they might draw me back into it...
by thomascountz | 2026-01-13 23:27:46+00:00
Let's pretend Alice tells the truth 100% of the time, and Bob is still at 20%. It's more easy to intuit that Bob's contribution is only noise.

Slide Alice's accuracy down to 99% and, again, if you don't trust Alice, you're no better off trusting Bob.

Interestingly, this also happens as a feature of them being independent. If Bob told the truth 20% of the time that Alice told a lie, or if Bob simply copied Alice's response 20% of the time and otherwise told the truth, then the maths are different.
by tremon | 2026-01-13 23:28:22+00:00
It's as if many of you have never really understood the concept behind separation of powers. There is a very clear reason why the branches of government are constructed in partial opposition to each other, and the validity of that reason is readily demonstrated every day. Who cares if one branch of the government doesn't want to fund a particular story or slant: another branch should be happy to write that check to provide a counterbalance.
by alterom | 2026-01-13 23:29:04+00:00
I knew he was a loonie, but thought that you're exaggerating.

Nope.

Quote [1]:

While I’m being politically incorrect, let me describe to you the mind of a teenage boy. Our frontal lobes aren’t complete. We don’t imagine the future. Our bodies want sex more than we want to stay alive. Literally. Lonely boys tend to be suicidal when the odds of future female companionship are low.

So if you are wondering how men become cold-blooded killers, it isn’t religion that is doing it. If you put me in that situation, I can say with confidence I would sign up for suicide bomb duty. And I’m not even a believer. Men like hugging better than they like killing. But if you take away my access to hugging, I will probably start killing, just to feel something. I’m designed that way. I’m a normal boy. And I make no apology for it.

There's a lot to unpack here, starting with equating female companionship to sex, and ending with the dichotomy between having sex and murdering people.

I started looking for a source of his hypnosis quote, and stumbled into [2].

Umm. Not going to quote it.

[3] is a higher level overview of Scott Adams' hypnotism. It didn't make me any happier.

Ugh. I used to like Dilbert in the 90s as a kid. Wish I knew about Scott Adams now as much as I knew then.

That's to say, wish he wasn't such a horrible person.

[1] https://web.archive.org/web/20160116140056/http://blog.dilbe...

[2] https://www.tumblr.com/manlethotline/616428804059086848/hey-...

[3] https://www.forbes.com/sites/michaelschein/2018/06/20/dilber...
by disqard | 2026-01-13 23:29:09+00:00
> The history directory contains information on the history of edbrowse, how it came to be and what it is trying to accomplish. This includes a wikipedia article, written in markup. It was deleted by the wikipedia maintainers, for lack of sources. If edbrowse is described in a book or mainstream magazine in the future, perhaps this article can be reintroduced
by ericmay | 2026-01-13 23:29:16+00:00
I’m not following your point, or maybe you missed mine. You said 100,000 Russian soldiers dead doesn’t make the US any safer, and I agree, but it does make Europe safer because there are fewer Russian soldiers. But then you compared the population of Russia and the EU to imply that Russia is no threat to Europe.

But that analysis is flawed, because the population of Europe isn’t one monolithic block that is guaranteed to respond to Russia with military force in such a way that a direct comparison of the numbers makes much sense. For example, what I mentioned already.

And your reply was Ukraine is not in the EU.

??
by kranke155 | 2026-01-13 23:30:01+00:00
Why would they need to do everything? Are you assuming that by the nature of even allowing 10% of labour not being replaced by AI, moving the other 90% of workers into that sector will create no issues with changing wages and wealth distribution ?

I would claim you are already wrong, and that de industrialisation in the West already moved a large number of workers onto a small number of sectors in the services, mostly to the detriment of the overall welfare of the population.
by arjie | 2026-01-13 23:30:13+00:00
The only real mechanism is "Disallow: /rendered/pages/*" and "Allow: /archive/today.gz" or whatever and there is no communication that the latter is the former. There is no machine-standard AFAIK that allows webmasters to communicate to bot operators in this detail. It would be pretty cool if standard CMSes had such a protocol to adhere to. Install a plugin and people could 'crawl' your Wordpress from a single dump or your Mediawiki from a single dump.
by riazrizvi | 2026-01-13 23:30:40+00:00
Seems reasonable. He makes a provocative statement for ppl in his audience to draw their attention and make the important point it’s not okay (we should avoid) ppl who dislike us based on skin color. And he makes the further point he agrees there is still systemic racism against black folks and it’s a big problem. And yet, as you see in response to your posting of the video, ppl still dismiss it because they’d rather hold on to the soundbite to maintain their outrage, rather than understand the guy’s position.
by meowface | 2026-01-13 23:30:53+00:00
I remember being an /r/TheMotte poster years ago where I possibly would've either made or steelmanned a reply similar to yours. I am so grateful I am no longer like that and am able to just confront reality for what it is.

I was a big fan of Scott Adams for years; there is no point trying to rationalize his later turn. He became a diehard Trump supporter who's made hundreds of statements as ridiculous and irrational as the one about black people.
by devhouse | 2026-01-13 23:31:12+00:00
random idea, instead of blocking scrapers, maybe detect them (via user-agent, request patterns, ignoring robots.txt) and serve them garbage data wrapped in dad jokes.

if (isSuspiciousScraper(req)) {
return res.json({
data: getDadJoke(),
artist: "Rick Astley", // always
album: "Never Gonna Give You Up"
});
}
by tombert | 2026-01-13 23:31:18+00:00
I just think Jevins paradox [1]/Gustafson's Law [2] kind of applies here.

Maybe I shouldn't have used the word "replaced", as I don't really think it's actually going to "replace" people long term. I think it's likely to just lead to higher output as these get better and better .

[1] https://en.wikipedia.org/wiki/Jevons_paradox

[2] https://en.wikipedia.org/wiki/Gustafson%27s_law
by tux | 2026-01-13 23:31:25+00:00
Yeah AI scrapers is one of the reasons why i have closed my public website https://tvnfo.com and only left donors site online. It’s not only because of AI scrapers but i grew tired of people trying to scrape the site eating a lot of reasorcers this small project don’t have. Very sad really it was publicly online since 2016. Now it’s only available for donors. Running a tiny project on just $60 a month. If this was not my hobby i would close it completely long time ago :-) Who know if there is more support in the future i might reopen public site again with something like anubes bot protection. But i thought it was only small sites like mine who gets hit hard, looks like many have similar issues. Soon nothing will be open or useful online. I wonder if this was the plan all along whoever pushing AI on massive scale.
by crazygringo | 2026-01-13 23:31:37+00:00
Seriously, I can't help but think this has to be part of the answer.

Just something like /llms.txt which contains a list of .txt or .txt.gz files or something?

Because the problem is that every site is going to have its own data dump format, often in complex XML or SQL or something.

LLM's don't need any of that metadata, and many sites might not want to provide it because e.g. Yelp doesn't want competitors scraping its list of restaurants.

But if it's intentionally limited to only paragraph-style text, and stripped entirely of URL's, ID's, addresses, phone numbers, etc. -- so e.g. a Yelp page would literally just be the cuisine category and reviews of each restaurant, no name, no city, no identifier or anything -- then it gives LLM's what they need much faster, the site doesn't need to be hammered, and it's not in a format for competitors to easily copy your content.

At most, maybe add markup for <item></item> to represent pages, products, restaurants, whatever the "main noun" is, and recursive <subitem></subitem> to represent e.g. reviews on a restaurant, comments on a review, comments one level deeper on a comment, etc. Maybe a couple more like <title> and <author>, but otherwise just pure text. As simple as possible.

The biggest problem is that a lot of sites will create a "dummy" llms.txt without most of the content because they don't care, so the scrapers will scrape anyways...
by dangus | 2026-01-13 23:31:58+00:00
Because you’re invested. You’re a Scott Adams fan.

As someone who likes the Harry Potter series, I hear you. It’s tough to see your idols fall into being dumbasses.

If you sincerely think Scott Adams had zero bias, that he’s not a bigot, that he didn’t support “stop the steal,” that’s on your conscience and your value system. I choose to believe the impulse of what he said, not the 30 minutes of damage control afterward.

I’d say nobody asked the guy his opinions on such subjects and just wanted to read his funny office comics.

But that’s what happens with celebrities like this.
by bigwheels | 2026-01-13 23:32:01+00:00
No need to be puzzled- occasionally a funny submission will live for a bit on the front page but in general the spectrum of acceptable humor around here is very narrow.

It's sort of a case of barking up the wrong tree on that front. Personally I've been enjoying laughing at the slickdeals forums such as https://slickdeals.net/f/19069660-16-5-ft-pancellent-snake-i.... Obviously it can't compete with higher brow humor, but at least they're nice there.
by HeyLaughingBoy | 2026-01-13 23:32:03+00:00
[shrug]

Your mileage varies, I guess. I used to live with easy walking distance of an upscale supermarket, but yet I did most of my shopping by driving to a different one farther away. Buying groceries with a car is simply more convenient.

Even after I moved out of that neighborhood, it wasn't unusual for me to stop at the grocery store every afternoon on my drive home.
by orbital-decay | 2026-01-13 23:32:43+00:00
It's three issues:

- AI shops scraping the web to update their datasets without respecting netiquette (or sometimes being unable to automate it for every site due to the scale, ironically).

- People extensively using agents (search, summarizers, autonomous agents etc), which are indistinguishable from scraper bots from website's perspective.

- Agents being both faster and less efficient (more requests per action) than humans.
by mikeyouse | 2026-01-13 23:32:51+00:00
Yeah every once in awhile I’ll catch an old comedy special and it’s almost jarring how much of the content from some comics was “my wife is awful and she’s really dumb for expecting things from me”.

Neighbors of a certain age have that same mindset.. “Want to come over for a drink and get away from the ball and chain?” Or “After your done with the lawn, would your wife let you come over for a drink?”

I mean I wouldn’t mind grabbing a beer but your view of relationships is exceptionally weird.
by merlincorey | 2026-01-13 23:33:46+00:00
Which ones are you claiming have already been achieved?

My understanding of the current scorecard is that he's still technically correct, though I agree with you there is velocity heading towards some of these things being proven wrong by 2029.

For example, in the recent thread about LLMs and solving an Erdos problem I remember reading in the comments that it was confirmed there were multiple LLMs involved as well as an expert mathematician who was deciding what context to shuttle between them and helping formulate things.

Similarly, I've not yet heard of any non-expert Software Engineers creating 10,000+ lines of non-glue code that is bug-free. Even expert Engineers at Cloud Flare failed to create a bug-free OAuth library with Claude at the helm because some things are just extremely difficult to create without bugs even with experts in the loop.
by nonfamous | 2026-01-13 23:33:50+00:00
That’s how it works for us here in Australia. We have 16Wh of solar and 40KWh of battery, and pay (and receive) wholesale rates for electricity. During the say electricity prices are very low or negative, and we run off the solar and charge the car then. In the evenings when demand is high electricity prices can spike, and our system will automatically sell to the grid then. Sometimes we may need to draw from the grid in the early morning to make up for that, but the price we pay then is insignificant compared to what we make selling the day before.
by nebula8804 | 2026-01-13 23:33:52+00:00
When that youtuber Benn Jordan released a video describing techniques to covertly throw off Flock cameras (such as obscuring part of the plate with dirt or mud but still allowing it to be clearly read by humans), we saw a Florida legislature update the rulings in record time to overcome these techniques.

You add this feature and then the next day all "blind spots" will be covered with additional Flock cameras.
by deepsun | 2026-01-13 23:34:04+00:00
Try to comply to an infosec standard. Typically one of many compliance controls are "every change must be reviewed and approved by another person". So no one can push on their own.

I know folks tend to frown on security compliances, but if you honestly implement and maintain most of the controls in there, not just to get a certificate -- it really make a lot of sense and improves security/clarity/risks.
by zozbot234 | 2026-01-13 23:34:07+00:00
> In 2029, AI will not be able to read a novel and reliably answer questions about plot, character, conflicts, motivations, etc. Key will be going beyond the literal text, as Davis and I explain in Rebooting AI.

Can AI actually do this? This looks like a nice benchmark for complex language processing, since a complete novel takes up a whole lot of context (consider War and Peace or The Count of Monte Cristo). Of course the movie variety is even more challenging since it involves especially complex multi-modal input. You could easily extend it to making sense of a whole TV series.
by iscoelho | 2026-01-13 23:34:16+00:00
At this time, there is no commercial offering for hardware/ASIC WireGuard implementations. The standard WireGuard implementation cannot reach 10G.

The fastest I am aware of is VPP (open-source) & Intel QAT [1], which while it is achieves impressive numbers for large packets (70Gbps @ 512 / 200Gbps @ 1420 on a $20k+ MSRP server), is still not comparable with commercial IPsec offerings [2][3][4] that can achieve 800Gbps+ on a single gateway (and come with the added benefit of relying on a commercial product with support).

[1] https://builders.intel.com/docs/networkbuilders/intel-qat-ac...

[2] https://www.juniper.net/content/dam/www/assets/datasheets/us...

[3] https://www.paloaltonetworks.com/apps/pan/public/downloadRes...

[4] https://www.fortinet.com/content/dam/fortinet/assets/data-sh...
by kstrauser | 2026-01-13 23:35:03+00:00
> I was a self confessed skeptic.

I think that's the key. Healthy skepticism is always appropriate. It's the outright cynicism that gets me. "AI will never be able to [...]", when I've been sitting here at work doing 2/3rds of those supposedly impossible things. Flawlessly? No, of course not! But I don't do those things flawlessly on the first pass, either.

Skepticism is good. I have no time or patience for cynics who dismiss the whole technology as impossible.
by colechristensen | 2026-01-13 23:35:11+00:00
Besides being a cook which is more of a robotics problem all of the rest are accomplished to the point of being arguable about how reliably LLMs can perform these tasks, the arguments being between the enthusiast and naysayer camps.

The keyword being "reliably" and what your threshold is for that. And what "bug free" means. Groups of expert humans struggle to write 10k lines of "bug free" code in the absolutist sense of perfection, even code with formal proofs can have "bugs" if you consider the specification not matching the actual needs of reality.

All but the robotics one are demonstrable in 2026 at least.
by amrocha | 2026-01-13 23:35:23+00:00
The answer applicable to individuals is to leave the suburbs and move to a city.

The answer applicable to the government is to build better cities.

The answer is never stay in the suburbs but take drugs the rest of your life and spend the end of your life miserably unhealthy. You’re free to do that if you want to, you just can’t pretend it’s healthy.