MurphyA/hacker-news huggingface dataset:
by floxy | 2026-01-13 22:44:32+00:00
Do we need to come up with more internet protocols/services that don't require a negotiation process? So that it would work better with very high latency sneaker-net flash-drive networks? Especially for the already asynchronous ones like email? I could envision a user with a messenger/email-like client who "sends" (encrypted) messages that get put on a flash drive. This is carried around the neighborhood, etc, where others do the same. Eventually someone takes it to a machine with regular internet access, where the messages get delivered to their intended recipients. And then replies to these messages (coming hours, days, weeks later) also get put on a flash drive, and maybe hopefully get back to the original receivers. And if the internet-down situation has been resolved, the recipients will already have their messages, but if not, they'll get them when the flash drive arrives.

I suppose this isn't complete without mentioning RFC 1149 (IP Datagrams on Avian Carriers).

https://www.rfc-editor.org/rfc/rfc1149
by GoatInGrey | 2026-01-13 22:45:15+00:00
If the person behind it pretends to have produced it themselves, or (this actually happened) put themselves in AI-generated photos with celebrity artists in their cover/album art, then I will sour on them and stop listening to their uploads.

This has only happened once. The rest of the time, I will be listening to a radio playlist as I work when a song comes on that makes me go "Wait a minute." Checking the song's cover art, clearly AI. Artist page? 30 singles in 2025, every one with AI cover art. The bio reads like a Suno prompt (and probably is). The uploader then gets tossed in the proverbial bin.

The above has been happening more and more often. To the point where it's about 30% of the songs I hear on the radio playlist, as of this week. I'm in the process of migrating over to Deezer as a consequence. They label AI-generated music and do not recommend them or include them in radio playlists.

Edit:
Not the exact same artist, but I searched a generic song name to find an AI slopper. This one AI-inserting himself into pictures with women for cover art is the same idea as the one putting himself in pictures with celebrities like Ariana Grande. https://music.youtube.com/playlist?list=OLAK5uy_kEPAFHKkMPF1...
by mrguyorama | 2026-01-13 22:45:19+00:00
It's so weird.

She's still convinced that woman boxer is secretly trans.

Or how the primary concern TERFs like her have is that men will dress up as women to rape them in the women's room, instead of what they do now, which is rape women including in places that are women's rooms.

It's fascinating (in a horrid way) what they consider important.

It's also fascinating how the person who wrote "Fight Fascists as a teenager" thinks is really important we eliminate a tiny subset of people from the population.
by 4k0hz | 2026-01-13 22:46:03+00:00
I'm not opposed to the idea of natural language search, my point is the tools should be on the user side. Right now, I can ask questions about plain text pages that haven't been updated in 30 years directly in Firefox with no effort from the site operator. If an agent needs to have direct access to documentation, it's trivial for it to download pages autonomously (or even set up its own MCP server). There's literally no reason to demand that millions of sites independently add features that browsers and agents already have better and more uniform versions of.
by jama_ | 2026-01-13 22:46:03+00:00
Actually, in my recent vibe coding adventures I tested making a ProRAW converter app that also applied the included gain map to the image and encoded via libjxl on device. Surprisingly, Photos.app was able to display the converted image with HDR, but the HDR tag in the UI is only displayed for images with the proprietary gain map.

There seems to be some support there, though I tested on iOS 26.
by nickthegreek | 2026-01-13 22:46:31+00:00
I don't find it fair, nor in good faith to claim my argument is lazy. By downloading the media of the artists who's behavior your find abhorrent, but who's art you enjoy (and you can separate the art from the artists), you can assure yourself to some degree that they are not receiving monetary gain. People who were interested in the Harry Potter game (but didn't want the author to finance) simply pirated the game. Roman Polanski, R Kelly, and many others artists are exploited in this fashion.

I do agree that the consumption of that media could very easily increase its cultural strength.

Even in your influencer example, there are ways to bring less traffic/ad views to that content while allowing some ability to consume. example here: https://libredirect.github.io/
by einsteinx2 | 2026-01-13 22:46:41+00:00
My very first job in tech I had a cubicle, but that was the only time. I’m also not a fan of open floor plans, but seems like they’re standard now. Feels like a “careful what you wish for” situation since everyone hated the idea of “cubicle farms” and wanted them gone (like the famous scene in Office Space), but somehow open floor plan is actually worse.
by abakker | 2026-01-13 22:46:55+00:00
People don't respect the salary premium software developers have received and expect relative to other creative, human endeavors.

You lay it out perfectly in your answer, and I'll add that the entire non-tech world generally feels that if tech jobs lose their shine due to AI, its actually a welcome reversion to the mean. Software has likely depressed wage growth in many other jobs.
by arjie | 2026-01-13 22:47:06+00:00
Someone convinced me last time[0] that these aren't the well-known scrapers we know but other actors. We wouldn't be able to tell, certainly. I'd like to help the scrapers be better about reading my site, but I get why they aren't.

I wish there were an established protocol for this. Say a $site/.well-known/machine-readable.json that instructs you on a handful of established software or allows pointing to an appropriate dump. I would gladly provide that for LLMs.

Of course this doesn't solve for the use-case where the AI companies are trying to train their models on how to navigate real world sites so I understand it doesn't solve all problems, but one of the things I think I'd like in the future is to have my own personal archive of the web as I know it (Internet Archive is too slow to browse and has very tight rate-limits) and I was surprised by how little protocol support there is for robots.

robots.txt is pretty sparse. You can disallow bots and this and that, but what I want to say is "you can get all this data from this git repo" or "here's a dump instead with how to recreate it". Essentially, cooperating with robots is currently under-specified. I understand why: almost all bots have no incentive to cooperate so webmasters do not attempt to. But it would be cool to be able to inform the robots appropriately.

To archive Metabrainz there is no way but to browse the pages slowly page-by-page. There's no machine-communicable way that suggests an alternative.

0: https://news.ycombinator.com/item?id=46352723
by whatsupdog | 2026-01-13 22:47:08+00:00
Understandable. But the question I don't see anyone asking, and I really want answered, is how will they identity? I'm not a good singer at all. Recently I wrote a song, uploaded the music to Suno and it created nice music and composition. I downloaded the individual layers of music, sent the vocal to another app that changed it to my voice. Put everything together and it sounds like me singing.
by tyre | 2026-01-13 22:48:10+00:00
Look at how people have responded to Rust. On the one hand, the learning curve for memory safety (with lifetimes and the borrow checker) can feel exhausting when moving from something like Ruby. But once you internalize the rules, you're generally cooking without it getting in your way and experiencing the benefits naturally.

Writing secure systems feels similar. If you're trying to back port something, as you said, it can be a pain in the ass. That includes an engineer's default behavior when building something new.
by neuroelectron | 2026-01-13 22:48:24+00:00
Going to miss you Clott Adams. Your self-depreciating humor is a benchmark we really need, especially in the black community, which to it's detriment, has been gassed up to the point were self-reflection is very difficult. Mysterious forces prefer it to be this way and despite us knowing that "black pride," like any kind of pride is a sin, it doesn't seem to be allowed to be addressed. Despite the internet building many places for such discussion, instead we get censorship in various forms including spam, bots, well poisoning, deboosting, filter bubbles, ineffective search, dark patterns, and so on.

A cyberattack targeting an oncology journal has taken it offline that published a peer-reviewed study from Tufts and Brown University exploring links of COVID injections to newly diagnosed or rapidly worsened cancer shortly after COVID injections. Did this have anything to do with your cancer? It doesn't seem like this kind of question is allowed to be entertained either.

In the early 2000s we would say that the Internet sees censorship as a network failure and routes around it. Now we see that was wishful thinking. The Network Effect prefers centralization and the government prefers subtle control and liability shields held by corporations.
by mscdex | 2026-01-13 22:48:30+00:00
On Linux, this is why I always turn to using abstract sockets when I only need local locking. Only one process can bind and the kernel cleans up automatically on process exit.

You could do the same thing with TCP/UDP, but abstract sockets give you more flexibility in naming with 108 characters vs. being forced to use a 16-bit integer. Also it means you aren't using up a port that could otherwise be used for actual network communication.

Abstract sockets also make for a nice process existence monitoring mechanism since any processes connected to the bound socket are guaranteed to be immediately notified when the process dies.
by ggm | 2026-01-13 22:49:17+00:00
It was fat finger memory. it was X10R3 or something similar, which I had previously used in UCL on Ultrix machines in the 80s. I don't think it was R5, I don't think much got upgraded in that space but .. it was a long time ago.

This was a SECOND HAND cray. It was a tax contra made in the 90s when Boeing sold a lot of stuff to the Australian Defence forces, and to avoid a massive tax burden donated science trash to the uni.
by ebiester | 2026-01-13 22:49:22+00:00
This post is talking about very small companies. At that 20+ person department, it's true. Once you have a team where the founder doesn't know everyone, the average matters a lot more.

If you have 15 people, you can hire 15 people and they will be able to organically organize if you hire well. If they have a question, they know what everyone is working on. The code base is small enough that everyone can just figure it out even if the documentation is bad.

The larger that group is, the more effort it takes to make sure everyone has the context they need to get their job done. That's where management matters.

And honestly, when I was the first manager (team of 17) brought in, I was writing code and on my own project in addition to starting to build up the "what do we need to do to scale?" You bring someone like me in at 17 people because you're going to need to scale soon and someone needs to build the first set of processes that solve the problems of the next stage, and figure out the onramp because done wrong, they make everything worse.
by glenstein | 2026-01-13 22:49:33+00:00
Look at what happened to Opera. They fell apart, abandoned their Presto engine for Chromium and sold to an outside investment group and now they serve ads based on user data.

There was, in my opinion, no better browser company past or present than Opera in the 2000s and 2010s (sorry Mozilla). But their example exposes the fallacy of assuming that building out great features guarantees market share gains.
by protocolture | 2026-01-13 22:50:01+00:00
>For Scott, like family, I’m a better person for the contribution.

This is the only issue I have with your statement.

I have a lot of favourite creators who are noteworthy for something bad or another. I like their stuff. The bad stuff doesnt particularly affect me. We get on fine. I read Howard and Lovecraft. I enjoy the heck out of them. I used to watch reruns of the Dilbert cartoon.

The issue here is sort of the implication that family is a net positive despite bad behaviours. Thats bs. Anyone who has had to push shitty assholes from their family isn't happy that they existed, or made better through their existence. Scott Adams is just a niche internet microcelebrity who made some funny comics and said some shitty things on his podcast. Blocking him is a lot easier than getting rid of an abusive family member, and his net effect on someone is going to be a lot lower.
by phil21 | 2026-01-13 22:50:50+00:00
Eh, this is just not proven true by observing what people do though.

When I lived in Europe for a couple months, my first time there I grocery shopped like an American - filled up an entire cart with a week or two worth of groceries and then everyone stared at me when I checked out.

It's absolutely true that Europeans who live in walkable cities go to the market to pick up groceries a few times a week. Americans simply do not, with very few exceptions.

The grocery store density is much higher though. There were at least 2 grocery stores within a 5 minute walk from anywhere I've stayed in a city core in Europe. At least a dozen within 15 minutes.

It's simply a difference in culture. There are plenty of places in the US where you could drive to half a dozen grocery stores within 15 minutes but people simply don't do so. The store sizes reflect this cultural difference too. The average grocery store in the US seems to be 4-6x larger than those in Europe.
by tac19 | 2026-01-13 22:51:04+00:00
If you think there is ever any other outcome for a democracy, you are part owner in what we built. Corruption and capture are inevitable, and blaming the particular politicians in power today, misses the point. They're only in power because at every step along the way, we the people happily swallowed beautiful lies in exchange for the "freebies" that trickled down to us.

If you imagine we just got unlucky with the _wrong_ people in power, you haven't yet learned the real lesson, and are doomed to support the entire thing continuing, or being reborn in new form.
by seanmcdirmid | 2026-01-13 22:51:09+00:00
> A good artist is just as expensive as a good programmer.

Let's look at industry, and just go look at what video game artists make compared to programmers with a similar amount of experience. Now, are you just claiming that they just aren't very good artists, so they aren't paid well? Because I've seen their work, and its not shabby at all.
by falloutx | 2026-01-13 22:51:42+00:00
Its not just AI scrappers doing it by themselves but now users are also being trained to put the link in the claude chat/chat gpt and ask it to summarise it. And off course that would show up on the website end as a scraper.

In fact firefox now allows you to preview the link and get key points without ever going to the link[1]

[1] https://imgur.com/a/3E17Dts
by benjiro | 2026-01-13 22:51:43+00:00
The problem is that people are horrible narrators about their own issues/past. They like to leave out critical information.

The idea of a company in the 80's going around that they are promoting Asians to positions over white people, sounds as far fetched as finding oil in my backyard. The reverse is way more likely in that time periode.

More then likely, he was not qualified for the job. But people often have a hard time accepting this, and feel entitled for position. Often by virtue of working somewhere longer. When passed over for promotion, then they create narratives its not themselves who is the issue, but it must be somebody else their fault.

So when you 20, 30, 40 years later tell the story, are you going to say "well, i was not qualified" or are you going to double down that you got passed over for a promotion, because "somebody had it out for me", or as "DEI hire" as that was the trending topic in conservative circles. What is a little lie to make yourself feel better, and have the world perceive you as the victim of horrible DEI hiring practices ... in the 80s!!!

If people think racism is rampaging today, they really did not live in the 80's... So yea, if it smell funny, you know there is bull.... involved.
by ineedasername | 2026-01-13 22:51:58+00:00
Why does an agent tasked with email summarizing have access to anything else? There’s plenty of difference between an agent and a background service or daemon but it’s at minimum got to be given the same restrictions in scope they would be, or an intern using your system for the same purpose. Developers need to bring the same ZTA mindset to agent permissions they would to building the other services and infrastructure they rely on.
by TeMPOraL | 2026-01-13 22:52:03+00:00
> Deeply unpredictable and unsafe people on a chip, so not the sort that I generally want to trust secrets with.

Very true when comparing to acquaintances, but at a scale of any company or system except the tiniest ones, you can't blindly trust people in general either. Building systems involving people and LLMs is pretty similar.

> I don't think it's that complex, you can have secure systems or you can have current gen LLMs. You can't have both in the same place.

That is, indeed, the key. My point is that, unlike the popular opinion in threads like this, it does not follow that we need to give up on LLMs, or that we need to fix the security issues. The former is undesirable, the latter is fundamentally impossible.

What we need is what we've been doing ever since civilization took shape, ever since we've started building machines: recognize that automatons and people are different kinds of components, with different reliability and security characteristics. You can't blindly substitute one for the other, but there are ways to make them work together. Most systems we've created are of that nature.

What people still get wrong is treating LLMs as "automatons" components. They're not, they're "people" components.
by Viren6 | 2026-01-13 22:52:04+00:00
I also work on Stockfish, that is not the reason. The reason is because the SF17.1 is functionally different, there is no way to get these to match without changing the net option to be the same as the stockfish binary.

See https://tests.stockfishchess.org/tests/view/69515c60572093c1...
and https://github.com/lichess-org/lila/pull/18671
by dagss | 2026-01-13 22:52:10+00:00
Nice to see HTTP API for consuming events.

I wish there was a standard protocol for consuming event logs, and that all the client side tooling for processing them didn't care what server was there.

I was part of making this:

https://github.com/vippsas/feedapi-spec

https://github.com/vippsas/feedapi-spec/blob/main/SPEC.md

I hope some day there will be a widespread standard that looks something like this.

An ecosystem building on Kafka clients libraries with various non-Kafka servers would work fine too, but we didn't figure out how to easily do that.
by iscoelho | 2026-01-13 22:52:20+00:00
VXLAN over WireGuard is acceptable if you require a shared L2 boundary.

IPSec over VXLAN is what I recommend if you are doing 10G or above. There is a much higher performance ceiling than WireGuard with IPSec via hardware firewalls. WireGuard is comparatively quite slow performance-wise. Noting Tailscale, since it has been mentioned, has comparatively extremely slow performance.
by array_key_first | 2026-01-13 22:52:35+00:00
Humans are humans, computer programs aren't. A computer program learning doesn't matter, and it's not comparable to human learning. I have no empathy, sympathy or any sort of allegiance to computer programs.

I would imagine the vast majority of other humans agree with me. I'm not just gonna betray humankind because some 1s and 0s "learned" how to write music. Who cares, it's silicon.
by 19-84 | 2026-01-13 22:52:39+00:00
I included a metadata dump of every subreddit found in the torrent. it includes a status field which will show of a subreddit is private along with a much more details

data catalog readme: https://github.com/19-84/redd-archiver/blob/main/tools/READM...

reddit data: https://github.com/19-84/redd-archiver/blob/main/tools/subre...
by JohnFen | 2026-01-13 22:52:40+00:00
> I feel like this needs diagrams.

And there's the problem.

All of that stuff is well and good, but it seems like I have to have a fair degree of knowledge and technical skill, not to mention time and effort, to confirm that everything is as they're representing. And it's time and effort I'd have to expend on an ongoing basis.

That's not an expectation I could realistically meet, so in practice, I still have to just trust them.
by pixl97 | 2026-01-13 22:52:50+00:00
Some of the AI applications may sign the data in a purposefully detectable way.

Other than that no idea.

With this said, this may be more of a reason to get rid of the AI trash slop that scammers use to attempt to make money, gum up the platform with, and not actually ban people that make decently good AI based songs.
by tombert | 2026-01-13 22:52:55+00:00
> I generally like to enjoy a good book, movie, blog, or comic strip without letting politics get in the way.

It's certainly easier once they're dead. I can't speak for everyone, but part of the issue is that we don't want to financially support anyone who is doing bad stuff, so once they're dead I don't have to worry about funding them.

Hyperbolic example; suppose David Duke wrote a fantasy novel. Let's even assume that this fantasy novel had nothing to do with race or politics and was purely just about elves and gnomes and shit. Let's also assume that the novel is "good" by any objective measure you're like to use.

I would still not want to buy it, because I would be afraid that my money is going to something I don't agree with. David Duke is a known racist, neo-Nazi, and former leader of the KKK, and if I were to give him cash then it's likely that some percentage of this will end up towards a cause that I think is very actively harmful.

Now, if you go too deep with this, then of course you can't ever consume anything; virtually every piece of media involves multiple people, often dozens or even hundreds, many of which are perfectly fine people and some of which are assholes, so unless you want to go live in a Unabomber shack then everything devolves into my favorite Sonic quote [1].

So you draw a line somewhere, and I think people more or less have drawn the line at "authorship".

[1] https://www.reddit.com/media?url=https%3A%2F%2Fexternal-prev...
by nextos | 2026-01-13 22:52:59+00:00
Well, you have many options. Given that you seem to have a good publication record, I'd expect a couple of offers after making 5 or 10 applications.

If you are a good programmer, avoiding areas that are too hot (e.g. ML) and focusing on things that can make best use of your skills (e.g. compilers, verification) could be a good idea.

Research assistant positions are also great a backdoor to PhD offers, in case you are interested in that.
by joe_mamba | 2026-01-13 22:53:11+00:00
Which is why I dislike the GDP being thrown around in discussions as the ultimate dick measuring metric. High economic value activities don't translate or don't trickle down into high social value environments.

For example, I went to visit SF as young lad and I was expecting to be blown away given the immense wealth that area generates, but was severely disappointed with what I saw on the street. I used to think my home area of Eastern Europe is kind of a shithole, but SF beats that hands down. Like there's dozens of places on this planet that are way nicer to live in than SF despite being way poorer by comparison.