MurphyA/hacker-news huggingface dataset:
by BeetleB | 2025-09-30 19:15:56+00:00
In other words, this is exposing a long standing flaw in journalism. I know things are super polarized now, but even 20 years ago, when mentioning a Congressperson regarding a particular social problem, they would specify if he was a Democrat/Republican.

I really don't need to know which party he is part of. If the article was about a party's stance, it makes sense - but the article is about one politician.
by pixl97 | 2025-09-30 19:16:02+00:00
I mean yes, if you have a large well funded company that brings profit to said country that is how common law works.

In the US for example if you happen to bring gambling funds to some other country from us citizens you will be arrested in very creative ways while not even getting close to the US.

At the end of the day all law is what the government wants to do and can get away with. When it comes to not actual citizens of the country they tend to get away with a whole lot more. Or another more simple way to put it, "You can beat the wrap, but you can't beat the ride".
by dwa3592 | 2025-09-30 19:16:22+00:00
I don't know if it's just me or other people are feeling it as well. I don't enjoy videos anymore (unless live sports). I don't enjoy reading on my monitor anymore, I have been going back to physical books more often. I am in my early thirties.

The point is that sora2 demo videos seemed impressive but I just didn't feel any real excitement. I am not sure who this is really helping.
by zozbot234 | 2025-09-30 19:16:28+00:00
The "philosophical questions" dividing formalism from constructivism are greatly overstated. The point of having those degrees of undecidability or uncountability is precisely to be able to say things like "even if you happen to be operating under strong additional assumptions that let you decide/count X, that still doesn't let you decide/count Y in general." That's what formalism is: a handy way of making statements about what you can't do constructively in the general case.

To be fair, constructivists tend to prefer talk about different "universes" as opposed to different "sizes" of sets, but that's all it is: little more than a mere difference in terminology! You can show equiconsistency statements across these different points of view.
by trinsic2 | 2025-09-30 19:16:29+00:00
Im sorry, if you run a site some where not in the UK. It doesn't give the country jurisdiction over the entire internet.

If a country wants to enforce some kind of rules, they will have to apply them to the countries residents, because its the resident that go out on the net and conduct the behavior, not the other way around.

This has been common sense for a long time now. Everybody is going crazy/mad. Must be some seriously narcissistic people running the UK.
by sxzygz | 2025-09-30 19:16:34+00:00
I don’t think you’re remotely correct, but I also don’t know how to dispute your ignorance in any useful way.

To @esafak I suggest following @westurner’s post.

I like the concept of Stable Manifolds. Classifying types of them is interesting. Group symmetries on the phase space are interesting. Explaining this and more is not work I’m prepared to do here. Use Wikipedia, ask ChatGPT, enrol in a course on Chaos and Fractal Dynamics, etc.
by therobots927 | 2025-09-30 19:16:35+00:00
These guys with 4.0 sharpe ratios at 5M AUM… are they running algos and if so at what time frame? I’m assuming building out the data / execution infra for that is expensive, not to mention the compute and storage power required to identify market inefficiencies after you have the infra built. You’re looking at a pretty significant upfront investment for that.
by ashivkum | 2025-09-30 19:17:24+00:00
Given that Orion (which I repeatedly attempt to daily drive due to the dearth of browsers meeting my requirements right now on macos) is still full of bugs that hamper usability, and seems to introduce new ones with every update, I don't know why Kagi insists on overextending itself like this. They just started porting their broken browser to Linux, they're creating a maps app, all while they clearly do not have the manpower to finish the projects they've already started.
by hinkley | 2025-09-30 19:17:30+00:00
My yard stick is discoverability. If you don’t touch things for a while they get fuzzy, and someone might have refactored it. So you need to be able to familiarize yourself with bits of the code you haven’t looked at recently. Helps with code reviews, onboarding, and production outages.

In particular it’s difficult to train new people to take up on-call duties if they cannot sit in the corner of the room and try either the same things you’re trying or their own pet theories without taking your attention or interfering with your tests. They need to be able to hear the repro steps and spool up their own snapshot in a similar state. That scales. Gatekeepers do not. Discoverability is necessary but insufficient to achieve this. There’s more to it but the foundation is discoverability and reproduceability.
by drivers99 | 2025-09-30 19:17:31+00:00
A paragraph or more with a personal story or example(s) for each item would make it more relatable and understandable. I'm curious about "I know that flow states are very similar to manic states." Or like for #1, what are some examples of "[setting] up your life in such a way that effort feels rather effortless"? Edit: the one about shoes was a good example. I has a bit about helping your back that explains why you say that.
by poisonarena | 2025-09-30 19:17:32+00:00
>The music industry already went through this with AutoTune and we know how that turned out.

they use it, everyone uses it, it got better to the point where most people dont know its used, ever heard of melodyne? well AI made it even better.

And then there has been about 20 years of people using it even as their style of music, notably in hip hop, reggaeton, urbano, country, etc.

Boomers like to think it was just an annoying fad in 2008-2011 or something, but it never went away, now everyone uses it, whether obvious or not
by antonvs | 2025-09-30 19:17:40+00:00
You can typically address that with a system prompt, so you don't have to mention your expectations every time.

If you're using one of the coding agents like Claude Code or Gemini CLI, you should have a .md file (e.g. CLAUDE.md) for your project which contains those kinds of instructions, and any other useful context for the project.

https://www.anthropic.com/engineering/claude-code-best-pract...
by DavideNL | 2025-09-30 19:18:00+00:00
Yup, i quit Proton (Mail) for the same reason. I had been using it for a long time… There are so many little bugs and annoyances, it’s frustrating to see new features being released all the time while obvious bugs and shortcomings are not fixed.

It was a very big relief going back to a normal email client.

I still support Proton (i pay for Proton VPN) and hope they will succeed in their mission.
by cosmic_cheese | 2025-09-30 19:18:13+00:00
Windows doesn't do it any favors, for sure. Running Linux with with every tweak under the sun for better life still leaves a large gap between x86 laptops and MacBooks, however, and while there's probably some low hanging optimization to be taken advantage of there I think the real problem is that x86 CPUs just can't idle as low as M-series can, which is exacerbated by the CPU not being able to finish up its work and reach idle as quickly.
by alphazard | 2025-09-30 19:18:22+00:00
The biggest hiring hack for junior engineers is to hire the ones that have already been programming for a decade, and are called "junior" because they recently graduated university.

The junior/senior language is corporate-speak to equate everyone's value to "years of service" in industry or at a company. Obviously that's not how competency works, and if you are serious about hiring competent people, you should mostly ignore it. It's useful for listings, it is common terminology after all, but it's not semantically or descriptively useful.
by dcastm | 2025-09-30 19:18:38+00:00
Hey OP, I found some issues with your code:

During SFT, it uses the full training dataset[1]:

df = pd.read_csv('data/extraction_training_data.csv')

And during the evaluation, it uses the middle part of the same dataset[2]:

df = pd.read_csv('data/extraction_training_data.csv')

df = df[100000:100000+NUM_TEST_SAMPLES]

Also, you split train/test/val by chunk and not by document[3]. Then, the model "has seen" the documents that you're using to evaluate it (even if you're not evaluating it on the same chunks).

[1]: https://github.com/herniqeu/extract0/blob/0f8696a6fb1b620658...

[2]: https://github.com/herniqeu/extract0/blob/0f8696a6fb1b620658...

[3]: https://github.com/herniqeu/extract0/blob/0f8696a6fb1b620658...
by Hoodedcrow | 2025-09-30 19:18:42+00:00
When it comes to age verification - I still don't understand how you'd make it subpoena-proof? Like, the ones I've seen proposed protect you from the site itself getting more data than it should. But what about a government agency subpoenaing the website to see what credential this account was verified with and then comparing with the age-assuring agency's logs?..
by echelon | 2025-09-30 19:18:44+00:00
I'm a software engineer and hobbyist actor/director. My friends are in the film industry and are in IATSE and SAG-AFTRA. I've made photons-on-glass films for decades, and I frequently film stuff with my friends for festivals.

I love this AI video technology.

Here are some of the films my friends and I have been making with AI. These are not "prompted", but instead use a lot of hand animation, rotoscoping, and human voice acting in addition to AI assistance:

https://www.youtube.com/watch?v=H4NFXGMuwpY

https://www.youtube.com/watch?v=tAAiiKteM-U

https://www.youtube.com/watch?v=7x7IZkHiGD8

https://www.youtube.com/watch?v=Tii9uF0nAx4

Here are films from other industry folks. One of them writes for a TV show you probably watch:

https://www.youtube.com/watch?v=FAQWRBCt_5E

https://www.youtube.com/watch?v=t_SgA6ymPuc

https://www.youtube.com/watch?v=OCZC6XmEmK0

I see several incredibly good things happening with this tech:

- More people being able to visually articulate themselves, including "lay" people who typically do not use editing software.

- Creative talent at the bottom rungs being able to reach high with their ambition and pitch grand ideas. With enough effort, they don't even need studio capital anymore. (Think about the tens of thousands of students that go to film school that never get to direct their dream film. That was a lot of us!)

- Smaller studios can start to compete with big studios. A ten person studio in France can now make a well-crafted animation that has more heart and soul than recent by-the-formula Pixar films. It's going to start looking like indie games. Silksong and Undertale and Stardew Valley, but for movies, shows, and shorts. Makoto Shinkai did this once by himself with "Voices of a Distant Star", but it hasn't been oft repeated. Now that is becoming possible.

You can't just "prompt" this stuff. It takes work. (Each of the shorts above took days of effort - something you probably wouldn't know unless you're in the trenches trying to use the tech!)

For people that know how to do a little VFX and editing, and that know the basic rules of storytelling, these tools are remarkable assets that compliment an existing skill set. But every shot, every location, every scene is still work. And you have to weave that all into a compelling story with good hooks and visuals. It's multi-layered and complex. Not unlike code.

And another code analogy: think of these models like Claude Code for the creative. An exoskeleton, but not the core driving engineer or vision that draws it all together. You can't prompt a code base, and similarly, you can't prompt a movie. At least not anytime soon.
by SleepyWalrus | 2025-09-30 19:19:33+00:00
How are you approaching this? I assume it's some combo of unit tests and integration tests where you are making sure the response is generally consistent across multiple runs of the same prompt - or if you need to change the prompt to make sure the result was the same as before.

From what i've seen using LLMs, your best bet is to have evals for 100ish (if possible) examples with know ground truths. This way you will statistically get results of how accurate your LLM prompt is working. Having more examples will help increase the precision when hallucinations come in.

Unfortunately things get a little harder with qualitative responses, where you are expecting certain words or sentences in the response. Your best bet here is to also have 100 examples of what you expect the response would be and a form of semantic similarity comparison between the response and your ground truth.
by mithr | 2025-09-30 19:19:52+00:00
I agree with some aspects, and think the author perhaps misunderstood some others.

> If I collect 100 XP, what does it mean for my language skills? For that matter, why do I collect extra XP when I receive a potion? Can the XP I collect be used in a way to carefully guide me towards the specific language skills I would explore next?

Using XP to guide the user towards a particular path is an idea, but it's just not one that Duolingo uses. The purpose of XP in Duolingo is simpler: people like numbers to go up, so they get XP for using the app. It also enables an ecosystem of rewards; I'm generally not a competitive person, and there have still been days where I took a few more Duolingo lessons because I was close to completing a "daily challenge".

Similarly, friend streaks, leaderboards, etc, all have innately appealing hooks. They won't all appeal to everyone all the time, but one of them will appeal to someone some of the time. If they get you to practice for 5m a day more than you would've otherwise, I think they've served their purpose.

Broadly, I agree with other comments about expectation management and time commitment. Could you get yourself to a solid level of understanding in a new language only by using Duolingo? Possibly, but you'd need a lot of dedication and hard work, and much more than 5m a day. If you really wanted to learn a language, and had the time, there are much more effective ways to get there.

Duolingo isn't really built towards encouraging that kind of intense learning, because they know most people who download the app are looking for a bite-sized learning experience, and are willing to accept bite-sized results in return. For myself, I can say that after a couple of years of leaning Spanish on Duolingo, with no previous experience in the language, and an average effort of probably ~10m a day (many days less, some days more), I can read texts if they aren't too complex, follow a casual conversation, and communicate basic things. That's way more than I would've been able to do if I wasn't using the app.
by VSerge | 2025-09-30 19:19:58+00:00
Wouldn't you know whether a teacher is reliable or not? If reliable, they probably have this reputation also because they can also say when they don't know something. And if you found out a given teacher isn't reliable, you'd be careful about what they say next - or you would just ask someone else.

The problem here is for a child to be thinking this system is reliable when it is not. For now, the lack of reliability is obvious as chatGPT hallucinates on a very regular basis. However, this will become much harder to notice if/when chatGPT will be almost reliable while saying wrong things with complete confidence. Should such models be able to say reliably when they don't know something, this would be a big step for this specific objection I had, but it still wouldn't solve the other problems I mentioned.
by hitekker | 2025-09-30 19:20:03+00:00
Andy Grove, Steve Job's friend (if not mentor), agreed:

"Not only did we lose an untold number of jobs, we broke the chain of experience that is so important in technological evolution. ....abandoning today’s 'commodity' manufacturing can lock you out of tomorrow’s emerging industry." https://www.zdnet.com/article/us-high-tech-manufacturing-bas...

No one listened to him, certainly not Intel.
by thegrim33 | 2025-09-30 19:20:03+00:00
Ah, a person whose technical assessment I just can't believe at all. I notice their blog also posts all their socials, including a Bluesky. What do I see in their latest 10 posts? Stereotypical sociopolitical hate farming about Israel, immigration, capitalism, etc. Yup .. all checks out - person with crazy technical beliefs is pretty off the rails across the board.
by minimaxir | 2025-09-30 19:20:42+00:00
The livestream showed an interesting UX with Facebook-style permissions that make it so you very explicitly have to opt into this feature: https://bsky.app/profile/minimaxir.bsky.social/post/3m22zg2h...

Even moreso than Facebook tags, the person being cast can cause the deletion of the source video at any time.
by unethical_ban | 2025-09-30 19:20:44+00:00
I just had a thought: (spoilers Expanse and Hyperion and Fire Upon the Deep)

Multiple sci-fi-fantasy tales have been written about technology getting so out of control, either through its own doing or by abuse by a malevolent controller, that society must secer itself from that technology very intentionally and permanently.

I think the idea of AGI and transhumanism is that moment for society. I think it's hard to put the genie back in the bottle because multiple adversarial powers are racing to be more powerful than the rest, but maybe the best thing for society would be if every tensor chip disintegrated the moment they came into existence.

I don't see how society is better when everyone can run their own gooner simulation and share it with videos made of their high school classmates. Or how we'll benefit from being unable to trust any photo or video we see without trusting who sends it to you, and even then doubting its veracity. Not being able to hear your spouse's voice on the phone without checking the post-quantum digital signature of their transmission for authenticity.

Society is heading to a less stable, less certain moment than any point in its history, and it is happening within our lifetime.
by ryanrasti | 2025-09-30 19:20:50+00:00
Thanks for the great points and link to SafeQL! I'm a big fan of its approach to bringing type safety to raw SQL strings. For static queries, it's a fantastic solution.

My take is that while "Just use SQL" is healthy pushback against heavy ORMs, a good query builder solves two fundamental problems that raw SQL can't in the application context:

1. Dynamic composition: A query builder is the macro system that SQL is missing. The moment you need to build a query programatically (e.g., conditional filters or joins) you're left with messy/unsafe string concatenation

2. Handling Relations (and other common patterns): Using raw SQL, a complex query with JOINs returns a flat list of rows that now becomes the application's job to properly denormalize. It greatly reduces cognitive load to think in terms of relations, not just join conditions.

Again, showing is stronger than telling. To illustrate, I'd urge you to go through the first couple of examples in the playground and think about how you'd express them (e.g., the composability of the "example1" query) in something like SafeQL: https://typegres.com/play/
by yupyupyups | 2025-09-30 19:21:37+00:00
I actually did, but admittedly it was maybe 4 years ago. Brave vs Firefox. Brave gave the fingerprinter a lot of information about my hardware including the exact model of my GPU, while Firefox did not.

I think I wrote some report at one time about this issue, so it was a bit more than just surface level testing. Chromium was always a disapointment whenever I attempted a comparison.

I think a more fair comparison would be today's Brave vs some hardened Firefox such as Librewolf, Mullvad Browser or even Tor Browser. Because the issue is not how vanilla Chromium or Firefox perform, but how well they can be hardened in practice.

Worth noting is that Brave does better when it comes to compatibility, because it leaves WebGL and other APIs enabled, while something like Tor Browser will disable those for privacy reasons. It hints at different priorities between these projects.
by unethical_ban | 2025-09-30 19:21:39+00:00
I just had a thought: (spoilers Expanse and Hyperion and Fire Upon the Deep)

Multiple sci-fi-fantasy tales have been written about technology getting so out of control, either through its own doing or by abuse by a malevolent controller, that society must sever itself from that technology very intentionally and permanently.

I think the idea of AGI and transhumanism is that moment for society. I think it's hard to put the genie back in the bottle because multiple adversarial powers are racing to be more powerful than the rest, but maybe the best thing for society would be if every tensor chip disintegrated the moment they came into existence.

I don't see how society is better when everyone can run their own gooner simulation and share it with videos made of their high school classmates. Or how we'll benefit from being unable to trust any photo or video we see without trusting who sends it to you, and even then doubting its veracity. Not being able to hear your spouse's voice on the phone without checking the post-quantum digital signature of their transmission for authenticity.

Society is heading to a less stable, less certain moment than any point in its history, and it is happening within our lifetime.
by cesarb | 2025-09-30 19:21:50+00:00
> Applications do not talk to the filesystem directly,

Sometimes, they do. For instance, BTRFS_IOC_CLONE to do a copy-on-write clone of a file's contents (now promoted to other filesystems as FICLONE, but many other ioctl operation codes are still btrfs-specific; and other filesystems have their own filesystem-specific operations).
by susam | 2025-09-30 19:21:57+00:00
This article explores a particular kind of abstractness in mathematics, especially the construction of numbers and the cardinalities of infinite sets. It is all very interesting indeed.

However, the kind of abstractness I most enjoy in mathematics is found in algebraic structures such as groups and rings, or even simpler structures like magmas and monoids. These structures avoid relying on specific types of numbers or elements, and instead focus on the relationships and operations themselves. For me, this reveals an even deeper beauty, i.e., different domains of mathematics, or even problems in computer science, can be unified under the same algebraic framework.

Consider, for example, the fact that the set of real numbers forms a vector space over the set of rationals. Can it get more abstract than that? We know such a vector space must have a basis, but what would that basis even look like? The existence of such a basis (Hamel basis) is guaranteed by the axioms and proofs, yet it defies explicit description. That, to me, is the most intriguing kind of abstractness!

Despite being so abstract, the same algebraic structures find concrete applications in computing, for example, in the form of coding theory. Concepts such as polynomial rings and cosets of subspaces over finite fields play an important role in error-correcting codes, without which modern data transmission and storage would not exist in their current form.
by currymj | 2025-09-30 19:22:15+00:00
sign languages are completely different languages from spoken languages, with their own grammar etc.

subtitles can work but it's basically a second language. perhaps comparable to many countries where people speak a dialect that's very different from the "standard" written language.

this is why you sometimes have sign language interpreters at events, rather than just captions.

there's not really a widely accepted written form of sign language.
by pixl97 | 2025-09-30 19:22:22+00:00
This here should trigger a red flag when you hear anyone say "The government should be run like a business".

Businesses kill themselves all the time from the loss of institutional knowledge. We see stuff like "government spends X a year paying people Y to build almost no product Z". Instead, we're paying people Y to be ready to build Z when something goes terribly wrong like war.