MurphyA/hacker-news huggingface dataset:
by snthpy | 2025-04-23 21:41:25+00:00
Nice post and I very much agree!

In fact I tried to make some similar points in my CMU "SQL or Death" Seminar Series talk on PRQL (https://db.cs.cmu.edu/events/sql-death-prql-pipelined-relati...) in that I would love to see PRQL (or something like it) become a universal DSL for data pipelines. Ideally this wouldn't even have to go through some query engine and could just do some (byte)codegen for your target language.

P.S. Since you mentioned the Google Pipe Syntax HYTRADBOI 2025 talk, I just want to throw out that I also have a 10 min version for the impatient: https://www.hytradboi.com/2025/deafce13-67ac-40fd-ac4b-175d5... That's just a PRQL overview though. The Universal Data Pipeline DSL ideas and comparison to LINQ, F#, ... are only in the CMU talk. I also go a bit into imperative vs declarative and point out that since "pipelining" is just function composition it should really be "functional" rather than imperative or declarative (which also came up in this thread).
by parasubvert | 2025-04-23 21:41:32+00:00
It didn’t bomb in the market. It was priced for supply constraints. They basically tied Meta on all headset revenue in its first year (450k units and $1.4 billion). visionOS is a triumph and foundation for the next decade of computing, and the entire product line of Apple is adapting to its look and feel. The entire XR / VR industry is changing their strategy to respond to visionOS , particularly Meta horizon OS which has incorporated numerous improvements that were directly inspired by Apple. And plenty of Apple products sold a lot less than 10 million annually to this day.
Show HN: Fast and Quality Code Chunking with Chonkie
by snyy | 2025-04-23 21:41:53+00:00
Hi HN,

We’re Chonkie (https://github.com/chonkie-inc/chonkie) — we build open source tools that help split documents into meaningful chunks for use with AI models.

When you use LLMs over large documents or codebases, you often need to break them into smaller parts to fit the model’s context window. Our chunkers do this in a smart way: they preserve structure and meaning, so only the most relevant pieces are passed into the model. This reduces hallucinations, avoids confusion, and improves performance and accuracy.

Today we’re launching our Code Chunker — a fast, structure-aware way to break down source code into high-quality, token-aware chunks.

How it works:

(See the code: https://github.com/chonkie-inc/chonkie/blob/main/src/chonkie...)

Code Chunker uses tree-sitter (https://tree-sitter.github.io/tree-sitter/) to parse your code into an abstract syntax tree (AST). It then recursively merges and groups nodes in a way that respects both code structure and token limits.

It supports all languages that tree-sitter supports, and is designed to preserve formatting and semantics. Large functions or class definitions won’t be split in the middle of a block — instead, we dive recursively into the AST to produce clean, coherent chunks that fit your configured token budget.

What it’s useful for:

- Embedding-based code search - RAG (retrieval-augmented generation) over codebases - Long-context analysis of code - Preparing repos for fine-tuning or pretraining

Try it out:

- Open source package: https://docs.chonkie.ai/chunkers/code-chunker - Hosted playground (free with account): https://cloud.chonkie.ai

Happy Chonking!
by dang | 2025-04-23 21:42:37+00:00
Could you please stop posting unsubstantive comments and flamebait? You've unfortunately been doing it repeatedly. It's not what this site is for, and destroys what it is for.

If you wouldn't mind reviewing https://news.ycombinator.com/newsguidelines.html and taking the intended spirit of the site more to heart, we'd be grateful.
by nativeit | 2025-04-23 21:43:05+00:00
> On February 6, someone posted a lengthy and detailed critique of Elez’s code on the GitHub “issues” page for async-ip-rotator, calling it “insecure, unscalable and a fundamental engineering failure.”

“If this were a side project, it would just be bad code,” the reviewer wrote. “But if this is representative of how you build production systems, then there are much larger concerns. This implementation is fundamentally broken, and if anything similar to this is deployed in an environment handling sensitive data, it should be audited immediately.”
by assassinator42 | 2025-04-23 21:43:11+00:00
No you don't, MinGW(-w64) targets windows directly (with MinGW statically linked in). I've built a Windows->Linux cross-compiler that depends solely on DLLs built-in to Windows (kernel32.dll, MSVCRT.dll, and user32.dll).

Granted that was hundreds of hours, some patches (only 8 lines though), and probably a bit of masochism.

I did of course need MSYS2 command line utilities like make and bison to run the GCC configuration/make scripts. Although we use the mingw32 version of make along with the cross-compiler which also has no other dependencies (it uses cmd.exe as a shell if you don't have a bash.exe in your PATH).
by phtrivier | 2025-04-23 21:43:28+00:00
> I’ve been asking for years here and nobody has made a solid argument to me how Facebook has a monopoly in anything or how a social networking monopoly even could exist. It’s a competitive market out there. Some of their competitors are on the DMA’s hit list too.

This seems pretty convincing to me, given that Meta owns Facebook, Instagram and Whatsapp: [1]

> Facebook leads the pack with 3.04 billion users, maintaining its position as the most extensive social networking site globally. > YouTube follows with 2.5 billion users, reinforcing its status as the premier platform for video sharing and consumption. > WhatsApp and Instagram are tied in the third position, each with 2 billion users. WhatsApp is renowned for its messaging services, while Instagram is a favorite for photo and video sharing. > TikTok, with 1.5 billion users, rounds out the top five, showcasing its rapid rise as a leading platform for short-form video content.

In terms of social media, the only "competitor" at the same scale as facebook is tiktok and snap.

We might leave in the bubble that uses twitter, bluesky, reddit, etc... but their small relative to the blue site, for better or for worse.

Break up Meta into differents, apps, and suddenly the monopoly becomes much less obvious.

> and it’s a fairly neutral principle to state that “murder is intolerable in our society”.

Do you mean it's "neutral" because there is no "arbitrage" in deciding if someone is a murderer ?

Or that the principle behind it is universal ?

In this case, is it still "neutral" once your start talking about, say, self defense ? death penalty ? assisted suicide ? war times ? (or, if you're going to stretch it a lot, abortion ?) I'm not bringing it to say there is an equivalence, I'm saying you _will_ have people making the equivalence, and different people will disagree. It's called principles - no law say they have to be universal, and they're usually not.

[1] https://prioridata.com/data/social-media-usage/#Social_Media...
by otterley | 2025-04-23 21:43:37+00:00
As a former student of the author, I don't think he's saying they should be able to avoid jurisdiction. I think he was musing on whether it would even be possible under this new Ninth Circuit framework/test. He concludes it's unlikely, and hence for Shopify (or any other company putting cookies in browsers) to have any chance of avoiding it, they're going to have to appeal to SCOTUS.
by bri3d | 2025-04-23 21:43:57+00:00
I tried this with clang ASAN. Nothing happens. It won't catch this bug. ASAN detects the presence of incorrect behavior, not the absence of correct behavior.

There's no use-after-free, use-after-return, use-after-scope, or OOB access here. It's a case of "an allocated stack variable is dynamically read without being initialized only in a runtime case," which afaik no standard analyzer will catch.

The best way to identify this would be to require all locals to be initialized as a matter of policy (very unlikely to fly in a games studio, especially back then, due to the perceived performance overhead) or to debug with a form of stack initialization enabled, like "-ftrivial-auto-var-init=pattern" which while it doesn't catch the issue statically, does make it appear pretty quickly in QA (I tested).
by permo-w | 2025-04-23 21:44:18+00:00
the Mail app has its own massive issues. for whatever reason it is completely unable to just background sync and notify you immediately when you get an email. why is every messaging app able to do this instantaneously but email is not?

also their new default-on email classification system is a fucking nightmare and I was so glad when I figured out you can turn it off

plus why do my email drafts load in oldest first?
by parasubvert | 2025-04-23 21:44:23+00:00
They had about 450 K units in the wild in the first year. They will sell around 600 K units of the first version until the second one is released later this year. This was on a potential production target of 900 K units. So it’s not exactly a failure so much as an underperform due to them over pricing it for supply constraints.

VisionOS is clearly a triumph and the basis of UX for their entire product line. The scepticism is gonna age like those who were sceptical about the original Mac and Windows. Vision Pro isn’t even all that expensive by historical standards.
by dmonitor | 2025-04-23 21:44:50+00:00
I can see the appeal of "colonizing mars as an extinction-proof backup plan", but I'm not convinced that it's a positive-EV play. Attempting to go to mars increases odds of our survival in case of earth going to shit by some amount, but it also increases the odds of earth going to shit due to the waste, energy expenditure, and missed opportunity cost of not solving pressing issues.
by growdark | 2025-04-23 21:45:00+00:00
>Ge0rg3’s code is “open source,” in that anyone can copy it and reuse it non-commercially.

A little nit-picking, but that's not what open source means, especially as it relates to the GPL in this case. If you can't use the code commercially, it's neither "open source" (as defined by OSI) nor free software (as defined by the FSF).
by coderenegade | 2025-04-23 21:45:07+00:00
I think this is correct, especially the part about how we actually do modelling. The topological naming problem is really born from the fact that we want to do operations on features that may no longer exist if we alter the tree at an earlier point. An AI model might find it easier to work directly with boolean operations or meshes, at which point, there is no topological naming problem.
by J_McQuade | 2025-04-23 21:45:09+00:00
Oh wow, just had to log in and give you a high-five for livelove because this is the first I've heard of it and it sounds like the sort of thing I absolutely need to try out.

I remember giving Love2D a go a couple of years ago with Fennel and the lack of such a thing sent me grumbling back to Common Lisp. I'd never even have thought of building that functionality in Love/Lua myself - assuming it's something that the runtime just didn't support - and it absolutely would never have occurred to me to use LSP to set it up. I've not even used it yet and it's already doing things to my brain, so thanks!
by jiggawatts | 2025-04-23 21:45:13+00:00
This is much ado about nothing. The article tries to very hard to make something ordinary sound nefarious.

This appears to be DOGE employees simply doing their job.

You may not agree with what they’re doing in a political sense, but if you were tasked with the same problem you’d come up with a nearly identical solution.

For example: “tenant admin” is probably the special role that can bypass access control (not audits!) and see and read all data.

This sounds scary but I regularly request this right from large government departments and I get it granted to me.

Its use is justified when normal access requests would be too complex / fiddly and error prone. Generally, in a large environment, there is no other way to guarantee 100% coverage because as an outsider you don’t even know what permissions to ask for if you can’t see anything due to a lack of permissions!

Seriously: sit down for a second and think about how you would go about getting access to make a full copy of an organisation’s data for an audit if you fully expect both passive resistance and even active efforts to hide the very things you’re looking for.
by mrguyorama | 2025-04-23 21:46:17+00:00
This is rhetorical sleight of hand.

There is no physical force in the universe that causes words written on a government letterhead to mean anything. The exact same government that granted you "inalienable rights" will ignore them when it's corrupted.

There is no way to construct a government such that it CANNOT execute a minority if enough people want that to happen.

The only answer, as it has always been, is to ceaselessly, diligently, and without fail, never vote in people like Trump.

Unfortunately, the republican party has spent every single moment since Nixon's resignation ensuring that the party would never let that kind of thing stop them again.
by AStonesThrow | 2025-04-23 21:46:43+00:00
When I worked for an ISP in the early 90s, we were just getting accustomed to real DNS domain names being rather ubiquitous and properly distributed.

My supervisor (who became an avid venture capitalist/angel investor) burst into the NOC one day to crow about having purchased “sex.org” and he knew damn well he would never use it; he was just getting in on the speculation.

Anyway, we had a real customer you may know as 3M. Now most companies are pleased to register a quite readable and recognizable domain name that evokes their company, and so you can perhaps imagine how miffed 3M’s execs were, when they found out that “3M.COM” was literally illegal under IETF standards!

Now I was also forced to imagine this, because I certainly was never privy to such meetings or the decision process, but the outcome was plain for all to see:

3M chose to register the domain name “mmm.com” and so for many, many years at the dawn of the Information Age, their public-facing domain and brand was a wry comment on the narrow shortsightedness of Internet standards, and clever ways to get around them.
by gjsman-1000 | 2025-04-23 21:46:53+00:00
That's not happening. Everything that comes with a computer could be possibly construed as anti-competitive. Even the Start Menu - after all, if Start11 and StartIsBack exist, why should Microsoft have the right to ship their own start menu? How about calculators (Desmos)? The system that puts maximize, minimize, and close on windows (after all, WindowBlinds exists)? The login screen (LogonStudio)? What about the Task Manager (Process Explorer)? File Explorer (Total Commander)? The Media Player (VLC)? The PDF viewer (unfair competition against Adobe!)?

I agree that at some point, it crosses a line. Perplexity is nowhere near powerful or influential enough to cross that line.
by tokioyoyo | 2025-04-23 21:46:57+00:00
Don’t agree with the OP how it’s fun to watch, but you have to acknowledge how citizens of basically every other country feel after being made fun of for the past few months. I have close relatives living in the states, and I feel bad for them. But your own government has been belittling your neighbours across both of your borders and calling them weak. I’m not going to say that the government does not deserve some of the repercussions of their own actions.
by smj-edison | 2025-04-23 21:48:06+00:00
Replying to your edit: it is relevant, because it means people are trying but it isn't working. When people aren't trying, you have to get people to start trying. When people are trying but it isn't working, you have to help change the approach. Doubling down on a failing policy (e.g. we just need to create more resources) is failing to learn from the past.
by jajuuka | 2025-04-23 21:49:23+00:00
I grew up the same way and it's for sure wild to think back how if we had a question about something we had to do digging at a library to find the answer hopefully. Now it's just search and done. Or read a wikipedia page about it.

I do see the "I asked chatGPT" response more and more and initially had a similar feeling but I think it's still early days for LLM's. Will they be around in 10 years and ubiquitous like search engines? Who knows. But undoubtably they will get better over time and more accurate. Just like how the early internet had a lot of bad information on it, it got better over time.

This might also be a divide between different types of people. Personally I am very curious and want to really understand how something works so I get tons of information that won't help me solve a problem, but I understand the tool or part better. I would guess you might be in the same basket. But there are also people who just want the answer to solve the problem. They don't care how it works they just want it to work. And that's fine. It takes all kinds. Not everyone needs to have a masters in CS to use a computer or program one. Best we can do is try and nurture curiosity among other people and help them figure out ways to learn more and more.
by nozzlegear | 2025-04-23 21:49:27+00:00
> If this is true, I find this case troubling and weak, and hope it is overturned. It is squarely on the shop operator to be compliant - Shopify is just a platform vendor and shoppers are not Shopify customers; rather, they are customers of the shop. This seems to be akin to suing Google because a website uses Google Analytics but didn't disclose it in their privacy statement - silly...

Most of my work is in the Shopify app dev ecosystem, and while I haven't been following this case very closely, I do think it's ironic how Shopify is behaving here given the privacy standards they enforce on their app developers.

Some context: all Shopify app developers are required to follow the EU's GDPR rules for customer data, full stop. Your app must implement Shopify's mandatory GDPR webhooks. You must delete customer data when a shop's customer is deleted; you must produce all data you store on a shop's customer within 7 days upon receipt of a certain GDPR webhook; and you must delete all the data you store on the shop itself after the shop uninstalls your app.

Additionally, if your app requires access to any customer data (whether its via the Customer API, or via other APIs e.g. to get the name of a customer who placed an order), you need to apply for access to that data on an app-by-app basis – replete with an explanation for why your app needs the data. Shopify's app store staff has to manually review and approve that data access application before you can publish your app on their app store.

To be clear, I think these restrictions are a good thing†, as apps used to have access to a veritable firehose of private customer data. But it's ironic to see Shopify enforce such standards on their app developers, while at the same time arguing that they should be able to track their own potential customers anywhere and everywhere across the internet regardless of privacy laws.

† Though I think it's a little odd that a Canadian company is making me, an American app developer, think about/adhere to the EU's GDPR rules. Not to mention other privacy laws like the one in California. Why not just call it "Shopify's Privacy Standards?"
by userbinator | 2025-04-23 21:50:06+00:00
On Windows 11 24H2, more stack space was modified by a new implementation of Critical Sections.

IMHO this shows the downfall of Microsoft. Why did they do that? Critical sections have been there for many decades and should be basically bug-free by now. My best guess is someone thought they'd "improve" things and rewrote it, then made some microbenchmark that maybe showed the dubious improvement.

The other comment here mentions Raymond Chen, who wrote this article about why backwards-compatibility is very important (and arguably what got Microsoft into the position it's in today):

https://devblogs.microsoft.com/oldnewthing/20031224-00/?p=41...

and also this memorable case: https://news.ycombinator.com/item?id=2281932
by JohnKemeny | 2025-04-23 21:50:20+00:00
HALT is a problem that belongs to the complexity class RE (recursively enumerable), which is a class that contains the complexity class NP.

NP: Problems with efficient verifiers — given a candidate solution, you can check correctness in polynomial time.

RE: Problems with semi-algorithms — you can recognize “yes” instances by eventually halting, but you may run forever on “no” instances.

I wouldn't consider it a categorical error.
by inferiorhuman | 2025-04-23 21:50:55+00:00
I'm not the person you responded to, but I've mostly just accepted that homebrew is another paper cut that you get from using a Mac. If I post publicly about it I'm usually not looking for help.

Years ago I worked with someone who strongly disliked brew because it leaned far too heavily on magic. I was okay with it because it seemed to work well. Brew still uses magic but now it just seems like I'm fighting it every single step of the way. I am le tired.
by MrRadar | 2025-04-23 21:51:02+00:00
The D language basically does that. You can write D programs that evaluate D code at compile time to generate strings of new D code which you can then basically compile-time eval into your code as needed. Combined with the extremely powerful compile-time reflection capabilities of D it's the closest thing I've seen to Lisp metaprogramming outside of that family of languages and it's easier to read than Rust macros or C++ template metaprogramming.
by munchler | 2025-04-23 21:51:05+00:00
Thanks. So the tools downloaded from GitHub were allegedly used to scrape personally-identifiable information (PII), details about ongoing legal cases, union-related data, and corporate secrets. The whistleblower observed large spikes in outbound data traffic, suggesting that gigabytes of sensitive information were exfiltrated with logging disabled, so as not to leave a trail.
by treetalker | 2025-04-23 21:51:18+00:00
Reasonable, as used in the law in many if not most situations, has become a contronym. Reasonableness should be rigorous: it's in the term itself (capability of being reasoned / derived through reasoning). The intent behind the term is to use logic to ascertain / derive / apply the (sometimes tacit) social rule; but many judges turn that into "I'm reasonable (i.e., I'm not unreasonable, meaning clearly wrong much of the time), and this is my decision (whether or not I explain my supposed reasons to expose them to analysis and criticism), so therefore my decisions (and the things at issue) are reasonable; or, in my view, the thing at issue was not reasonable." Of course, such reasoning is itself illogical and, in my view, therefore unreasonable.
by znpy | 2025-04-23 21:51:56+00:00
> Obsidian

Probably not what you're looking for, but I'm having a wonderful time running a private instance of Mediawiki. It's only accessible to me in my lan (or through my vpn). It's been my private digital garden for a few years now and i like it very much.

The only thing I truly miss is the possibility of pointing a Wikipedia-like app (might as well be the same codebase of the official wikipedia app, but pointing at my private endpoint).

I'm not sure it has all the features Obsidian has (I haven't tried Obsidian) but it has a fairly large number of extensions: https://www.mediawiki.org/wiki/Category:All_extensions
by rkagerer | 2025-04-23 21:52:30+00:00
This is really cool, but I'm super skeptical of their proposed use case for protecting cities.

Aren't lightning conditions often preceded by strong winds and poor weather conditions? Not a great time to be flying drones. And the approach seems more complicated than simply installing lightning rods.

I'd sooner envision people using the technique to get a kick out of throwing lightning around like they're Zeus.