MurphyA/hacker-news huggingface dataset:
by jauntywundrkind | 2026-02-24 18:31:56+00:00
Given how many accounts folks sign up for with their Google account, it very well could mean losing access to bear every single account you have online. That could be an enormously difficult travail.

Yes I think there's many situations where being kicked out of your apartment would be an affront. If this made up crime of jaywalking got folks kicked out? Yes that would be an affront.

I'm willing to taper my outrage down some. Are you willing to come up some?
Show HN: Fastdedup – Rust dataset deduplication (2:55 vs. 7:55 688MB vs. 22GB)
by wapplewhite4 | 2026-02-24 18:32:52+00:00
I've been working on a Rust CLI for dataset deduplication and wanted to share benchmark results. Ran on FineWeb sample-10BT (14.8M records, 29GB) on a single machine.
Exact dedup vs DuckDB + SHA-256:

2:55 vs 7:55 wall clock (2.7x faster)
688MB vs 21.9GB peak RAM (32x less)
Single core vs 4+ cores
Duplicate counts match exactly (51,392 both ways)

Fuzzy dedup (MinHash + LSH) vs datatrove:

36:44 vs 3h50m+ — datatrove stage 1 alone ran for 3h50m and we killed it
datatrove's bottleneck turned out to be spaCy word tokenization on every document before shingling. fastdedup uses character n-grams directly which is significantly cheaper
23GB vs 1.1GB RAM — this is a real trade-off, not a win. datatrove streams to disk; fastdedup holds the LSH index in memory for speed

Honest caveats:

Fuzzy dedup needs ~23GB RAM at this scale — cloud workload, not a laptop workload
datatrove is built for distributed execution, tasks=1 isn't its intended config — this is how someone would run it locally
Tiered storage to spill LSH index to disk is on the roadmap

Demo: https://huggingface.co/spaces/wapplewhite4/fastdedup-demo
Repo: https://github.com/wapplewhite4/fastdedup
Happy to answer questions about implementation or methodology.
by bigyabai | 2026-02-24 18:32:55+00:00
> The government spying on what you do has been old news for 20 years.

The methodology has evolved dramatically in those 20 years, what we've seen from Snowden is almost certainly obsolete in the light of new surveillance tactics. Even as a pessimist myself, I'm still routinely shocked by the lengths that American tech has been bugged.

Salt Typhoon is really the icing on this cake; "lawful" intercept turned against the state that implemented it. There are more twists left in this story no matter how jaded you might feel.
by softmax9 | 2026-02-24 18:33:23+00:00
Hi, this is Emmett. You may know me as the founder of Twitch (YC 01), and more recently as the (extremely) brief CEO of OpenAI.

I believe the question of how advanced AI systems learn to cooperate with humans is one of the most consequential technical problems of our time.
If we get this right, AI becomes a powerful collaborator in human progress. If we get it wrong, we will be deploying systems whose incentives we do not understand.

I’m building something to work directly on this problem.
Softmax is constructing large, scalable environments where AI agents learn cooperation and competition. At toy scale this works. At real scale, it becomes a massive systems problem.

We are hiring engineers to build the core runtime layer that makes this possible.

This will be unusually hard. You should not apply unless:

-- You are exceptionally strong technically
-- You have built at least one non-trivial system end-to-end
-- You prefer high autonomy and high expectations.
We are open to early-career engineers (including graduating seniors) if you are operating well above your peer group.

You will work directly with me to design the system, implement it, measure it and improve it.

This is not incremental work. It will influence how advanced AI systems behave at scale. If that excites you, and you believe you’re capable of contributing at that level, I’d like to talk.

Looking forward to meeting you,

Emmett

==========================

Requirements:

-- Strong quantitative background (CS, math, physics, or equivalent depth).

-- Fluency in Python and C++

-- Comfort with systems design and performance tradeoffs

-- Daily use of AI tools in your development workflow

==========================

Location: San Francisco (onsite)

Time commitment: Full-time

Apply here: https://softmax.com/jobs/softwareengineer

In the “Anything Else” field, please mention you came from HN so we can prioritize your application.

Also include:

-- A system you built end-to-end

-- What broke at scale

-- GitHub
by snifideezy | 2026-02-24 18:33:36+00:00
Ductape lets you integrate any backend component instantly. Import endpoints, databases, storage, queues, or workflows, define environment rules once, and reuse integrations across projects and teams.

Bring your own APIs (REST, GraphQL, SOAP, webhooks), databases (SQL, NoSQL, graph), message queues, and storage services and integrate natively. Works with whatever your backend uses, so you can start small and scale without rewriting code or migrating. You can start using it instantly.

With Ductape, you get unified, type-safe calls you define once and reuse everywhere — across services, environments, and even teams. Everything runs inside your backend (Node/TypeScript), so you maintain full control over logic, retries, secrets, and execution.

Example usage:

const result = await ductape.run('payments.createCharge', { amount: 1000 });
const rows = await ductape.run('db.query', { sql: 'SELECT * FROM users' });
await ductape.run('storage.upload', { file, bucket: 'avatars' });

Switching providers? Update the config, no code changes needed.

Ductape is not a Backend-as-a-Service. It doesn’t give you a full backend. It standardizes how your backend code talks to external systems, making integrations consistent, reusable, and type-safe. Unlike unified APIs that lock you into providers, Ductape works at the protocol level and lets you bring your own tools.

You can try it out now. We are currently in Beta
by zer00eyz | 2026-02-24 18:33:39+00:00
> problem since the dawn of version control ... a tool's fault ... or it is something that people aren't caring about.

At the start of my career I ended up in a UI position. Old school usability on the back side of a 2 way mirror.

The tool has lots of shortcomings: images, documents that aren't text, working with parts of repositories... These aren't issues faced by the kernel (where emailing patches is the order of the day). And these shortcomings have lead to other tools emerging and being popular, like artifactory, journaling file systems, and various DAM's.

Technology on the whole keeps stacking turtles rather than going back to first principles and fixing core issues. Auth (DAP, LDAP, and every modern auth solution). Security (so many layers, tied back to auth). Containers and virtualization (as a means of installing software...). Versioning is just one among this number. We keep stacking turtles in the hope that another layer of abstraction will solve the problem, but we're just hiding it.

One of the few places where we (as an industry) have gone back and "ripped off the bandaid" is Systemd... It's a vast improvement but I would not call it user friendly.

Usability remains a red headed step child, its the last bastion of "wont fix: works for me" being an acceptable answer.
by gus_massa | 2026-02-24 18:34:05+00:00
Flag them, enough flags kill the comments. After a while, the account/user is banned. If you see too many that are undetected after a few days, you can email dang/tomhow hn@ycombinator.com

For the obviously stupid comment I'd not worry to send an email, until there are too many.

For the last one https://news.ycombinator.com/item?id=47130567 perhaps you can send an email just in case.
by jeroenhd | 2026-02-24 18:34:19+00:00
Developer registration doesn't prevent this problem. Stolen ID can be found for a lot less money than what a day in a scam farm's operation will bring in. A criminal with access to Google can sign and deploy a new version of their scam app every hour of the day if they wish.

The problem lies in (technical) literacy, to some extent people's natural tendency to trust what others are telling them, the incompetence of investigative powers, and the unwillingness of certain countries to shut down scam farms and human trafficking.

My bank's app refuses to operate when I'm on the phone. It also refuses to operate when anything is remotely controlling the phone. There's nothing a banking app can do against vulnerable phones rooted by malware (other than force to operate when phones are too vulnerable according to whatever threshold you decide on so there's nothing to root) but I feel like the countries where banks and police are putting the blame on Google are taking the easy way out.

Scammers will find a way around these restrictions in days and everyone else is left worse off.
by Tharre | 2026-02-24 18:34:20+00:00
There simply isn't a known solution to this problem. If you give users the ability to install unverified apps, then bad actors can trick them into installing bad ones that steal their auth codes and whatnot. If you want to disallow certain apps then you have to make decisions about what apps (stores) are "blessed" and what criteria are used to make those distinctions, necessarily restricting what users can do with their own devices.

You can go a softer route of requiring some complicated mechanism of "unlocking" your phone before you can install unverified apps - but by definition that mechanism needs to be more complicated then even a guided (by a scammer) normal non-technical user can manage. So you've essentially made it impossible for normies to install non-playstore apps and thus also made all other app stores irrelevant for the most part.

The scamming issue is real, but the proposed solutions seem worse then the disease, at least to me.
by skinnymuch | 2026-02-24 18:34:52+00:00
I’m not the most well versed but isn’t that still insane to be 4x valuation of PayPal? Maybe it’s more PayPal valuation being crap vs Stripe being too high. Adyen is close to PayPal with a PE of 30 (vs PayPal’s sub-10) and Adyen like PayPal is close to being back to its IPO level.

PayPal seems crazy when it has acquired businesses like Honey (probably hasn’t helped) and Braintree/Venmo since then. Pretty funny PayPal was spun off as the better growth stock but eBay has tripled since then and their market caps are the same now.
by garbawarb | 2026-02-24 18:35:18+00:00
> Speculative as it is, the scenario has unnerved investors. The S&P dropped more than 1% on Monday, and the software component of the index fell to its lowest level since Trump’s “liberation day” tariff announcement in April. Doubtless some of the wobble is attributable to Trump’s latest tariffs, but Uber, American Express, Mastercard and DoorDash, specifically named in Citrini’s report, all lost between 4% and 6%.

So how exactly does the article attribute the movements of the market to this Substack post? What is the proof that this was the cause? Journalism usually deals with proof of what it says but I don't see any in articles like this.
by shagie | 2026-02-24 18:35:24+00:00
That's a success rate that largely is based on suing people who don't have the resources to fight it (no claims made about if they're right or not).

However, the IRS has had reductions in staff and funding which made it harder to go after the bigger accounts who have more forensic accounting needing to be done to find the money in the various tax shelters.

https://www.pbs.org/newshour/nation/irs-faces-challenges-in-...

> "The IRS is simultaneously confronting a reduction of 27% of its workforce, leadership turnover, and the implementation of extensive and complex tax law changes" mandated by Republicans' tax and spending measure that President Donald Trump signed into law last summer, Collins said in her report.

https://www.americanprogress.org/article/the-fiscal-impact-o... (May 2025)

> The Global High Wealth department of the IRS is designed to audit ultrawealthy individuals and corporations, who often hire highly sophisticated tax advisors to devise ways to avoid taxes and to respond to the IRS if they are challenged. But, as of late March, the department was cut by nearly 40 percent—and likely more by now with the additional RIFs.

I would be willing to contend that while they've got a 93% overall, that's historical numbers and the teams that would go against Meta and others are severely understaffed.
by agentic-wiki | 2026-02-24 18:36:05+00:00
As we hit the limits of "Vibe-Coded" Oracles, a quiet pilgrimage has begun toward the deterministic certainty of the 1970s mainframe. This piece explores the "Neuro-Symbolic" pantomime of 2026: using LLMs as polite, lying butlers while relying on COBOL state machines in the basement to ensure the money actually moves from A to B. Is the future of AI just a humiliating retreat to 50-year-old architecture?
by GitPushOrigin | 2026-02-24 18:36:15+00:00
Fair, but that's just what hype is. Overpromise, underdeliver. Most of us recognize its limits and take advantage of its strengths. This post (and many in it) seem to be inferring that AI is useless because it isn't AGI, answered a simple question wrong, was tricked, or didn't answer perfectly. This is cherry-picking at best, disingenuous at worst.
by gjsman-1000 | 2026-02-24 18:36:16+00:00
> Stolen ID can be found for a lot less money than what a day in a scam farm's operation will bring in.

Well, in that case, Google has an easy escalation path that they already use for Google Business Listings: They send you a physical card, in the mail, with a code, to the address listed. If this turns out to be a real problem at scale, the patch is barely an inconvenience.
by Stromgren | 2026-02-24 18:36:32+00:00
I find Stripes fees excessive too, but I don’t think I’ll ever switch. I’ve been running a small SaaS product on the side of other work for >15 years and if it taught me one thing, it’s that I need to reduce the things I have to maintain, reduce manual work, reduce the things that can go wrong. There’s nothing worse than having to fix a bug in a codebase you haven’t touched for a year and possibly in a feature you haven’t touched in many years. I simply love that Stripe handles not just the payment, but the payment application, the subscription billing, the price settings, the exports for bookkeeping. I’ve had a few instances where my site was used fraudulently to check stolen credit cards and it was quickly flagged and I could resolve it with Stripe. I’m sure someone can mention alternatives and I’m sure that I could build something that would work myself, but they keep a big part of what it takes to run the business out of my mind and I’m willing to pay for that.
by Kirby64 | 2026-02-24 18:36:33+00:00
The sensors are very cheap:

https://www.arducam.com/arducam-ov5647-standard-raspberry-pi...

If you want a fancy one with a lens and an IR cut filter it'll run you a grand total of $35:

https://www.arducam.com/arducam-ov5647-noir-camera-board-w-m...

Sure, the extra stuff like LTE modem, battery, solar panels, casing, etc, costs a whole lot more money, but these things clearly are built cheap. The optics and imaging sensor is a joke compared to real, proper cameras.
by a_protsyuk | 2026-02-24 18:36:44+00:00
This is the fundamental problem with hierarchies - knowledge is multi-dimensional but folders are one-dimensional. You shouldn't have to decide if "Vanguard 2026 review" lives under /retirement or /budget or /investments. What if you could just search "retirement investment options I reviewed" and find it regardless of where it was filed - by meaning, not by path?
by mmsc | 2026-02-24 18:36:45+00:00
`dom.text_fragments.enabled` to remove "Copy link to highlight" on right-click. Yes, it can be useful, but I never use it and the very rare occasion of needing to use it when opening a page, I can just search it myself.

`privacy.query_stripping.strip_on_share.enabled` to remove "Copy clean link". I would rather it just did that clean link thing automatically, but I don't actually care about clean links -- it's just annoying having two "copy link" next to each other (especially with one which is greyed out 99% of the time!)
by valtlfelipe | 2026-02-24 18:37:17+00:00
Hey HN!
I'm Felipe, the maker of Hedit.

I created Hedit after using an outdated hosts file editor that didn't support Apple Silicon. I wanted a modern, user-friendly alternative that works seamlessly on today's systems.

Hedit is still evolving, and I’d love your feedback.

Thanks for checking it out, and happy to answer any questions!
by Nition | 2026-02-24 18:37:22+00:00
In 1997 I typed up a letter to Maxis in Microsoft Creative Writer about how much I liked their games and wanted to move to America and work at Maxis when I grew up:

https://i.imgur.com/1eHcead.jpeg

Unfortunately I made the mistake of mentioning that it'd be cool if you could print out an image of your city in SimCity 2000, as you could in the previous SimCity game. That was enough to get me only this letter from legal as a response:

https://i.imgur.com/Y2wGcRt.jpeg

I did grow up to become a professional game developer though.
by skydhash | 2026-02-24 18:38:17+00:00
You forgot to address the random aspect of the failure cases.

Real world is chaotic, technology was always first about controlling, then improving said control. A lot of the risks in the situations you described have been brought down that the savings (time, money,…) are magnitude more than the cost of the failure.

I’m not asking for perfection, but something good enough that we can demonstrate the savings outweigh the costs. So far there’s none. In fact, we are increasing it. And fast.
by craftkiller | 2026-02-24 18:38:25+00:00
The Librem 5 would be eliminated by the additional requirements of:

> "I want a CPU that isn't crap while being expensive"

> "I don't want to pay full flagship prices for sub flagship performance"

Adding my own experience: the battery life is also atrocious[0] and simply running a software update on a completely stock librem 5[1] managed to send it into an infinite boot loop that I was only able to recover from by flashing the factory image.

[0] Sitting on a shelf, with the screen off, not connected to cellular networks, not being used at all except to check the battery % periodically throughout the day: I got ~11 hours of battery life. My pixel 10 has been operating under the same conditions for 4 days and is still at 71% battery life (I'm intentionally draining it down to ~50% for long term storage while I wait for the bootloader to unlock in 2 years).

[1] The phone had been sitting on a shelf gathering dust for years. No software had been installed, no accounts had been set up, it had never actually been used as a phone. Could not get more "stock" than that.
by Bender | 2026-02-24 18:38:48+00:00
Is kdbx broken or has it been causing data loss? I've been using KeepassXC as long as it has existed and no issues for me thus far. If kdbx is not problematic for it's intended use then I think moving to SQLite just makes it more hacker friendly which I have no need for. I have no need for other applications extending the use of my passwords.

If anything, maybe give people the option to export to SQLite and then use that going forward but keep it entirely optional.
by Yapping7880 | 2026-02-24 18:39:04+00:00
Pretty interesting. There was a study about Clemastine use as a potential treatment/prolonging for ALS, but it did not show any significant benefit at preventing/delaying neuron death. I bring it up ALS because there are certain treatments for MS (like IVIG Infusions) that can also be beneficial for ALS patients.

https://pmc.ncbi.nlm.nih.gov/articles/PMC10568021/
by jauntywundrkind | 2026-02-24 18:39:18+00:00
Fairly amusing, sometimes for good reason, sometimes less nobly so.

> Gas Town is a collection of AI agents with fanciful names ("Deacons," "Dogs," "Mayor") organized to monitor one another's work. Think of it as a kind of surveillance-heavy labor camp for bots

> Moltbook made Gas Town's ant farm-like spectacle visible to non-coders.

> Novelties like Gas Town and OpenClaw that aim to free programmers from drudgery always risk turning into just another form of "yak-shaving" (rabbit-hole quests that can delay delivering actual

> That means we're in for some wild times, with more crazes flaring up and flaming out, new kinds of human-machine collaborations evolving, and unforeseen cybersecurity disasters multiplying

> Productivity gains will be elusive… The information sphere will get swamped… Security disasters will multiply… Labor markets could get weird
by rprend | 2026-02-24 18:39:57+00:00
I was curious, and the American Clearing House has a TPV of $93 trillion, which means ACH is 78%?? That seems too high.

Oh - not all bank transfers count in GDP. I often move money from one account to another.

Note that Visa has the same issue: withdrawing money from an ATM shouldn’t count towards GDP! Neither does Vemo-ing a friend to settle up a split restaurant bill (my Venmo is attached to my debit card).
by kube-system | 2026-02-24 18:40:07+00:00
I think expecting software licenses to enforce your rights outside of the realm of software is a pretty bad take. I think Linus's take is quite solid: "I give you my source code, you give me your changes back, and we're even". There are a lot of us who don't think that FOSS should be weaponized as a poison pill to enact the authors worldview on topics outside of the realm of software alone.

If it should be a consumer right, why limit it only to devices certain types of software? Why not consumer protection law that applies to all devices? I think software licenses are the wrong tool for this problem.

There's a lot of crazy crayon licenses out there that try to fix the whole world by tacking on a whole lot of restrictions to their software licenses, prohibiting use for a long list of reasons... to me it sounds like a bunch of newspeak, as if "more restrictions = more freedom"
by CamperBob2 | 2026-02-24 18:40:10+00:00
One option that shouldn't be overlooked: get a temporary subscription to an OpenAI model that allows you to run what they originally called "deep research" (nowadays called "Extended Pro" mode.) This isn't available on the freebie chat page, it will require at least a $20/month subscription (and maybe more, not sure.)

Then, basically paste your post into the prompt and let it crunch. It will take up to 30 minutes or so, and will often give you a reasonably comprehensive report in which most of the references actually exist. It is absolutely a better-Google-than-Google class of resource.

I'll do that and see if it comes up with anything meaningful, and also try it on Gemini 3.1. For a query like this I wouldn't expect it to return a list of thousands of individual reports, but it might give you some good leads that you can follow up with your existing journal access.
by giancarlostoro | 2026-02-24 18:40:49+00:00
Tests are written for various goals: integration testing, to prevent regressions, and in the same effort to prevent regressions to protect mission critical / business logic code. If all those nuances are captured by good tests, you arguably have "100%" test coverage, you don't need to test every single line of code ever written to have 100% test coverage in my eyes. But then when you go to translate your project to a new language, you port the tests first, then test against those tests.

This is my personal belief on this anyway.
by atonse | 2026-02-24 18:41:22+00:00
Same here. I've found the "me me me" a bit off-putting over the years, but can't deny that he is a genuinely smart, interesting, and forward thinking person. I especially enjoyed his writings on measuring every aspect of his life [1].

Also Wolfram (person and company) don't seem to be stodgy and stuck in old ways. At least as an outside observer (I'm not a mathematician, nor do I use Wolfram's main tools), seem to handle new trends with their own unique contributions to augment those trends:

Wolfram Alpha was a genuinely useful and good tool, perfect for the times.

These tools will actually further supercharge LLMs in certain use cases. They've provided multiple ways to adopt them.

Looking forward to see what people will do with this stuff.

1: https://writings.stephenwolfram.com/2012/03/the-personal-ana...