skysight-inc/HackerNews huggingface dataset:
Unlike ext4 that locks the directory when unlinking, ZFS is able to scale on parallel unlinking. In specific, ZFS has range locks that permit directory entries to be removed in parallel from the extendible hash trees that store them. While this is relatively slow for sequential workloads, it is fast on parallel workloads. If you want to delete a large directory subtree fast on ZFS, do the rm operations in parallel. For example, this will run faster on ZFS than a naive rm operation:

find /path/to/subtree -name -type f | parallel -j250 rm --
rm -r /path/to/subtree

A friend had this issue on spinning disks the other day. I suggested he do this and the remaining files were gone in seconds when at the rate his naive rm was running, it should have taken minutes. It is a shame that rm does not implement a parallel unlink option internally (e.g. -j), which would be even faster, since it would eliminate the execve overhead and likely would eliminate some directory lookup overhead too, versus using find and parallel to run many rm processes.

For something like fast mail that has many users, unlinking should be parallel already, so unlinking on ZFS will not be slow for them.

By the way, that 80% figure has not been true for more than a decade. You are referring to the best fit allocator being used to minimize external fragmentation under low space conditions. The new figure is 96%. It is controlled by metaslab_df_free_pct in metaslab.c:

https://github.com/openzfs/zfs/blob/zfs-2.2.0/module/zfs/met...

Modification operations become slow when you are at/above 96% space filled, but that is to prevent even worse problems from happening. Note that my friend’s pool was below the 96% threshold when he was suffering from a slow rm -r. He just had a directory subtree with a large amount of directory entries he wanted to remove.

For what it is worth, I am the ryao listed here and I was around when the 80% to 96% change was made:

https://github.com/openzfs/zfs/graphs/contributors
No, its not similar at all.

Parent is telling you: "if A is so simple and obvious, why does nobody do A", your counter argument: "if many people believe A it does not mean it is true". This is entirely unrelated, the point is that these things are NOT obvious to the average programmer, he/she would benefit from learning this, and claiming that these things are broadly "stupid and obvious" is petty and false.

Also, the things you're saying just don't add up with your criticism that the author is missing some fundamental part of software philosophy. If the author is only missing something, then it still makes sense for the majority to learn the things he is saying, at least, as explained by your parent.

Finally, if anything can be compared to religion, it surely is the evangelism of functional programming zealots.
This isn’t really wealth transfer, it’s a billionaire funding organizations that work on things she wants to promote. Philanthropy is probably better than merely hoarding wealth, but an actual democratic process would be to directly give the wealth to fellow citizens. Somehow, that never seems to happen…
I think it's an acceptable response. Not only there's no SLA, but people are free to not provide a service to misbehaving user agents. It's like rejecting connections from Tor.

If anything, a 429 is a nice heads up. It could have been worse; she could have redirected those requests to a separate URL with an... unpleasant content, like a certain domain that redirects to I-don't-know-what whenever they detect the Referer header is from HN.
Do colocation facilities solve that?
There is a very competitive market for colo providers in basically every major metropolitan area in the US, Europe, and Asia. The racks, power, cooling, and network to your machines is generally very robust and clearly documented on how to connect. Deploying servers in house or in a colo is a well understood process with many experts who can help if you don’t have these skills.
Are you OK with Brave using Chromium as their base?
iCloud is just as bad, sends important things to spam constantly and marking as “not spam” has never done anything perceivable.
The Investing Cult Fueling MicroStrategy's Ascent: 'Have Fun Staying Poor'
Same, I religiously create a masked email for every website (just checked, it's now at 163!). I simply don't give my "main" email out.

Oddly enough, simply unsubscribing from the things websites themselves has kept thing clean, I've yet to notice any true spam from a random source aimed at any of my emails since I joined last year.
Why do people write like this?

This is no way to write.

Every time I read something.

Written like this.

I expect a sales pitch for a course at the end. /rant

Perhaps it's just a personal preference, but I prefer reading fully-formed paragraphs instead of one sentence per line. I really wish people would stop writing their blog like it's a marketing copy for get-rich-quick schemes.
I don’t think it is.

To oversimplify, our input system takes a continuous stream of raw input. We can’t stop it, really.

We get our input directly from the source. Even if it’s aliased by our neural pathways, when they receive that info initially, it’s unadulterated.

LLMs take fixed amounts of discrete tokens which must be modified before it even reaches the training routine . Even multimodal models take in discrete tokens.

Information is lost when recording reality to video and even more is lost when converting that video into tokens.

And LLMs only learn in fixed steps. We take in information while we generate our whatever it we generate (movement, sense of self, understanding of our surroundings and place in those surroundings, next sentence, etc.)

Talking specifically about the most popular transformers models.
Fingerprinting or attestation?
It’s the same for me. I genuinely don’t understand how I can be having such a completely different experience from the people who rave about ChatGPT. Every time I’ve tried it’s been useless.

How can some people think it’s amazing and has completely changed how they work, while for me it makes mistakes that a static analyser would catch? It’s not like I’m doing anything remarkable, for the past couple of months I’ve been doing fairly standard web dev and it can’t even fix basic problems with HTML. It will suggest things that just don’t work at all and my IDE catches, it invents APIs for packages.

One guy I work with uses it extensively and what it produces is essentially black boxes. If I find a problem with something “he” (or rather ChatGPT) has produced it takes him ages to commune with the machine spirit again to figure out how to fix it, and then he still doesn’t understand it.

I can’t help but see this as a time-bomb, how much completely inscrutable shite are these tools producing? In five years are we going to end up with a bunch of “senior engineers” who don’t actually understand what they’re doing?

Before people cry “o tempora o mores” at me and make parallels with the introduction of high-level languages, at least in order to write in a high-level language you need some basic understanding of the logic that is being executed.
TBH these voices might have been the original reason why "demons" got defined by the ancients as evil spirits.

They often speak evil things, are unseen to the general population, but torment the sufferer ... a basic candidate for the category of "demon", especially in pre-modern times.

Also, I don't think that demons are a particularly Christian phenomenon. They certainly predate Christianity and various "heathen" religions were full of them: Indo-European, Amerindian, African...

But the idea of schizophrenia as a very intense mind going on empty is interesting. Only I would say that it needs some specific pathway to go down the schizophrenic route. Plenty of people with intense fantasies are normally adjusted and don't fulfill the criteria for a mental disease.
Why do people make this slop when you can just use acrobat reader? Lol
Obviously when Americans donate money they want a building or scholarship named after them.
If she cares which she most probably is, she / experienced people in charge should put this fact into project planning.

But there are limits and nobody sees future, dont expect impossible miracles just because it would be nice.
Google's Quantum Computer Is Paper Airplane
I moved from my own colocated 1U running Mailcow to Fastmail and don't regret it one bit. This was an interesting read, glad to see they think things through nice and carefully.

The only things I wish FM had are all software:

1. A takeout-style API to let me grab a complete snapshot once a week with one call

2. The ability to be an IdP for Tailscale.
Realistically it probably wouldn't make a difference. $2 billion is ~25 cents/person globally, we aren't talking about a significant amount of money here except for the fact that it is concentrated to a small number of people.

Which is a problem for a lot of "tax the rich" schemes. The rich don't actually have that much money relative to the large number of people who want a piece of it. The trick is in the effective deployment of capital but that rarely gets enough focus.
ZFS replication is quite unreliable when used with ZFS native encryption, in my experience. Didn't lose data but constant bugs.
I am, of course, well aware that musicians and the music industry existed before copyright. I am questioning the possibility that humans might be successfully optimized out of music or even entirely out of the music industry. Even when models are better than humans, humans will be free to make music, just as chess players are still free to play chess now that humans are no longer the best at chess.

The point about algorithms driving culture is more interesting.
The MicroStrategy ''strategy'' has worked well so far. Vamos a ver...
The complexity makes automated testing easier. We arrived here for reasons that may or may not not be critical to you but warranted implementation nonetheless. There is no conspiracy.
Does verbally engaging by speaking and/or listening to e.g. music with vocals or podcasts helpfully occupy the brain when there is psychosis?

Do headphones playing audio with words just loose around the neck, not even on, help stave off verbal psychosis?

language learning apps,

music from another room: https://www.youtube.com/results?search_query=Music%20from%20...
The directors of this laundry list of non-profits will be very happy that their high salaries are secure.

If only there were a government that could build affordable housing directly. Perhaps from a billionaire tax ...
There's a particular type of person that scours their HTTP logs and makes up rules that block 90% of feed readers using the default poll interval. If I stick your RSS feed into Miniflux and I get 429'd, I just stop reading your blog. Learn2cache. I'm talking to you, Cheapskate's Guide.
This question:
https://news.ycombinator.com/item?id=41548440
There is no point in doing such type of conversions.
Well now I can't tell if it was edited or if I just misread and decided to correct my own mistake. I'll leave it be so I remember next time, thanks.
Also CYA. If you run your own servers and something goes wrong its your fault. if its an outage at AWS its their fault.

Also a huge element of follow the crowd, branding non-technical management are familiar with, and so on. I have also found some developers (front end devs, or back end devs who do not have sysadmin skills) feel cloud is the safe choice. This is very common for small companies as they may have limited sysadmin skills (people who know how to keep windows desktops running are not likely to be who you want to deploy servers) and a web GUI looks a lot easier to learn.
have you tested that this helps? seems pretty simple to script with an agent framework
Oddly she actually got a quarter, despite seemingly having been "entitled" to half. Though perhaps it isn't so odd; if she's willing to give so much away so quickly, clearly she wasn't merely aiming to fleece him.
Having schizophrenia does not in any way invalidate your conjecture on a possible link between EMF exposure and schizophrenia. However, there has been a very large amount of research on EMF exposure and various health concerns, including schizophrenia specifically, without much effect shown. So, unlike you, I would be quite surprised if it was found to be contributing.

Interestingly though, there have been some studies that show a possible link between schizophrenia and ionizing radiation. (for instance: https://pubmed.ncbi.nlm.nih.gov/11087010/ )
If she just wants it gone/the responsibility off her chest she could send it to one of the really big re-granters.
This wasn't a rewrite-in-Rust effort, and I think that's the problem. Nothing valuable from curl has been rewritten in Rust.

Only some existing Rust code has been added to curl, but the Rust ecosystem already has a better, safer way of using that code.

Curl is not planning to ever require Rust, so the rewrites are limited only to optional components, and can't fully guarantee that the code is safe. The Rust components are required to expose an unsafe unchecked C interface for the rest of curl. C compilers are unable to enforce the safety invariants of the interface, like the Rust compiler would in a program fully written in Rust.
You do pay for your link, right?
https://archive.ph/L7fOF
I’d like to unsubscribe from your blog
> it becomes just another arcane skill set

Its an arcane skill set with a GUI. It makes it look much easier to learn.
Are those backups geographically distributed?
Plugging https://BareMetalSavings.com

in case you want to ballpark-estimate your move off of the cloud

Bonus points: I'm a Fastmail customer, so it tangentially tracks

----

Quick note about the article: ZFS encryption can be flaky, be sure you know what you're doing before deploying for your infrastructure.

Relevant Reddit discussion: https://www.reddit.com/r/zfs/comments/1f59zp6/is_zfs_encrypt...

A spreadsheet of related issues that I can't remember who made:

https://docs.google.com/spreadsheets/d/1OfRSXibZ2nIE9DGK6sww...
It's wasted operations on the user's end, the server's and the network infrastructure. None of those are free.
I don't think "low hanging fruit" has negative connotations attached to it.

The only negative sentiment tangentially associated with it is that when it's exhausted, further progress slows down.
It’s trading time for money
This is good. I won’t say a bad thing about it. I just always wonder if there’s a better way.

Would it not be better to use the money to ~~bribe~~ donate to politicians instead? Two billions dollars can change the results of elections and sway a lot of policy at the local, state, and federal level. It’s a matter of wealth amplification, that two billion could have altered the course of several billions in government budgets. Like a big lever moving an absolutely enormous boulder.

Why donate to non-profits fighting for something when you can just win the fight by changing the law? Rather than donate to a non-profit that helps the homeless, wouldn’t it be more effective to directly change the policies that lead to homelessness in the first place?

Evil Republican megadonors do it, and it’s working great for them. Where are the non-evil leftist megadonors? If it’s an oligarchy, it’s not impossible to have a good an kind-hearted oligarch.
Show HN: Image, Vid, and Audio Converter and Compressor: All Happens in Browser
I’ve created a lightweight tool that converts and compresses images, videos, and audio entirely in your browser—no uploads to servers required. The tool is fast, easy to use, and perfect for quick media optimization directly from your browser. It also support bulk image conversion and compression.
> to waste data

Useless traffic.

RSS has a structural problem: you download a "window" of data (the feeds between some timestamp in day A and some other in day B), which may or may not contain new data. You will easily lose some and receive a lot of duplicates.

It would have been better to be able to first check if new data is available. (And even better to only download the new ones, and all of them - "everything after YY-MM-DD hh:mm:ss")
Network bandwidth
Not to be pedantic, but isn’t the billionaire’s class wealth mostly derived from their ownership of an asset class that does draw from everyone, stocks?
I’m a consultant. Having looked at several enterprises, there’s a lot of work being done to make a lot of things that don’t really work.

The bigger the ambition, the harder they’re failing. Some well designed isolated use cases are ok. Mostly things about listening and summarizing text to aid humans.

I have yet to see a successful application that is generating good content. IMO replacing the first draft of content creation and having experts review and fix it is, like, the stupidest strategy you can do. The people you replace are the people at the bottom of the pyramid who are supposed do this work to upskill and become domain experts so they can later review stuff. If they’re no longer needed, you’re going to one day lose your reviewer, and with it, the ability to assess your generated drafts. It’s a foot gun.
How is it determined on chain if you’re validating on a fork?
So? You can write arrays of whatever dimensions on paper, it's a matter of notation, not of the substrate.
U.S. Navy Shoots Down Own Plane as Fresh Strikes Target Houthi Rebels in Yemen
Gift link: https://www.wsj.com/world/middle-east/u-s-navy-shoots-down-o...
I would argue that HTTP statuses are a bad design decision, because they are intended to be consumed by apps, but are not app-specific. They are effectively a part of every API automatically without considerations whether they are needed.

People often implement error handling using constructs like regexp matching on status codes, while with domain-specified errors it would be obvious what exactly is the range of possible errors.

Moreover, when people do implement domain errors, they just have to write more code to handle two nested levels of branching.
I'm a little surprised it seems they didn't have some existing compression solution before moving to zfs. With so much repetitive text across emails I would think there would be a LOT to gain, such as from dictionaries, compressing many emails into bigger blobs, and fine-tuning compression options.
That's a valid question, but I also see the change when she starts speaking French with people here. So it's not the location.

At least, it's not just the location. That may play a part, but it also happens otherwise.
> With o3 now public knowledge, imagine how long it’s been churning out new thinking at expert level across every field. OpenAI’s next moat may be the best synthetic training set ever.

Even taking OpenAI and the benchmark authors at their word they said that it is consuming at least tens of dollars per task to hit peak performance, how much would it cost to have it produce a meaningfully large training set?
>and those who survived generally didn't make it until 25 years old

That's a myth.
There are other, if often at least tangentially related, reasons but more than I can give justice to in a comment.

Many people largely got a lot of things wrong about cloud that I've been meaning to write about for a while. I'll get to it after the holidays. But probably none more than the idea that massive centralized computing (which was wrongly characterized as a utility like the electric grid) would have economics with which more local computing options could never compete.
"With o3 now public knowledge, imagine how long it’s been churning out new thinking at expert level across every field."

I highly doubt that. o3 is many orders of magnitude more expensive than paying subject matter experts to create new data. It just doesn't make sense to pay six figures in compute to get o3 to make data a human could make for a few hundred dollars.
This does not address the issue raised in iLoveOncall's third paragraph: "the same comment can be a nitpick on one CR but crucial on another..." In "attempt 2", you say that "the LLMs judgment of its own output was nearly random", which raises questions that go well beyond just nitpicking, up to that of whether the current state of the art in LLM code review is fit for much more than ticking the box that says "yes, we are doing code review."
George Soros? It’s interesting how reviled he is to his counterparts on the right.
Cmon man.

There’s a thing called facts. Billionaires exploit the poor.

Why do they fight unionization and workers rights?

https://www.jwj.org/emboldened-billionaires-take-aim-at-new-...

The prison phone market is owned by billionaires:
https://en.m.wikipedia.org/wiki/Inmate_telephone_system

Amazon now accepts SNAP/EBT payments after destroying small businesses:

https://www.paymentsdive.com/news/amazon-now-accepts-ebt-car...

Farmers are not allowed to reuse seeds from billionaire firms:

https://grain.org/en/article/5142-seed-laws-that-criminalise...
> the book frequently falls back on discussing things in a very OOP centric way

I do procedural most of the time. Do you think I can still benefit from reading the book? Judging from the summary in blog post, it seems to be a nice read even for non-OOP code. It's just my first impression though.
I have several orders of magnitude less resources than she does but I do the thing which I think scales the best.

I just give directly to poor people.
Such as via HEAD and Etag?
That's the public API price isn't it?
Feed readers should be sending the If-Modified-Since header and web sites should properly recognize it and send the 304 Unmodified response. This isn’t new tech.
If the transfer is done to orgs working on foundational issues for the poor instead of spreading it directly, the impact could be tangible.
Write, a lot, often.

Read, and try to do it questioning why a particular style works on you.

Use people, or ChatGPT, or something similar to get feedback, but be critical of it: you want to keep your own style.
> It would have been better to be able to first check if new data is available.

Or, as the article says, to actually check when you are able. All she is asking for is that readers make conditional requests, at reasonable intervals, and respect 429s.
I for one won't be trading in my old ZX-9R.
No, it’s not revolutionary if someone manages to find a counter-example 22 minutes after someone proclaims that it is revolutionary. It clearly hasn’t been relegated to obscurity.
“Tax the rich” isn’t just about the money. It is more to the power that comes with a handful of people having insane amounts of money. Money is power, whether we like it or not.

Why else an unelected private citizen (Elon) is able to bully congress? He is going to pour 100 million plus dollars to mess with British elections. More than 60% of the money raised by the GOP this year came from ultra wealthy people. Striking Amazon workers are getting beaten up by cops for using their right to protest. And so on
There is no public API for o3 yet, those are the numbers they revealed in the ARC-AGI announcement. Even if they were public API prices we can't assume they're making a profit on those for as long as they're billions in the red overall every year, its entirely possible that the public API prices are less than what OpenAI is actually paying.
If only people know of the standards
And any operation that takes n bits as input can be trivially turned into an O(1) time and O(2^n) space algorithm through tabulation.
>Eugh, that is a turnoff.

That's because you're too used to C/Algol style languages
Part of the (slightly vague and confusingly written) message is that she's also investing in for-profit organisations that have overlapping goals with the charities.
That so weird, it’s seems like everybody here prefers Claude.

I’ve been using Claude and openai in copilot and I find even 4o seems to understand the problem better. O1 definitely seems to get it right more for me.
I'm no longer interested in getting a motorcycle, for similar reasons.
They weren’t before?
It seems google has a massive advantage here since they can tap all of YouTube to train. I wonder what openai is using for its video data source.