skysight-inc/HackerNews huggingface dataset:
It's nice to see Ousterhout's idea of module depth (the main idea from his A Philosophy of Software Design) getting more mainstream — mentioned in this article with attribution only in "Other notes", which suggests the author found it natural enough not to require elaboration. Being obvious-in-hindsight like this is a sign of a good idea. :-)

> The concept of deep vs shallow modules comes from John Ousterhout's excellent book. The book is [effectively] a list of ideas on software design. Some are real hits with me, others not, but well worth reading overall. Praise for making it succinct.
Thanks for the reminder. I really strongly dislike how it tracks when I 'visit' my television, that kind of creeps me out a bit
I strongly dislike swap on servers. I can understand some use cases laptops and one-off situations.

I would much rather have an application get killed by OOM killer than swapping. Swapping absolutely kills performance. Not having enough RAM is a faulty state and swapping hides that from admins resulting in hard to debug issues. The OOM killer leaves handy logs, swapping just degrades your service and needs to be correlated with RAM usage metrics.

My experience is also that swap will be used no matter how low (or was it high?) you set the swappiness number if the memory throughput is high enough, even if there is enough RAM available.
I don't think are are right. I used GIS software with SSD, and it handle huge files with SSD as ram alternative (swapped). Maybe it is better to do this in a different way, but this definitely works.
"Other organizations are similarly optimistic about the utility of AI assistance"

Oh yes, wait when the AI start to hallucinate throwing non-existent precedents.
You know, I don't like to kick a dead horse while it's down. I bet Boeing feels just awful about all of this and they're someday soon going to start doing their best to remedy it. I don't think one or two or three major problems in rapid succession is anything more than bad luck and hey, look at all the good work they've done for their shareholders! We should just trust that they're a good American company and they're going to get better and leave it at that! Besides, the FAA is almost bankrupt and Trump is about to go back into office so why waste our time on things we know aren't going to get fixed?
>If we stop replicating those limitations, it's not unreasonable to expect that the social problem will change also.

This is called technological determinism and is not an accurate heuristic for how humanity adopts tools

Humans generally adopt tools broadly after the social environment allows it, not when the tool is capable. This has been shown over and over. Never has there existed a tool whose introduction was immediately and universally adopted.

There’s almost always a period of introduction, then decades of middling adoption and refinement, then the social climate changes and production adjusts enough to adopt en masse.

This was true for every major invention and is an artifact of human social structures
Probably in large part because when you're no longer a monopoloy, you can't soak the consumer for enough extra margin to spend many person years of time and money going nowhere most of the time.

That's putting it harshly of course, but it's probably notable that the only places you might find something approaching a team or department like the Bell Labs of old are large incumbents in fields like Apple or Microsoft. If you're a smaller competitor or in a highly competitive space, you don't have the luxury of being able to spend large chunks of money and people on R&D that may never produce anything useful or salable. In theory you might be able to get something like this out of academia, but then you run into the publish or perish mindsets.

I wonder if one way the states and federal government could encourage development in towns and areas that are dying as the world consolidates and small towns lack opportunity would be to subsidize these sorts of non-competitive R&D spaces in those otherwise undesirable living areas. A sort of multi pronged subsidy, to both the workers (discounted home loans, dedicated public transport), to the local industries (grants or loans to builders in the area to build homes and infrastructure) and to the companies themselves (tax incentives, short term subsidizing of salaries etc), and in exchange the public and the government gets the results of the research perhaps under reduced term patents or special licensing deals.
> It takes too much work to verify everything in every field personally, you wouldn't be able to move at all.

Yes and no. The scale of the checking problem is formidable, as you're aware. However, many claims in scientific papers are weak. Even highly cited papers can contain nonsense that doesn't stand up to mild scrutiny. Given that, I think progress can be made towards the problem if every researcher simply spent more time checking previous work. Checking everything is impossible, but progress can be made by prioritizing, dividing the work up among everyone, and doing checks that don't take much time.

As an example of a highly cited paper with easily noticed major issues, consider this comment I posted on PubPeer: https://pubpeer.com/publications/95455FA4147A9CBD5EAA5185D21...

The first version of this paper was published in 1991 and has over 300 citations. It's still cited to this day. Despite this, in 2016 I read the later journal version of the paper and pretty quickly realized that the first part of the paper was basically nonsense. You don't need to look hard to realize that either! The problem can be found by simple spot checks, looking at the trends of the equation. (I can't quite recall, but I think that's how I figured out that the model was wrong in the first place.)

My paper refuting the model to date has zero citations that aren't from me. The closest I've received so far was an email from someone who was curious that I was apparently the first to notice the problem, over 20 years after the first publication of the model.
Not quite 32x as there's a 3-5 bytes of input per number, and a range of -999…999 for the output (and you'd generally want to load those consecutive bytes at the same time). 4x or 8x is certainly possible though; and you can even do that in Java with jdk.incubator.vector to some extent, although the available operations are somewhat limited, and Hotspot's codegen leaves enough to be desired.
I (personally) think the best result does involve criminal liabilities for CEOs. That's having seen this same story play out at many organizations.

However, criminal liability in itself won't solve it. Capitalism forces this kind of behavior; it's the natural trend for any company. The Dictator's Handbook describes it well.

What's needed is what's been done in every other industry: Regulation which changes incentive structures. Raw capitalism forces meat packing plants to pack ground rats in with your ground beef, quack medicines, and all sorts of other issues. The regulatory solution needs to have short-term economic consequences of some kind for doing the wrong thing. There are many of those, including:

1) Require insurance, and let the market sort it out. If the settlements and fees came from an insurance company rather than Boeing, the insurance company could set rules and inspections as it believed adequate to turn a profit.

2) Have high standards and regular inspections

3) Major changes to both capitalism and corporate governance. We have the best system we've thought of so far, but we sort of stopped thinking about new systems 50-100 years ago (fascism and communism were the last major attempts, and didn't turn out too well)

4) Completely overhaul our infrastructure for transparency. This could include whistleblower protections, as well as FOIA-like schemes, where an academic can look at what Boeing is doing.

It's worth noting this is a quasi-monopoly / duopoly situation, so market systems tend to work worse than most places.

But yes, it's a problem that criminal consequences are for poor people or people lower down the rungs. People at the top should go to prison too if they do something bad, with the same quality legal process as poor people.
I know I will get downvoted here but I like to keep everything enabled. The more Google knows about me, the more relevant the ads they can serve. I hope Google’s ads will one day be as relevant as the ads I see on Facebook and Instagram.

And if I ever get falsely accused of a crime, my Google location history, combined with my Google Photos’ metadata, could serve as my alibi.
What exactly is a "disbursement complaint"? Your comment is the #6 result in a Google search, so it's not exactly common, and the other results aren't terribly informative.
A noninvasive treatment for "chemo brain"
I actually really like it, particularly location history. For instance I find it fun to go back and look at past trips in detail and reminisce.

I can definitely see where someone wouldn't want that though
It doesn't show because the management has the same opinion as glimshe.

That's opinion is wrong though, because testing is more then just playing the game a little.

You get the same issues in companies that straight up don't value tests whatsoever. Unsurprisingly, bugs become increasingly frequent, especially if the software is developed by multiple people.

Methodically testing something in a reproducible manner, potentially through scripting to enable regression testing is challenging, in some cases more challenging then writing the code/behavior you're testing.

glimshe isn't wrong about how hard this is going to be for the QA people though. These companies don't value quality, which is precisely the reason why they're hiring the people that are easiest to replace. Most QA workers currently just go through the motions of a "manual acceptance test", with the result you just mentioned.
What’s wrong with hibernation, ssd wear? (Asking because I hibernate all the time as sleep is still buggy on my framework)
agreed, such as Equifax; after it was breached and our, coughs, "stolen data" was stolen from them.
Been following this for a while b/c Jim Keller, but every time I look at the arch [1; as linked by other commenter] as someone who doesn't know the first thing about CPU/ASIC design it just looks sort of... "wacky"? Does anyone who understands this have a good explainer for the rationale behind having a grid of cores with memory and IFs interspersed between and then something akin to a network interconnecting them with that topology? What is it about the target workloads here that makes this a good approach?

1. https://docs.tenstorrent.com/tenstorrent/v/tt-buda/hardware
Daylight Savings Time by Grandpa Jones
What happens if you reverse direction twice?
> Phones are literally essential computing devices in modern society

Cool, it doesn't matter because US courts disagree with you, even if they did agree with you, there's nothing in the constitution that says the welfare of American society is in jeopardy because Apple sets rules on their own devices that you don't have to buy.

Your argument literally only makes sense if you pretend Android doesn't exist. It is not possible to exhibit monopolistic behavior if you are not a monopoly, and Apple is not a monopoly by any stretch of the definition.
in HPC systems, especially in bioinformatics, astrodynamics or fluid dynamics, if you don't have swap, you are asking for trouble, mostly cuz the code has been written by graduates of each field who can't program
Status and autonomy. Even an adjunct professor still gets addressed with a honorific. You rarely have anyone yell at you or look over your shoulder as you work. And, as a friend who has a TT job at a Canadian University recently observed, it is generally the adjuncts who most adopt the professorial look: sweaters, jackets with elbow patches, horn-rimmed glasses.

So long as these things are enticing to enough people, supply will outstrip demand and wages will fall.
Great idea, and this is kind of solution is why improving performance of smaller local models is important, not just the highest quality state-of-the-art (local or cloud) models.
I've never needed accurate fractions, except for one case where I should have stored the width and the height of the image as the original figures instead of trying to represent it as a fraction. But that's not a big issue, there's literally no downside to having width and height of the image as integers.

I see no reason why I would need to represent it as an accurate fraction instead of two numbers, even if I divide it later I can always just do that inaccurately since the exact aspect ratio doesn't matter for resizing images (<1% error won't affect the final result)
The Yi models were actually released back in early November 2023. So there isn't as big a gap in time as it seems.

I'm not sure why there is such a big gap between the release of the models and the publication of the paper.

EDIT: Okay, this appears to be a new set of models with the same name, based on the same models from November but now with multimodal capabilities.
It’s fundamental to how S3 works and its ability to scale, so it is a defining feature of S3.

If you think wider, a bucket itself is just a prefix.
This is the thread I was thinking of, thank you!
I wouldn't be surprised if we get to this level of legal theatricality at some point.

> In 897, the 9-month-old corpse of the late Pope Formosus stood trial by the reigning pontiff, Stephen VII. Stephen VII convicted Formosus, sentenced the cadaveric Pope to have three fingers of his right hand amputated and then had him buried in a common grave.

https://en.wikipedia.org/wiki/Cadaver_Synod
If a feature of an open core product can be provided by the community, it's not valuable enough to gate behind an enterprise wall.

Nor is it a bad thing when a community implementation competes with the enterprise implementation. At a minimum it gives you a standard to exceed. For a feature like this, accepting the community offer to configure arbitrary providers lets you define which providers get enterprise-level support going forward.

The response to this makes it clear that the company has no intention of working with contributors. As many have said here, that's their right, but as a prospective customer it looks like they're unable or unwilling to compete on quality against even their own userbase's freely developed contributions, which reduces my confidence in the quality of their enterprise offering more than if they had accepted it and built a better equivalent interface or defined better support for it.
This is exactly right, except that whenever there is a deviation there is a side channel conversation of "How can we fix this without needing to do all this paperwork, while still complying with the regulations?" between the factory floor, quality, and the engineers.

For example perhaps a rule says "you need to do an inspection when a panel is removed" so the engineers and quality will get together and say "what if we just have the technician remove a couple screws on the panel and peek under it, then the panel hasn't technically been removed so we don't need to do the inspection". And then it turns out they remove all but one screw and twist the panel completely away so it's basically open but not "removed". And, it's all there in the work instructions, exactly what they did, but if anyone asks they can say "oh no, we didn't REMOVE the panel". And of course, the actual work instructions are only viewable in some 1970s green screen terminal or an all-caps printout thereof that comes in a multi-binder acceptance packet.
The FDA won't usually approve a drug that doesn't work. Yeah, regulatory capture occasionally happens, and the FDA's definition of "work" is looser than you might hope. But it's just not a profitable strategy to keep throwing good money after bad on a drug that simply doesn't do anything.
It looked much better on contemporary monitors than it does on modern ones.
> Believe the hype.

I'd rather believe the test results.

Is there a neutral third-party that has validated S3's durability/integrity/consistency? Something as rigorous as Jepsen?

It'd be really neat if someone compared all the S3 compatible cloud storage systems in a really rigorous way. I'm sure we'd discover that there are huge scary problems. Or maybe someone already has?
It probably should grind to a halt because the incentives for “research” are skewed to commerce to such a degree that the structure of the investigatory mechanism is foundationally flawed
Kellyanne Conway Advocating for TikTok on Capitol Hill
Just document it on the README: PRs are will not be accepted or vetted due to <x>. It's as simple as that.
It's not fine print, it's the second sentence of the main body text!

If someone can't be bothered to even read beyond the first sentence of the marketing page, then privacy and encryption aren't actually important to them, it's just an aesthetic.
Ah, well by those criteria alone, PenAir 3296 in 2019 would probably win - a passenger died inside the plane after a runway excursion.
Is it an abstraction for requesting the data you want, or an abstraction for storing the data in a retrievable manner?
> Is working for me in mobile Safari.

Apologies for the directness, but your definition of working doesn’t align with others then. If you mean “working as intended” where the intention is a hard to read and clumsy ux, then yep it’s working. As a proposal to how to make it less clumsy and easier to read, maybe consider having the text not inside the bars?
"AWS' availability zone isolation is better than the other cloud providers."

Not better than all of them.

A geo-redundant rsync.net account exists in two different states (or countries) - for instance, primary in Fremont[1] and secondary in Denver.

"S3 even operates at a scale where we could detect "bitrot""

That is not a function of scale. My personal server running ZFS detects bitrot just fine - and the scale involved is tiny.

[1] he.net headquarters
Arguably HNSW indexes for vector DBs are a variant of skiplists.
"Let's begin the adventure"
Go QA! Next, sysadmins turn LOPSA into a union!
The article points out that the DoJ previously charged Boeing with withholding information in the MCAS issue (but later dropped the charges).
Which side do you think the money is on [1]?

[1] https://www.politico.com/news/2024/03/09/kellyanne-conway-ti...
I think “blame QA” would be a valid response if QA had actual power to delay product launch dates in order to meet quality standards.
Show HN: Hatsu – Self-Hosted ActivityPub Bridge for Static Sites
> Just don't try running any DOS applications, that didn't work so well

It worked OK if they were small applications and didn't access hardware directly.
Agree.

> S3 even operates at a scale where we could detect "bitrot" - random bit flips caused by gamma rays hitting a hard drive platter (roughly one per second across trillions of objects iirc).

I would expect any cloud provider to be able to detect bitrot these days.
It's largely outsourced to cut costs, you get what you pay for.
Are filesystems the correct abstraction to build databases on? Isn’t a filesystem a database in a way? Is there a reason to build a database on top of a filesystem abstraction rather than a block abstraction?

To say you can’t build an efficient database on top of S3 makes sense to me. S3 is already a certain kind of data-storing abstraction optimized for certain usages. If you try and build another data-storing abstraction optimized for incompatible usages on top of that, you are going to have a difficult time.
I used to have swap on MLC SSD 128Gb bought per $100 but do not remember year. I used it on a laptop with really heavy use of swap for web-browsing. The SSD stopped being functional after few years of such usage. It refuses to write anything but I can read my files having few KB/s somehow. I never watched SMART on this drive but I believe swapping killed it.
People seem to have an easier time forgiving crimes if they're highly abstracted. I'm not sure if this is apocryphal but apparently drone pilots are less likely than other soldiers to feel extreme guilt about killing people. Prince Harry flew a helicopter in action and compared it to a video game, likely a PR recruiting statement but revealing nonetheless. I'm not a soldier so am speaking out of turn and may be completely off base.
>ChatGPT is destroying the freelance writing market.

As someone very close to this area, I seriously question this. Yes, there are very low-rent content mills with material being cranked out by people who are being paid pennies per word. But serious freelance writing being commissioned by many corporations (where the pay is more in line with $1/word) are not going to be replaced by ChatGPT anytime soon. The writers may use ChatGPT as an assistant and perhaps rates will decline further over time but this basically falls in the same category as we won't need programmers any longer.

Maybe? But now you're in the category of AI will take all the jobs.
The question relates to how can you create a system that helps align peoples incentives with the goal of the forum.

Imagine if you could allow users to delete comments they don’t agree with. That would create the antithesis of a curious discussion, so that feature isn’t available. So, yes, a good system can constrain what users are allowed to do with intelligent guardrails.
Yes, all off and several google domains blocked with noscript too.

I don't want anything to be automatically personalised, and Firefox already does a good job of keeping my browsing history & bookmarks.
But that would violate the free will of all of the people who have no problem with China owning the app that they use. There's endless propaganda and advertising we are subjected to in the west. Second guessing people's free will because of influence destroys democracy.
Nvidia has insane margins so it isn't hard* for a well-funded player to beat them in FLOPS/$. The hard part is the compiler toolchains, the libraries, the documentation, getting models to run fast.

* Everything is relative. It's hard to make even a simple microcontroller - but also it isn't hard, you know?
Yes, I turned it off a long time ago.

But I'm also not normally signed into a Google account, I don't use anything that automatically signs me into Google (not a browser nor any other program or device), I run aggressive Web tracker blocking, I try to use Tor Browser for sites that don't require logins, and my phone is GrapheneOS without any Google Play apps.

That's little more than the minimal, IMHO. Google and many other tech companies are still able to violate me, but the next tier of defense against them is too difficult.
same, mine dates back to november 2009, I think it might be to the day it was introduced, through my HTC Dream/G1 phone
People generally don’t like being interrupted by “smart” comments, be it by an LLM or by other people. It requires tremendous contextual and situational awareness to know when it is appropriate.
> S3 is a cloud filesystem, not an object-whatever. [...]I think the idea that S3 is really "Amazon Cloud Filesystem" is a bit of a load bearing fiction.

Does anyone actually think this? I have never encountered anyone who has described S3 in these terms.
The Play Kits by Lovevery: Montessori Toy Subscription Ages 0-5
Human conversations are often multithreaded. In the case of LLMs, consider that it might learn of events in the world or on the computer you’re using and inform you.

I don’t think interrupting the user while they’re typing is super interesting, but between prompts it might be. “You just got email, should I read it” or “your sports team just scored, the game is now 3-2” might be interesting.
"Building and Maintaining an Amazon S3 Metadata Index without Servers" - https://aws.amazon.com/pt/blogs/big-data/building-and-mainta...

Here is the architecture of Amazon Drive and the storage of metadata.

"AWS re:Invent 2014 | (ARC309) Building and Scaling Amazon Cloud Drive to Millions of Users" - https://youtu.be/R2pKtmhyNoA

And you can see the use here at correct time: https://youtu.be/R2pKtmhyNoA?t=546