skysight-inc/HackerNews huggingface dataset:
S3 is obviously not a filesystem in the sense of a POSIX filesystem. And I would argue it is not a filesystem, even if we were to relax POSIX filesystem semantics (do not implement the full spec). But what is certainly possible is to span a filesystem on top of S3. It is basically possible to span a filesystem on anything that can store data. You can even go crazy for demonstration purposes and put a filesystem on top of YouTube (there are some tech demos for that on GitHub).

I think a better question is whether there are any good filesystem implementations on top of S3. There are many attempts like s3fs-fuse[^1] or seaweedfs[^2], but I have not heard many stories about their use at scale from big companies. Just recently there was a post here about cunoFS[^3]. It is a startup that implements a POSIX-compliant (supports symlinks, hard links (emulated), UIDs & GIDs, permissions, random writes, etc.) filesystem on top of S3/AZ/GCP storage and claims to have really good performance. I think only time will tell if it works out in practice for companies to use S3 as a filesystem through fs implementations on top of S3.

[^1]: https://github.com/s3fs-fuse/s3fs-fuse

[^2]: https://github.com/seaweedfs/seaweedfs

[^3]: https://news.ycombinator.com/item?id=39640307
It depends on the risk class according to IEC 62304. When you're developing Class C software you'll need acceptance criteria that goes into how you initialize variables etc.
So you came from an S3 or other put-get world, and found actual filesystems odd?

I suppose that's not so different from a WMP user's epiphany when they discover processes, shells, etc.
They said high_er_. It's not controversial to think that C++ and Rust are higher-level than C.
> The Name Finding Guide is fun, easy to use and extremely effective

From https://www.nordicnames.de/wiki/Finding_The_Perfect_Name

I find this ... funny.

I'm happy to live in a country where we are free to choose our offspring's names (though I do think Elon Musk could have done better. I Checked and "Elon" is approved.)
At least in my experience, 99% of the time that I run out of physical RAM, it's because of some runaway process that's gobbling up as much as it can for no real gain, or otherwise attempting to perform a computation that could only complete with an astronomical amount of memory.

After the offending process is killed, every other useful process has had all its memory swapped out, since the offending process was so urgent in its requests for memory. Then, since the system is so lazy at swapping memory back in, each process has degraded performance for the next several minutes of usage. So as an ultimate fix, I have a shell script on each of my machines that does "swapoff -a; swapon -a" to swap everything back within a minute.

My own experience makes me wonder, what RAM configurations are people running where they reportedly find swap so useful? Is everyone else running so many useful applications simultaneously that they use almost all their RAM?
seems like the solution is to make the paperwork of approval more efficient.

this is kind of what github did for version control. it went from being this arcane chore to a fun little interface with colorful buttons.
Swift language achieves data-race safety
It looks like there are only 35 in Iceland.[1] It's more popular in the continental Nordic countries, though.

[1]: https://www.nordicnames.de/wiki/Mohammed
> S3 is not even files, and definitely not a filesystem.

I agree. To me the correct analog for S3 is a block storage device (a very weird one where blocks can be any size and can have a key associated with them) and not a filesystem. A filesystem is an abstraction that sits on top of a block storage device and so an "S3 filesystem" would have to be an abstraction that sits on top of S3 as the underlying block storage.
I don't quite follow the argument:

> it’s on you to ensure the foreignptr’s lifetime becomes interlinked with the returned b

Yes; the simplest way to do that is to make sure that your data types never contain raw `Ptr`, only `ForeignPtr` -- same as in C++, where seeing `mytype * x` should ring the alarm bells.

You could say "but what if I call another FFI function that needs the Ptr as an argument"? In that case, surely the function needs to document if it takes ownership of the pointer. If it doesn't document that, yes, it'll crash; but that's unrelated to finalizers (the "impossibility of composing" of which which is what the post claimed); it would also crash if no finalizers were involved.
thanks, that looks like a book i'd enjoy!
I'm a math PhD, was a tenured professor and then transitioned to industry. We've got two humanities PhDs that work as QA testers on our team. They're both fantastic, especially in thinking about either big picture questions or nuanced takes that others missed out on.
And do you think prices have to increase so that you can have an "artifical oversupply" of housing?

And I thought you were advocating for free markets, yes, since you talked about "market rate". Sorry for the wrong inference.

And just to be clear, I'm not a proponent of rent control, maybe rent stabilization as you said. I think, in general, people being able to keep living where the lived for a long time is a social good of great value and that we should try to implement housing policies that will make that possible.
Was hoping the article might shed some light on the ambiguity of some of the prohibition signs in the UK and parts of Europe, e.g. the "no motor vehicles" sign[0]. Given that the ones with the red circle but without the red slash typically mean up to what is shown is allowed and anything above is not (e.g. maximum speed, maximum width, maximum height), the one showing a car and a motorbike could reasonably be interpreted as anything up to the size of a motorbike and car are allowed but anything bigger (such as a lorry and a bus) are not. Adding a simple slash, as the rest of the world seems to do, and as per other prohibition signs in the UK and Europe (e.g. no right turn) would remove all ambiguity. Wonder if there's some strange history behind that apparent anomaly.

[0] https://en.wikipedia.org/wiki/Prohibitory_traffic_sign#No_mo...
Is there anything on this assertion that map is obsolete to dive into? That's a bold & very different claim.
Sending the data to /dev/null is the cheapest option if that’s all you care about.
I'm not sure how this would translate into a query, but have you thought about analyzing the longest chain of devices and comparing their PDFs? I feel like that would potentially demonstrate the game-of-telephone effect you're getting at.
To clarify, H and O and H2O are weakly emergent entities out of the artifacts of electrons/protons, similar to the copper in your example. The behavior of electrons and protons/neutrons completely explain the behavior of atoms and molecules.

And when electrons say annihilate by combining with a positron, then the artifact in this case is the say particle physics and energy conservation, whose behavior completely explains electrons and positrons, which then are emergent entities.

The naturalist claim is this happens all the way down to the base rules, which are the core never changing artifacts out of which all properties/behavior is emergent.
Well done, Aquamann parents. He'll always be called Aquamann in our hearts.
Any evidence outsourcing is the issue?
Well I’ll add to my response that I think it is delusional to think that (security) features ship bug free. It is a bar that _nobody_ can or has met. It is not how the software world works at large.
It is mentioned in the linked article.
They did not, in part because it would reveal the data-filtering routines (particularly the political censorship - Chinese LLM papers sometimes mention the ban list but never reveal it), and also in part because it might reveal things they'd rather keep secret.

For example, Bytedance has already been caught using the OA API to generate data for their models because they are having such a hard time catching up to OA - and evading bans for doing that, and also instructing employees on how to lie & cover it up: https://www.theverge.com/2023/12/15/24003151/bytedance-china...

Do you think that a small Chinese startup like 01.AI, which by their own admission had to "bet the farm" to buy enough GPUs to train the Yi models at all https://www.bloomberg.com/news/articles/2023-11-05/kai-fu-le... , and which were completely silent about cloning the American LLaMA architecture until people analyzed the released checkpoints and noticed it looked awfully familiar, is going to be above such tactics...? In this economic/geopolitical context? Especially when everyone seems to be doing it, not just Bytedance?* (01.AI claims that, the architecture aside, they didn't simply further train LLaMA models but trained from scratch. You can decide for yourself how much you are willing to believe this.) I wouldn't bet a lot of money on it, and that's why I don't expect to see any large comprehensive data releases from 01.AI for the Yi models.

* This is one of my theories for why so many disparate models by so many different groups all seem to weirdly converge on the same failure modes like 'write a non-rhyming poem', and why GPT-3.5, and then GPT-4, seemed to be oddly difficult to surpass, as if there were some magnetic force which made reaching near 3.5/4 quality easy for 'independent' models, but then surpassing somehow difficult. Everyone is lying or mistaken about 3.5/4 data getting into their corpus, and the sugar-rush of imitation learning fools you into thinking you're making a lot of progress, even when your overall approach sucks. (As Andrej Karpathy notes, neural nets want to work, and so even if you have serious bugs in your code, they will still work pretty well - and simply permanently fall short of their true potential. Cautionary recent example: https://twitter.com/karpathy/status/1765473722985771335 )
Yeah. Loopholes are usually filled with the bodies of those that abused it to the point of being paved over. So even if Chad was winning, he lost, and the ability to play will be removed.
Yes, both can be and are true at the same time. It's not an either/or.
Twitter thread: https://x.com/khoomeik/status/1766805213644800011?s=46
This is why regulation is rarely the answer. Corporate lawyers are ultimately more clever and better-paid than the congressional staffers that are writing the laws.

It's also much easier to find a loophole than it is to predict and avoid all loopholes, especially with all the compromise required to pass a law.
I think the parent meant that it could be built by 'modern' people, homo sapiens sapiens, with the same intelligence as people living today
Many reasons, but here's one from the same site: https://thelocal.to/one-year-fifty-cover-letters-three-inter... (the URL kind of gives the point away already)
Mine: https://github.com/dvcoolarun/web2pdf

Small command-line tool to convert webpages to beautifully formatted PDFs. It supports batch conversion, custom styling, appending CSS, complex layouts, page numbers, table of contents, and pagination, among other features.

Recently: https://news.ycombinator.com/item?id=39265756
Cool, I try to do the same and yeah, my success rate is roughly the same. :)
This is hard to take seriously from Amazon.

I realize it's a big org with many diverse teams. It's just that the company seems to be rotting from the head down. And it's hard to overlook the stories of how some employees get so exploited.
It's also very flammable, which is a bit of a problem.
Or how clustered cultures are.
Those responsible will golden-parachute out and will simply be replaced by similar.
I implemented a solution by threading the listing. Get the files in the root then spin a separate process to do the recursion for each directory.
Hi, author here! I think my main concern with this process is that the predicate itself might never have gone through clinical trials.

So even if the new device works as well as the predicate, that predicate might be equivalent to a whole chain of devices that have never gone through clinical trials.

This might be fine if the device is low risk, but the 510(k) process has a history of clearing devices that have resulted in patient deaths.

Of course it's a balance between too much red tape and having unsafe devices, I was just personally surprised at where the FDA draws the line today.
The same rules apply for an adult changing their name: https://www.skra.is/english/people/names/name-changes/

As someone who spent half my life with a name I hated, to me this is more "human rights violation" than "fine".
Funny that he is now into… cryptocurrencies. The man has experience with bogus markets.
Wise old saying:

"Three people you should never lie to: your doctor, your accountant, and your attorney."
This shows Steve Jobs was not exaggerating to claim personal computers wouldn't have had proportionally-spaced fonts had it not been for the Mac. Windows 1.0 and 2.0 font was a horrendous-looking fixed-width thing.
Its not so much in direction as it is bureaucracy and corruption.

From what I've seen, regulatory agencies and processes are created for a combination of well intended concern for public safety and a power grab. Neither of those are based on indirection so much as ignorance (or hopefulness?) and greed, respectively.
Those are not my kind of humor. To my knowledge, LWT doesn't do those. I could be mistaken, as I honestly do remember all their episodes by heart.
S3 is really high latency though. I store parquet files on S3 and querying them through DuckDB is much slower than file system because random access patterns. I can see S3 being decent if it’s bulk access but definitely not for random access.

This is why there’s a new S3 Express offering that is low latency (but costs more).
Not sure if the author is aware of EFS
Interestingly the page mentions that the jump was possible because of better landing sites (made of foam). Really surprising !
Isn't that what this thread is about? The GP started talking about how this social hierarchy is ruining the country.
Funny how Caesar is on the approved list. In fact so is Hannibal! Napoleon is the only world famous conqueror who doesn’t make the cut that I could find in a brief search.
Couple issues:

The article itself is basically a direct description of how people are lured into academia with exactly that expectation, and then end up in the gig economy. Not "choosing" much of anything. The market says you're the academic equivalent of a taxi driver.

There are other locations to consider theory if theory's your thing.

Museums: support of archaeology, art analysis, sociology, geography, history. Ex: The British Museum, https://www.britishmuseum.org/research/projects

Aquariums/Zoos: Earth science, plants, genetics, ecology, animal science, zoology, microbiology, nutrition, pathology, physiology, medicine, conservation. Ex: Columbus Zoo and Aquarium, https://www.columbuszoo.org/science

NGOs and Foundations: Earth science, plants, genetics, ecology, astronomy, education, data science, sampling/measurements, foreign affairs, international politics, finance, economics, public outreach. Ex: The Carnegie Foundation and Sub-Foundations: https://en.wikipedia.org/wiki/Carnegie_Corporation_of_New_Yo...

Gov: support of aeronautics, engineering, data science, computer science, forestry, agriculture, architecture, almost every hard science, economics, finance, law, even recreational specilists. [1] Feds have ~3M employees. States have ~5M employees. Local govs have ~14M employees. [2]

A lot of the jobs are workaday jobs, yet there's still a bunch out of ~22M that are somewhat "research". Formerly a contractor at NASA, and even for a contractor (not civil servant), seven publications. Mostly, minor citations, maybe 10-15, yet still, seven publications on research topics.

[1] https://www.usajobs.gov/help/working-in-government/unique-hi...

[1] http://www.truthfulpolitics.com/images/u-s-government-employ...
They don't have to be more clever. They just have to be faster to adapt, which is trivial given the glacial pace at which legislation is passed in the US.
In addition to representing basic supply and demand principles, this sounds like a good way to mitigate the worker shortages than many restaurants have faced recently. You need enough workers to meet peak demand. This serves to lower peak demand by spreading it out.
The features in the EE should be there because the effort requires expertise and cost. If it can be done by the community then it’s not really enterprise grade.
S3 actually uses a completely custom system[1] for writing bytes to disk. I haven't seen much in the way of details on the on-disk format but I certainly wouldn't assume it resembles a normal filesystem.

[1]: https://aws.amazon.com/blogs/storage/how-automated-reasoning...
I don't doubt that it's possible to find out what kind of car the jury members drove, but is there actually a public record of it? If so, please show the link.
I guess that's a third approach you can take, if you're already a nihilist on some level.

I'm not, so I find the message of finding niches people haven't pushed hard enough into to make the world a better place (and maybe make some money while you're at it) to be pretty uplifting.
That article is old. DynamoDB was used because of the old, weak consistency model of S3. Writes were atomic, but lists could return old results so needed consistent list of objects.

But in 2020, S3 changed to strong consistency model. There is no need to use DynamoDB now.
FWIW I don't mind the sideways text, but the ant's-eye-view histogram is one of the strangest user experiences I've had in data science.
Aquamann Aquamannson
> “The reason why Texas and Florida are doing well and California isn’t, it’s the cost of housing and high taxes,” said Sung Won Sohn, an economist at Loyola Marymount University in Los Angeles. “We have lost a lot of small businesses.”

This former is the crux of the problem: California entered into a suicide pact with real estate speculators in the 70s, from which it seems entirely unwilling to extricate itself. It’s an incredibly destructive drag on the state’s entire economy that prevents new business formation and labor mobility.
The article spends at least 4 paragraphs explaining how the scheme works, did you read it?

There is no loophole, since what they did was illegal to begin with and they knew it, it's a very basic and common scheme, it's VAT fraud and that type of fraud has existed since VAT exists.
Flashback to that Clichy datacenter fire near Paris...
150K worth of JS doesn’t seem too bad in my eyes, considering the level of interactivity here (not just for the filtering, but also for the input dialog). Almost half of the 150K is actual data, which is embedded into the JS file directly.

To put things into perspective: the preview images are around 20–60K each, so if you scroll the entire list, you end up downloading ~5M. If at all, this is where I’d start to look at in terms of optimising bandwidth.
This looks very similar to the Picochip designs used in a lot of small cellular base stations for SDR. I hope it is similar, because those were fantastic chips to program for. That influence could have come via Intel's acquisition of Picochip.
“New information technologies, including AI deepfakes, quantum computing and blockchain, could also present challenges, says the report.

"Law enforcement should anticipate that criminals will leverage technological innovations to gain profit and influence," the report says. "Law enforcement should also continue to contribute to policy change related to the privacy of personal information, artificial intelligence, the Internet of Things, quantum computing, digital ledger technology and more."”
It's an existential problem for the species that we can encode into our structures conceptions of the way the universe works that are measurably wrong

Bloodletting is well understood that it doesn't work but there was a time where the most trusted people performed that

Why is that even possible? There was absolutely no epistemic proof that bloodletting was associated with a falsifiable hypothesis which would lead to improved health outcomes - in fact it was all based on these "humors" in the body that needed to be "balanced" which makes no mathematical sense whatsoever.

Even then, as early as the 1400s there were scientists saying "This is actually bad" - and yet George Washington had bloodletting done on him in his dying repose at the end of the 1700s

300 years of an activity that is bad for you that was encoded into medical practice

The conclusion we should come to is that MOST of our assumptions about the structure of the world and how to optimize within it, are based on literally nothing but aggregated social velocity, instead of claims that are measurable and testable
Written in English, using a German TLD. I love the future!
"If you run an open source project, I'm entitled to have my contribution accepted"

_This_ is the sense of entitlement that people (rightly) disparage.
Being in the PNW I for one would rather the sun go down at 4 in the winter than 3. Losing an hour of sunlight at 10pm in the summer is ok for me. I have blackout shades specifically because the sun is up too late in the summer in the northern US.
I love this reply.

It's a particularly touchy subject because it involves people's health and the ability/inability to pay for it.

But as a sufferer of a debilitating disease with a miracle drug that costs an arm and a leg, I've become a convert to the US pharma-industrial complex. These drugs take billions of dollars and decades to research--that funding/development isn't going to happen without venture capitalists who shoulder that risk for the profit reward. An equal number of pharma venture capitalists lose all their money, researching dead-end drugs.

I'm incredibly blessed to have both a cure invented during my lifetime and the means to pay for it. But even if I lacked the means, I would still infinitely prefer a world where a cure exists that I need to somehow access, as opposed to a hopeless world with no cure.
I would love to see data on what the impact of more local restaurants, cafes and delis are seeing. As we work from home, we are spending more time in the actual places we live. This but paints one picture, and maybe the reality is that we don't need a sandwich shop on every single block.
Mastery of the subject matter is never overrated when the goal is ambitious and the success criteria is unforgiving.

Bloated monopolies with compliant regulators can afford this sort of thing. FAANG was hungry once, and we got along because we respected each other’s abilities and were knife fighting our competitors.

Focus on an attitude of humility around what one still has to learn, what one always still has to learn. Focus on an attitude that others may always have something to teach.

Focus on an attitude that mastery is never attained, only arbitrarily pursued.

The interpersonal dynamics of mutual respect fall out.
I fear that many people high up in comfortable positions - ie L6+ - have drank the kool-aid with respect to this corporation, and why wouldn't they they get paid rather well, it's the L4s and L5s that get screwed over or have a carrot of promises dangling in-front of them.