skysight-inc/HackerNews huggingface dataset:
Large datasets can be tricky to handle, as the normal workflows people take for granted may no longer work as expected.

For example, many filesystems from nix will scale just fine, self-check, and de-duplicate. However, accessing a path in a high-branching factor tree can cause problems for ls or rm etc.

Notably, for external BLOBS we found it simple to convert a filename into its sha512 hash with standard formatted media specific extensions, and include the extracted meta-data file in json (details of the encoding, label, and stats etc.) Thus, for quality of life improvements we would pack the sub-paths based on the file hash characters... so the smaller leaf path content entries were present in a given path (char[0] is local index, char[1..k] is the sub paths.)

It is strange, but when the files get big it is convenient to be able to audit each part in a decoupled way independent of the underlying filesystems/NFS/databases.

the file hash stored inside a database also infers the host OS file set label, and packed location

* the metadata is preserved along side the media in human readable utf8 json text, and thus the host node does not require knowledge of the media specific encoding during most operations (i.e. the file-server has minimal dependencies.)

* the file external-BLOB location is set by the size of k-1 hash string length used (k=128 chars in hash512 for example)

* normal CLI still works in each k-1 leaf path, and will be under ((2+w)16files) entries depending on how its implemented. Note, Windows usually demands k<124 sub-paths deep, and caps string lengths to under 260 chars.

BLOB file sets are trivially accessed/locked by many processes on the host OS, and additional files with extensions/analytics may be put beside the original media as json metadata etc.

* operates on top of whatever filesystem you are deploying at the moment, where we assume k<=128 will sit under your file system limits

* user and group read-only permissions are supported on the host NFS or JBOD

* Must turn-off auto-indexing filesystem search routines on the host OS node

* a database BLOB index can be rebuilt/ported from the archive tree leaf nodes

* source file corruption is self-evident (the metadata should match inside the json file as well)

* contents are obfuscated, but duplicate file checks are trivial (note this differs from block level de-duplication, which can be impractical if the data flow rate is high)

* tree-root-node sub-paths may be externally mounted on explicitly sharded volumes to share/backup the workload as needed... given the pseudo-random hash makes specific io-busy areas unlikely.

Mind you we only had to deal with only around 40TiB of sparse video data on that old project. Unsure if such a method would be performant for 2M hours of content.

Sometimes the metadata format inside media is versioned in nonstandard ways... if your intent is long term access support, than storing stats on the program and version used to read the file may be necessary to parse it properly in the future (even if a VM OS image snapshot with the codecs/parser is also archived as a read-only file.)

Best of luck =3
Crypto Industry Loudly Defends Telegram's Pavel Durov
To be fair, this project is not a CL Emacs. It's a separate editor doing its own thing that happens to share the same keybinds and a few architectural decisions.
Good job, we built something similar. Maybe not be ready for a full show hn, but if you want to try: https://hn.garglet.com

Has some additional features:

1. find similar users

2. Negative similarity search

3. Browse user comments from oldest first

4. Flattened comments in reverse chronological order on stories

Edit: show hn thread:

https://news.ycombinator.com/item?id=41404856
https://archive.ph/5ui6z
Salesforce CEO Marc Benioff says Microsoft Copilot has disappointed customers
Upgrade your desktop: Ubuntu 24.04.1 LTS is now available
Looking forward to the emoji for https://en.wikipedia.org/wiki/Lopado%C2%ADtemacho%C2%ADselac....
In many cases, a simple off-the-shelf smart plug would suffice.
Total aside.

In Neal Stephenson book Seveneves the technology of a future is in a few small ways described as weirdly un-advanced compared to the present. I wouldn't describe it as the focus of the book but it still seemed particularly implausible to me but ... I hadn't really thought about Japan. I've never been but I've read that in a few ways technology (fax machines were (are?) still popular just a few years ago) is weirdly retrograde.

That said for potential readers of Seveneves - as with all Stephenson's book it needed an editor to keep him in line. The second half was no where near as good as the first. There were plausibility problems with the technology used throughout the book. Also it was really a lot of fun and I have to admit that I enjoyed reading it.
> as 1 ten millionth the distance of a line drawn from the equator to the north pole, through Paris.

Rationalized but nearly unrealizable.
The FDA shortage list allows compound pharmacies to produce it without paying for patents/licensing.
I'd love to live in a world where failure is free, but this aint it. This seems like it has potential to poison your image and potentially harm others as well.
Well, for what it's worth, your machine-translated sentence is basically incomprehensible in Japanese, let alone in a position to go viral (except in the capacity in which exquisite gibberish sometimes does). I could only infer what I think you intended to say ("This only works as long as translation is expensive"...?) by translating it back literally coupled with guesswork about what English text could have given rise to this "translation".

Not that your point isn't actually a good one - we do now often see the worst of US-made culture war toxoplasma (in all stages of its lifecycle) being imported wholesale into European cultures where it is barely relevant to local circumstances, which I would squarely blame on sufficient English skills and superior production value of anglophone politics.
Hey, thanks again for the talk and for answering my fork bomb question with a live demo!
Compared to libraries like bgfx and sokol at least, I think there are two key differences.

1) SDL_gpu is a pure C library, heavily focused on extreme portability and no depedencies. And somehow it's also an order of magnitude less code than the other options. Or at least this is a difference from bgfx, maybe not so much sokol_gfx.

2) The SDL_gpu approach is a bit lower level. It exposes primitives like command buffers directly to your application (so you can more easily reason about multi-threading), and your software allocates transfer buffers, fills them with data, and kicks off a transfer to GPU memory explicitly rather than this happening behind the scenes. It also spawns no threads - it only takes action in response to function calls. It does take care of hard things such as getting barriers right, and provides the GPU memory allocator, so it is still substantially easier to use than something like Vulkan. But in SDL_gpu it is extremely obvious to see the data movements between CPU and GPU (and memory copies within the CPU), and to observe the asynchronous nature of the GPU work. I suspect the end result of this will be that people write far more efficient renderers on top of SDL_gpu than they would have on other APIs.
If having one is good, having two must be better!
This would be much more interesting if it had some details - which band led to the spike, what tech/approach helped with scaling, etc.
Am I allowed to use this as party lighting by putting it on a 60 inch TV in my living room?
I feel like there is also a big misconception of 'waveform collapse' and the influence of a cognitive observer 'measuring' the final result, surely wavefunction collapse happens constantly due to several particles self interacting with each other and the environment. (not what your implying btw just needed to state it) and yes quite precisely the destroy entanglement point is the Decoherence process that permanently ties (correlates) that particle with the physical world around it. The future is inherently unknown to any observer and only advancing forward reveals the truth (at least on the Macro scale lol)
Show HN: Asyncpal: Preemptive concurrency and parallelism for sporadic workloads
Hi HN ! Alex here. I'm excited to show you Asyncpal (https://github.com/pyrustic/asyncpal), a Python library for parallelism [1] and preemptive concurrency [2] tailored for sporadic workloads [3].

I've been working on a private project where it would be convenient to have asynchronous versions of some operations without using `async/await` [4]. Besides `async/await`, which represents cooperative concurrency via the `asyncio` package, Python also provides preemptive concurrency through its `threading` package. Additionally, the `concurrent.futures` package builds upon the `threading` package to provide a thread pool [5], which is the design pattern my project needed for managing concurrent tasks.

Although a thread pool is the right tool for the problems it solves, its creation and usage involve the allocation of resources that must be properly released. For this reason, it is recommended to use a thread pool with a context manager [6] to ensure that resources are properly released once the pool executor has finished its tasks.

However, this strategy can introduce overhead in programs that sporadically submit tasks to a thread pool, as multiple pools may be created and destroyed throughout the execution of these programs.

Maintaining one or a few thread pools for the duration of a program can be an effective solution, assuming these thread pools can automatically shrink after workers have been idle for a short period defined by the programmer.

I developed Asyncpal to meet the requirements and extended it with processes to achieve parallelism. For more details about this project, please refer to the README. You can download the lightweight package on PyPI, try the examples provided in the README, or run the tests on your machine.

Let me know what you think about this project.

[1] https://en.wikipedia.org/wiki/Parallel_computing

[2] https://en.wikipedia.org/wiki/Concurrent_computing

[3] https://www.cloudcomputingpatterns.org/unpredictable_workloa... (related)

[4] https://en.wikipedia.org/wiki/Async/await

[5] https://en.wikipedia.org/wiki/Thread_pool

[6] https://superfastpython.com/threadpoolexecutor-context-manag...
Apple's great AAC encoder was (is?) also available as part of iTunes for Windows. One can extract the DDLs from the installer and use them with qaac to encode AACs. Apparently even works in Wine: https://www.andrews-corner.org/qaac.html ! OBS also picks up CoreAudio DLLs so streamers install iTunes for Windows to improve audio quality on their streams.
The world "dragon", i.e. Greek "drakon", originally meant just "big snake" and this is its meaning in the stories from the Greek/Roman antiquity or in the Bible translations.

Much later, during the Middle Ages, "dragon" began to be used for translating the names of many kinds of animals, usually of the winged type, from the mythologies of various countries.

In order to identify the many kinds of "dragon" animals, in each case one would have to trace the origin of the story, which was the original language of the story, which was the original word that has been translated as "dragon", and which was the description of that animal, e.g. with or without wings, with fur or with feathers or with scales, with or without feet and so on.
Thanks for the info. What if the poison was exactly a poison like in this case? I realise “the dose maketh the poison” but it wasn’t exactly strychnine or cyanide.
> It just bores the rest of us.

Yet you take the time to reply. This always baffles me.
He’s facing civil repercussions. He, as a worker of the city, disseminated information to the press that reveals undercover police reports, witness names and testimonies, and various other sensitive information. That may not be illegal, but if he broke a contract or other agreement then it’s expected that he faces repercussions.

The city may be in the wrong for downplaying the severity, but he’s in the wrong for directly handing over the hacked information he has to journalists.
It looks fractally terrible, but:

> "This is not about speech. It's not. It's about the actual action of
> going on the keyboard, going into the dark web, gathering the information,
> downloading it to your computer and then disseminating it to people
> who are in the press or otherwise," Klein said.

... sounds a lot like free expression (especially when the city is lying)
On The Edge: a book review of Nate Silver's Riverian memoir
Florida state parks proposal was further along than DeSantis said
Bill to Require Public Schools to Ban, Limit Smartphones Passes (CA)
> usually quite delayed.

I used to be a regular reader of AnandTech since the early 2000s and the delays are what drove me off the site. Specifically when the Nvidia GTX 1080 launched on May 27, 2016. The AnandTech review came out 2 months later on July 20, 2016. [1] I had no problem waiting a whole week, but after that it was getting ridiculous. They just didn't serve their readers.

After I found replacement reviewers, mostly on YouTube, for my in depth reviews, I never went back to regularly visiting AnandTech. Their time had already passed in 2016 as far as I'm concerned. Not only were they delayed, but their reviews weren't even the most in depth any more.

--

[1] https://www.anandtech.com/show/10325/the-nvidia-geforce-gtx-...
Reports of the Death of Dental Cavities Are Greatly Exaggerated
Especially sketchy places like Hacker News. Just look at the name!
I mostly agree. Still, being a minority from Montreal who left and found life in Japan significantly less alienating, I hesitate to agree wholeheartedly.
Scary and stunning. The RIGHT stuff. American heros. Thanks.
My strongly held opinion is that dragons are dinosaurs and like dinosaurs and birds are in the group Archosauria so I'd be inclined to lump dragons in with birds. This explains why you never see dragons because you never see dragons for the same reason you never see dinosaurs.
Microsoft is terrible at this. First they launched a GPT-4 based bot (beating Open AI to it), that tried to convince a reporter to leave his wife [1]. Then they released half-baked Copilot bringing a bad name not just to themselves but to all of AI. Now people are reluctant to use anything that has AI in it [2], and I blame Microsoft.

[1] https://www.nytimes.com/2023/02/16/technology/bing-chatbot-m...

[2] https://www.cnn.com/2024/08/10/business/brands-avoid-term-cu...
Craziest thing IMO: It doesn't leave its larval stage, but you can give it the hormones that turn other reptilians into adults - and they work! You'll get a living adult axolotl, a pretty normal looking reptile with just a few minor bugs (IIRC).
NASA makes room on SpaceX trip to return astronauts stuck in orbit
Yeah, pretty sure I would have simply been suspended for pulling off the GP's prank. Maybe even expelled, but then parents would talk it down. Your event would definitely have me gone. Sorry your experience was like that.
This article may give you some informed answer:

https://mitchellh.com/writing/grapheme-clusters-in-terminals
The US intervened AGAINST Israel, Britain, and France during the Suez crisis, in favor of the Arabs.

Not against Israel (and certainly not in favor of the Arabs) - but rather against Dayan and Ben-Gurion's strategy of calculated provocations against Syria and Egypt. Dulles had actually decided in favor of providing arms to Israel by the end of late 1955. But his hand was tipped by Israel's severely destabilizing actions (most notably Operation Olive Leaves), and most decisively by Ben-Gurion's calculated decision to also conceal these plans from Washington.

The other narratives that you're presenting above are similarly problematic. You aren't even using the term Zionism correctly. It isn't about the geographic origins of the Jewish people; but rather specifically about the idea of setting up a 19th century-style nation-state in their interest (and of resettling large numbers of people to a place where their ancestors had not set foot in for well over a millenium) -- by definition (and in every dictionary and encyclopedia definition you will find) an intrinsically modern concept. Nor is it "core" to Jewish people in general, only to some.

I wish we could explore these topics further. Unfortunately, you are attributing statements to me that I simply didn't make (I never said that the American Zionists were "the center of the movement", or even remotely implied as much), which, on top of the multiplicity of broken narratives you are presenting here, suggests that continued discussion is unlikely to be productive.
They are, though, considering how poorly we treat non-violent felons. That’s beside the point though, because his legal rights are not being infringed. Being sued and being charged are completely different. One is civil, the other is criminal.
Why would you even say something like that?
Our property values were great until they installed the seismographs.
I really love this kind of thing. I made one called 'redoku' a long long time ago. It generates random challenges. Try it here: https://padolsey.github.io/redoku/
int *ptr;

// but let's change it to *int ptr;

// because the pointer symbol is more logical to write first

Please can we solve a real problem instead?
I like https://nohello.net/ better, I find it a bit more instructive.
AI SaaS Launcher
Dome launched a SaaS platform that uses generative AI to build a SaaS frontend. The differentiator from other low-code, no-code tools is you get the full code base and it's platform agnostic.
Apple stands by decision to terminate account belonging to WWDC student winner
> Cultural heterogeneity is born out of isolation.

What level of "isolation" forms that threshold though? We're nowhere near a single worldwide religion, for example, which is odd because it's the most existential of cultural beliefs.
Bandwagoning onto this aside, I had really similar thoughts on both fronts. Are things really "retrograde" in Japan because they hang onto older technologies faster, or do they hang around longer because they make sense for their circumstances and needs? We don't say walkie-talkies on security guards are retrograde (not a perfect analogy, I know).

And yep, I like to think of Seveneves as 3 books in a big trench coat where the first 2 are fantastic and I wholeheartedly recommend to anyone that likes some solid sci-fi.
I made some pretty big changes worthy of a re-post.
Or a 2012 MacMini, $~90 on ebay. Quiet, small form factor, runs Linux.
People think they’re so cool for spying.

Then you get older and realize… we should all be friends. There’s just no point in fighting.

There should be no us vs them.

Hopefully this can be figured out by our leaders soon!
For what it's worth, he didn't generate this data from an attack; he's just downloading it from Tor BBSs. The term "cybersecurity expert" contains multitudes.
I put a few forums online that never got active users. What they did get was spam, plenty of it, a lot of it. We can imagine the sheer amount of garbage posted on hn, reddit, Facebook etc

Deleting the useless garbage one has to develop an idea where the line is suppose to be. The bias there will eventually touch all angles of human discourse. As an audience matures it gets more obvious what they would consider interesting or annoying. More bias.

Then there are legal limits in each country, the "correct" religion and natuonalism.

Quite the shit storm.
> First there was the beta amyloid theory

First? Isn't the beta-amyloid cabal still blocking all Alzheimer's research unless the researchers find a way to even tangentially support that long disproven theory?
We are generating React/Remix app atm, but our architecture is designed to support other frameworks as well.

It is achieved by using data as a source of truth, not the code. Web tooling is very fragmented. People have too many opinions on how to write components and that makes it nearly impossible to have components written by hand and then synced back into the UI without enforcing a huge amount of constraints. You will end up writing code in such a way that the UI can handle.
1491 is a good book about the history of the America (N & S) before Columbus and Europeans arrived:

https://a.co/d/dNSm5Ez
Password protect a static HTML page, decrypted in-browser in JavaScript
Haha thanks. Probably looks great on bigger displays.
Regarding the suggested categorization: Why is a dragon considered “grounded”? Why is a scorpion considered more “squishable” (good luck!), than a lizard?
> they locked interest rates at 0

"How to destroy innovation and ensure monopolies take over your economy."
the author's own games: https://eblong.com/zarf/if.html
The acquisition of PA Semi was announced in April 2008, so it is possible discussions were already in progress by the time of the first iPhone launch
That's why I try as hard as I can to find either truly "dumb" devices with mechanical switches vs momentary buttons or devices that remember their last state after A/C power is restored. Hard to figure out the second option though without trying it unless a review happens to mention it specifically.
Since you mentioned Gaza and Palestine, I assume you are against Israel’s response. I don’t want to turn this comment section into that at all. I just wanted to say I feel that I can’t speak in support of Israel. The opposite can also be true.

Again, not wanting to turn this into a Palestine/Gaza/Israel thing just pointing out that people on the other side feel the same way.
I'll allow it this time.
Heroku is still good for tons of stuff. After Salesforce bought it, it stopped getting much better, they removed part of free quota, some add-ons disappeared, and the like. For example, http2 support just went beta on may. It's a shame.
Guidepup: Screen reader driver for test automation
Good point, those are totally different things, but it is often hard for someone else to tell the difference unless you explain.... explaining can also be a complex issue in office politics, because some people will see explaining as seeking and requiring their approval, and therefore subordinating yourself to them.
Very fair. The line between conscientious preservation and alienation can be (and often is) an easy one to cross.
Nations are not made from dirt. National character wont seep into any group that wonders in. Replacement of the Japanese means the death of Japan, just as much as it does to any other country and has caused so many issues in the west

Economic stagnation is preferable (and has better solutions anyway), the only ones to gain from immigration are foreigners that hate you, your way of life, and some fat cats that hate you ten times more
There are two entangled curves: the demographic shift and the urban real estate pyramidization game.

The demographic "leveling off" is inevitable. Until that point is reached, however, favorable demographics can partially offset pyramidization. The US population is still growing (largely through immigration) so it has not reached the endgame stage like Japan and parts of Europe have.

The pyramidization game works by artificially restricting urban housing supply more and more over time. If everyone reacted by buying instead of renting, the game would always end in a 2008-style crash, when the pyramid's bottom-most layer finds itself under water with no further buyers to push it up.

Instead, with renters in the picture, housing prices rise until rents equal the maximum amount of income that can be extracted from renters. This keeps the bottom-most pyramid layer just afloat.

At the equilibrium point, economic growth is stunted. The "working segment" of the population is trapped by rents and mortgages, and cannot take chances. The "housing baron segment" tends to underfund productive investments like the stock market, with real estate looming large on their books. The government has to allocate a lot of resources to the budget effects and stabilization requirements caused by the real estate system, including indirectly via the banking system.