skysight-inc/HackerNews huggingface dataset:
Even pure python code could have race conditions with the GIL disabled. Stuff like accessing and modifying a dictionary item in python code is assumed and currently guaranteed to be atomic because of the GIL. Remove the GIL and decades of assumptions break.
For anyone looking at it on desktop and wondering how to play it: make the browser window wider.

Window width as a determining characteristic of a mobile? Come on.
US immigration is broken beyond repair. Hard to summarize all the issues in an HN comment, but you may find some of Cato's work on this relevant (e.g., https://www.cato.org/policy-analysis/why-legal-immigration-n...).

Briefly, US immigration has little to no concept of merit. The simple (in theory but hard legislatively) fixes are to make it a lot more like a points based system that favours a combination of skill/education/wages instead of race or country of origin and on the worker rights front removes all dependence on the employer for immigration.
> "And as outlined above, these means are no suitable replacement for true thread based parallelism."

Your only argument is that "thread-based parallelism can't be achieved without threads", but that's not relevant to the conversation whatsoever.

The fact of the matter is that Python (already today) allows you to achieve parallelism across both IO-bound and CPU-bound workloads.

For CPU-bound workloads, the number of threads you can run in parallel is bound by the number of cores you have. For IO-bound workloads, your threads are just waiting on interrupts.

What are concrete use-cases where thread-based parallelism in Python is so desperately needed right now, that can't be achieved through process-based parallelism?

I'll give you one: real-time latency/throughput-sensitive DSP. Think real-time audio processing, or real-time algorithmic trading. Python isn't used there to begin with (for an entire flurry of reasons) - GIL or no GIL.
https://peps.python.org/pep-0703/

Quote: "In PyTorch, Python is commonly used to orchestrate ~8 GPUs and ~64 CPU threads, growing to 4k GPUs and 32k CPU threads for big models. While the heavy lifting is done outside of Python, the speed of GPUs makes even just the orchestration in Python not scalable. We often end up with 72 processes in place of one because of the GIL. Logging, debugging, and performance tuning are orders-of-magnitude more difficult in this regime, continuously causing lower developer productivity."

Quote: "We frequently battle issues with the Python GIL at DeepMind. In many of our applications, we would like to run on the order of 50-100 threads per process. However, we often see that even with fewer than 10 threads the GIL becomes the bottleneck. To work around this problem, we sometimes use subprocesses, but in many cases the inter-process communication becomes too big of an overhead. To deal with the GIL, we usually end up translating large parts of our Python codebase into C++. This is undesirable because it makes the code less accessible to researchers."
Aren’t we the eternal optimist today! Ah, to have that kind of faith in humanity again.
Threads can end in limbo too. At least with multiprocessing you get to kill those that hang. Threads, not so much.
I already block EU countries from my site. Wrote a gem called "GDPR safe" and it returns an http error code 457, if the IP address indicates an EU country.
Thanks for the reply, but when you mean "fine-tuning" for the prompt, do you mean fine-tuning of the LLM encoder of the prompt right ? (The thing that transforms the prompt into a sequence of embeddings?) But that is not cheap/easy to train ...

I know some systems also allow an extra fixed embedding parameter to the prompt, that can also be fine-tuned. But that is yet another thing that can be fine-tuned very cheaply.
And loudmouths with outrageous opinions love Twitter because they know their precious tweets will eventually get caught by some semi-popular website one day.
> Don't you think this reasoning is a bit black and white?

> This is not a trick question, those are genuinely the only two outcomes I can think of.

Only being able to see the two extreme outcomes is pretty much the definition of black / white thinking.

What normally happens is somewhere in the middle.

> Can you see any other possible outcome from the vast majority of employment being made obsolete?

There are an infinite number of possible outcomes.

Probable outcomes are much smaller, but again there’s way more than two.

Life ain’t binary.
> If this isn't true the only hope for existence (assuming AGI that can replace humans) is that you're a pet of whatever entity controls the AGI.

That's basically it. The best case scenario is that said entity is democratically elected.
https://archive.is/z4nt6
I really want to laugh at this but I can’t suspend my disbelief that a nutritional study in this vein actually has a control group.
I think the EU started down the path all on it's own. Fining someone who has google fonts is a bit over the top.
Prisons don't deter crime. They might give the impression of deterrence to honest individuals. However, I think everyone in prison believed they had a scheme, process, or system in order to evade detection; believed what they were doing was on the boundary of the law, but inside it; or they committed a crime of passion.
Remember graphene.

Oh, also it's a ceramic, so good luck using it in motors and so on. https://en.wikipedia.org/wiki/Ceramic_engine
Thanks. Of course. I'm flattered.
Do you need a degree to work in tech?
Spacex it’s aiming to launch in 2023 about 100 times per year, and they are not too far behind given that they launched already 49 times. The launch cadence is going to drastically increase once starship is available.
It seems a quite bigger impact that your numbers show.
You used 12 launches per year, so you were off by an order of magnitude.
(Submitter here, but also one of the authors of the presented work.)

The Quanta article rushed through some aspects of our work, so I'll try to use this opportunity to elaborate. This has a very small target audience: those who have skimmed the original post, and would like to go a bit deeper. AMA!

Alice gives us a unit distance avoiding set. We want to prove that its density is less than 1/4. Independently, Bob gives us an n element point set on the plane. We use it to translate Alice's set into n translated versions, take all 2^n possible n-wise intersections between these translations, and write up a tricky and huge linear program for the densities of these intersections. Solving that LP gives us an upper bound for the density of Alice's set.

Bob's finite set works for any set coming from Alice. So we have reduced Erdős's problem to finding a finite set with the property that its LP objective is less than 1/4. That is the search problem that we solve by starting from the 7 element Moser spindle, and incrementally adding points to it, guided by a modified beam search. The LP size is exponential in the number of points, but before exhausting memory and/or CPU budget, the search has come back with a 23 element set that is a witness to the fact that the Erdős's conjecture is true. (It is the weird graph in supplementary material https://bit.ly/unit-distances )
I spent a long time rebutting each counterfactual in turn, but then I recognised that I was falling for a gish gallop. Furthermore, as dang is (rightly) adamant about avoiding personal remarks, I had to cut out the funny bits.

So instead, here's the simple truth.

The UK, in a surge of authoritarianism, cut its own balls off by leaving the EU (and the Civil rights it confers). It did this to appease fringe nutjobs and to make a pile of money for hedgies. Then it howled in pain and blamed the EU, even though the EU was against the chopping of the plums from the get-go.

The conditions for this bollockectomy were created by a barely-elected government, after the fall of which we have had, mainly, unelected government.

This entire manoeuvre was done under a screed of fractal dishonesty, in which scuttling little fibs decorate a structure of brassy falsehoods all stacked higgledy-piggledy on a giant whopper. Unwilling to accept the blame, the responsible parties continue to lie to this day.

In a parallel move completely unrelated to the above, the unelected UK government is ramping up surveillance. The EU has not done this, but the liars blame it anyway.
Progress in the name if progress is rarely a good choice.

The key question that remains unanswered is

Why should Python even need a free threading model?

There are no good answers afaik.
They were suggesting that this is a question that is going to be on people's minds, which is very different from suggesting that the answer is yes.
The Openness of AI
you can't downvote a submission, so that's already one issue.

>lag should be a message to a mod if there is something heinous like gore on the front page. It’s used as a censorship button here and that isn’t cool

I mostly agree and that is how I use flag. I've never flagged a submnission, personally unless I felt the site was outright malware (I haven't experienced that here).

But I figure in this case flagging isn't too dissimilar to how reddit will hide submissions/comments with enough downvotes.
This reminds me of some game design video/article/talk (don't remember) where a MOBA (League of Legends?) was at least attempted to design in a way that there would be the balance of the imbalance.

It boils down to sure, some playable characters are too strong, but given enough characters to select from, the "meta" will shift around because there'll always be something else to counter whatever the other team chose. There might be a lack of balance in a single match, but across multiple matches, there's no one stable winning formula.

Really wish I had a link to the resource I'm trying to reference here.
What do you mean "these clowns did Brexit"? All they did was to organize a referendum. Why does this make them clowns in your eyes?
I read the thread, but I appreciate your condescending tone and attempt to imply I hadn't. That's surely worked throughout the course of internet history. ;P

(I consider your root comment take to be shallow and I've noted that clearly I'm not the only one who thinks so. You're free to ignore it.)
This, yeah.
> The GIL doesn't prevent race conditions between individual python instructions

Yes it does. Unless we mean something different?
Most systems don't grow forever, and can stay on one machine.

And "one beefy machine" has a very high limit, so by the time you actually outgrow it you usually have tons of resources available to help rewrite things.
Everyone? It’s the preferred unit for electromagnetic wavelengths.
Three men have died, a Frenchman, an Italian, and a German. They ask each other why they've died.

The Frenchman says: "I ate some bad food and I died."

The Italian says: "Her husband came home."

The German shouts: "I had the right of way!"
1. The "stable ABI" is broken on nogil, the selling point of the stable ABI was "add this C preprocessor flag and your extension will work on all future CPython versions, after paying a speed penalty". This is useful for eg closed source extensions. If the nogil build was the only build available, these extensions would require recompilation.

2. There are a lot of users that want fast Python and a lot of effort was put in to optimise it. I think the core team wouldn't want to release and expect everybody to use a version which regresses in performance, for a feature (nogil) which most won't be able to use due to using C extensions which haven't had nogil-supporting code changes.
Yes, the same is true for free threading. Yet people assume free threading is free concurrency and that's the problem.
Nuitka is just a packaging system which places all dependencies inside of an executable. It doesn't compile into machine code. Why do you conflate it with compilers?
AI currently depends on capitalism. Is expensive model training based on data from a global internet going to be taken over by states, along with the internet itself?

Looking forward to Minitel going global...
well, there's 2 forms of disagreement. I never felt like I was off put by any of dang's comments that I read. AKA a disagreement of tone (in the words of The Big Lebowski: "You're not wrong, Walter. You're an asshole!). He feels professional and won't devolve into flaming like other mods on other sites. He makes his points and lets his sourcing and historical knowledge talk instead of insults or appeals to authority.

Of course there's plenty of times where I disagree philosophically, and that's fine. At the end of the day I'll never fully agree with any one person. I just simply don't want to be called any number of insults you'd hear elsewhere if you dare not tow the line perfectly.
“This time should be the real deal. Just got news that the physics institute managed to produce the sample and replicate its magnetizing qualities, but yet to see Meissner effect. I think the problem right now is the superconducting material’s purity is too low, only a few %, but if we have made a start this problem will be solved quickly.”

Afaik The Meissner effect is critical for a superconductor
Are you inclined to believe that a pallet is worth less than £1.18?

I’m not an expert in the pallet supply chain, but that seems extraordinarily low to me.
I see GDPR as the same thing. People in Germany getting fined heaps for including google fonts in the websites.
I disagree for the simple reason that I've lived in the UK for 40 years, and I recall each home secretary being more authoritarian and pro-surveillance than the last. The RIP bill is a decade old and was strengthened, under home sec May, before the referendum.

I would describe the EU as wavering. Perhaps they'll do it, but it's far from certain.
Prometheus will always pull metrics from a metrics exposing endpoint. However, Prometheus can then push metrics to anything that has the proper integrations for remote writing[0]. So you could run Prometheus in Agent Mode [1] in your DC to ingest metrics and push it to some central location.

[0]: https://prometheus.io/docs/operating/integrations/#remote-en...

[1]: https://prometheus.io/blog/2021/11/16/agent/
Would be amusing if British ministers could no longer use WhatsApp. They seem to be addicted to it.
Your argument appears incomplete. Either there is some method of obtaining "a true expression of public views in the wide", in which case: What is it?

Or there is no such method, in which case: Why do you specifically advise to drop social media channels? What makes them less valuable as a method of gauging public views than, say, talking to a taxi driver, or an opinion poll? You are suggesting that I drop every belief that each one of these parts accurately represents the whole, but then why specifically ask us to drop out of one of these methods over any other?
Very nice. But a few issues.

1. The incorrect messages disappears too quickly. And it appears slightly off the screen (I am on a MBP 15"). It should persist.

2. There is no zoom for Europe. I tried using Mediterranean. So when asked to show Estonia, I can't even get to the NW European states without scrolling. Which means that the incorrect message will never be seen.

Similarly, asked for Guernsey had to zoom in but it selected Jersey. No amount of zooming will let me select from the two. It becomes grainy.
What you say just seems to be a general property of humans exchanging information. Not an intrinsic problem to social media.

Where can we find "A true expression of public views in the wide"?

I've been using social media all my life and for me the benefits far outweigh the negatives.

I never believed it should be my sole source of information just as much as gossiping or talking to my hairdresser shouldn't be my sole source of information. If I want to have a nuanced opinion.
How I Spent My Summer of 1982: The Making of Donkey Kong for the Atari 2600
Yep.. This will be the test bed for it. See which companies bend the knee. Then hobble the others.

Once this is done, they'll move the law around to other countries.
You would be well served with arena based (shared) object allocation and a gil per thread model. No need to draw everyone else into this.
Nothing makes them less valuable. They're mostly just as valuable. The problem is belief they're more representative, more "real"

I advise to drop because of cumulative deleterious effects on my mental health and real world social relationships. Some people may have more resilience. I think most people become trapped in mostly narcissistic behaviour.
How many people drive their car for leisure? Motorsports? Riding motorcycles for fun? Using high powered GPUs for gaming? That’s all just burning energy for fun. In your words, a middle finger to the environment. Should that all be forbidden?
It’s called “advanced data protection”. You’ll find it hidden deep within the iCloud settings.

It’s off by default.
I sure wish work life worked like that. Instead they say "why are we paying you? Nothing is broken", and coincidentally stuff breaks weeks after being let go.

I understand it for non-technical companies (even if by now, decades later, they should treat IT like they treat insurance... sigh), but it's baffling for a tech focused company to treat engineers like that.
Neither does LPython yet, even when it does it seems like LPython is meant as a Numba alternative, not something to run arbitrary Python code.

"LPython is built from the ground up to translate numerical, array-oriented code into simple, readable, and fast code."
Are you joking? Even a random middle class flat in Beijing would have at least one OK air filter appliance. Party elites likely have pretty good industrial grade ones everywhere. First thing is shield themselves from the fruits of their policies...
CIA plotted to convince us UFOs exist as a distraction.

And CIA plotted to hide the UFOs from the public through other distractions.

I mean imagine if both are true. Honestly, makes sense.
That's it, that's what I would die for, do you have any tips/guidelines to get to your position ?
> The "stable ABI" is broken on nogil, the selling point of the stable ABI was "add this C preprocessor flag and your extension will work on all future CPython versions, after paying a speed penalty". This is useful for eg closed source extensions. If the nogil build was the only build available, these extensions would require recompilation.

It looks for a flag, if it doesn't see it then it turns the GIL on.

Where is the need for recompilation?

> I think the core team wouldn't want to release and expect everybody to use a version which regresses in performance

But you're just guessing that it's slower in GIL mode, aren't you?
Well, Altman is CEO of a company called OpenAI, after all - it makes sense he wouldn't be in favor of transparency. Wait that doesn't make sense...
17000 pallets are worth much more than £20,000, which apparently covers all the associated cost of the bonfire.

They sure didn't buy all those pallets.
And in applications like text-to-speech/speech synthesis and speech recognition.

Then there are the gray areas like training statistical models that are not ML/ANNs, but are things like Hidden Markov Models and the Vertibi algorithm. While not using ANNs, they work in a similar way in that they are statistical models trained on a large corpus of data, and those models are then used to predict various things like the part of speech, end of a sentence, or the pitch of a phoneme.
Good outlook. You weigh it comparable to other channels. Media at large places greater weight on it, what's said on it, and it's relative importance.

If we treated all tweets as comparable to spitballing over drinks or hairdresser gossip the world would be a better place.

I am unsure there is any true expression of popular sentiment, ever. My problem again here is inflated beliefs to Twitter as reflective of some wider community view. Quite apart from being anything but random sample, it's riddled with both bots and trolls.
I dunno, we started with the Berol handwriting pen which is basically a plastic tip.
Your basic biro is not a good writing pen - they are difficult to control. The ink is thick and gloopy so it takes too much force to get going and then shoots off quickly.
Modern ballpoints, from the likes of Mitsubishi and Pilot are inexpensive and much much better.
Why do they say it is Greek?
That's why it's called LK-99
I think you’ve misunderstood the arrangement. They were not granted the land where the rails were laid alone. They were granted vast amounts of additional real estate, and the value of that land could have maintained the railways in perpetuity. However, similarly vast fortunes were extracted from the railways instead, and the generational wealth created during these events in the 1800s has proved more durable than the commercial viability of the rails that the country had intended to support.
In my line of work I've been using numpyro to model physical phenomena.

There are multiple unbalanced categorical variables, so partial pooling helps a lot to infer the target in regions where the data is sparse.
Tesla's role in shaping the EV landscape is undeniable. Their advent redefined the trajectory of electric mobility when major automakers were largely dismissive of the concept. With the success of their Model S, and more the Model 3, Tesla shattered the misconception that EVs lacked practicality, thereby nudging traditional manufacturers to expedite their own electric ventures.

The opening of Tesla's Supercharger network has been instrumental in making EVs from all manufacturers viable for a broader demographic in the U.S. Moreover, for a considerable period, Tesla struggled to meet the high demand for their vehicles, with many potential owners enduring long wait times to receive their cars. Given the limited and less attractive EV alternatives at that time, it's unlikely that these consumers would have opted for another EV.

In the U.S., where Tesla has a market share close to 60%, Chinese automakers like BYD, SAIC, or Geely have not yet established a significant presence. Thus, most American consumers would not have likely considered these other EVs.

Additionally, Tesla's pricing strategy has exerted downward pressure on the overall EV market, making these vehicles more accessible to the masses. Other manufacturers are indeed emulating Tesla's approach, further acknowledging Tesla's influence on the industry's transition to electric vehicles.

As to the emissions offset calculation, the figures referenced consider each Tesla vehicle as a replacement for a conventional gasoline car. Whether a Tesla purchaser might have considered another EV is irrelevant to the emissions reductions associated with each Tesla vehicle. Also the amount of emissions needed to offset SpaceX emissions is comical and obviously Tesla covers those even with a small fraction of the vehicles they sell.

https://www.cnn.com/2023/04/20/investing/china-tesla-ev-pric...

https://www.businessinsider.com/ford-ev-production-slow-than...

https://www.npr.org/2023/02/02/1152586942/tesla-price-cuts-f...

https://electrek.co/2021/11/08/ford-ceo-praises-tesla-intern...

https://www.cnbc.com/2021/10/28/tesla-is-setting-the-bar-for...

https://electrek.co/2023/06/05/gm-ceo-tesla-lead-electric-ca...

https://insideevs.com/news/652293/ferrari-ceo-says-tesla-was...
I want the other propaganda machines to be punished IN ADDITION to TikTok, not just TikTok because it's a Chinese propaganda machine.
and even they are looking into changing its shared memory and process model to work and make it multi-threaded: https://www.postgresql.org/message-id/flat/31cc6df9-53fe-3cd...

probably a way more problematic effort than no gil python tough and it might fail
I'm reminded of something my civics teacher mentioned in class about the difference between parties in communist countries and the US. The number of party members in the US is a rounding error. Almost no one is an actual member of the Democratic or Republican Parties.