skysight-inc/HackerNews huggingface dataset:
Sure. First of all, I want to say that backprop, by which I mean reverse-mode differentiation for computing gradients, combined with gradient descent for updating parameters, is pretty great. In a sense it's the last thing we should be trying to replace, since pretty much the whole deep learning revolution was about replacing hand-designed functions with ones that can be optimized in this way.

Reverse-mode differentiation has about the same time cost as whatever function you're optimizing, no matter how many parameters you need gradients for. This which is about as good as one could hope for, and is what lets it scale to billions of parameters.

The main downside of reverse-mode differentiation (and one of the reasons it's biologically implausible) is that it requires storing all the intermediate numbers that were computed when evaluating the function on the forward pass. So its memory cost grows with the complexity of the function being optimized.

So the main practical problem with reverse-mode differentiation + gradient descent is the memory requirement, and much of the research presented in the workshop is about ways to get around this. A few of the major approaches are:

1) Only storing a subset of the forward activations, to get noisier gradients at less memory cost. This is what the "Randomized Automatic Differentiation" paper does. You can also save memory and get exact gradients if you re-construct the activations as you need them (called checkpointing), but this is slower.

2) Only training one layer at a time. This is what the "Layer-wise Learning" papers are doing. I suppose you could also say that this is what the "feedback alignment" papers are doing.

3) If the function being optimized is a fixed-point computation (such as an optimization), you can compute its gradient without needing to store any activations by using the implicit function theorem. This is what my talk was about.

4) Some other forms of sensitivity analysis (not exactly the same as computing gradients) can be done by just letting a dynamical system run for a little while. Barak Pearlmutter has some work on how he thinks this is what happens in slow-wave sleep to make our brains less prone to seizures when we're awake.

I'm missing a lot of relevant work, and again I don't even know all the work that was presented at this one workshop. But I hope this helps.
The physics of lift and aerodynamics were faaaaar from well understood at the time of the first airplanes, though. New areas tend to run a bit ahead of the underlying science; the fundamentals expand to support and improve the applications over time.
The article links to a YouTube video of a lecture by the author[0]. One of the top comments contains a list of timestamps in the video where he discusses specific surgeries:

7:55 Angina example
10:05 Parkinson’s disease example
13:10 Multiple sclerosis example
14:52 emphysema example
18:47 knee pain
20:40 spine surgery
21:52 Injection therapy for pain
24:59 Explain perceived effectiveness
26:29 correlation vs causation
29:33 Improvement not due surgery
30:33 Natural history
34:01 regression to the mean
35:43 concomitant treatment
39:16 perceived improvement: patient vs clinician
41:50 therapeutic envelope
42:38 Intervention: the placebo pill
44:02 Building the ideal placebo
47:02 “Why do we still operated?”
52:00 Determining effectiveness
52:55 Reducing error in estimating the truth
54:55 Why we need blinded randomized trials
55:12 Ethics and Placebo
59:50 One possible solution
1:00:20 Current status of placebo RCT in orthopedics
1:00:44 Summary, questions, and comments

[0]: https://www.youtube.com/watch?v=IzueFu1cq5U
> I'm curious about this: is there any record of actual Puritans persecuting someone explicitly for having a facial tattoo?

Like “fundamentalism”, “Puritanism” is probably more commonly (outside of specific technical discussions of sectarian history or theology) used in a sense which does not refer specifically to the theological group the term technically denotes but a broader (but overlapping, not a superset) group defined largely by a set of traits stereotypical of the group designated by the technical term.
>Comments in here just corroborate the writer's argument about SV's prudish culture

Isn't that American culture? You see that everywhere, from movies to games.

Violence and murder: ok!

Sex: OMFG EWW ARE YOU INSANE THINK OF THE CHILDREN
The abortion debate still happens (at varying intensities and varying degrees of public view) in much of Europe.

The gun control debate is largely settled but I suspect it will start up quite loudly if the EU ever tries to normalize gun laws across member states. The difference between say, the Netherlands (low ownership, very hard to get a license), Austria (moderately regulated and lots of unlicensed ownership), and Finland (very high ownership rate but strictly regulated) is probably wider than any US state, because the US constitution has been interpreted to set a fairly high bar for any regulation.
I won't pretend to be an expert or even that familiar with Tetris, but from what I know, this is kind of disingenuous. Yes, the USSR and its communist policies meant Pajitnov didn't own his work, and it probably contributed to his being left out in the cold while western countries profited from his idea, but I don't think the USSR actually prevented him from getting paid. That's more him getting screwed over by his business contacts.

The USSR definitely didn't help, and if he had IP protection maybe he could have gotten control back, but even then, I kind of doubt it.
Well yeah they are exploiting the fact that they have an SoC. And they don’t need to scale outside the SoC. There is still space to add a lot more memory.
Wow. All the bashing at kubernetes and serverless functions. I’m not sure what the point of the author was other than the complexity aspect.

K8s and containers solve some very painful problems. I’ve seen two multi month migrations to k8s and cloud-y systems from hard metal servers.

Hard metal is nice but it’s hard to guarantee that state between replicas is the same and there is no version discrepancy.

Everyone that moves to cloud is because they want a good balance between compute and storage. They don’t want to deal with figuring out how many servers to rent. Let it scale up and down as needed. When you care about 99.99% reliability you want redundancy and multiple replicas load balanced. You want prod to run what you staged and tested. You want isolation guarantees. You want ephemeral systems that can be recreated from scratch and destroyed easily.

If you’re just a couple of devs and you don’t care about multiple 9s of reliability and everything fits on a single server then yeah the cloud is not worth it. K8s is not worth it. Know thy tools and the problems they solve.
Given the tensions in the region, anything is risky. Perhaps the only ones who could pull it off are the Swiss, but that doesn't solve the question who will pay for the effort, and who will get whatever remains when the salvaged cargo and ship is sold off.

My personal wild guess: nothing will happen, the ship will break apart, no one will dare and try to contain it for fear of getting targeted by someone's warship or drone, and only the nations who can afford it will clean up their coasts.
... just like flying cars!
People Thought Covid Was Relatively Harmless for Younger Adults. They Were Wrong
you can also do tasklist /svc in a command prompt to get a list of svchosts.exes, pids and the services they are running.
Congress needs to pass a law so this stops being a political football under control of the Executive. You'll know if all the fuss about Net Neutrality was empty rhetoric if the Democrats don't propose any legislation in the next session. It's my controversial opinion that most of the debate around this issue at the policy level is political theatrics based more on partisanship and personalities than material differences in proposed and enforced law or administrative policy.
Nearly as irritating as, otherwise literate people who insist on writing "ppl" instead of "people".

[and I don't think you're being pedantic]
I really doubt there is any truth to that. I'm pretty sure they would have sustained themselves on Buckwheat, Boar, other game, cabbage, and over the last few hundred years, Potato.

They may have all slept together in one room around a fire and spent more time indoors during the winter but there is no way they hibernated. If that were the case millions in Ukraine would have survived Stalin's intentional famine (Holodomor). Families could have simply just rode it out sleeping and eating a piece of bread.
I'm using US-intl (international) right now, supported everywhere I've seen. AltGr+q is ä, AltGr+s is ß, AltGr+y is ü, etc.
Might seem weird at first, but it has most of the special or combined symbols you might need, not just German ones. Other than that, it's your usual US layout suitable for vim/evil, shell, coding, etc.
Fauci tells kids he gave Santa the Covid vaccine
> the near term lockup of the top of the line fab in the supply chain also reminds me of how Apple had secured exclusivity for some key leading edge iPhone parts (was it the screens?).

Yes, Apple managed to lock up most of the global supply of capacitive touchscreens for about a year after the iPhone came out. The iPhone wasn't the first phone to use a capacitive touchscreen, but for a while, it seemed like it was because nobody else could produce devices with them in large volumes.

People used to dismiss Tim Cook as "just" a supply chain guy. But I think it's become clear that supply chain management is at least as important to Apple's success as anything on the design or marketing side.
Ask HN: How do you decide which programming language to use?
Which all factors you will consider for choosing a programming language in 2021 for building a cloud SaaS application?
Apple puts supplier Wistron on notice after Indian factory violence
There's still a missing word or something else going on: "Flurly is a Shopify alternative attempts"
But the comment I replied to said this:

> "people in border villages go up in mountain caves during the winter, and basically lie down there, starving and dying" to be a horror story

It didn't include all the other things you mentioned. Only the part in quotes seemed to be enough for GP to deem it as a suspect horror story.
> If you do graphical or audiovisual work, it’s more complicated, because in that case, you’re probably an Apple user and unwilling to listen.

Well that’s too bad. Sounds like the author just didn’t have the experience or energy to give advice to windows/ Linux users like myself that do audio/ graphical work. I was really interested in seeing what he had to offer.

I personally use an NEC Lavie Hybrid Zero to make my YouTube and Instagram content for my real estate practice. I’ve resigned to stating away from 4K as the render times on an i5 with integrated graphics are just too long for the marginal quality bump from 1089p. Most of my audience seems to be watching on their smartphone anyway, so 4K doesn’t matter to me.

This opens up lots of older laptops for the apps that I use (Davinci Resolve, GIMP, any office suite), but I want to be future proof enough to be able to do 4K when it becomes the norm. For me this means a thunderbolt port so I can use an external GPU.
This is not a replacement for TCP protocol. The protocol described is a mechanism to send different API messages using the same HTTP SSE connection with ability to track acknowledgements. Once we switch to gRPC bi-directional stream, the protocol will be simplified as we can send messages and acknowledgements on the same connection.
What you're describing is probably a "double NAT" situation, where both your ISP router and your own router are providing NAT. This can work fine albeit with some extra latency for simple use cases, but if you ever run any services on your home network that either rely on UPnP or port forwarding, it'll fall apart.

The best-of-both-worlds solution here is to have the outer ISP-provided router put your own router into some kind of DMZ, or use a bridge mode if the ISP router provides it. This basically turns your ISP-provided router into a dumber modem, and leaves all NAT and routing to your own hardware.
You mean "Cue"...
Context: Tens of thousands of Indian farmers are protesting at the outskirts of the Delhi for 3rd week now. They’ve set up social media presence to fight misinformation spread in mainstream news channels. Their Facebook page was deleted the same day it was created. The same Facebook India allowed really toxic pages spreading hate to continue for months until WSJ wrote about it. https://www.wsj.com/articles/facebook-hate-speech-india-poli...
"If you see such a signal and it's not coming from the surface of Earth, you know you have detected extraterrestrial technology," says Jason Wright, a SETI-centric
astronomer at Penn State University in Pennsylvania. "Unfortunately, humans have launched a lot of extraterrestrial technology."

The UFO crowd is going to have a field day with that quote.
It reminds me of Bayesian model sampling, where you have a distribution over possible weights and 'draw' a model from the distribution for each evaluation... A problem is that there may be interesting co-dependencies amongst the weights which independent sampling will have a hard time getting right.
Let's solve that with this little gem:

https://www.youtube.com/watch?v=0pCFVX6lzHU
Wikipedia: "The term backpropagation strictly refers only to the algorithm for computing the gradient, not how the gradient is used; however, the term is often used loosely to refer to the entire learning algorithm, including how the gradient is used, such as by stochastic gradient descent."

-- Meaning follows usage.

https://en.wikipedia.org/wiki/Backpropagation
Drugs are a replacement for meaningful positive feedback from society, like achievements, progressing in life, being able to provide, getting things like love and respect, encouragement etc. etc. Drugs can keep one's attention away from this and release similar hormones you would from being a productive, recognized member of your community or society.

It is a chicken and egg problem though, like many others in life. Do people take drugs and therefore stop progressing in life or do they not see any other paths forward, any positive examples to follow (for whatever reason) and therefore turn to drugs, and it's perhaps one bad decision they can take out of lots of bad options from the cards they were dealt?

People rarely ruin their lives if they just experiment with drugs for recreation, self-discovery, psychedelic trips etc. if their life is in order, with healthy relationships, a pride in their work etc. The danger is mostly when it is a substitute for life/social achievements.

Similarly with porn and OnlyFans. It provides an intimacy to people who don't currently have the means/skills to get it in real life. But could they perhaps develop it if they put in more effort? Now the bitter kind of people would say it's not worth it, they will just cheat on you, trap you in marriage, the divorce you and take it, everyone is a golddigger or just wants to date assholes etc. etc. There's lots of ideologies for this. Again chicken and egg. Are you unable to form relationships because you spend so much time with fake intimacy, fake achievements in video games, fake virtue and validation on social media etc, or the other way around?

The underlying issues are societal and they aren't just about the surface level products and services.
I'm curious which building was it? I live in Jätkäsaari so I probably walk past it every day
I suspect people labeling Elop as "worst CEO" are largely same group of people who ultimately led to Nokias downfall. Completely misreading and misunderstanding the market and the trends of mobile at the time and wanting to shift the blame to others who do not appreciate the genius of their products.
but we did have quite a few advances at the time of the first airplane, for example by that time steam & combustion engines were already invented, which required non-trivial understanding of physics, chemistry and material science was very advanced.

I hold a pessimistic view that we are still in hunter-gatherer mode as it comes to understanding cognition.
https://en.wikipedia.org/wiki/Induced_coma ?
In what universe are Docker and Kubernetes not as popular now than they ever were before? The core of Docker became a standard that I'm pretty sure is used in every new production pipeline on the planet. And I don't much like Kubernetes but it works and I don't know if a competitor that is as powerful and that is gaining popularity.
I don't get why you're downvoted, I agree with your idea. It's where we should and must move towards anyway, the time of nations squabbling is over if we want to tackle the crises of the future: climate, water access, food access, poverty, droughts, space exploration, and if they're turning out to be real, dealing with non-terran species.

The only open question I have - who decides upon engaging? The UN Security Council which should deal with issues is effectively gridlocked as the Russians and Chinese veto everything.

The UN General Assembly isn't that much trustworthy either, given how many countries would vote an instant Yes on the question if Israel should be sanctioned.

In the end we need some form of "global democracy" with strong protections of individual rights.
I think the contemporary design circles have forgotten what an icon is supposed to function as. It needs be unique (hence the term icon), unambiguous, and instantly recognizeable. It also needs to embody its meaning using familiar/legacy semiotics - saving a file is a floppy disk even though we don't use those things anymore.
How the Weber Genesis gas grill was created
Perhaps because many communities deeply believe sex is more than just for pleasure?
> I think outside the UK Acorn has been obscure, at least before the Archimedes

No way. The BBC Micro was seen all over Europe, if you could afford one you had one, and plenty of schools signed on to the econet and installed them by the dozens.

Commodore was seen as not appropriate for classroom use ('a gaming machine') whereas the BBC Micro was seen as an educational tool. Which it actually was (it also made for a pretty good games machine, as many students found out to their joy).
Almost every person making decent money I know pays for private healthcare and avoids the government-run system whenever possible [0]. No lines and much better service. When someone gets a very rare disease, people often need to fundraise millions to go to the US. Many kinds of treatments simply aren't available.

[0] for big ticket stuff there's usually no private alternative, if you're dying from cancer you'll probably have to go to a government facility and hope for the best
Yeah, fuck Woody.
making something like this with eg, amlogic socs, would be significantly faster and require no fans and less power. it would be cool to see someone do something like this with the not terrible rpi broadcom chips
So.... how about taking sketches and turning them into photos?
His/her point is that by the time most people see a doctor about a problem, it is too late for lifestyle changes to have an effect and that surgery is semi-urgently necessary.
Dozens of Al Jazeera journalists allegedly hacked using NSO Group spyware
Yes it is Vinoth Kumar as mentioned in the article and the password was: solarwinds123
If you take article in the spirit of "All models are flawed, but some are useful" (some famous statistician named G.E.P.Box), then it is interesting perspective from which to look at organization.
Nope. I am from Texas and have had MANY encounters with law enforcement. If there’s not a problem on paper in 99% of cases there isn’t any problem. In the remaining cases there could be a civil rights issue, but again that’s up to the attorneys to argue.
Seems like you could just use better active learning strategies to get around the issue, though... Keep your usual dataset, but progressively build a reservoir of 'important' examples while training. (where important == high loss or near decision boundary, for example.) Then when building batches, mix in some examples from the broad training set and some from the reservoir.
And there still is a pretty active BBC Micro/Master/Archimedes user group even today.
I missed the evidence in your comment.
I disagree with this, mainly because it is the recommendation algorithms that have a huge impact on who rockets to the top, and those algorithms pretty much by definition will have some type of bias, so why not bias them to a more equitable distribution of views and revenue?

For a good example, see this video by "How to Cook That" author that laments how all the content farms around baking have gamed YouTube's algorithm so that real bakers (who show recipes that actually work) have been pushed out by content farms showing eye candy on loops with impossible recipes: https://youtu.be/6abePkXncCM
Yes, you're correct, it is a double NAT.

The latency measured inside is around 9-11ms, so much higher than the 3-4ms measured at the ATT gateway.

I am not doing any port-forwarding, but I can definitely see it run into all kinds of problems, or require some configuration beyond my simple skills.

I'll investigate your comment: The best-of-both-worlds solution here is to have the outer ISP-provided router put your own router into some kind of DMZ, or use a bridge mode if the ISP router provides it. This basically turns your ISP-provided router into a dumber modem, and leaves all NAT and routing to your own hardware.
For a better picture, there were many people back then trying to monetize their adult content on Patreon - well, until Patreon started to ban them aggresively, which eventually gave rise to OnlyFans. It’s right that OnlyFans didn’t do anything substantially innovative, but the main point of the article still stands - tech companies have have failed to provide agency for adult creators for a long time.
> the author jumps into saying that Martin isn't just wrong, but irresponsible. That isn't supported by anything else in the essay other than the author's opinions

A succinct statement of my own position.
I don't think that this method is practical. You need to eat a lot of food to get 59 kg of body fat. It's easier to conserve that food and just eat it at winter. Food conservation was practically a solved problem for a long time, you just have to get that food in the first place. Those who die because of starvation usually did not have enough food to begin with (because of bad harvest, for example).
Per diem rates for Germany in CSV format
But it's the whole story and its trappings what matters. Basically what yorwba said: that this is a cyclic, almost ritual yearly dying that wouldn't be out of place in a horror movie, with the villagers resignedly going up the mountain to a cave to lie down and die, but that somehow there are enough survivors when winter ends, seen "lying in the sun". I didn't think it was necessary to spell everything out, but the whole story seems like a horror story.

Needless to say, there's nothing unusual or unbelievable about people dying of starvation.
None of what you stated justifies the need for ad hominem. So, again, why the ad hominem?
I cannot read the article due to elsevier being cancer, but I thought it was illegal to deal with ivory at all, no matter how old, because a strict prohibition simplifies policing of ivory (as elephant poachers cannot pretend they merely found centuries old ivory laying around somewhere.)
I've seen them in Germany, Belgium, France, and those were the only countries I had regular access to at the time besides Poland where I never saw any western machines other than an Atari 520 and the occasional whitebox IBM PC clone.
> It's possible, but better to just be the conscientious achiever for your own sake.

I don't think that kind of committment is one concerned with the prospect of failure, and this may be the difference in subjectivity, which seems to be grandparent's point.