skysight-inc/HackerNews huggingface dataset:
>> But GPT-3 is much more successful, including at giving correct answers to arithmetic problems that weren't in its training set.

That's not exactly what the GPT-3 paper [1] claims. The paper claims that a search of the training dataset for instances of, very specifically, three-digit addition, returned no matches. That doesn't mean there weren't any instances, it only means the search didn't find any. It also doesn't say anything about the existence of instances of other arithmetic operations in GPT-3's training set (and the absence of "spot checks" for such instances of other operations suggests they were, actually, found- but not reported, in time-honoured fashion of not reporting negative results). So at best we can conclude that GPT-3 gave correct answers to three-digit addition problems that weren't in its training set and then again, only the 2000 or so problems that were specifically searched for.

In general, the paper tested GPT-3's arithmetic abilities with addition and subtraction between one to five digit numbers and multiplication between two-digit numbers. They also tested a composite task of one-digit expressions, e.g. "6+(4*8)" etc. No division was attempted at all (or no results were reported).

Of the attempted tasks, all than addition and subtraction between one to three digit numbers had accuracy below 20%.

In other words, the only tasks that were at all successful were exactly those tasks that were the most likely to be found in a corpus of text, rather than a corpus of arithmetic expressions. The results indicate that GPT-3 cannot "perform arithmetic" despite the paper's claims to the contrary. They are precisely the results one should expect to see if GPT-3 was simply memorising examples of arithmetic in its training corpus.

>> So what changed? We aren't sure, but the speculation is that in the process of training, GPT-3 found that the best strategy to correctly predicting the continuation of arithmetic expressions was to figure out the rules of basic arithmetic and encode them in some portion of its neural network, then apply them whenever the prompt suggested to do so.

There is no reason why a language model should be able to "figure out the rules of basic arithmetic" so this "speculation" is tantamount to invoking magick.

Additionally, language models and neural networks in general are not capable of representing the rules of arithmetic because they are incapable of representing recursion and universally quantified variables, both of which are necessary to express the rules of arithmetic.

In any case, if GPT-3 had "figure(d) out the rules of basic arithmetic", why stop at addition, subtraction and multiplication between one to five digit numbers? Why was it not able to use those learned rules to perform the same operations with more digits? Why was it not capable of performing division (i.e. the opposite of multiplication)? A very simple asnwer is: GPT-3 did not learn the rules of arithmetic.

_________

[1] https://arxiv.org/abs/2005.14165
This piece my minimaxir is a nice (less-bloated) article about GPT-3 that can help you see few more things like the limitations https://minimaxir.com/2020/07/gpt3-expectations/
In any building spies had access to there was a game of cat and mouse as (for example) spies would see people with radio equipment scouring rooms through the window as they heard their bugs go pop one by one.

Peter Wright (who wrote spycatcher) was the one who first got to look at The Thing; He actually broke it and had to make a new membrane for the microphone. He also invented (within MI5 at least) their technique for detecting superhet receivers (RAFTER), at one point they apparently were parked next to the soviet receiver.
Unfortunately, not. The Zoe and Leaf platforms are different. Which is stupid.

The Zoe drivetrain was codesigned by Renault and Continental and Continental makes it.

There's a great teardown video of a Zoe's power electronics on YouTube.
I can see your point. I’m currently fitting new doors in my house and teaching myself how to do it. It’s a pain in the backside however, but it’s satisfying and I feel a sense of pride every time I open and close the door to go to the bathroom. I did that!
https://git.rip/exconfidential
What are some of your most common workflows??
I am eternally indebted to you for Pandas. Many thanks for that.

Are you talking about there being support for multiple language libraries like PyArrow or about there being multiple Apache projects that utilize Arrow like Parquet and Spark?

If not, I'm not following what sub-projects you are speaking about. As far as I know, Arrow is principally the Arrow Columnar Format and Arrow Flight with some other potentially interesting interfaces for compute kernels and CUDA devices.

Am I missing something?
I have a slightly different problem. My employer will pay to help us keep our skills up. We can take training classes and go to 1 related conference per year. We have some time during regular development to work on innovative projects that we'd like to implement or experiment with.

That's all great, but much of it ends up not being applicable. For example, we were trained in a new language about 3 years ago, but we haven't been allowed to use it in our product yet! I've been doing my home projects in it, so I'm ready to go when we do start using it. But most of my coworkers took the class and haven't touched it since. They've likely forgotten everything about it. Likewise, the conferences are nice, but I've never implemented anything useful after having read a paper about it, or seen a presentation on it. (The few times I've tried, it turned out the paper didn't give enough information to do your own implementation!) It does keep me aware of what's going on in the field, but I'm not sure how useful it actually is to my job.
Congratulations to the release! It's so refreshing, it's blazing fast, it doesn't load some stupid web fonts or other unnecessary things, I'd say it was worth the effort and would hope more websites do this. It just works :)
2 kids and one in a car seat fit in the back of mine.
I love/hate the sarcasm that the only shutdown options are tomorrow or in 4 days.
That depends on speed for sure.
The excuse I've seen is that Amazon points out that the shipping time was still 2 days, it just took them a week to start the shipping process. It seems like they're trying to minimize time in transit as opposed to trying to get the package to my doorstep ASAP
Do you know many black hat techniques? Around 2011-2013 was when Google shifted from being extremely easy to game to very difficult. 2014 was really the end of it. Have a look at some niche site blogs from the time - revenue from new niche sites tanked from like $1.5k/month each to barely close to $100 (with a lot more work up front).

Anyway my point is if you rewound the clock to 2008, you'd have a way bigger problem than you might think.
Google employee, but opinions are my own.

As a parent I'm grateful for the flexibility to choose where I work until next summer, however it has become very clear to me that a large number of lower-income essential workers who are parents are currently facing a major childcare crisis because they have to return to work despite schools being closed.

This is really revealing underlying disparities in childcare access and the inequities in our education system. Given the immediacy and severity of this crisis, people in my community are trying to figure out if they can repurpose existing social service foundations, like school PTAs, to raise funds from more well off community members to support others who are in this sort of childcare bind.

But it's very hard going, not at the least because everyone is in their own personal logistical crisis and it's hard to think about others' childcare needs when you are trying to figure out your own.
Apple donates its proceeds from John Lewis documentary to museums that honor his
I don't disagree with the general sentiment, but I don't believe the reasoning is actually true. Generally companies pool their employees into a risk pool. Smaller ones will find a broker that does it, larger ones probably do it with their company population. But in general, the risk gets spread out enough that a couple individuals do not cause insurance to spike.

I could be wrong also, not an expert by any means, but that is basically what our HR rep told me when I inquired (not because of age but because my wife is high-risk/high-cost, depending how you look at it). I was told that was not part of the equation because of how it was setup. It could if it was a small enough business that tried to negotiate something themselves, maybe?
2nd Place Facebook Hackercup Qualifier
Well done. That’s the perfect attitude to writing and maintaining code.
That seems to cover either a decent workstation OR a good chair, but not both?
> "like google, but a bit better"

For simple queries like “who was the president of country X in YYYY” it’s probably just a bit better (if cached, of course, Google search is wicked fast).

But for more complex queries, Google is still remarkably dumb. Or downright insolent, ignoring my verbatim selection or quoted terms.

I’d pay good money for scarily smart search and a “grep for the web” service, that included JSON, CSS, JavaScript, comments, whatever. A toggle button for dumb/smart search
It's not inside the VPC, I'm connecting from the outside. I agree there's little need to check fingerprints for VPC-internal sessions.
>it actually works and has probably saved far more young people from committing suicide have completed

Please don't say things like this unless you know. People say the same thing about SSRIs when pretty much every clinical trial says the exact opposite (hence the FDA black box label for both drugs).

Accutane causes crazy hormonal changes. I personally know multiple people that ended up in a mental hospital after taking that drug (including my brother).
That sounds reasonable, but the quite from OP says something completely different, it says "The laser rapidly determines if an unintended observer is within the nominal ocular hazard distance (NOHD) and immediately shuts off the glaring output to prevent accidental eye injury" - that doesn't sound like the mechanism you describe.
Is there a reason why we'd want to seed the solar system with life?
This is nice but it would be better if people could enjoy their neighborhoods without having to think about noise and pollution.
Well, one benefit would be a relaxation of constraints on filesystems. This might be worth performance loss.
Is "subversion" a skill (unless we're talking about spies ;)? It's just a tool. I've used it. I've used cvs, git and other stuff too. If I had for some reason to work in a company that uses some other tool to handle their code repos, I'd learn it in a month or so (less if it's organized logically). It's like saying "driving a Honda Civic" is a skill - driving is a skill, Honda Civic may be what you're driving right now, and next week you may need to drive a BMW, and being able to do both is what I'd call a skill.
Why in my conscious mind would I ever wanna do something like this?

Especially that lately Slack has proven to be so unstable (lots of intermittent downtime). Meaning I would just lock my infra automation code in CTO.ai servers for... what?
Checking https://status.inreach.garmin.com/ (oh the memories) Looks like the meat and potatoes held together! I'd credit segregated infrastructure and redundancy.
It seems like Arizona is not a very optimal place to grow crops not already suited to the environment. And the usage of water by residential customers has got to be extreme for the region. I have only flown into and out of Phoenix but the amount of backyard pools and golf courses visible during the approaches and departures was not something I could wrap my head around.
Ultrasonic buzzers? I kinda fail to see how that would help, shouldn't be too hard to filter out the ultrasonic range noise.
If it were meaningful for the athletes, they would not be taking their own lives after clearly struggling in complete misery for years; clearly even endangering lives of loved ones. You can tell most just don't understand what they signed up for.

In any case, we're rewarding and glorifying this activity. It's not just there, of course people are free to do as they please. We're making them go through this sacrifice (that clearly leaves great damage) for a reward of glory, fame or just money. If you give gold medals for it, no matter how pointless, unfulfilling and destructive it is, someone will do it. It's our responsibility.

When there are really beautiful sports out there, that players really clearly enjoy, and which are reasonably healthy (of course to an extent every activity has risks), there's simply no excuse.
People who hate clickbait headlines should start clicking the non-clickbait headlines. The authors themselves rarely have any control over the headlines and we know that all of the major publications are A/B/n testing various headlines for news, at minimum, and are most likely feeding that information back into some automated headline generator.
Probably the ubiquitous "master".
Do you have evidence that masks are ineffective in reducing the transmission of influenza?
The sentence structure works fine if the aggregate length is replaced by the count.

> over 95% of global communications traffic is handled by just 23 undersea fiber-optic cables

I picked the number "23" at random, but I estimate it to be the right order of magnitude.
Null Hypothesis
Facebook sues EU antitrust regulator for excessive data requests
I'm curious, when you say terrorist, do you mean groups like Evil Corp (mentioned in the article), or do you mean groups of more "traditional" terrorists funding themselves via malware?

Edit: Or were the ransomware payments at hand not even malware related, but more "traditional" ransoms?
Well this was good timing: https://www.businessinsider.com/airbus-completes-autonomous-...
Historically, companies as well as individuals respond well to economic incentive (both positive and negative). As an example from a different industry, carbon credits have created a market that encourages and rewards green activity; taxation on products and services that are perceived as "negative" acts as a constraint on supply and demand.

Equally, the government itself is a huge purchaser of services and has undue influence in how companies behave. The desire for companies to win federal and military contracts allows governments significant leverage; perhaps not in the Facebook case, but certainly in areas like cloud.
Ask HN: What concept marks your boundary of knowledge in your area of interest?
Even experts have a limit to their skill set and knowledge base. I'm curious what concept you consider just beyond reach of whatever skill you are honing, hobby you are learning, or existing area of expertise.
Hey rosywoozlechan I am the Product Manager for this app, can you file an in app bug with this name so we can look in to your issue? (look for little bug icon on main screen to file issue)
have you seen Jerold Nadler?
You provide pre-trained models to then train further.

This happens now.
2020.30 Almost on Time – Rakudo Weekly News
> The European manufacturer just completed flight testing for its Autonomous Taxi, Take-off, and Landing project in June after its flagship aircraft successfully navigated each phase of flight on its own as pilots simply watched.

Talk about training your replacement.

My little brother is starting pilots school soon, maybe I should talk him out of it.
Very much this. Knowing particular set of keywords that constitutes latest fashion language is a short-term skill. Knowing the paradigms that guide all of them and being able to learn the keywords if necessary in a short time is a long-term skill. Some companies prefer to "hire to the spec" to save short-term learning costs. Smarter companies look into long-term skills which will be useful whatever keywords are in fashion this season.
That will only stop law abiding citizens from committing crime.
I'm surprised by the "The Slight Upswing is Best" graphic. I understand Cub-Scout-softball-playing-me isn't any example at all for what a professional-league baseball player should do, but I always internalized swinging up and through the pitch, and I was the best batter in my league. Is (or was) there some explanation for why you would want to swing flat at a ball?
Yale Antitrust Scholars Resign Because Director Advises Apple, Amazon
Your experience tracks with mine as well.

I run VoIP PBXes and they occasionally need to send an email, usually for voicemail to email but occasionally for other alerts.

By default they just send straight to the internet, sending from pbx@pbx.domain.name, forward and reverse DNS mapping back to their own addresses, etc. but no other setup.

This works perfectly fine with Gmail and Gsuite accounts, but Office 365 occasionally decides it hates one of our servers. Even if the client has the sending address whitelisted, it still just gets hard blocked for no apparent reason.

Gmail, I can fire up a telnet session right now and send myself an email from my home IP address just typing raw SMTP commands in to a console. It's going to work, and unless I'm spoofing a real email address it's not even going to end up in spam.
This is what happened in India. As aquifers have been depleted, people in many areas there are struggling to get drinking water. Once upon a time, people used to get drinking water from dug wells even in the summer. Now, there is no water even at 600 feet.
Ohio Dept. Of Health Contact Tracing Leaks Citizen's Information
Wouldn't clicking a link involve a mouse?
It's basically impossible to find areas of quiet on the peninsula, if you want genuine quiet. Even the parks along Skyline have a consistent level of noise from planes overhead.
Not if using/selling the email address you provide is according to the ToS of the seller. Then they can legally spam john+as.entered.in.the.form@gmail.com but not john@gmail.com, which is a huge downer.
A company which sells that much software can certainly afford to re-implement an AGPL component; or at least implement a good enough stub implementation to make the software run acceptably. Especially if, as Chris DiBona of Google claims, all AGPL software is useless and unneeded.

However, the point was that releasing the proprietary (oh so secret) source code is never the only option, and it is indeed false scaremongering to claim that it is.
The Long Road to the Porsche 911
While models such as XLNet incorporate recurrence, GPT-{2,3} is mostly just a plain decoder-only transformer model.[1]

[1]https://arxiv.org/abs/2005.14165
[2]https://d4mucfpksywv.cloudfront.net/better-language-models/l...
That says "startup". ML is the buzzword that investors love, and k8s/devops allows avoiding big investment into infrastructure which may need to be dropped anyway when it turns out the market doesn't actually want yet another "apply ML to click stream to save on ads costs" startup (I'm stereotyping of course but you get the idea).
You should because it's a terrible career, although really I think most pilots end up bailing out of the pilot career into good industries so in the end, no big deal. Let 'er rip and enjoy the view when you get it
Most of it runs over Iridium, so I wonder how much IoT is really involved vs just being a different hardware front-end for Iridium services.
A few people have commented on the logistics of paying a large Bitcoin ransom which can entail hiring a 3rd party to pay it.

Could an independent party buy the decryption keys from the ransomware party for their asking price then attempt to resell this to Garmin (or other party) for more money?

Of course it's a bit game theory because you're depending on the target to pay and the ransomware attacker to not relinquish and resell the key to anyone else including the target.

Ignore the legality of it all else it's not very interesting to think about.
It's basically a 555 timer, some resisters, and a piezo buzzer. Hardly worth 50 bucks! You can build one yourself for a mere fraction of that.
Maybe FedEx, UPS, and DHL should start first?

Possibly they could go to single pilot operation on freighters?
Oh my god, this is so true in my experience.
Interesting. I have never heard about seed oil over consumption being an issue.
It's probably not possible but it ought to take terrain topology and trees in to account. New motorways are usually built with earth banks topped with trees to stop noise pollution. Its very effective.
You should discredit the Wired article
I'm a fan of the GPL etc, but in this article he is saying that in 2011, most of the complex AGPL software that would be useful to Google has a substantially similar version already implemented inside of Google. That's something I could believe about Google, especially 9 years ago.

"MongoDB is probably the most prominent AGPL project, he said, but it replicates software already used within the Google back-end infrastructure. Google uses a proprietary custom-built distributed database known as BigTable. The company has repeatedly indicated that it will not open source BigTable, but it has published a research paper on the platform, and its basic ideas are now used in open source platforms such as Hadoop HBase and Cassandra.

In similar fashion, the company has not open sourced core platforms such as the Google File System (GFS), its distributed file system, and MapReduce, its distributed number-crunching platform."

He also made this quote:

""If you look at the interior of Google and how we make software, we don't launch a lot of software to the outside world," he said. "With the AGPL, you have to be very, very careful with how it is expressed. Otherwise you have to invoke the sharing in many different places. [The ban] is really about saving engineering time."

This part sounds like a partial truth and a partial lie. I'm sure it does save a little on engineering time, but it seems odd not to acknowledge the elephant in the room that they may have to share software they don't want to.
Many live in single family homes, yes, but in the UK at least they very often have shared street parking across a pavement (a sidewalk). That is why I was thinking lampposts.
One man's conspiracy theory is another man's truth. The Russian collusion hoax showed that even intelligent, rational individuals, can subscribe to - and elevate - an absolutely false narrative so long as it furthers a personal goal or ambition.
Great points. I've observed this myself for years as a Director in a tech co.

Only other thought about it: managers with 1 report are also very likely to be new managers. Experienced managers do not (usually) take on roles managing a single person.

To put it more generally: Good managers are unlikely to take a role managing just 1 person so therefore managers with a single report are likely not good managers.
I've always pictured scrolling as moving a camera or visor over a static sheet.
Yes, but that means you're saying the USPS has some kind of advantage locating where there are disproportionate unbanked and also a dearth of banks. But I keep hearing about the unbanked as being an issue of large urban areas, which don't have any shortage of bank locations.

So for these five or six people in rural areas that can't get a bank account, and aren't complete deadbeats, and can't get to a bank as easily as they can get to a post office, the USPS has a cost advantage in serving them. Okay. I just don't see numbers that make this a big source of free money.
Looks like a big rainbow table generated by AI.
Thanks Jay for creating this amazing chart.