skysight-inc/HackerNews huggingface dataset:
So this is for me to easily manage all my linters, formatters and such in one image from a group of upstream, published images, right?
The vast, vast majority of users (99.9999+%) wouldn't even notice.
I've been using GPT2 as a writing aid for a little while (the 1558M model is a lot better than the smaller ones). Some of my recently highly upvoted HN comments were substantially written by GPT-2. There is quite a bit of art that goes into crafting prompts that produce useful output.

There are a few things about GPT2 that I didn't like (for instance, the number of "quoted text" blocks) but I have found that if I put my own words in the prompts (in particular when they contain long sentences), it makes things work.
I think I may be a bit slow -- I don't get it =/
> You can get this incredibly basic feature if you pay for YouTube Red, which seems to indicate the only reason this feature isn't provided for the free version is spite.

It's because YouTube's music agreements prohibit it on mobile platforms to prevent it competing with Spotify et al.
For most of human history text has not existed. I think you are conflating language with written language which is quite common in the post-Gutenberg age.

I think sentience like most things is a spectrum, so I'm not really sure what you mean by sentient, but I would argue that for most people the bar for sentience is much higher than text prediction. The Chinese room is only one aspect of our minds, and we don't even know what consciousness is.
Questions to Excel in Machine Learning Interview
On the Naturalness of Software (2012) [pdf]
I'm not saying that North Koreans cant be good engineers, I'm saying that it's going to be an uphill struggle for NK to compete for tech talent when US/Chinese companies have so much more of the capital required to build these models
I've seen a credible-looking documentary (despite being History Channel, IIRC) on YouTube claiming that there's evidence of large-scale slave/lower class uprisings in many Philistine cities right before the start of archaeological evidence of Israelite settlements in the Judean highlands. The documentary claims that the Israelites were Philistine in origin. The level of hatred of the Philistines may have been out of a need to keep a political distinction between the old and new cultures, to keep them from melting back into Philistine cities during times of hardship.

I think it was this same documentary that theorized a small number of escaped slaves from Egypt wandered through Midian and into Canaan. The documentary identified a minor city-state in/near Midian that's documented to have worshipped a god named Yahu, and theorized that these wanderers had some kind of dramatic religious experience there, which later mutated into Yahweh worship. The documentary further theorized that this small group of actual escaped slaves were adopted by, and became the leaders of, the nascent Israelite communities, accounting for the Egyptian slavery narrative.

The documentary didn't mention that Canaan was an Egyptian vassal state from the 18th to 13th centuries B.C.E. If the Israelites originated from Philistine slave / lower class uprisings, I wonder if the oral history of the Egyptian vassal state period is the origin for the narrative of being slaves in Egypt despite there being no archaeological evidence of a massive-scale slave escape from Egypt. Being a slave in a state that's essentially a slave of Egypt probably feels like being doubly a slave to Egypt. To me, this sounds more likely than a small number of Egyptian slaves being adopted by local tribes and their narrative becoming the tribal narrative.
They all have two aspects, the cause and the disease it triggers.

COVID-19 is the disease caused by the SARS-CoV-2 virus like AIDS is caused by HIV.

It gets complicated where they don't know or understand the cause like a lot of autoimmune diseases.
Oh, and as we've observed before in mohawk, the final page is absolutely delightful. I'm told this particular author's entry was subsequently removed. Hm, let's see what the PR person says.
So, other ideas that I want to mention: There's an entry with a huge crop of people pasted in, but other than that, the input is pretty sporadic. Maybe they could be arranged and directed?
There's an odd history at the top of the list. Some of these people are that Waylon Jennings. People have been discussed pretty tightly, but that's enough to suggest they're part of that: "Vokoun" and "Carter" seem pretty stable. I can't help but wonder if the "Vokoun" entries could come from the Vokoun journal itself, and be part of the Hall of Mirrors.
If that’s the only thing that separates this from human writing; I’m sure it can be influenced easily.
Yeah, but even if it's lower, the number is certain, decided on over the negotiating table. In an IPO, you don't know till the day of your IPO exactly how much you're going to raise.
Useful insight. Thanks!
Yeah, it seems tied to the economic "cycle". Thanks!
That was the norm in the US until the 1980s.

PSA stewardess class, 1974.[1]

[1] http://psa-history.org/site/assets/files/4429/7406.jpg
I mean, its a pretty reasonable case of someone being forgotten by the system that was meant to protect him.

Also he doesn't really fit the definition of a domestic terrorist, he never seemed to be pushing a narative and didn't actually kill anyone.
Is there anywhere I can read more about the technical details behind this? It sounds pretty interesting.

I searched for "DVB firmware", but didn't find much.
This is horrifying and whenever someone (in this thread and many others) exclaim how this is "cool" and "exciting" I picture a 13 year old boy out with his mate in the woods saying that after firing three 9mm rounds into a tree just after stealing his fathers gun. That is not to disparage these posters, this is quite obviously in a naive sense a "cool" piece of technology but the ramifications in todays already extremely polarized society of seeing this technology end up in the hands of "the wrong people" and used for all kinds of nefarious purposes makes me feel quite uneasy. Now we can't trust text, the most trusted medium in human history, and then what?

Someone else in this thread doubted that we would see AI within their lifetime, but now think there is a 50/50 shot it will happen in the next decade due to GPT-3. I wasn't expecting to see the disintegration of society during my lifetime, and while I don't think there is a 50 % chance of THAT happening in the next decade, these days that just feels much more likely than before.

OpenAI should stop whatever they are doing and create a searchable repository of every piece text generated by this model so that we have a quick way of checking automatically provenance at the very least.
Holy shit this is impressive. So do I understand correctly that you access the model via API, or can you train your own?

A couple of the statements and the repetitions made me wonder, but overall I was taken in. Good shit and interesting to think about.
OK, I read the first sentence and it sounded like a typical poor-quality marketing-blather article so I came here and read your post.

I then reread it and it indeed read like a weird, rambling, incoherent article. Looking at it closely, it had a good many contradictory, meaningless and incoherent sentences.("It is a popular forum with many types of posts and posters.")

The headline, however, seemed about right.

It's true the nonsense in this article is a bit different than the nonsense of a GPT-2 article. But the thing GPT-2 paragraphs sound pretty coherent 'till they suddenly go off the rail. This is more like an article that was never quite on the rails and so it's slightly more internally cohesive. But not "better".

Maybe the article just reflects the author's style. Anyone have a GPT-3 test site link?
> I don't believe that there's any experience of consciousness distinct from the use of language.

To me this indicates a very narrow view of consciousness. Consider for a moment the quiet consciousness of the cerebellum for example.

I like the way David F. Wallace put it: 'Both flesh and not'. There's an astounding amount of consciousness that is not bound by language. One can even argue that language might hinder those forms of consciousness from even arising.
Thank you for that! I hadn't seen it before.

I'm a little nervous about the idea of coming to conclusions about individual outcomes based on national surveys of self-reported diagnoses. It seems like there are vast opportunities for outside factors to mislead attempts at analysis.

For example, the proportion of people who were misdiagnosed to start with; the increased openness over time when it comes to accepting or speaking about the diagnosis; the improvement in mental health resources meaning more diagnoses; the possibility that patients decompensate and lose insight or reject diagnoses over time; etc etc.

If you're thinking "that sounds like a No True Scotsman", you're right. The disease is clearly progressive for some people. Declaring that people who don't demonstrate that progression don't have the disease is semantically useless but may be clinically useful.
> `Object` is translated to `宾语` which means the grammar component object in subject, verb, object, etc.

Sounds right (though OOP treats objects artificially as grammatical subjects, they are the things on which functions operate, and thus more like what would normally be grammatical objects; they are the patients rather than the agents of actions.)
I am growing my anxiety as more layers to the Docker onion grow faster than I can stay current. In the past 2 years my company adopted kubernetes to manage our already confusing Docker infrastructure design, and then they added Rancher to it because no one was making sense of kubernetes.

Meanwhile we're shipping on five year old containers that everyone is afraid to update and no one remembers how to build them. We're building a skyscraper on a floating pier and trying to reach the moon before the tide changes.

I know this is the way, but I am having a hard time because it just doesn't make sense. This doesn't feel like process. It feels like compounding of reactions. Is it just me? My company? Or is this a general feeling?
Quite a lot of SEO already uses simple word generation techniques. It isn't clear GPT-3 is an improvement there - human text recognition might not be whatever Google does.

It may be that Google's algorithms don't care at all how human-like the text is, or that their own recognition algorithm/NN (whatever they use) isn't fooled. Even if it is affected, Google has the money and corpus to build its own competing NN to recognize GPT-3 text.
I agree with his assessment that technical literacy is a must have in today's world. I didn't understand his argument that the programmer's golden age is over?
Optimizing Haskell for performance can be tricky. When I wrote a functional image library (updated at [0]) I tried to get the frame draw rate down by using strictness, unpacked records, and so on, but one of the changes that made the biggest difference came from changing round to truncate[1], I went from 120 ms/frame to 65 ms/frame! The reason why is because round has quite a bit of logic associated with it[2] in Haskell's standard library, versus a simple one-liner for truncate.

It sort of shows that in even simple functions such as this, underlying implementation details can have an impact on performance.

Also, for some reason filling a C array in Haskell was faster than doing it in C, probably due to the switching between RTS.

[0] https://github.com/siraben/functional-images

[1] https://github.com/sbond75/OpenGLTesting/commit/116384edd6a3...

[2] https://hackage.haskell.org/package/base-4.14.0.0/docs/src/G...
Any place that homogenous has deep racism and sexism waiting for you just underneath the surface.

For me, this makes it a hard pass.

It’s not even about the benefits of diversity, as I’m a white male and would fit right in as long as I kept my mouth shut. It’s about the huge downsides to a culture that values conformity and enforces unwritten, arbitrary rules to ensure future conformity.

Conformity and homogeneity is gross.
> In which case that's not being questioned here, we're talking about why they see "black" as a specifically racial color.

You can't think of why that might be?
Those dishes hurt to pick up right when they come out of the machine. Dishes in your home are gross in comparison.
Heh, no, I didn't say it was moral, and my point wasn't to explain, it was to redirect.

But to explain-

In fantasy world the money going to bonuses could go to severance, but in reality that is a misuse of cash, in some cases illegal.

The owners are the only ones entitled to the cash in the business, well, after creditors are repaid. Reducing the debt owed to creditors is the function of bankruptcy.

Workers are not owners and they definitely are not creditors. Giving them severance could in fact be considered stealing.

Putting cash into keeping operations going to service debt- THAT is how the owner/creditor dynamic plays out.

And key employees- managers- without whom the business crank does not turn- they become MORE valuable. Hence, bonuses.

Is this moral? No. It isn't. I never said it was.

But the way to make it moral isn't to rant- which I didn't do- and make use of undefinable and wrong/inapplicable terms like "ruling class".

Neither "ruling" nor "class" has anything to do with these dynamics.

There are a very precisely defined set of roles and relationships here, enshrined in law, going back to tradition, for thousands of years.

The way to make it moral is to understand what an owner is, what a creditor is, how the law works, and then to define what morality means.

Does it mean that workers become creditors, that labor creates a debt? That might be one avenue to explore, from a moral universe perspective. But changes to one role will change the other roles, and what one person considers moral, others may not.

My experience is that most people who make claims of immorality do not understand ownership, a foundation principle upon which nearly all societies that have practiced philosophy and have attempted to define morality have been based on.

Forgive me but you cannot talk intelligently about morality if you do not understand ownership.

That's my point.

Cheers, best wishes.
this is something you could do with NLP already before.
I can’t tell if the headline is saying GPT-3 will be a big deal, or people will think there’s something huge there but there’s actually nothing. Bitcoin hasn’t disrupted anything.
>there are no "security issues" in a dumb media player

There is also no Netflix playback, which is a very common use case for consumers.

BTW, the internet connection can be used for key revocation as a way to combat piracy and consumer choice. So, it's "worse" than "just" tracking.
I don't appreciate the snide remark.

This is a politically charged topic so any strong political affilications are notable. I would've also mentioned it if he had run for lib-dems or green or any other party.
Synesthesia with poetry / metaphors. strikes me as a more interesting subject. At what point does a specific sense cross the point of abstraction that is relatable to other senses?
I don't think people who tend to go into these extremes(cancel culture) can understand or extrapolate what he implied.
I agree, but some people seem to think you can solve systemic economic issues by banning pieces of metal.
I do 6-10 hours per day, depending on the day. My team has quite good WLB. I have heard of other teams that are more pressured, but haven't spoken directly to those teams.

Compared to my previous... 4 jobs (+1 company founded), this is the 2nd lowest stress. The one lower stress job had 1/3 the compensation, no career growth, and was just a "marking time" federal tech job. YMMV.
When I read comments like this--and yes I read the article and understand it was generated by an algorithm--I can't help but think the next AI winter is around the corner.

This does not impress me in the slightest.

Taking billions and billions of input corpora and making some of them _sound like_ something a human would say is not impressive. Even if it's at a high school vocabulary level. It may have underlying correlative structure, but there's nothing interesting about the generated artifacts of these algorithms. If we're looking for a cost-effective way to replace content marketing spam... great! We've succeeded! If not, there's nothing interesting or intelligent in these models.

I'll be impressed the day I can see a program that can 1) only rely on its own limited experiential inputs and not billions of artifacts (from already mature persons), and 2) come up with the funny insights of a 3-year-old.

Little children can say things that sound nonsensical but are intelligent. This sounds intelligent but is nonsensical.
Probably still worth something to the right person!
True. Who ever heard of a VC that believed in hype? Hyper rational.
I just watched a video on branchless programming, and it blew my mind that the guy got a 3.36s function to return in .48s by using more code. The idea of trying to outsmart a compiler or runtime is motivating me to pick back up coding after 8 years away.
Remembering Grant Imahara
Back when I lived in New Jersey I would visit this place:
https://www.fossilguy.com/sites/bbrook/index.htm

It was amazing to go to a stream in the woods of NJ and find fossilized shark teeth, shellfish, squid and bones. I think people have even found dinosaur bones there. Such a wonderful experience and it does have an uncanny way of putting your place on this planet into perspective.
When most of your population is borderline starving the number of top engineers can be counted on very few hands in NK.
Low prices attract customers that will demand more features and make more complaints to you then any other demographic. In SaaS higher priced customers are typically more accommodating and in addition you get more resources to meet their demands.

Somehow there's something psychological that makes you appreciate a product less when you paid 10$ vs 1000$.
The DPRK doesn't have to compete for tech talent in the same way most countries do, because other states probably won't be able to poach tech talent away from the DPRK.

And how much talent would the DPRK really need to do impactful work with GPT-3 (assuming that it really can be used for be used for nefarious purposes)?
I use Plain TeX instead of LaTeX, although whichever system you use, these would be the same problems, and there are some possibilities:

- Use separate page numbering for the table of contents.

- Since the number of table of contents entries will not change, just use two passes; you don't need a separate page numbering for the table of contents.

- Never reference page numbers within the main text; use section numbers instead. This avoids problems with their size changed.

Anyways, when I need to do this, I do it purely in TeX rather than using a separate build system. (There is a way to use insertions containing alternating marks and penalties to extract the information needed without shipping out the page.)
The article is put in the context of the US reopening schools, but there's nothing comparable about the two situations. As far as I can tell, European countries have orders of magnitude fewer cases per million people than the US [1]. Additionally those countries have a comprehensive federal response which is lacking in the US. We're still debating mask wearing as a political issue and now hospitals are being told to report information on the pandemic to a potentially politically motivated organization instead of the CDC [2].

[1] https://ourworldindata.org/coronavirus

[2] https://www.washingtonpost.com/health/2020/07/16/coronavirus...
Do you have a link to that video?
If OP article was cherry-picked, the tree must not be very productive.

More than cherry-picking, there's the Eliza Effect - it's pretty easy to make people think generated text is intelligent. That text can seem intelligent for a while isn't necessarily impressive at all.

https://en.wikipedia.org/wiki/ELIZA_effect
I prefer beautiful women to hand out beverages and snacks on my flight; something that sadly appears to be a dying trend.
As others have stated it’s directly tied to geography. For the same effect in a far more dramatic way look at Kabul.

https://www.aa.com.tr/en/asia-pacific/afghanistanair-polluti...

Kabul’s geography resembles an elevated bowl much like Oregon’s Crater Lake. Just like the SLC area Kabul’s air pollution problem is magnified during the winter.
Local LEO told them to identify themselves and they were told to “fuck off”
The US is constricted by the two doctrines, the Wolfowitz Doctrine, and the Thucydides Trap, into a hot war with China to prevent China from taking the No.1 spot for military and economic power.

China is not under the same pressure. Its bigger growth in GDP means that sooner or later, probably around 2025, it will automatically take that No. 1 spot anyway, thus relegating the US to the No.2 position.

That is unacceptable to people in the US, where nobody under about the age of 50 has personal experience of that situation ever happening before. It would be unthinkable and mind-blowing for them. (For us older people, we can remember when the Soviets were first into space, they had bigger H-bombs, etc.)

Consequently, the US must embark on a hot war to prevent that happening. Unfortunately for the US they lost their golden opportunity of initiating the conflict before/during the Spring-Summer Campaign Season of 2020.

From here on in, the US will be under a declining probability of Victory, while China has a growing probability of Victory in that war. Nevertheless, the US will be forced to initiate the conflict which will very likely result in huge damage, defeat or bankruptcy for the US.

Most Americans will refuse to see this outcome and will be angry that they have been forced to see it happen.
Well, no, 'mens' translates to 'human' and wouldn't normally be used in this sentence (it'd put unnecessary emphasis on the species of who would be programming, which just feels weird).

I can't think of a Dutch version of the same sentence that wouldn't make the subject explicitly male (well, there are some archaic versions that would use 'alleman' but I can't think of one that wouldn't sound weird).
The main thing to consider is the author choosing the sentences. The author says they only made a couple( less than 10) edits. But the human input is what is important. I remember something similar when GPT2 came out(I think it was an interview conducted by GPT2, with human tuning).

I have been following the twitter hype on GPT-3. @quasimondo has done some excellent analysis on text generation using GPT-3. For me, when reading GPT-3 text, something is off. It jumps around too much. It does not seem to care. I couldn't read more than 10 sentences if the text is completely GPT-3 generated. But if prompted properly by the human at regular intervals, it sounds ok. Generally it holds a thought upto one paragraph. So maybe the usefulness of GPT-3 is in scenarios like, I have a thought, I want to complete it, I fire up GPT-3, prompt it and generate different results, choose one which is closest to my thoughts and edit it and publish. I am sure that's what this blog author did.

GPT-3 is really good at NLG. But people seem to be extrapolating the results to NLP.
The recovery partition on non-Mac laptops typically comes with preinstalled crapware too, making it worse than getting a vanilla Windows DVD.
> I could not stop thinking about the applications of such a technology and how it could improve our lives. I was thinking of how cool it would be to build a Twitter-like service where the only posts are GPT-3 outputs.

I finally clued in after this... no one in their right mind would think this was 'cool and would improve our lives'.