skysight-inc/HackerNews huggingface dataset:
This is called prompt engineering. If you find a popular, frequently repeated code snippet and then fashion a prompt that is tailored to that snippet then yes the NN will recite it verbatim like a poem.

But that doesn't mean it's the only thing it does or even that it does it frequently. It's like calling a human a parrot because he completed a line from a famous poem when the previous speaker left it unfinished.

The same argument was brought up with GPT too and has been long debunked. The authors (and others) checked samples against the training corpus and it only rarely copies unless you prod it to.
We're an expensive industry, where treating people like dirt turns out to cost a lot of money.

And so we're one of the few industries where treating people with respect is actually of interest to leadership. Due to a still-lingering belief in Taylorism and an educational environment that's suboptimal, we're still burdened with a lot of people who think fear-based management ("they wouldn't dare talk about X" is about the fear of speaking up) is useful, so we keep needing to teach people that this doesn't really work.

The idea that "all workplaces have assholes" assumes that somehow being an asshole is an immutable quality. For the vast majority of people, it isn't. They've been trained via fear and obedience, and they believe it's the way to results. Teaching them that it isn't helps both get them on a better path, and it makes the overall environment better. Maybe we can't get completely rid of people with negative traits, but we can shift ratios.

Yes, there are some people who revel in being an asshole, or just can't change. They're very few. It's worth helping the rest. (Because training somebody is much cheaper than replacing them)
If an individual hypothetically painstakingly searched through GitHub to see how others wrote an API call and copy-pasted, almost no one would have a problem with that even if they didn't attribute every little code snippet. But some are bringing out the pitchforks because ML can basically do that painstaking search (yes, I know it's not literally a search) so efficiently that it's actually (maybe) useful as a tool. But it's not fundamentally different from what many programmers do all the time.
Show HN: SitApp - Desktop app to monitor posture and remind you to sit up
It’s fascinating to see Airbnb drop React Native and now watch them attempt to build their own in-house universal UI system from scratch.

There are very few organizations that can spend the kind of resources necessary to try this kind of thing. However it turns out, it will be interesting.
I can't speak for anyone else, but when I first saw it, it seemed kind of okay, but I also didn't really look too deeply in to it. As I've looked at it a bit more closely and thought about it for a few days, my original feelings have soured quite a bit.

I never considered the copyright and related ethical implications of ML at all, or thought about the impact it may or may not have on programmers. Your first thoughts on something can be wrong (and actually, often are) and it takes a bit to really think things though – or at least, it does for me.
Maybe under land, through a Hyperloop.
You can compile only the decompressor of the official ZSTD library to wasm, it is ony 28 kB: https://github.com/facebook/zstd/files/6602821/zstd.zip
Yes, this is why dealing with air is so tricky in economic terms, because "uninducing demand" does have more intrinsic downsides. Car -> rail is a mere political problem, once you get there it "unlocks" more travel so it is clearly economically good.

I guess thank god for 9/11 boosting security theater. Don't like all the other patriot act garbage, but the degree to which air travel is so awful really helps here.
Gentoo's Portage also.
Nope. It was designed precisely for patterns like this.
Air travel is generally more energy efficient than trains, beyond a 300-400 mile range, depending on what you're traveling over/through.

Track and right-of-way is a scarce resource with large amounts of embedded energy. The sky, not so much.
All of my open source licenses require attribution, but Copilot does not give that attribution. So while my code is open source, Copilot is still violating the open source license. Just because it's open source doesn't mean there are not any terms that must be abided by.

I believe that gives me the right to be mad and to demand they fix their violations, one way or another.
The change is happening right as we speak.
Just several weeks ago the first cultured meat factory has been launched in Israel. It produces just 500kg per day - but it’s a huge step for the industry.
Cultured chicken is already being sold to consumers in Singapore.
Cultured dairy is being sold in the US (right now only 2 ice cream companies - but it’s also a significant cultural milestone).
There is a growing number of startups producing all kinds of cultured products - so the cultured meat revolution is coming, soon.
> in reality redhat became more like IBM

This is a pretty strong statement. How is Red Hat more like IBM now?
What if I don't pay?
Ask HN: How can computer science help people?
And I mean in meaningful, practical ways, not "knowledge itself is good enough" ways.
You likely have a "fake" HDR monitor. To cover most of the new gamut requires very bright backlight. Most cheap HDR PC monitors are only ~400nits, not nearly bright enough. They bare bones HDR 400 spec most meet is... Not very HDR.

For proper HDR you need 1000+ nits. Only Apple monitors and a few very expensive alternatives can do this. On other monitors the gamut is compressed and there's little difference between the colors at the edges.

You can test your monitor with this https://m.youtube.com/watch?v=NlAsAuBtmps
When it stops getting brighter, you've maxed out your display and it can't display the additional range.

For whatever reason TV tech is way better. Even cheap TVs tend to be brighter than the brightest PC monitors. If you have the space, a 40 inch TV sitting farther away will be far superior picture quality than a monitor
Fair use for training and "independent creation" are one think a AI "remembering and mostly verbatim copying code over" an another.

Many of the current Machine Learning application try to teach AI to understand the concepts behind their training data and use that to do whatever they are trained to do.

But most (all?) fail to properly reach the goal in any more complicated cases, at least the kinds of models which are used for things like Copilot (GPT-3?).

Instead what this models learn can be described as a combination of some abstract understanding and verbatim snippets of input data of varying size.

As such while they sometimes generate "new" things based on "understanding" they also sometimes just copy things they have seen before!! (Like in the Quake code example where it even copied over some of the not-so "proper" comments expressing programmers frustration).

It's like a human not understanding programming or english or Latin letters but has a photographic memory and tries to somehow create something which seems to make sense by recombining existing verbatim snippets, sometimes while tweaking them.

I.e. if the snippets are small enough and tweaked enough it's covered by fair use and similar, BUT the person doing it doesn't know about this, so if a large remembered snippet matches verbatim it will put it in effectively copying code of a size which likely doesn't fall under fair use.

Also this is a well known problem, at least it was when I covered topics including ML ~5 years ago. I.e. good examples included extracting whole sequences of paragraphs of a book out of such a network or (more brilliantly) extracting thinks like peoples contact data based on their names or credit card information (in case of systems trained on mails).

So that Copilot is basically guaranteed to sometimes copy non super smalls snippets of code and potential comments in a way not-really appropriate wrt. copyright should have been a well know fact for the ML specialist in charge of this project.
How about just leaning back and reading the discussions which evolve out of this post? Some may have something to say about it which will either help you solidify your point of view or add a new perspective to it which you might have missed.

The topic is a current one [1], which makes it even more valuable.

[1] https://news.ycombinator.com/item?id=27676266
No you don't get to brush off actual armed establishment of an autonomous zone with "benign intention". That is the equivalent of mass-hostage taking and the beginnings of a coup; exactly as "benign" in intention as the 6th.

> You won't find me defending CHAZ, like you seem to assume I will.

This is exactly what you're doing here, you saw the claim and came running. You're just having to back-peddle now that someone is calling you on what you're doing.

Also, it's funny how intention is the only thing you are grabbing hold of and bringing up. Is that because of literally everything else about the CHAZ situation and the riots and the destruction of property that surrounded it are completely indefensible and infinitely worse?

Is the only reason "Intention" even becomes something you care about because it's the one thing you could try and twist into X is worse than Y?
It would be nice if we had publically funded communication etc tools. I am not seeing a valid business nodel here that does not involve either massive spying, or poor people loosing access to rest of society.
Every social group eventually uses the weapon of censorship. It's not just government...even without a proper institutional structure , censorship will emerge as a thing that a social group does endogeneously.

Like just scrolling back and looking at my last 10 posts on HN , I had to delete them after a few minutes in order to cut my losses because they were being heavily downvoted and once you are in negative territory nobody can see your posts anymore.

People just crave and love being surrounded by people who see things the same way as they do, so after a person has been burned a bunch of times, they'd start stepping outside themselves and acting on what they think will sell well socially among the community.

Pretty soon everybody starts doing this and you'll soon have a community full of people who are worthy of an actor studio interview.

Hollywood, DC, San Francisco and the Valley are prime examples of this
IMHO, Threadreader does a better job of reading these kind of tweets
> People share code for the betterment of society, and while copyleft used to be popular early on, the software industry has been moving towards less problematic and more permissive licences. The spirit of open source is to share code, and make it possible to use it to train machine learning.

It sounds like this writer doesn't understand the point of the GPL or the distinction between free software and open source. Also quite a crude historical perspective given the increasing number of major projects licensed virally. Claiming that MITL's popularity justifies pirating GPL code makes no sense.
At energy and cost levels that exceed airline travel, per passenger-mile.
What counts as a "substantial portion"? Personally I'd say that a function is substantial, whereas one or two lines would not be.
> OP didn't redefine `err`, just assigned a new value to the `err` variable that was available as `catch`'s parameter.

How would you define "redefine" if this isn't an example of redefining?

> the `return e` in your example works since `e` was hoisted when you defined it using `var e = err`. If you tried `return err` instead, it'd result in a `ReferenceError`.

Ok, thank you.
>, why tell everyone now releasing all evidence at once? Clearly there is an element of timing.

Because a line item was added to the defense authorization bill, which contained COVID-19 relief funding, requiring the government to report on what it knew about UAPs as a potential security threat within 180 days of authorization.

Nowhere, and at no time, has the government ever claimed that aliens exist, that UFOs (or UAPs) are alien spacecraft, or that the government has hidden, or intends to reveal, such evidence. All of that is part of the BS woowoo viral hype cycle spun around this story by clickbait-driven websites and UFO believers who have been waiting for "disclosure" for decades.

And all of that more important news to discuss is still being discussed. This story hasn't distracted anyone, or stopped the media from reporting on anything else, including the economy.

If the government wanted to use the media to distract people from a bad economy, first it obviously wouldn't work because people don't need the media to tell them when the economy is bad, and second, it would be easier and more effective to just propagandize economic reporting rather than hoping for a second-order effect from an entirely unrelated story.
There seems to be an issue with Hacker News's URL parsing. The final period isn't included as part of the link.
Indeed, the Windows Research Kernel itself is on GitHub. Kind of amazing that Microsoft is hosting their own pirated OS kernel.

https://github.com/cnsuhao/Windows-Research-Kernel-1
I don't know if I agree with your argument about GPT-3, but I think our disagreement seems to be besides the point: if your human parrot did that, they would--not just in theory but in actual fact! see all the cases of this in the music industry--get sued for it, even if they claim they didn't mean to and it was merely a really entrenched memory.
Behind the Simplicity – Steve Jobs and Shin-Hanga
I thought that the median age in the world was around 20 but it's actually ~30. Though I doubt a lot of 30 years old today ever had exposure (heh) to a traditional film workflow.
It's more likely they'd sue someone who used it to develop something that ate into their lunch by saying it infringed on one of their 'secret' Linux patents they sabre rattle about every now and then.
Wow. I said you need a lawyer's interpretation. You just left me a 5-second link to Wikipedia and yet I'm the one who's condescending?

I'm not going to put any more effort into my comments than you are, except I'll leave one more link in case it's helpful and leave this at that: https://toslawyer.com/are-end-user-license-agreements-enforc...

P.S.: This is obviously all about the US; if you're arguing about another country then we're speaking past each other rather pointlessly.
Intel is already shipping 10nm server chips. See, for example: https://www.anandtech.com/show/16594/intel-3rd-gen-xeon-scal...

The article you linked is about their next generation server chip (which is also 10nm).
Have you used Copilot? I have not, but I have trained a GPT2 model on open source projects (https://doesnotexist.codes/). It does not just pattern match and replicate. It can be cajoled into reproducing some memorized snippets, but this is not the norm; in my experience the vast majority of what it generates is novel. The exceptions are extremely popular snippets that are repeated many many times in the training data, like license boilerplate.

Perhaps Copilot behaves very differently from my own model, but I strongly suspect that the examples that have been going around twitter are outliers. Github's study agrees: https://docs.github.com/en/github/copilot/research-recitatio... (though of course this should be replicated independently).
We coupd sctuallu fly even more efficiently, but slower, with turboprops
This is a stupid argument that the Twitter author made. Saving music digitally is reading by robot, so recording music that wasn't digital into a digital format is fair use.
Ancient Chinese reconstruction:

https://www.youtube.com/watch?v=VIkQSuZbbt0
No, living with partner is not the same as living with roomate and 3 flatmates. The two are actually massively different.
The license you have chosen requires attribution. You may not care[1] but the other party still most likely will be in violation if Copilot reproduces a significant chunk of your code.

[1] I also MIT license my public code on Github, and also wouldn’t care that much.
not really the same, fighters are quite smaller than airliners.
I've given thousands of hours to open source projects, I really think open source is a pillar of modern society. So you would think I am all for something like copilot, but no.

At first I thought this was a great feature, because easier access to code, but after some reflection, I am also very skeptical.

I am able to make my code open source, because I can make a living out of it, and I have a lot of open source code that I love to share for things like education or private stuff, but if you want to use it for something real, you need to hire me. If you can suck all the code without even I noticing it, that's not fair.

The other thing is code quality. I don't want to sound rude, but there are tons of bad code around. Not necessarily because the author is unskilled, but because the code might not need to be high quality (for example I wrote a script to sort my photos, it was very hastily written and specific to my usage, I used once and was done with it). Also, there are some bad/wrong pattern that are really popular.

I am surprised you are able to DMCA a twitch stream because someone whistle india jones theme but in this case it is considered fair use.
Alexander is pronounced as “İskender” in modern Turkish as well.
I think you're missing my point. I have tons of MIT code out there, including a node.js project used by lots of companies. I don't care about people using my code for money because I open sourced it under a permissive license. So I'm not really objecting to that.

But what's bothering me about this is that it's not a small company doing this. It's a company that's got crazy amounts of cash, who has been trying to trade on a "we're nice now and we love open source" image in the last few years, now taking all the open source code and balling it up in a closed-source app they will charge us for.

I'd be fine if I got to use it for free, extend it to whatever editing platform I like through its open API, and it was a part of an open project.

But right now it looks like they'll charge, and that bugs me.
> Reading some copyrighted code can have you entirely excluded from some jobs

What provision of copyright law are you referring to? Are you conflating copyright law with arbitrary organizational policies?
I'm a big proponent of open source and I'm usually not nice with bad moves of GitHub. For example, i find stupid to use vscode and believe that it is open source when it is a lie.

But, in that case, I think that the things that are put to charge GitHub are not right.

I think that the idea is nice and it is fair from open source code. Anyone is free of downloading free software and doing something similar, and it is nice.

I just find the product itself is stupid, and it is for users to be smart enough not to use that knowing that their is a risk of them being sued for involuntary violating copyright. And GitHub might be at risk if it is a paid service as the companies could sue them back by pretending that they expected the code generated by GitHub to be safe for commercial use.

Also, I would think that GH would have abused if they used 'private repo' codes to train their model without permission.
wow this got long, but I'm in Denver and we have like 4 ballot measures to vote on that revolve around this issue of race, class, development. Specifically Apartment Prohibition!! If anyone is interested.
--
denver is going to vote on a ballot measure soon to repeal the repeal of apartment prohibition and I feel it is similarly driven by race & class bias, driven by largely white home owners who literally say they want to protect their wealth (below).

Our city council only recently changed zoning to allow an increase from only 2!!! non-related adults living in the same place to 5. It's crazy to me that was ever a limit in the first place.

No 3 bed apartments for non-blood relatives?!

The old zoning that was fixed also made it harder and limited certain types of group homes, rehabs etc too, especially the number of and locations.

One of the filers of this repeal said the following in a press article - clear intent imho.

“This affects their very wealth. Their very wealth,” said George E. Mayl, one of the five voters who officially filed to create a referendum committee. “And not only that, their children’s, their heirs’ wealth. Someone’s home is their single largest investment of their life.”

also the way they use 'neighborhood' to me is not so veiled language in the context of race and class - just like the many policies and laws in the past. It's used as a rhetorical excuse just like 'protecting the kids' is often used.

Similarly like Trump & Reps in 2020 made 'protect the suburbs from' or 'border invasion' a key message.

There are another 2 housing measures on the ballot that are competing.

A big developer spent like $20 million or something to buy rights for a golf course in the city that they want to develop.

They bought it with a green space park easement... But to be profitable they have to repeal the easement so they can built over the park. They gambled on their power to change the law.

So they filed a measure to allow them to build more (to be fair they still plan on having a park, but less green space than currently protected in an easement).

So now there is a competing measure in response to protect the park.

I'm for it we don't have a ton of open green space in Denver and we can't build more. Let's change laws and remove red tape to build UP.

What happens if they both pass? who in the world will be able to decipher the two when voting?

And what does it say that corporations & white homeowners consistently and so plainly manipulate the law directly for their bottom line (oil and gas is a big one here)?

Another one on the ballot around homelessness. HUGE problem, we have tents in residential neighborhoods and lots of theft.

But it's pretending to address the problem while really making more laws and regulations to criminalize homelessness and disallow solutions.

They're so brave to invest in allowing homeless to sleep in parking lots lol...

While simultaneously making it harder to create group living and the rehab that a ton of homeless individuals would greatly benefit from.

Thankfully we do have some push by Rep. DeGette and a few others to buy old motels. That's a good investment and would actually help.
I think it's clear that Copilot pushes boundaries...technological and legal. It makes people uncomfortable and challenges a lot of assumptions that we have about the current world. But this is exactly what I expect from the next revolutionary change in computing.
> Copyright has concluded that reading by robots doesn’t count. Infringement is for humans only; when computers do it, it’s fair use.

Reading by a robot doesn't count. But injecting a robot between copyright material and a product doesn't magically strip the copyright from whatever it produces.
>There are several identifiable square-mile or larger areas with nothing but homes plus maybe one school and one church. Maybe a gas station / Dunkin Donuts within fifteen-minute walking distance.

This is just suburban America in general.
As others have already told you in this thread, substantial portions can mean the few lines of significant algorithm wrapped in boiler plate. So either way, Microsoft would have to prove the MIT code was not substantial.
Yup - Wildtype is already producing and testing (with famous chefs) great looking salmon. Check out their Instagram for product photos.
I like the idea proposed by I think Larry Niven the SF author, that speech started as a way to bypass and augment the corpus callosum so the two hemispheres of the brain could get more in sync, and provide a way of organizing, "do this, then do that, then 'be careful here' swing the rock and release."

Think about the internal focus you have when doing something carefully and how you talk yourself through it, from carpentry to skiing.

Using the same verbalizations, when showing someone else the same thing, evolves to language.