skysight-inc/HackerNews huggingface dataset:
It is questionable whether that filtering mechanism works, previous discussion: https://news.ycombinator.com/item?id=33226515

But even if it did an exact match search is not enough here.
What if you take the source code and rename all variables and functions? The filter wouldn't trigger, but it'd still be copyright infringement (whether a human or a machine does that).

For such a filter to be effective it'd at least have to build a canonical representation of the program's AST and then check for similarities with existing programs. Doing that at scale would be challenging.

Wouldn't it be better to:
* Either not include copyrighted content in the training material in the first place
* Explicitly tag the training material with license and origin infornation, such that the final output can produce a proof of what training material was relevant for producing that output and don't mix differently licensed content.
A couple of thoughts

1. The "hard" position - if you don't want "permissive" don't release it as open source is very "hard" and it does fly against what is a clear and growing view that whatever open source "truly" means, it's not supposed to mean exploitation of others work for free by large corporate entities. (who weirdly also are involved in finding a lot of development)

2. The "soft" position (this builds a community, which is the major benefit) also ends up allowing for exploitation.

3. the term "exploitation" is biased in the debate and shows where I sit. But using others work without payment and with no clear intention of keeping to the intention of the license they provided seems a good choice. FOSS found a loophole in the law and made a whole new means of making the law support community and individual rights - that the payment you make to me is to forward restrict your rights. If you can get out of that obligation have I had any payment?

4. There are two options going forward if we want to put that obligation back / create the utopia we are vaguely dreaming of

- Force a chnage in the interpretation of the current license - something like GPLv2 really means GPLv3.

- chnage the license (going forward) - ie GPLv4000

But both are fraught with problems.

In the end we are looking for a non-governmental solution to a problem that governments are clearly designed for - reallocating wealth according to human and social notions of fairness and / or most appropriate use of resources when the market fails to do it.

We pay scientists who will
mostly release open source work, the question then becomes why not coders and then which coders.

That does not seem a good solution - so perhaps it's government action to re-open the market in FOSS?
instead of buying home consumer appliances, i would elect to purchase appliances that are used in commercial kitchens or working restaurants.

They often only buy long lasting equipment, and the market shows it. It's hella expensive, but that's what you pay for.
Create a Full-Stack Web Application Using React and Node JavaScript
It was pci passthrough so the vm had a dedicated gpu, usb controller and nvme drive which I wired to the hardware KVM as extra inputs.

There are other options like https://looking-glass.io/ , but I preferred having this option, which is like having 2 computers if there's enough resources to share to the gaming guest (cpu pinning + huge pages).
See also: https://news.ycombinator.com/item?id=817235 (from 14 years ago)
Using similar logic NYT should pay all actors involved in their articles.
I wonder if this is because the purpose of linking to a book is to share awareness of that book’s existence - nobody is about to go and read it then and there to comment on its contents. Whereas the purpose of an article is to discuss it now, in the comments - the consumption horizon and bulk of the content is different.
Can someone explain what's the &-2 method, and why it should be better than &1 ?
There’s an awful lot of confident statements be made about the law here. I wonder if anyone who is actually a lawyer would like to chime in.
I run a small transactional email provider (https://mailpace.com), our IPs are very rarely added to blocklists- but we are very strict on what we allow through our service, and surprisingly we’ve had no long term delivery issues with any of the big providers.

So thanks to the federated/decentralized design of email, is totally possible to be part of the network without any special privileges.

We are sending millions of emails every day though, which is quite different to sending a couple hundred personal emails a week. If you’re running this on a cloud host, expect to be blocked by default. However if you can find a small vps provider you’ll have better luck on sending yourself.
I’m pleasantly surprised that nobody started the discussion on whether zero is odd or even ;-)
https://en.wikipedia.org/wiki/Parity_of_zero
Have a look at https://github.com/glaretechnologies/substrata/blob/ef48de33... for some (incomplete) notes.
I attended 30C3 and was fascinated by his talk "Seeing The Secret State: Six Landscapes"..

Although there is some interesting thoughts on psychological warfare in this latest presentation, I wish it was longer and a bit more in depth. If anyone has recommendations for further viewing/reading, please share.

https://media.ccc.de/v/30C3_-_5604_-_en_-_saal_1_-_201312282...
They are not the only ones to sue.
There is also a class action: https://githubcopilotlitigation.com/
It's extremely speculative to claim that LLM models are basically doing what humans do. There is very clearly something that isn't right about that because in order for a human to learn to speak and converse and they don't need to imbibe the entire corpus of all written text in human history - which is basically what we're doing with these LLMs. What we're giving them is vast amounts of data which is totally unlike how humans work. There's very clearly some gap here between what a LLM is doing and what a human is doing. So you can't use that as a basis to justify why it's ok for OpenAI to operate like this.

To put it another way, let's say I turn the dial all the way the other way, I train the worlds crappest LLM on NYT material, it massively massively overfits and all it will ever return is verbatim snippets of the NYT. Is that copyright infringement?

The core part of the argument here is actually just that OpenAI doesn't want to adhere to what the current standard is for using copyrighted material, if you want to use it and create something new with it you need to license the material. Since OpenAI's LLM isn't actually like a human it needs to license such a vast dataset that it would be uneconomical to run the business without stealing all the content.
I live in Sweden and can find quite a lot of old school kitchen appliances in flea markets/thrift stores. I bought my Technivorm Moccamaster coffeemaker in one, a Bamix immersion blender, a Bosch stand mixer, all of them from around the 80s and still working 100% fine.
Explore our journey in developing a Python package for interacting with YouTube API. From creating API communication code to implementing JSON mapping and rigorous testing. Dive into our latest blog post for insights and practical examples
Would it not logically follow that nothing of value would be lost, even if that were the case? From the point of view of LLMs and content creators, I would treat potential loss of future content being created like I would treat a lost sale. LLMs have value now because of training performed on content that already exists. There must be diminishing returns for certain types of content relative to others. Certain content is only of value if it is timely, and going forward, content that derives its worth from timeliness would find its creation and associated costs of production and acquisition self-justifying. If content isn’t of value to humans now or in the future, nor even of value to LLMs now or in the foreseeable future, not even hypothetically, then why should we decry or mourn its loss or absence or failure to be created or produced or sold?
Back in Ye Olden Car Days, making it to 100,000 miles was a mark of competent ownership & maintenance, as applied to fundamentally sound engineering. Chevy small blocks could make it. Novas, Malibus.

But yes, along the way were regular hassles with engine timing and carburetor adjustments. You could DIY if you invested in a timing light and you knew what you were doing, but you could also just take it to a garage, back when indie garages could still regularly undercut ripoff dealerships.
Oh look, it's the Matt Walker book that reference chains into nowhere and is riddled with errors [1]. Yea, we know about it, and your acquaintance is a massive pain in the ass barrier for us to actually clear out his bad ideas from the mainstream. And fun fact, despite his bad science he's still a tenured professor at UC Berkeley.

1: https://guzey.com/books/why-we-sleep/
https://www.cnn.com/2022/12/12/politics/nuclear-fusion-energ...
I’d be happy if the NYT was deleted. I find it has very little use as a source of anything, much like most mainstream media.
> Web doesn’t scale

> You can only do X in native

I wonder where are the Web haters now?
Does it matter if not everybody stops? What if some threshold of people stopped? Actually what is the current percentage of people tipping?
Elon Musk Is the New Republic's 2023 Scoundrel of the Year
Another source is mentioning 300k layoffs.

https://www.newsweek.com/mass-layoffs-happening-2024-hiring-...
I wasn't even aware that Neato is shutting down. I owned two Neato's, one is dead, the other one is dying (screen broken). Still sad.
So we have JSX-like language support for:

- Javascript / Typescript

- Lua (this)

- Go ( https://templ.guide )

- Ruby ( https://github.com/camertron/rux )

Any others?
Why would you be single in sf
Home run! (First blog post blows up on HN)
Site is susceptible to some kind of css attack. Too bad.
It feels like the author might be exaggerating ever so slightly, but it conveys a general feeling that things are built cheaply and without durability in mind.

To me, whether it's worse or better than before is somewhat of a moot point. To follow their example: after a hundred years of building juicers, we should have global juicer expertise. The generations of juicers created, the feedback on the models, the breakage rate should have generated a general knowledge of the best techniques for juice extraction, of the materials that are most adequate for the task, and how assembly should be designed for maximum durability. But we don't. What we have instead is cheap juicers, which underlines the point that cheap is what matters in how the design. Be it for maximum profitability or low price point.

Following on their other example about coffee grinders: last year I renewed my coffee making stack. I like coffee such az many here, and wanted good hardware; quality first, and cost a secondary concern. I took care of asking friends, watching videos, going on forums, reading tests. I ended up investing quite a bit in a Baratza machine, which is quite celebrated and very repairable, they sell replacement parts at reasonable cost, they even give you tips on how to extend longevity. All marks of a manufacturer who wants their craft to last. I suspect that you might be able to find the one juicer on some small website which ships direct from the manufacturer in Vermont. Juicing enthusiasts share their experience and knowhow on juicing websites and all swear by their mothers that this one brand revolutionized juicing for them. For equipment with any mild complexity, you need to acquire a relative expertise, and shop in the outskirts of the market. And obviously, you have time for that only for the stuff you care about.

As per not picking the cheapest option, price isn't a good indicator of quality. Certainly if you keep surrounding yourself with the cheapest copies, things will always break around you. But you'll get more reliability from a Corolla made by a manufacturer which obsesses about quality, then from a Mercedes which targets premium and luxury. Additional manufacturing cost is generally used to add more features and better looking materials, rather than producing sturdier things.

Anecdotally, I am still using the peeler I bought when I was a student over 20y ago. I can guarantee you that no research went into this option, and it was likely the cheapest option that Tiengong had to offer back then.

I enjoyed reading this, it's well written and entertaining.
Fair use is something Wikipedians dance around a fair amount. It also meant I did a lot of reading about it.

It’s a four part test. Let’s examine it thusly:

1. Transformative. Is it? It spits out informative text and opinion. The only “transformation” is that its generative text. IMO that’s a fail.

2. Nature of the work - it’s being used commercially. Given it’s being trained partially on editorial, that’s creative enough that I think any judge would find it problematic. Fail on this criteria.

3. Amount. It looks like they trained the model on all of the NYT articles. Oops, definite fail.

4. Effect on the market. Almost certainly negative for the NYT.

IMO, OpenAI cannot successfully claim fair use.
I think the archive of an article is more preservation of history and maintaining records of events which often disappear if not archived. The number of threads referencing articles which are defunct is always increasing. A book or movie or original content on the other hand will continue to hold its own commercial value so reproducing it is more akin to an actual loss for the license holder.

Definitely a grey area when that content is then used to train models though.
Hi, saw the post on Lobster [1] but didn't have an account there even if that post was more active.

I'm sure it was fun porting the Lua parser to Go and all but I wanted to let you know that Lua is very powerful on its own for making very nice DSLs, for example it can be used to make an HTML Builder DSL akin to JSX within the language itself (and by the way I think it's far more readable than JSX or XML) [2] and also some build tools use it as a base language [3]

[1]: https://lobste.rs/s/oubncm/i_made_jsx_for_lua_because_i_hate...

[2]: https://leafo.net/guides/dsl-in-lua.html

[3]: https://xmake.io/#/getting_started
Please don't post baseless accusations. I think dang has said that he tries to moderate less, not more, when YC companies are involved. (Although it's impossible to say what he would do in this situation.)
That is exactly what I was hoping for! 3DP/CAD is still one of the most exciting areas in FOSS and it's really cool to see this kind of thing moving forward.
The telegram group has a bunch of people (including myself) willing to mail pre-made ones, or the unsoldered PCBs for self solder.

It has become quite a community around the software and breakout hardware in itself
Both those brands are exactly that - brands - where a lot of the cost of the product is recycled right back into advertising to convince you that the brands are actually worth the prices they charge.

When buying clothing, it's worthwhile to spend a little bit of time learning what makes quality clothing and what doesn't. That's very helpful in avoiding over-branded garbage being sold for far more than it cost to make in a sweatshop.
Borg, My Post-Pandemic Homelab Server (2022)
I think they thought that the market for front-end web devs is very saturated. I cannot speak for London but in India it is indeed like that.
I'm really, really sorry for you, I can't begin to imagine how would life be if I was in your shoes.

I hope you recover somehow, from the bottom of my heart.
There's a live game going on until Saturday at https://cyclops.sh/
Do they even have 300k employees? Wikipedia says they have just 140k 2021.
My IDE is a tiling window manager, neovim, and several terminals. There is a browser somewhere for reading documentation.
Possibly because once an article is published the author receives no further payment. In all other mediums, there are residuals and royalties to be paid to the creators of the work.
Moving from low code space to fintech
I currently work at a low-code startup, but I'm thinking of transitioning to the Fintech industry in India. I'm uncertain whether it's a wise decision to shift from low code to Fintech. Are there any individuals employed in the Low code or Fintech field in India who could provide some advice?
Modern neuroscience does highly suggest this is essentially what's happening.
I find "modern" OOP concepts apply pretty well to graphical user interfaces. I believe that a good UI has a consistent and relatively strict hierarchy, with few "unique snowflake" elements. Even such a divisive idea as multiple inheritance often makes sense in UI, i.e. there could be an element inheriting low-level behavior (HTTP/API call, etc) from a button and a high-level behavior (style/presentation, etc) from a visual class.

(In a way, even CSS is kind of OOP, albeit with very confusing overriding rules.)

When writing generic backend code in a language like Java, I often found fighting against OOP because the business logic is not necessarily mappable to "dog inherits from animal". And I can't change the business logic, so OOP has to give in. But when developing user interfaces, I am usually in more control, I am actually designing it, not observing directly from the business logic. And OOP forces me to have a more consistent implementation, which is beneficial for the user, because consistent UI makes it easy for people to get used to it, find the underlying logic in it, and start relying on it. If all links on all web pages would inherit from normal HTML href link (like it was designed in the beginning), we wouldn't suffer from those weird JS web apps where you can't open a link in a new page for example.
Automatic hair-cutting machine 1996
> One man's wild journey from prison and gangs to high finance

... to another prison and gangs. /s
I believe that ChatGPT is fair use, just on a much larger scale than we're used to.
Seems like a job for AI.
Weirdest bit is this, I think.

> After all, IPv4 is still standing stronger than ever, 60 years after it was deemed deprecated due to so called “address exhaustion”.

IPv4: deprecated in 1963, 19 years before it was introduced.
I became a little bit addicted to built games with emojis - it gives them a familiar casual feel - most unfinished but those 2 work fine

https://flapimoji.franzai.com/

https://interdimensional-chimney.franzai.com/

and a little bit

https://updownredgreenetc.franzai.com/
So you want the unsupported, unmanaged, not monitored game server - that will get hacked - access to the credentials database that holds emails, password, names, addresses and possibly payment details?

You also want users to contact the the OS devs when their old, unmanaged, not updated game no longer works? Or you want the users not to install important security updates because they want to play one old game?

None of what you've said really makes sense in the the enterprise IT world. AS it's already been previously stated to you, you can't just spin up a VM and host your game on it, it just doesn't work like that. There are plenty of valid reasons for that in the thread already.
I find it hard to understand how someone can be confused about that. But I dimly remember talking to people with this confusion in the past.
I understand and agree with that. But to push back on the first sentence, I really don't think FreeCAD is acceptable. It's clunky, it's notorious for crashing on large models, its user interface is antiquated and really difficult to learn, and the code base is a monstrosity.
In general, file explorer apps are one of the rare apps that are allowed to opt out of scoped storage, so it doesn't really make much sense for them.

Supporiting all file operations via SAF while keeping compatibility back to Android 1.0 with old APIs would also be quite a hellish operation.
And add to that fact that NYT subscription is hard to unsubscribe from. People have aversion to NYT, even setting aside the bias.
See also: u-conf [0], discusses on HN previously at [1].

[0] https://nullprogram.com/blog/2023/01/18/

[1] https://news.ycombinator.com/item?id=34426430
It's not necessarily true that what can be read locally can be sent to a remote server.
That's true. And it was Green ministers that pushed to keep the last German NPPS running longer, as long as possible. It was also the Greens who sent the first German troops abroad under NATO mandates, so one can say tge reputation of the Greens is not always matched by their actions. They are very easy scape goats so.
Having remodeled several kitchens, this has also been my experience.

If there were a brand that released exactly one of each appliance, over-built that one model, and invested the budget in robust components instead of wifi smart home touch screen bullshit, I would love to stop becoming an expert in all these product categories.
Yes. Any delivery is 20% on top.
Those cite the original source that they used to write the article, the gpt models don't.
If it takes 120 seconds to read a newspaper article, the archive.is workflow is a significant overhead over that, a significant friction. Those links are a courtesy to other HN readers. This is very different from the economics of buying and reading a book.

"Piracy is almost always a service problem and not a pricing problem."

edit: It didn't even occur to me to compare the time-cost of "just pay for the article", but: last I read, it's half an hour of work to cancel a New York Times subscription [0]. So, that option's not even on the table.

[0] https://news.ycombinator.com/item?id=26174269 ("Before buying a NYT subscription, here's what it'll take to cancel it", 812 comments)
It doesn't, it opts out of it and tries to gain MANAGE_EXTERNAL_STORAGE permission which enables direct manipulation of files.

(Which I guess is why it's not available on Play Store).
I'm not sure this is credible. It stretches belief that Google would even have thirty thousand people in it's ad sales unit. That would be nearly 20% of alphabet employees if true. After laying that many people off there presumably wouldn't be anyone left at all in ad sales. This would seem odd for a company which makes it's money selling ads.
When a project that should take 5 months takes 500 months, this isn't a case of the pot calling the kettle black.
I'm glad the elitist, liberal car that everyone laughed at in 2005 is working so well for you, and that decades later you can laugh at a new generation of elitist liberals in their very expensive, not very green, pointless EVs.

Who, other than virtue-signalling liberals of course, could have predicted in 2005 that adding batteries to cars would work so well?

> to sum up then, its a very expensive, not terribly green, slow, cheaply made, and pointless way of moving around..

Is how the Top Gear review of the Prius went in 2008.
Only took 7 hours to get something that looks like it might work but clearly has tons of syntax errors and won't work as-is.

What are y'all trying to hide?
37C3 Video List
It’s good I don’t read it. Still works for me. YMMV.
You can also call eg Rust or OCaml code from Python, doesn't have to be C.
You « reach » by canceling your subscription. No need for anything more really.

That’s what I did a few month ago when I noticed Prime was way more expensive than I remembered, and couldn’t justify it anymore. I used to love Prime Video but every single thing I want to watch needs an additional few bucks nowadays, so no thanks.
AFAIK there is quite widespread consensus that WW1 and WW2 are the same conflict with a break. To be fair, they took ~100 years of nation-building and conflicts brewing after Napoleonic wars to get to that point.
You're getting mixed up. When applying the four factors, you need to individually separate all the uses. So you would need to repeat the fair use test for every alleged type of infringement. This means that the scraping from the public internet to OpenAI's dataset storage cluster is one instance where the full analysis of the 4 must take place, then the training itself, so another full analysis, then the distribution of model outputs, another one, etc.