skysight-inc/HackerNews huggingface dataset:
The best analogy for LLMs (up to and including AGI) is the internet + google search. Imagine explaining the internet/google to someone in 1950. That person might say "Oh my god, everything will change! Instantaneous, cheap communication! The world's information available at light speed! Science will accelerate, productivity will explode!" And yet, 70 years later, things have certainly changed, but we're living in the same world with the same general patterns and limitations. With LLMs I expect something similar. Not a singularity, just a new, better tool that, yes, changes things, increases productivity, but leaves human societies more or less the same.

I'd like to be wrong but I can't help but feel that people predicting a revolution are making the same, understandable mistake as my hypothetical 1950s person.
Indeed. But distance is a much more intuitive way to think about the problem than frames of reference of the rotations imo.

Are revolutions the coin rotating 360 degrees or are they the complete perimeter rotating across the other coin and touch the other one exactly once.

The problem is intended to be mapped onto a distance perspective and figured out that way. So it’s very much distance.
This happened to me as well - an ex-coworker (and friend) was unable to get their texts routed to my phone. I have never owned an iphone but apple hijacked their ability to send me a text message on my android phone and I could not figure out how they could fix it.

its sucks
The *pulled quote* says "A hospital" (read: cherry picked) and then uses that outlier to sway the assuming and the naive.

If I wanted to speak to the whole study I would have. However, the paragraph pulled specifically says "*a* hospital*.

Now who did the skimming?? FFS
Appreciate this, thanks.
> display also became animatable, so now you no longer have to figure out how to move an element between hidden, shown but not visible, and shown but visible.

Anyone know of any links regarding this? (Remember when blog posts had links?)
I did end up thinking about what you said, it took me a while before I got what you were trying to say. I will update what I wrote cause I think you have a good point. Would you like to collaborate? Or if there's anything you'd like to say let me know here, I'll be sure to include it.
I strongly disagree. Kids, even infants, show a remarkable degree of sophistication in relation to an LLM.

I admit that humans don’t progress much behaviorally, outside of intellect, past our teen years; we’re very instinct driven.

But still, I think even very young children have a spark that’s something far beyond rote token generation.

I think it’s typical human hubris (and clever marketing) to believe that we can invent AGI in less than 100 years when it took nature millions of years to develop.

Until we understand consciousness, we won’t be able to replicate it and we’re a very long way from that leap.
The newsroom is a different part of thr company than the legal department. Plus, sometimes your company does something that's newsworthy! Just like all journalism, there's always implicit bias. No reason to get suspicious about a news organization covering the news.
She would never be in the position that she is in if it wasn't for DEI. DEI systematically helps bad persons into power.
A search engines principle job is to provide you with links you can find the answer to your question.

The LLMs are ingesting all of that content en masse and would provide you the answer directly, with no compensation to the writers who actually did the research to provide that answer.

Search engines are symbiotic, LLMs are parasitic.
> That's the weird thing about dog people (mostly). They need this affection. They crave it. It's nearly the core reason they have a dog.

I think that's a great insight. It rings true regarding myself, but I never realized it until you mentioned it.
And now, of course, we have industrial and residential often in the same building!
Even if they win against openAI, how would this prevent something like a Chinese or Russian LLM from “stealing” their content and making their own superior LLM that isnt weakened by regulation like the ones in the United States.

And I say this as someone that is extremely bothered by how easily mass amounts of open content can just be vacuumed up into a training set with reckless abandon and there isn’t much you can do other than put everything you create behind some kind of authentication wall but even then it’s only a matter of time until it leaks anyway.

Pandora’s box is really open, we need to figure out how to live in a world with these systems because it’s an un winnable arms race where only bad actors will benefit from everyone else being neutered by regulation. Especially with the massive pace of open source innovation in this space.

We’re in a “mutually assured destruction” situation now, but instead of bombs the weapon is information.
If there are enough solvents in use to be detectable off–site, then the industry is in the wrong zone.
Written update at https://www.patreon.com/posts/94956611
The NYT also hallucinates from time to time: https://www.nytimes.com/2003/05/11/us/correcting-the-record-...

(That's a story about Jayson Blair, one of their reporters who just plain made up stories and sources for months before getting caught)

Edit: Sheesh, even their apology is paywalled. Wiki background: https://en.wikipedia.org/wiki/Jayson_Blair?wprov=sfla1
Yes, in both instances.
> why not a comparison with what the ROI of other individuals might have been

You're talking about a "what if" as opposed to concrete numbers we do a simple comparison of.

> Is money all we care about?

No, but in the context of the article, it is the metric.

The point is to challenge the premise that their success was only a product of their starting investment.
Wow this is awesome. I use a KVM switch currently and it takes a solid 2-3 seconds and for that reason I find myself usually just SSH'ing into the other computer and having a tmux session instead.

Excellent work.
If something is a top concern it's not particularly interesting more than one action is taken about it.
Do all automakers that now develop electric cars owe Tesla something as they cashed in once they saw Tesla's successful copyrighted material l?
A model is semantic, it contains the idea which is not copyrightable. Only how it is expressed could be copyrighted (i.e. if it outputs the copyright work verbatim). If this were not the case we would have plenty of monopolies and the world would fall apart.
That's not modern, that's been media since time immemorial. Geraldo spent 2 hours talking about what could be in Al Capone's vault only for them to finally open it up and it was empty. Magazines would print stories in serial format so you had to buy the next issue.

Writing and structuring to fit the length you want/need has been the norm for a century or two at least before social media came about. Hell, there's evidence that Shakespeare padded out a couple of his plays to fit the 4-pages per folio printing techniques of the time so that there weren't blank pages at the end.
Technically, you just send a request to OpenAI and they are the ones who feed it into GPT4. Although I'd argue this is irrelevant to your question, the law works in mysterious way so perhaps it carries some importance.
This is just rent seeking from dying media instead of working on creating something new in my view.

AI indeed is reading and using material sa a source, but is deriving results based on that material. I think this should be allowed, but now it is a fight who has better paid politicians pretty much.

I am open to hear other thoughts.
The fact that TLS connection encryption is gated behind the $60 edition (vs the $30 personal edition) completely turned me off it. Not a fan of basic security being paywalled.
Show HN: Ploomber Cloud Notebooks – Share Jupyter notebooks with one click
But it doesn't. There's no transcribing going on. mRNA is the *result* of transcribing from DNA. The genes aren't touched.

In normal operation the genes are the master blueprints from which work orders (in the form of mRNA) are generated. The cells use that mRNA to build the requested proteins. The mRNA vaccines are bogus work orders slipped into the production queue and they go nowhere near the DNA.
We'll find out won't we ;)

You have to imagine these limits are already fairly known within the legal community... If you're accused of copying/republishing my published work there will be some minimal threshold of similarity I would need to prove in order to seek damages.
And along with it, a different ideology would tag along.

Not a bad thing, but Japan or China or Russia, don’t align with Anglo centered ideology, so keep that in mind.
There’s a growing argument that most of the things we think zoning is protecting us from, it isn’t really necessary for, and that without those risks there’s no justification for government to have the power at all.
AFAIK, that, and also there is no clustering anywhere, so it makes no sense to talk about the styles as if they were a fixed set.

But every thing I've read sustains that the real conclusion from the styles holds: that you learn best if you are exposed to several of them.
Yes, there is large amounts of public domain text available, but does anyone believe this is a restriction that was imposed when feeding the models?
The complaint has specific examples they got from ChatGPT.

There is a precedent: There were some exploit prompts that could be used to get ChatGPT to emit random training set data. It would emit repeated words or gibberish that then spontaneously converged on to snippets of training data.

OpenAI quickly worked to patch those and, presumably, invested energy into preventing it from emitting verbatim training data.

It wasn’t as simple as asking it to emit verbatim articles, IIRC. It was more about it accidentally emitting segments of training data for specific sequences that were semi rare enough.
Same. Sadly, I feel we’re in the minority. I don’t want cutscenes, a narrative, or anything that drags me out of the flow of gameplay.

For my money, Quake III Arena was pretty much the pinnacle of gaming: play a match quickly, go to the next one or stop. Perfect.
Great free text-based css course from google / chrome.

https://web.dev/learn/css
What does PHP have to do with it? CelesTrak is an organization that distributes satellite tracking data .

You can use their data to watch for all sorts of things in orbit, like the International Space Station[1], weather satellites, etc.

[1] https://celestrak.org/NORAD/elements/graph-orbit-data.php?CA...
"fine grained" is relative, but you can go forwards/backwards 10 seconds in YouTube Android by doubletapping to the left/right of center on a video. If it's paused, doubletap to the left/right of the play button. It should also work on iOS, but I don't have an iPhone so can't confirm.

https://www.majorgeeks.com/content/page/youtube_double_tap.h...
I can get a printer to emit verbatim NYT content, and with a lot less effort than getting it out of an LLM. I find this capability of infringement equals infringement argument incredibly weak.
That's not true. For many people Emacs' text editor is the least interesting part of it and use evil mode to get Vim-like bindings. While the jokes may lean on the differences in key-bindings, they are hardly the whole story. Vim is a super lightweight editor that is available everywhere and very easy to carry around your own single-file config. You're allowed to configure it however you want. Vim too has its share of annoying key chords... <c-r><c-g> is one I use often enough that I stilllll haven't made a mapping for (and likely never will at this point).
Or the filter could be the other way, failing to litigate an AI to decelerate it's progress, and a risk of augmenting the underlying society too much too quickly.
I'm not from U.S., so I didn't look into this story closely. Just the name was familiar, and I also recalled this tweet from Ben Collins:

https://twitter.com/oneunderscore__/status/17378879685708392...

I mean this looks a bit like conservative PR campaign, but maybe plagiarism accusations are also true, I don't know.
I'm dying to know how Delphi fit into the CGI mix. Or are you just using Delphi 6 as an "era" marker. I too was using Delphi 5 and 6... and Kylix(!!!) during the CGI era, but all my web stuff was Perl/Python and some Tcl. Somehow the idea of piping CGI into a Delphi program, never crossed my mind!
It should be noted that there are explicit exemptions to allow copying program data intro RAM and into CPU registers (in many licenses). Whether that is truly necessary or not is at best debatable, but arguably training a model (especially one you then distribute or give access to) on copyrighted data is vastly different from regular copying into memory and should require explicit licensing.

The fact that the model can reproduce large chunks of the original text verbatim is proof positive that it contains copies of the original text encoded in its weights. If I wrote a program that crawled the NYT site, zipping the contents, and retrieved articles based on keyword searches and made them available online, would you not say I'm infringing their copyright?
These boosters are intended for low cycles not 60-100k like planes
We have a couple dozen years of modern time to show that bad people got into power way before DEI was ever a thing.
I wonder how you'd qualify for "classic".
I don't think they're looking to prevent the inevitable, but rather see a target with a fat wallet from which a lot of money can be extracted. I'm not saying this in a negative way, but much of the "this is outrageous!" reaction to AI hasn't been about the building of models, but rather the realization that a few players are arguably getting very rich on those models so other people want their piece of the action.
FWIW, I tend to be
an introvert, but I'm much more of a dog person.

Maybe the unconditional love and affection is a salve to the loneliness that introversion can bring?
I guess it's an "assumption", but it's an assumption that's directly challenged in the article:

> But of course we don’t actually care directly about performance on next-token prediction. The models already have humans beat on this loss function. We want to find out whether these scaling curves on next-token prediction actually correspond to true progress towards generality.

And:

> Why is it impressive that a model trained on internet text full of random facts happens to have a lot of random facts memorized? And why does that in any way indicate intelligence or creativity?

And:

> So it’s not even worth asking yet whether scaling will continue to work - we don’t even seem to have evidence that scaling has worked so far.
If Apple is in a lawsuit I'm not going to go to the Apple media relations page for the story. What about the NYT, also a for-profit company, makes it more principled than Apple, other than that they say they are?
Of that blog post the float formatting is a tiny fraction (excuse the pun) of the perf win.
[edit: they have since opened a comment section to the article.] It is unfortunate that the NYTimes don’t allow reader comments to this article. I like some of the NYTimes content, but in this case use of chatGPT is infinitely more valuable to me than subscribing to the NYTimes, so I would like to explain this concept and the associated risks by their litigation without cancelling my subscription.

Maybe it is time to move training of models to Japan that has explicitly adapted AI friendly legislation that allows training on previously copyrighted materials. My best guess is that if the inputs were legally obtained, then the output doesn’t violate anything until someone publishes it. Similar to how reading a newspaper in a public library is legal but copying its content verbatim and republishing is not.
Imagine a paid streaming service that has, say, the Lord of the Rings trilogy as part of their catalogue. They’ll be happy if you send people searching for “watch Lord of the Rings now” to their landing page.

But if instead you send everyone who searches for that an .mkv of Lord of the Rings that’s ripped from their site, they’ll probably be be less happy.
FWIW When I was taking journalism classes, style was not amorphous.

We had an entire book (400+ pages) which detailed every single specific stylistic rule we had to follow for our class. Had the same thing in high school newspaper.

I can only assume that NYT has an internal one as well.
Ask HN: Tips on setting up tech hiring at a startup?
I'm working at a startup where we're setting up our tech hiring process and I'm looking for feedback.

Our current process looks like this:

- Initial Chat (15min): intro, discuss compensation, ESOP, CV...

- Coding Task & Design Brainstorm (1h): A minimal coding task and system design case study. Focus on analytical thinking and approach to problem-solving.

- Take-Home Task (2h): A practical ML/backend/frontend problem

- Final Meeting: Review of tech stack, potential projects for the new hire, and final compensation alignment.

- Decision: Offer or not

I'm interested in your experiences and suggestions for refining this process.

What worked well for your team? What did you like or wish for when interviewing at other startups? Any pitfalls to avoid?
Yann LeCun through Meta is incentivized towards maximizing capital return based on local maxima. That is how all business works, there is not really a direct incentive to pushing boundaries beyond what can be immediately monetized.
If I ask an LLM "repeat this sentence: [copyrighted sentence]", is that copyright infringement by the LLM, and recorders such as cameras and parrot toys, or middle scooler troll logic? Because apparantly this is the argument they want to take on Microsoft Bing with.
Tutanota team here, we saw this post so need to set some things right:

This is not a vulnerability in Tuta. We have built Tuta with multiple layers of protection for our users. We currently use TLS and DANE to protect authentication and data integrity and (only tunneled) RSA-OAEP and AES-CBC to provide confidentiality. We have always communicated this transparently, it is nothing new. Neither the confidentiality nor the integrity of our users' data has been at risk.

However, we know that the implementation is not perfect regarding this detail. That is why we have also implemented the following security features since this has been reported first:

* 2-factor authentication

* Simple verification of downloaded Tutanota apps

We are currently starting to roll out new encryption algorithms. Enforcing MACs is part of this upgrade, just as post-quantum secure algorithms, authentication and signature verification. We already have a working prototype of this hybrid encryption protocol.

Tl;dr

There is no known vulnerability in Tuta. Security is the heart of Tuta, and we always fix reported vulnerabilities immediately.

Additionally, we'd like to add some facts about this blog post:

As part of their blog post, Proton confirms, that they indeed don't encrypt email addresses and names on their address books. So Proton basically knows all your contacts email addresses and names even if you don't send emails to them.

Proton claims that their Calendar metadata is encrypted besides date and time of events. So they don't encrypt that and claim it is not possible. In Tuta, even date and time of your events are encrypted as we handle notifications locally on users' devices - not on our servers.

Both services compete to see who offers the best security. This is basically good for all users. We are convinced that our product is more secure and are working hard to constantly improve security.
Should Stranger Things have to pay Goonies and Steven King?
it is a merciful subtext to this post however, let's be uncompromising in viewing the precendents that lead to this day. Approximately twenty years ago the Wordpress platform enabled millions of individuals to reliably self-publish. At that time there was considerable talk among certain circles, about monetization, especially "micropayments" .. also subscriptions, viewer circles, peer review and other approaches. For "mysterious reasons" the Google-Facebook ad model not only took over, but generated wealth on the levels of the Spanish gold raids on South America.

Now, those that profited most mightily, and their chosen stewards, are taking with both hands, any and every piece of written work they see fit on the Net. The inside circle includes international military, who see this as a crucial new competitive advantage over others. The West is in disbelief generally over the digital citizenship created by China, and the level of daily surveillance on commercial activity in the West.

Who exactly stood up and succeeded in diverting the past wave of copyright material pimping?
Yes apartheid is a label that can be applied but only when talking about the occupied territories, what Israel is doing in the West Bank is a system of population control that seems very close to or worst than apartheid, and with the colonist movement backed by the Israeli army it is effectively a form of ethnic cleansing, albeit a very ineffective one so far considering the growth of the Palestinian population.

But Israel itself is not an apartheid state, it is the most inclusive and liberal democracy in the entire region. Calling Israel an apartheid state because of what they do in the West Bank is a stretch, it would be like calling the USA a military fascist dictatorship because of what they did in Iraq.

And regardless of wanting to think of the whole of Palestine as a single country, the most important fact is the Palestinians and Israeli have absolutely no desire to live together in a single state, the only option the vast majority of Palestinians want is a single Palestinian state with no Israelis or jews (from the river to the sea). The Israelis are split but most favor a two state solution.

So your simplistic solution is not one that is grounded in any reality, it is a pure fantasy and projection of western virtue, and if you had any understanding of the actual situation you would realize that what you are advocating for (the dissolution of Israel and Palestine into a single state) will only happen with the genocide (an actual one) of one of the two populations fighting over that piece of land. Maybe it can happen one day with the two populations living in peace, but that is certainly not the case now, and all the hysteric propaganda is making it even less likely.
Establishing a legal route to train LLMs on copywriten content could certainly have a chilling affect on the progress of science and useful arts... Why would someone devote their life to their studies or craft when they know that an LLM will hoover it up and start plagiarizing it immediately?
This argument is moot. Just because some countries - see china - steal intellectual property it doesnt mean we should. There are rules to the games we play specifically so we dont end up like them.
Except Gmail does not own the copyrights to the email. So in the context to this article and theme of the post, the owner of the data is king. I don’t think any court would rule Google owned a novel sent over Gmail, little alone the contents of more normative emails.