MurphyA/hacker-news huggingface dataset:
by numpad0 | 2025-06-16 05:08:56+00:00
It's apparently known among LLM researchers that the best epoch count for LLM training is one. They go through the entire dataset once, and that makes best LLMs.

They know. LLM is a novel compression format for text(holographic memory or whatever). The question is whether the rest of the world accept this technology as it is or not.
by 9dev | 2025-06-16 05:10:38+00:00
I don’t think this analogy is fully apt. Instead, consider people going to a church or mosque. Some listen to the sermons and come out just fine, a few are radicalised over time and go find these bad people convincing them to act out on that. But drawing the line between legitimate religious teachers and ideological deceivers is hard, and condemning the entire religion would be the wrong conclusion.
by aiswaryap | 2025-06-16 05:10:52+00:00
ForgeCode | Founding Staff Engineer – Rust + Distributed Systems | Remote | Full-time | forgecode.dev

We’re building an AI-native product for developers - part of Surge 2023, Sequoia’s rapid scale-up program for early-stage startups - and are looking for a founding Staff Engineer to join us early.

A few quick bullets - -> Early-stage, fast-moving startup with real momentum -> Product built by the founders themselves — this is a rare chance to work directly with them on deeply technical challenges -> Stack is heavy on Rust, with real-world distributed systems at the core -> This is a founding team role — you’ll help shape architecture, team culture, and product direction -> Remote-first and async-friendly

We're looking for senior engineers (staff level and above) with strong experience building and scaling distributed systems in production, with Rust.

How to apply: Email me at ash@tailcall.run or fill in this form - https://forms.gle/8uhDngCcyz9WqCHS9
by jsrozner | 2025-06-16 05:11:07+00:00
I wouldn't call it "accumulation of cognitive debt"; just call it cognitive decline, or loss of cognitive skills.

And also DUH. If you stop speaking a language you forget it. The brain does not retain information that it does not need. Anybody remember the couple studies on the use of google maps for navigation? One was "Habitual use of GPS negatively impacts spatial memory during self-guided navigation"; another reported a reduction in gray matter among maps users.

Moreover, anyone who has developed expertise in a science field knows that coming to understand something requires pondering it, exploring how each idea relates to other things, etc. You can't just skim a math textbook and know all the math. You have to stop and think. IMO it is the act of thinking which establishes the objects in our mind such that they can be useful to our thinking later on.
by imgabe | 2025-06-16 05:11:15+00:00
No, the second point does not concede the argument. You were talking about the model output infringing the copyright, the second point is talking about the model input infringing the copyright, e.g. if they made unauthorized copies in the process of gathering data to train the model such as by pirating the content. That is unrelated to whether the model output is infringing.

You don't seem to be in a very good position to judge what is and is not obtuse.
by jjtheblunt | 2025-06-16 05:12:24+00:00
that is also true in wide, but unpredictably located, swaths of America, i can attest.

I grew up in a very famously religious suburb of Chicago, and the proudly super church-y family nearby ended up with the father convicted of embezzling from the church.

consistent with your nordic point, it seemed to surprise no one (perhaps because most of the area was northwest european recently derived families).
by pcthrowaway | 2025-06-16 05:12:34+00:00
You could deploy a new version, you'd just have older clients unable to connect to servers implementing the newer versions.

It wouldn't have been insane to rename https to httpt or something after TLS 1.2 and screw backwards compatibility (yes I realize the 's' stands for secure, not 'ssl', but httpt would have still worked as "HTTP with TLS")
by RainyDayTmrw | 2025-06-16 05:12:50+00:00
I fear we're regressing.

There is a concept in browser UX design called the "line of death"[1] - the delineation between trusted browser UX and untrusted website UX. Unfortunately, because it looks ugly, every new year of visual designers further weaken its guarantees.

Here's an interesting anecdote from an earlier time. In the 2000s, back when the internet was a lot newer, and UX best practices were much less well understood, and internet users were starting to see the first big wave of "evil" websites, many of us independently discovered a surprisingly simple and surprisingly effective mitigation. If you choose a custom browser theme, preferably with bright colors, websites can't fake browser UX elements. The default theme will clearly mismatch, and websites can't guess what theme you did pick.

[1] - https://textslashplain.com/2017/01/14/the-line-of-death/
by almostgotcaught | 2025-06-16 05:12:54+00:00
I'll never figure out why people post this kind of stuff here (and then it gets upvoted). there's literally nothing "hacker" related or even novel about these notes - it's just bog standard stochastic process. like these are just notes for some grad class or something. invariably someone will pop in and respond to my complaint saying "well actually I used everything in these notes for a project 10 years ago". ok. it strikes me, strongly, as just weird virtue signaling.
by magicalhippo | 2025-06-16 05:14:34+00:00
From the abstract[1]:

This enabled circuit operation below 3 V with an operating frequency of up to 25 kHz, which was constrained by parasitic capacitances

I would guess process improvements would help a lot towards lowering those parasitics. So I wouldn't take this initial attempt as a guide for ultimate speed.

Since this is 2D materials, a capacitor is a dielectric sandwiched by two conductors and capacitance scales linearly with area, I would assume just scaling things down would help immensely with parasitic capacitance. Changing materials or process could also change the dielectric constant which also affects the capacitance linearly.

Paper is sadly not open access, so I can't check if they mention this or have done some theoretical peak calculations or something. Would indeed be interesting to know.

[1]: https://www.nature.com/articles/s41586-025-08963-7
by tikhonj | 2025-06-16 05:14:50+00:00
We already have more insta feed or video games than you can eat. We've been inundated with optimized slop ever since social media became a commercial force, and the ages of cheap TV and tabloids wasn't that different either.

To make a fundamental difference AI-generated content would have to have some categorically different qualities from the sea of human-sourced garbage we're already swimming in. That's possible, but it isn't clear what that would even entail, much less when or whether generative models will be able to provide it, or what sort of social effect it would have.
by acosmism | 2025-06-16 05:14:55+00:00
There will always be a portion of the population susceptible to this kind of thing. that will never go away. "video games cause violence" , "social media causes suicide" etc. you can start at the "delusions of grandeur" wikipedia page and go down the rabbit hole to find that this happens with some small portion of the population all the time throughout history. this is a psychology issue not a technology one.
by BLKNSLVR | 2025-06-16 05:14:57+00:00
Thanks for clarifying. I agree with your answer. Do what works for you!

Since the advent of "gluten free" foods, specifically for coeliacs, the fact foods get advertised as "X free" leads a percentage of the population to believe that X is therefore bad and should be avoided for as-a-general-rule health reasons rather than health reasons limited to those who get complications as a result of X.
by psychoslave | 2025-06-16 05:15:01+00:00
The main issue on an economical point of view is that copyright is not the framework we need for social justice and everyone florishing by enjoying pre-existing treasures of human heritage and fairly contributing back.

There is no morale and justice ground to leverage on when the system is designed to create wealth bottleneck toward a few recipients.

Harry Potter is a great piece of artistic work, and it's nice that her author could make her way out of a precarious position. But not having anyone in such a situation in the first place would be what a great society should strive to produce.

Rowling already received more than all she needs to thrive I guess. I'm confident that there are plenty of other talented authors out there that will never have such a broad avenue of attention grabbing, which is okay. But that they are stuck in terrible economical situations is not okay.

The copyright loto, or the startup loto are not that much different than the standard loto, they just put so much pression on the player that they get stuck in the narrative that merit for hard efforts is the key component for the gained wealth.
by OhNotAPaper | 2025-06-16 05:17:06+00:00
> And of course, now, in retrospect, the whole thing looks silly.

Private enterprise should be the last people on earth to be allowed to label themselves. I have many marketer friends I love, but I truly think the practice of trying to pimp businesses to rich individuals has been probably the biggest waste of human effort in history (outside of maybe carbon-capture efforts). We're just stuck with shitty brands, broken products, and stupid consumers who think they're getting the best.
by bakugo | 2025-06-16 05:17:18+00:00
> Have you ever repeated a line from your favorite movie or TV show? Memorized a poem? Guess the rights holders better sue you for stealing their content by encoding it in your wetware neural network.

I see this absolute non-argument regurgitated ad infinitum in every single discussion on this topic, and at this point I can't help but wonder: doesn't it say more about the person who says it than anything else?

Do you really consider your own human speech no different than that of a computer algorithm doing a bunch of matrix operations and outputting numbers that then get turned into text? Do you truly believe ChatGPT deserves the same rights to freedom of speech as you do?
by vivzkestrel | 2025-06-16 05:18:55+00:00
The sad part of our human existence is that none of us ever live to see how our story ends. We "spawn" at a random point in time and "vanish" at another. Ageing is being worked on vigorously and while we did change our lifespan from 40 years to 80 years of existence thanks to modern science, in order for us to truly comprehend changes on a universal scale, average human lifespan would need to be 50000 years long. That way you'll see species evolve, continents move, quasars explode, maybe even Betelguese explode?
by eru | 2025-06-16 05:19:04+00:00
> If the LLM-assisted writers begin to not even understand their own work (quoting from abstract "LLM users also struggled to accurately quote their own work.") how do they know they are not putting out nonsense?

They are trained (amongst other things) on human essays. They just need to mimic them well enough to pass the class.

> Taking the article's task of essay writing: someone presumably is supposed to read them.

Soon enough, that someone is gonna be another LLM more often than not.
by pempem | 2025-06-16 05:19:25+00:00
Here are some examples:

Cramming schemes

TMobile - 2014 The FTC sued Tmobile alleging it knowingly kept 30–40% of fraudulent charges Tmobile settled for $90 million: at least $67.5M refunded to consumers, $18M to states/AGs, and $4.5M to the FCC

AT&T: $105 million for unauthorized premium SMS billing

Dodd‑Frank’s Durbin Amendment (2010): Congress required the Federal Reserve to cap debit‑card swipe (interchange) fees—typically a few cents—forcing banks to drop excessive micropayments to retailers. Because previously they were. And it was resulting in millions

State Attorneys General vs. Marriott (2021–2022) Hidden “resort fees” tacked onto hotel bills—$10–$35 per night. The Pennsylvania AG and coalition sued; Marriott settled and began disclosing mandatory fees upfront

Walmart: $45 million settlement no admission of guilt, but Walmart agreed to compensate shoppers who bought specified items from October 19, 2018, to January 19, 2024 for a max of $500 even though they knew they were overcharging customers

WholeFoods had a similar case, purposefully misweighing items

The list goes on and on.

The question on the table is: why pursue $3 for not getting the thing you ordered. Is it fair? Does it matter?

Based on continuous corporate fraud, I would say not calling it out will make it worse.
by Den_VR | 2025-06-16 05:20:24+00:00
Swinging back around again, the notion of “failures of vision” still on my mind.

Talk about overloaded. The two framings I was thinking of was first from an engineering & design perspective, but also second from an alignment perspective.

Some people recoil in horror when they look upon what Elon has done, but what a multinational corporation - one that has become engrained in daily life - can do when aligned to anything but the dollar is astonishing. Ironically it’s not something money can buy.
by morepork | 2025-06-16 05:20:26+00:00
There are notable Studio Ghibli films that were not made by Miyazaki such as Grave of the Fireflies, The Tale of the Princess Kaguya and When Marnie was There.

All of those were in my opinion excellent films and similar in style to ones made by Miyazaki, and I think fans of Miyazaki's work will also enjoy them.
by rgoulter | 2025-06-16 05:21:02+00:00
From the summary:

"""Going forward, a balanced approach is advisable, one that might leverage AI for routine assistance but still challenges individuals to perform core cognitive operations themselves. In doing so, we can harness potential benefits of AI support without impairing the natural development of the brain's writing-related networks.

"""It would be important to explore hybrid strategies in which AI handles routine aspects of writing composition, while core cognitive processes, idea generation, organization, and critical revision, remain user‑driven. During the early learning phases, full neural engagement seems to be essential for developing robust writing networks; by contrast, in later practice phases, selective AI support could reduce extraneous cognitive load and thereby enhance efficiency without undermining those established networks."""
by eru | 2025-06-16 05:21:15+00:00
> What is ranked as “top” is ultimately influenced by the priorities of the LLM's shareholders [123, 125].

As if that's anything new. There's the adage that's older than electronics, that freedom of the press is freedom for those who can afford to own a printing press.

> However, this convenience came at a cognitive cost, diminishing users' inclination to critically evaluate the LLM's output or ”opinions” (probabilistic answers based on the training datasets).

Reminds me of Plato's concern about reading and writing dulling your mind. (I think he had his sock puppet Socrates express the concern. But I could be wrong.)
by briffid | 2025-06-16 05:22:07+00:00
Quotation is fair use in all sensible copyright system. An LLM will mostly be able to quote anything, and should be. Quotation is not derived work. LLMs are not stealing copyrighted work. They just show that Harry Potter is in English and a mostly logical story. If someone is stabbed, they will die in most stories, that's not copyrightable. If you have an engine that knows everything, it will be able to quote everything.
by OhNotAPaper | 2025-06-16 05:22:18+00:00
> ai assistance for coding

I honestly think it's gonna be a decade to define this domain, and it's going to come with significant productivity costs. We need a git but to prevent LLMs from stabbing themself in the face. At that point you can establish an actual workflow for unfucking agents when they inevitably fuck themselves. After some time and some battery of testing you can also automate this process. This will take time, but eventually, one day, you can have a tedious process of describing an application you want to use over and over again until it actually works.... on some level, not guaranteed to be anything close to the quality of hand-crafted apps (which is in-line with the transition from assembly to high-level and now to whatever the fuck you want to call the katamari-damacy zombie that is the browser)
by niemandhier | 2025-06-16 05:23:27+00:00
AI is the anti-Zettelkasten.

Rather than getting ever deeper insight into a subject matter by actively working on it, you iterate fast but shallow over a corpus of AI generated content.

Example: I wanted to understand the situation in the Middle East better so I wrote an 10 page essay on the genesis if Hammas and Hizbulah using OpenAI as a cowriter.

I remember nothing, worse of the things I remember I don’t know if it was hallucinations I fixed or actual facts.
by pempem | 2025-06-16 05:23:34+00:00
Such a good question - I hope someone answers with more than an anecdote (which is all I can provide) - I've found the skills that don't leave you like riding a bike, swimming, cooking are all physical skills. Tangible.

The skills that leave: arguments, analysis, language, creativity often seem abstract and primarily if not exclusively sourced in our minds
by ulrikrasmussen | 2025-06-16 05:23:37+00:00
Yes, I think so too, if not just for the reduced number of round-trips to the database. The evaluation strategy that PostgreSQL employs for CTEs is essentially a degenerate form of seminaive evaluation where it only has to consider the delta for one subgoal in each rule due to being restricted to linearly recursive programs with no mutual recursion. The restriction to not have mutual recursion means that PostgreSQL can just stratify the CTE and compute a fixed point using the degenerate seminaive algorithm for each strata. Once a stratum is done, it can consider its idb as ground facts in the next, and so on.

I am really unhappy about the design of CTEs, and frankly I think it is a clunky hack designed by someone who was not aware of all the research on Datalog evaluation, which Ullman and others had already written excellent textbooks about at the time. CTEs are simultaneously too powerful - Turing-completeness in a declarative query language is a sure way to tell that the designers screwed up - and too restricted because being stuck in the Turing tarpit rules out so many techniques for optimization.

I didn't know about DuckDB's approach, but it seems to be a way to mark your relations as moded and exploit that during the evaluation. It appears to improve performance, but unfortunately the design it builds on is inherently flawed. I wish SQL would get a proper pure Datalog fragment in the future.
by vishnugupta | 2025-06-16 05:23:55+00:00
> You can't just skim a math textbook and know all the math. You have to stop and think.

And most importantly you have to write. A lot. Writing allows our brain to structure our thinking. Enables us to have a structured dialogue with ourselves. Explore different paths. Thinking & pondering can only do so much and will reach the limits soon. Writing, on the other hand enables one to explore thoughts nearly endlessly.

Given that thinking is so intimately associated with writing (could be prose, drawing, equations, graphs/charts, whatever) and that LLMs are doing more and more of writing it'll be interesting to see the effect of LLMs on our cognitive skills.
by creatonez | 2025-06-16 05:25:01+00:00
The point is more that SSL 3.0 and TLS 1.0 were nearly identical. That is, the breaks in similarity were at SSL 2.0 -> SSL 3.0 (and TLS 1.2 -> TLS 1.3, to a lesser extent), as opposed to the common misconception that TLS 1.0 is what changed everything.

But yes, it's all a bit irrelevant now that anything below TLS 1.2 is sketchy to use.
by imgabe | 2025-06-16 05:26:46+00:00
Who said anything about freedom of speech? Nobody is claiming the LLM has free speech rights, which don't even apply to infringing copyright anyway. Freedom of speech doesn't give me the right to make copies of copyrighted works.

The question is whether the model weights constitute of copy of the work. I contend that they do not, or they did, than so do the analogous weights (reinforced neural pathways) in your brain, which is clearly absurd and is intended to demonstrate the absurdity of considering a probabilistic weighting that produces similar text to be a copy.
by sho | 2025-06-16 05:27:11+00:00
Has it occurred to you that the narrative you're repeating here is awfully convenient for the elite? Don't question their wealth - don't you know civilization itself depends on it!

> I’m not making this shit up. Literally in anthropology one of the theories

It's a theory, yes. And there's another theory which says that's all BS invented by the ruling classes over time - the church and kings back in the day, the billionaires these days - to justify their otherwise quite unjustifiable positions, cloak them in mumbo-jumbo about natural law or what not, with the goal of discouraging questioning of the status quo.
by aschobel | 2025-06-16 05:27:36+00:00
Indeed! It is a form of massive lossy compression.

> Llama 3 70B was trained on 15 trillion tokens

That's roughly a 200x "compression" ration; compared to 3-7x for tradtional lossless text compression like bzip and friends.

LLM don't just compress, they generalize. If they could only recite Harry Potter perfectly but couldn’t write code or explain math, they wouldn’t be very useful.
by inasio | 2025-06-16 05:27:50+00:00
These paintings sound almost perfect for an NFT art project (burn it and turn it into digital tokens), given that the quality of the art pieces is not super high, but there's huge cultural resonance. To be fair the idea is much older (Yves Klein, the Klein blue guy, Zone de Sensibilité Picturale Immatérielle [0]).

[0] https://en.wikipedia.org/wiki/Zone_de_Sensibilit%C3%A9_Pictu...
by invaliduser | 2025-06-16 05:28:53+00:00
1. I say both somewhat 50/50. I say SSL instinctively, and TLS when I think about it and remember we don't say SSL anymore. It's been like that for around 10 years now, before that I'd only say SSL.

2. I started programming professionally in 1998 and I'm in my early 50s.
by intended | 2025-06-16 05:29:37+00:00
Nah, cameras work as long as people are watching and infractions are punished. You need a high conviction rate. Without that people realize that theres a good chance nothing happens, so they stop caring.

Forcing people to pay, and then using that payment to ensure upkeep, is what makes a difference.

Waymo will be making way for cheap versions, where costs are even lower and upkeep a suggestion.
by SlightlyLeftPad | 2025-06-16 05:29:43+00:00
You really just need to not forget to do that. Isn’t it that simple?

A less snarky answer, and why AWS is largely a non issue these days is because the secrets were designed out of code And are effectively provided as an integral part of the infrastructure which includes regular and reliable expiration and rotation. So any chance you get, design secrets in this way.

The only thing ever in code are references to the correct roles or secrets. Only ever references to the location of the secret. Get in the habit of this and the problem is drastically reduced and becomes something you don’t have to think about.