MurphyA/hacker-news huggingface dataset:
by neya | 2025-06-15 17:18:25+00:00
I never mentioned LiveView in my comment, just Phoenix (you can use Phoenix without LiveView). But, in defense of LiveView, I use it in production - however, you will need something to compliment it for sure - I use Svelte 5, which is great. LV has a learning curve, but it makes development so much better once you get the hang of it, tbh. May need some 2-3 projects to get used to it. My $0.02.
by Molitor5901 | 2025-06-15 17:18:29+00:00
I've always felt this way, any indication that you are there and receiving the email is just a system somewhere a long the line opting you into something else. My general rule for some time now is to report it as spam, and block the domain. Never respond, never acknowledge. Same with telephones, if I don't recognize the number I just don't answer.
by aspenmayer | 2025-06-15 17:18:51+00:00
As there is no reason to believe that Harry Potter is axiomatic to our culture in the way that other concepts are, it is strange to me that the LLMs are able to respond in this way, and not at all expected. Why do you think this outcome is expected? Are the LLMs somehow encoding the same content in such a way that they can be prompted to decode it? Does it matter legally how LLMs are doing what they do technically? This is pertinent to the court case that Meta is currently party to.

https://en.wikipedia.org/wiki/Artificial_intelligence_and_co...

> See for example OpenAI's comment in the year of GPT-2's release: OpenAI (2019). Comment Regarding Request for Comments on Intellectual Property Protection for Artificial Intelligence Innovation (PDF) (Report). United States Patent and Trademark Office. p. 9. PTO–C–2019–0038. “Well-constructed AI systems generally do not regenerate, in any nontrivial portion, unaltered data from any particular work in their training corpus”

https://copyrightalliance.org/kadrey-v-meta-hearing/

> During the hearing, Judge Chhabria said that he would not take into account AI licensing markets when considering market harm under the fourth factor, indicating that AI licensing is too “circular.” What he meant is that if AI training qualifies as fair use, then there is no need to license and therefore no harmful market effect.

I know this is arguing against the point that this copyright lobbyist is making, but I hope so much that this is the case. The “if you sample, you must license” precedent was bad, and it was an unfair taking from the commons by copyright holders, imo.

The paper this post is referencing is freely available:

https://arxiv.org/abs/2505.12546
by histriosum | 2025-06-15 17:18:59+00:00
I'm not sure why you find it distracting, it's an on point extension of the scenario. There are rules by which companies are supposed to operate, and evaluations (audits, for example) intended to ensure compliance with those rules. That an LLM may react differently when being evaluated (audited) than when in normal operation means that it may be quite happy to lie to auditors while making money illegally.

Seemed a clear extension what-if to me.
by jjk166 | 2025-06-15 17:19:10+00:00
I think it makes sense that our microbiome should be able to trigger such a response. If your microbiome is changing, it means that some microbe is gaining numbers it didn't previously have, and your current bodily functions, such as your immune system, aren't stopping it. That doesn't necessarily mean your immune system is compromised, but if it is then it would probably be good not to spend a lot of time around other individuals, especially large groups or strangers. Other reasons for your microbiome to be shifting, like a sudden change in diet or enviroment, could also be indicative of an issue like food shortages or territorial change where it would also be good to minimize your exposure to and reliance on others. Finally, depending on what exactly is gaining a foothold, you could potentially be a threat to your kin if you come around them. Developing a social fear response to certain changes in gut microbiome could thus be quite beneficial for most social creatures.
by godelski | 2025-06-15 17:19:43+00:00
> I know that the internet is not full of training data for this API because it's a new API.

1) are you sure? That's a bold guess. It was also a really stupid assumption made by the HumanEval benchmark authors. That if you "hand write" simple leet code style questions then you can train on all of GitHub. Go ahead, go look at what kinds of questions are in that benchmark...

2) LLMs aren't discrete databases. They are curve fitting functions. Compression. They work in very very high dimensions. They can generate new data but that is limited. People mostly aren't saying that LLMs can't create novel things but that they can't reason in the way that humans can. Humans can't memorize half of what a LLM can yet are able to figure out lots of crazy shit.
by elbear | 2025-06-15 17:20:18+00:00
If we're talking about solving an equation, for example, it's not hard to memorize. Actually, that's how most students do it, they memorize the steps and what goes where[1].

But they don't really know why the algorithm works the way it does. That's what I meant by understanding.

[1] In learning psychology there is something called the interleaving effect. What it says is that you solve several problems of the same kind, you start to do it automatically after the 2nd or the 3rd problem, so you stop really learning. That's why you should interleave problems that are solved with different approaches/algorithms, so you don't do things on autopilot.
by CobaltFire | 2025-06-15 17:20:20+00:00
My son was diagnosed with B-ALL (RUNX1) in 2020.

I don't want to go deep into it today (Fathers Day here), but he's alive and well now. We rang the bell just over two years ago.

He is enrolled in a study through the Children's Oncology Group mentioned here, and underwent an experimental modification specifically for male patients.

Specifically, the current state of treatment protocols (when he started) was that males received an extra ~6 months of treatment as there was thought that the testes could serve as a repository for the cancer. The data says that is likely not true, and that the tradeoff for the longer chemo is worse than any risk present.

We were fortunate that he hit every single "best case", from him being diagnosed very early, to all of the best possible results from his blood tests at every point.

Many of my comments talking about my experience are buried, but there is plenty that I've said here on HN.
by hinkley | 2025-06-15 17:21:59+00:00
Ugh. One of the reasons I never turned on the tracing code I painstakingly refactored into our stats code was discovering that OTEL makes no attempts to introduce a span to the collector prior to child calls talking about it. Is that really how you want to do event correlation? Time traveling seems like an expensive operation when you’re dealing with 50,000 trace events per second.

The other turns out to be our OPs teams problem more than OTEL’s. Well a little of both. If a trace goes over a limit then OTEL just silently drops the entire thing, and the default size on AWS is useful for toy problems not retrofitting onto live systems. It’s the silent failure defaults of OTEL that are giant footguns. Give me a fucking error log on data destruction, you asshats.

I’ll just use Prometheus next time, which is apparently what our OPs team recommended (except one individual who was the one I talked to).
by Jaygles | 2025-06-15 17:22:21+00:00
I unsubscribe from mailing lists 20x more often than I knowingly subscribe to them.

It should be illegal to sign someone up to a mailing list without explicit consent. If I create an account with my email, or provide it as a part of a checkout process, you should not have the ability to sign me up to a mailing list without me explicitly opting in via a dedicated checkbox or button (and it should initialize as un-checked of course).

Breaking the mailing lists into 30 different categories is w/e, but auto opting people in to new categories should also be illegal. Such a scummy dark pattern
by lentil_soup | 2025-06-15 17:23:14+00:00
That's a bit of a strawman argument, no? The options are not only become a tyrant or let Putin rule the world. There's many and more clever options. I think we can demand much better from the people in power.

Also, that rhetoric of The West vs the world is a bit lazy. Things are more complex, even recent events prove The West is not a unified block where everyone thinks the same way.
by kogekar | 2025-06-15 17:23:26+00:00
Tried a weekend challenge: build 3 small projects in 24 hours using APIs from OpenAI, Anthropic (Claude), and Google Gemini. Kept it simple and focused on speed and usability. The video shows the builds, how each API handled things, and where they struggled.

Not a deep benchmark, but more of a practical test under pressure. Curious if anyone else has tried this kind of side-by-side under real build constraints.
by johnsmith1840 | 2025-06-15 17:23:34+00:00
Not sure how much you've gotten into CL but online learning while similar is not the same.

Online learning is more akin to RL in that it's a structured and boxed enviroment. Step outside of that box or the box changes too much and you collapse.

CL is much more similar to meta learning. The concepts are more about learning NEW content while keeping previous the same.

CL is a completely open problem with all model types. EWC is amoung the better attempts (and a favorite of mine) at solving it with big limitations.
by MoonGhost | 2025-06-15 17:23:48+00:00
> An animal can 100% recall and associate memories, such as mentioning the name of a playmate to a dog (=tail wagging). However, it seems like they can neither remember nor project ”what happens next” and continue to build on it.

There are videos of dogs stopping kids from falling in the water. They definitely can project 'what happens next'. I.e. what kid is doing, why, and what's going to happen. More over dog brings the toy kid wanted from the water. In other words animals are not as primitive and stupid as some want them to be to fit in their theories. BTW, parrots often are really talking, not just reproducing random words.
by ikrima | 2025-06-15 17:23:59+00:00
:P I had a stroke; typing is literally difficult. I'm trying to say don't read too much into it, i can't really have a conversation on a comment thread b/c of brain injury. I think the emoji's get stripped out so maybe my tone seems more abrasive than whimsical

but also, i mean you are just flat out wrong on some very big parts. E.g.: i think in 2024 or 2023, there was a big breakthrough in geometrization of Langlands. IIRC, there was a second big break through on the discrete-continuum connection relating to primes in some manner but can't remember specifics off top of my head.

i think you're confusing maybe what Beth numbers are used for vs. what i'm proposing that they be repurposed for. You're right, no one is using them the way i referenced but that's kind of what math research is...?
Show HN: CocoIndex – Open-Source Data transformation for AI, only process delta
by badmonster | 2025-06-15 17:24:01+00:00
Hi HN community,

I’ve been working on CocoIndex, an open-source data transformation framework for AI. it supports incremental processing and only processes what’s changed, for data freshness especially when resources cannot catch up.

With 100 lines of python you can easily set up a production grade pipeline from vector embeddings, knowledge graphs, structured extraction etc.

Once you bring the pipeline as live mode, it automatically detects source change, and keeps the target store updated, with minimal amount of processing.

I’m building this framework to be as simple as possible to develop with, yet production-ready from day one — combining the best practices and lessons I’ve learned over the past years.

Previously, I was a tech lead at Google on projects like search indexing and ETL infra for 8 years. After I left Google last year, I went through pivoting hell. In all the projects I’ve built, data still sits in the center of the problem. I need to write custom logic to prepare data for AI and I need the data to stay fresh for AI to generate effective decisions or recommendations. So I started CocoIndex.

Getting started: https://cocoindex.io/docs/getting_started/quickstart

Examples: https://github.com/cocoindex-io/cocoindex/tree/main/examples

If you prefer to read: https://cocoindex.io/blogs/tags/examples/

Would love to learn your thoughts. Thanks! Linghua
by Kapura | 2025-06-15 17:24:13+00:00
It is a crime to stalk people. When we catch people doing it, we should stop them.

I was taught many, many times growing up in the U.S. that people had a right to privacy, to free speech, to being considered innocent until proven guilty.

When governmental organizations police the speech of individuals for things that are critical of the regime, we lose our right to free speech.

When they download the contents of your phone when you travel, you lose the right to privacy.

When people are denied a writ of habeas corpus, when they are trafficked to countries that are not from and have never been to, we are considered guilty unless we have people "on the outside" who are capable of fighting for our return.

They aren't even trying to make an argument for this, outside of the cult of personality of the current regime, the belief that He can do no wrong. If you "both-sides" this you allow the trends to continue.
by akomtu | 2025-06-15 17:25:13+00:00
In the Big Short movie there is a scene where the old trader scolds two newbies: "why are you so happy? don't you understand that if your bet is right, it means the american economy is going to crash, that millions will lose their jobs?"

Right now we're betting on sp500 going up, which is mostly backed by the belief that machines are going to replace us soon.
by quacked | 2025-06-15 17:25:17+00:00
> Do you think every police department in the US oppresses minorities and infringes on civil rights or something?

There are some people who not only believe this but can make very compelling cases that this is the case. It's a dead-end rhetorical argument; yes, it is actually possible for literally every precinct in the US to violate people's civil rights.

The difference is that some people, like (I suspect) the person you're responding to, seem to think that the position itself--armed law enforcement officer--is archetypically immoral and should not exist as a function or profession in a civilization. This is naive to to the point of absurdity and underwrites most of the idiocy that's widely abound in anti-policing movements. In one breath they claim that "police" are as a class immoral, and in the next they proclaim that their political opponents must be "brought to justice" by armed people following a set of written laws. It's absurd!
by stackskipton | 2025-06-15 17:25:42+00:00
Ops type here, Otel is great but if your metrics are not there, please fix that. In particular, consider just import prometheus_client and going from there.

Prometheus is bog easy to run, Grafana understands it and anything involving alerting/monitoring from logs is bad idea for future you, I PROMISE YOU, PLEASE DON'T!
by timewizard | 2025-06-15 17:26:37+00:00
That's not a serious question. Of course people do. Your inability to understand the language does not impact anyone else other than yourself. This should go without saying.

I'm also an expert in C, Go and JavaScript. Ruby is an excellent language and the smalltalk paradigm has some real strengths especially for duck typed systems. The only reason I don't use it more often is because it is slow for the type of work I'm doing recently.

It was amazing for web work and it's fantastic for writing small little utility scripts.

A open distaste for things does not make you sophisticated or smart. You're not in any category of high repute when you do this.
by nickpsecurity | 2025-06-15 17:27:59+00:00
You named a few of the largest, technology companies who each have a tiny percentage of their programmers using or developing formal methods. That supports the parent's point.

I'd also probably would count MS Research against that, or separately, since they're more like a University lab than a business. Labs often can run at a loss doing research on things that might not be practical. MS Research certainly has produced some practical things. Yet, what they do wont likely apply to a random, for-profit company.

Very, very, few companies find this stuff practical outside hardware companies where it's easier to apply with clearer ROI. There's also uptake in both cryptocurrency space and distributed databases. Most business software won't use it because it makes no sense to.
by pvg | 2025-06-15 17:28:02+00:00
Nobody is interested in banning you, people are simply asking you not to shit in the place they use so that they and you can continue using it.

Trying to present this shitting as some sort of principled martyrdom or, heaven help us, favour to the rest of us is silly, selfish and unconvincing. Just ease off on the shitting in the future, it's not like most everyone else has any trouble doing it.
by hinkley | 2025-06-15 17:28:11+00:00
It’s been a minute since I worked on this but IIRC no, which means that if the request times out you have to be careful to end the span, and also all of the dependent calls show up at the collector in reverse chronological order.

The thing is that at scale you’d never be able to guarantee that the start of the span showed up at a collector in chronological order anyway, especially due to the queuing intervals being distinct per collection sidecar. But what you could do with two events is discover spans with no orderly ending to them. You could easily truncate traces that go over the span limit instead of just dropping them on the floor (fuck you for this, OTEL, this is the biggest bullshit in the entire spec). And you could reduce the number of traceids in your parsing buffer that have no metadata associated with them, both in aggregate and number of messages in the limbo state per thousand events processed.
by chii | 2025-06-15 17:29:37+00:00
> it’s really not worth their time though.

no, but a company has more levers than just small claims court - such as banning you from doing business with them, and removing all existing relationships.

Google, for example, could ban you off gmail, remove your storage in gdrive, and take away all of your youtube videos.

A big enough company with your data/process/utility that you must rely on and is locked in, would have enormous leverage over you that a small claims court won't have.
by mbesto | 2025-06-15 17:29:37+00:00
> Those cars were something like $700k each

Source? Also, those numbers are quoted with including capital expenditures, which will get depreciated over years. Also, to do a like for like comparison you have to include all of the people, processes, and systems in place that support drivers. That cost center at Uber has to be in the millions globally for Uber (and hard to calculate on a per driver basis, but possible if we had internal numbers).
by sigotirandolas | 2025-06-15 17:29:43+00:00
My thought is that we humans are bad (by computer standards) at arithmetic and memorization because those are not evolutionarily useful on their own.

On the other hand general problem solving is, and so far any attempt to replicate it using computer algorithms has more or less failed. So it must be more complex than just some simple heuristics.

Perhaps the answer is just "more compute" but the argument that "because LLMs somewhat resemble human reasoning, we must be really close!" (instead of 25+ years away) seems wishful thinking, when:

(1) LLMs leverage a much bigger knowledge base than any human can memorize, yet

(2) LLMs fail spectacularly at certain problems and behaviours humans find easy
by lilsoso | 2025-06-15 17:30:16+00:00
> Is this actually a problem you see? I'm going on 15 years in the industry and haven't seen any issues training people up on a new language in just a couple months.

Some years ago the largest company using Elixir in the US, or at least on the west coast, abandoned Elixir because they couldn't find enough developers.

Yes. The adoption is poor despite the loud voices.
by BoiledCabbage | 2025-06-15 17:30:39+00:00
Is there any notable difference between how it's presented in the post

> Thus, addition is a function P:NxN -> N such that for all numbers a, b,

> 1. P(a,0) = a

> 2. P(a,S(b)) = S(P(a,b))

And this alternate formulation?

1. P(a,0) = a

2. P(a,S(b)) = P(S(a),b)

Ie "decrease one from b and add it to a", instead of "decrease one from b and add it to the total".
by JohnFen | 2025-06-15 17:30:54+00:00
> They also want to make people accidentally give consent or to mislead them into consent.

Which is a logical impossibility. You can't be tricked or accidentally give consent. Consent is an informed, intentional decision. Anything else doesn't count.

But I do agree: the tech industry understands consent just fine, it's just fundamentally opposed to the idea.
by lenkite | 2025-06-15 17:31:04+00:00
India's share of world GDP fell from ~24% in 1700 to ~4% in 1950. There was an explicit de-industrialization of India - colonial Britain destroyed the textile industry deliberately. Keep them poor and stupid was an explicit state policy.

India was heavily exploited by the British compared to China. Extraordinary raw transfer of minerals to the British - most geographical areas were fully exploited of gold, diamonds, coal, manganese, mica, etc. Mines were left utterly bereft - colonial Britain was world-leader in resource extraction. Enforced cash-crops agriculture -instead of local crops that could feed people, farmers were forced to plant indigo, cotton, opium, tea, etc. This resulted in several mass famines.

Independent India was left dead poor - extraordinarily more poor than China with no mineral wealth left to support industrialization.

China was only semi-colonized and retained nearly all its mineral wealth.
by d3ckard | 2025-06-15 17:31:04+00:00
This is a very good point.

I have very similar thoughts after working with Cursor for a month and reviewing a lot of “vibe” code. I see the value of LLMs, but I also see what they don’t deliver.

At the same time, I am fully aware of different skill levels, backgrounds and approaches to work in the industry.

I expect two trends - salaries will become much higher, as an individual leverage will continue to grow. At the same time, demand for relatively low skill work will go to zero.
by AndrewKemendo | 2025-06-15 17:32:13+00:00
Help me make sense of this as an old timer because I’m lost

Everything described in the thread has been going on since the Patriot Act was signed in 2001.

As early as 2010, I was able to look up ANY IMEI/IMSI combo in Proton and see all links to other IMEI/SI collected worldwide.

By 2013 I could query those in Palantir on a Secret or SCI level depending on who held the data which would also aggregate and provide to me OSINT, LE reports or other data associated with those id

What’s new here?

Is it just that more people know about it now?

All the stuff I described above was public information as to both “capabilities” and used as casus belli for warrants (US) or kinetic actions (OCONUS).
by johnsmith1840 | 2025-06-15 17:32:30+00:00
Yes but it's similar to RNNs or energy models.

They try to keep a single continuous "state" that always updates.

It's more about going "farther" than something more akin to "go forever" that CL promises.

Scaling laws are true in that infinite scale would 100% lead to AGI. But at the same time the problem with it is that you can't infinitely scale the computation per task.

RL solves this problem in general but it has a deep assumption of knowing the future. Step too far out of the box and it collapses.

The smallest natural brains handle unknown future states with a fixed computation budget per timestep which is truly incredible.