MurphyA/hacker-news huggingface dataset:
by smeg_it | 2025-05-11 15:42:32+00:00
I'm definitely no economist but the current administration doesn't seem to listen to them anyway. To me, this is going to be an extremely high tax on lower and middle income people, as well as small businesses. Most of us buy Chinese products all the time or, at least, ones that have Chinese in the supply chain somewhere. I know there has been a trade imbalance and maybe tariffs is a tool that could have been used, but I learned in high school(maybe in collage too) that it's most effective when you present a united front with other allies. Unfortunately, we really don't have allies like we used to. The current admin has destroyed, or at least highly eroded trust and partnerships we had in the past. By attacking almost every country, we stand truly alone. There was an article about Vietnam recently which explained that because we have/are fighting with them too, they have great leverage to get what they want by leveraging the U.S. against China. To me, we've just given away all our leverage by not being trustworthy and attacking all other countries at once (figuratively, for now at least). I'm simply not hopeful for our future from a majority of citizens point of view. For our GDP per capita, we do absolutely horrible, in what seems like most international indexes, comparatively. The areas we do "well" are not good ones. Like number of our citizens incarcerated. I think we beat China, Russia, and most every country in that. From the perspective of "life, liberty, and the pursuit of happiness", I think we've failed. I don't know, exactly, but from what I've read our Cost/Benefit ratio on healthcare is one of the most dismal in the world. We don't rate well, in almost any category that is a positive for our populous, especially considering our GDP per capita.
by selfhoster | 2025-05-11 15:43:09+00:00
> You essentially outline why it should be broken up.

I disagree:

1) My wife and I have a FREE Gmail account we use for home and other combined interests. 2) We watch all our streaming (movies, docs, etc.) and TV (Tablo TV DVR for free OTA) using FREE Chrome on Linux laptops in our LR, MBR and one for ambiance that runs all day between the kitchen and LR visible across both rooms showing relaxing aquarium and bird videos. We pay for YouTube Premium and Amazon Prime which we watch on Chrome and Netflix is free with T-Mobile. All courtesy of Chrome and Linux. Chrome is the leading browser. We don't want Edge as our main browser, even though it uses Chrome underneath it, like Windows 11 (which we also don't use) is loaded with Microsoftie crap and garbage. 3) We have individual FREE Gmail accounts for our individual interests. 4) I have my own FREE YouTube account for tech videos. 5) We use only FREE Google Maps, the other map services suck in comparison. 6) We pay $2 a month for Google Drive because it works well (although there is still no Linux client) it works well in the browser (any browser). Amazon's deal for uploading files doesn't work as fluently, tried it. Microsoft OneDrive works OK but only for large single compressed files in my experience, it gets confused with small files and especially borks .git folders. 7) Google Search, even in the age of AI (or what we are all calling "AI") is still the best search engine. 8) There is no way I will ever use an iPhone. Microsoft got out of the phone market which is great since the only thing I can't stand more than Apple products like Mac (which I am forced to use at work because our COO is a die hard Apple fanboy).. is Windows. That leaves Android which has worked extremely well and is technically FREE except the two biggest vendors are Google and Samsung and in this case, Google sucks because we've had several Google phones and a tablet and all quit working too soon, became useless too soon or batteries failed too soon and Samsung is even worse than Microsoft at loading crap and garbage on their phones. 9) We pay for everything with FREE Google Pay, it works extremely well and doesn't cost us a dime to use.

Windows, the crap that it is, is the monopoly which is incredible because the OS sucks but not as bad as Mac. We should all be using Linux laptops and desktops.
by saisrirampur | 2025-05-11 15:43:12+00:00
Neat project! Quick question, will this work only if the entire row is a duplicate? Or even if just a set of columns (ex: primary key) conflict and you guarantee only presence of the latest version of the conflict? I’m assuming former because you are deduping before data is ingested into ClickHouse. I could be missing something, wanted to confirm.

- Sai from ClickHouse
by immibis | 2025-05-11 15:43:29+00:00
I don't get the whole friction thing. Yes, it's a thing. No, I don't see how it makes any kind of point here. What you call friction appears to be the inverse of investment. Not monetary investment, but actual resources put towards making something work.

I also don't see a strong connection between the digital world getting more frictionless and the physical world getting worse. Unless you're suggesting that we're forgetting about the physical stuff because we're going all digital, they seem to just be two things happening at the same time. There are ways they can be linked. We're going frictionless digital because it's the easiest way for our benefactors to take your money, and we're going crumbling infrastructure because it's the easiest way for our benefactors to save money. But I don't think it's a direct relationship.

Is the FAA letting air traffic control fail because the FAA is busy tweeting? I don't think so. It's because it's being defunded... by a guy who spends all his time tweeting. Another weak connection there, but it's simply because of government priorities. But it started before then. I think physical infrastructure has been on a slow decline since long before things like social media existed.

Tangential: More than once (I refuse to say the two nickels catchphrase) I have spotted a person at a techno party sitting down with their phone and been like "oh no you don't" and they have never been annoyed by this.
by eWeSaYYY | 2025-05-11 15:43:37+00:00
That’s endemic to American capitalism not VCs of modern times.

Wall Street is built on looting the pensions of retirees.

The American economy has always been “already absurdly rich person takes 9 of the widgets worker produced and leaves workers 1 to share.”

In the money printer era this allowed big salaries for some compared to the norm but the rich still took their 9 too.

We wrapped mafia like thug behavior of the pre and post war world into empty semantics.

The only option for unlocking a massive amount of liquidity for the public to stabilize their individual situations is taxing the rich.
by DoctorOetker | 2025-05-11 15:44:22+00:00
> Being able to decode them without physically digging them up and damaging them is awesome.

Can you provide some citations on the technology being used in situ without digging up? As far as I understood this is the application of technology widely popularized by the Herculaneum Challenge, where scrolls are still physically dug up, and x-rayed (which will slowly still damage the scrolls) but without physically breaking them open as was repeatedly attempted in the past.

I don't care much about the slow damage from x-rays: as long as the content is succesfully extracted, one can imagine little other use for the scrolls as is.

I mostly hope some lost works on mathematics will be recovered..
by immibis | 2025-05-11 15:44:43+00:00
Because we're a post-competence society. Very little useful data will be gained by the operators of these bots. They don't work, and nobody cares they don't work. We're doing everything cargo-cult now. We're building giant machines that do nothing but spew smoke into the air, because that's what they did in the Industrial Revolution and it brought prosperity, didn't it?
by dragonwriter | 2025-05-11 15:45:32+00:00
This is a deceptive title: it pretends to be an article about HunyuanVideo-I2V 14B (a model which does not exist; HunyuanVideo is a 13B model) running on a moderate consumer GPU, but the link is directly to a pay-to-generate hosted image/video generation service (which also claims that the model requires GPUs with at least 60GB aggregate VRAM to run locally in a frontend like ComfyUI contrary to the headline here—this also isn't true, I know, I’ve run it on a 16GB card.)

The OP also posted a comment here that purports to describe the HunyuanVideo model, but other than the name and attribution to Tencent, the easily verifiable facts reported in that comment (the 14B model size and the 1.3B lighter companion model size) are not true for HunyuanVideo, but are true of a different popular video model, WAN 2.1.
by moonikakiss | 2025-05-11 15:46:18+00:00
Neon actually does have a columnstore extension with pg_mooncake today. The key difference with pg_mooncake vs hydra is the bet on open storage formats (Iceberg).

(1) https://neon.tech/docs/extensions/pg_mooncake (2) https://www.mooncake.dev/blog/clickbench-v0.1
by wiz21c | 2025-05-11 15:47:07+00:00
> "sophisticated reasoning skills"

Does it mean that it uses the data it has to the maximum possible level to produce new reasoning (that add to those produced by less algorithms). IOW, are we still in the realm of: with a given data set, A.I. can produce up to N reasoning capabilities and consequently, can't produce more than that ? IOW, reasoning is bound by knowledge ? And therefore, maybe we could just start from a data/knowledge set in which we add some randomness and self play until some form of reasoning emerge ?
by raincom | 2025-05-11 15:47:23+00:00
"Missiology is the academic study of the Christian mission history and methodology". Earlier, Missiology used to be called as "Practical Anthropology". Even today, the best materials for learning phonetics and linguistics practically come from Christians, because of their drive to proselytize everyone on this earth, with various languages, etc. "Summer Institute of Linguistics" is one such.
by caust1c | 2025-05-11 15:47:44+00:00
How does the deduplication itself work? The blog didn't have many details.

I'm curious because it's no small feat to do scalable deduplication in any system. You have to worry about network latencies if your deduplication mechanism is not on localhost, the partitioning/sharding of data in the source streams, and handling failures writing to the destination successfully, all of which cripples throughput.

I helped maintain the Segmentio deduplication pipeline so I tend to be somewhat skeptical of dedupe systems that are light on details.

https://www.glassflow.dev/blog/Part-5-How-GlassFlow-will-sol...

https://segment.com/blog/exactly-once-delivery/
by southernplaces7 | 2025-05-11 15:48:00+00:00
It seems that in the modern era of social media campaigns for everything there can hardly exist a perfectly chill, normal activity that someone hasn't somehow contrived into a type of moral and ethical sin. It's tedious, sad and ultimately, kneejerk stupid. I strongly doubt that the world's domesticated cat population is generally creating an ecological apocalypse and the studies I have seen around it are far from anything you could call solid. Either way, believe it or not, you can actually also use very practical solutions like bell collars to easily fix most of these situations. How about getting off your moral pedestal about such a silly "issue".
by LegionMammal978 | 2025-05-11 15:48:27+00:00
Because they don't get to see the entire letter shapes. The page at [0] shows the basic idea: they're forced to make decisions based on each part of each stroke of the letter. If they were heavily overfitting on the strokes of the letters in the training sample, then they'd be so inaccurate outside the sample that the assembled outputs would hardly resemble letters at all, much less words.

(Also, this is heavily-damaged handwriting, not clear print, so each letter isn't even uniform in shape. A model trying to cheat at ink detection would have an uphill battle trying to guess what all the variant letter shapes might be.)

[0] https://scrollprize.org/grandprize#how-accurate-are-these-pi...
by vessenes | 2025-05-11 15:49:02+00:00
This is so wrong as to be almost laughable. My VC friends are working double shifts on financing companies that are disrupting nearly every market vertical. There’s almost an infinite greenfield out there right now.

Quick example : a company founded in the last three or four months that provides appointment setting and calendar management for a single healthcare vertical. They are already profitable. There are at least 5,000 market verticals like this in the US alone.

Tech to provide this is going to keep commodifying and that will leave early entrants as wealthy incumbents; journalism telling people to be certain that the opposite will happen is borderline irresponsible and certainly missing the situation full stop.
by icedchai | 2025-05-11 15:49:39+00:00
There were some high end Ataris and Amigas (Atart TT 030, Amiga 3000, etc.) but they came out a bit later. There was even the A3000UX that ran a Unix port!

Still, I agree. The 68K workstation was essentially obsolete by the time NeXT shipped. Sun was shipping early Sparc systems around the same time. The writing was on the wall. No wonder they didn't stick with their own hardware for very long.
by hnhn34 | 2025-05-11 15:50:14+00:00
> Whatever people say about AI, they're incapable of doing quality investigative reporting any time soon

the latest Gemini models have a very low hallucination rate in benchmarks [0]. Feel free to try it yourself. Just go to gemini.google.com, choose Deep Research, and ask it to write a report about a topic that you're intimately familiar with.

[0] - https://github.com/vectara/hallucination-leaderboard
by calebkaiser | 2025-05-11 15:50:19+00:00
I understand the spirit in this line of criticism, but I think it's easy to muddle the timelines and feel as if things "aren't moving," when in fact, the pace of research and improvement is great.

For context:

- GPT 2 was released in Feb 2019

- GPT 3 came out roughly 18 months later in 2020. It was a huge jump, but still not "usable" for many things.

- InstructGPT came out roughly 18 months later in early 2022, and was a huge advancement. This is RLHF's big moment.

- About 10 months later, ChatGPT is released at the end of 2022 as a "sibling" to InstructGPT. It's an "open research preview" at this point. This is around the time OpenAI starts referring to certain models as being in the "3.5 family"

- GPT-4 comes out in March 2023, so barely 2 years ago now. Huge jumps in performance, context window size, and it supports images. This is around the time ChatGPT hits 100 million users and is really becoming a reliable, widely adopted tool. This is also the same time that tools like Cursor are hitting the market, though they haven't exploded yet. Models are just now getting "good enough" for these kinds of applications

- GPT-4-Turbo comes out in November 2023, with way larger context windows and lower pricing.

- About 12 months ago, GPT-4o released, showing slightly increased performance on existing benchmarks over 4, but now with state-of-the-art audio capability support for something like 50 languages.

- 5 months ago, o1 releases. This is a big moment for scaling compute at test time, which is a major current research direction in ML. Shows huge improvements (something like 8x over 4) on some math/reasoning benchmarks. Within months, we have o3 and o4, which substantially improve these scores even further.

- In February of this year, we get 4.5, and then months later, the confusingly named 4.1, which shows improvements over 4o.

So to be clear, in 2019 we had an interesting research project that only a few people could tinker with.

18 months later, we had a better model that you could play with via an API, but was still a toy.

It takes more than two years to go from that to ChatGPT, and a few more months (nearly 3 years total) to get to the "useful" version of ChatGPT that really sets the world on fire. It took roughly 4 + 1/2 years to go from "novelty text generation" to "useful text generation".

In the 2 years since then, we've gotten multimodal models, a new class of reasoning models, baseline improvement across performance, and more. If anything, there is more fundamental research and wider variety of directions now (the kind of stuff that shifts paradigms) than before.
by mpweiher | 2025-05-11 15:50:22+00:00
I used to be very impressed by this sort of stuff, because it baffled me.

It certainly sounds uber-impressive!

However, I have seen how error-prone it is, and also read and understood a little more about the mechanisms.

For one, I have had people tell me stuff they "read" in me. It was valuable as an insight as to what vibes I might be sending out, unbeknownst to me. But it tended to be laughably wrong about me.

Now you might think that this is just me being defensive..."you can't read me".

But people do get it wrong, and a girlfriend once confessed to me, somewhat exasperated: "I can't read you". To which I said: "You should try listening to me instead".

Communication ≫ Reading

I have also gotten quite a bit better at it myself, and it can be intoxicating. Because when it works it is almost magical.

But while it can be stunningly precise, it just isn't very accurate.

So it's a useful tool that can yield information, but don't get high on your own supply. Treat it as a very sensitive but also very noisy channel of information.
by rickydroll | 2025-05-11 15:50:36+00:00
Back in 2017, I went to see the eclipse at Madras, Oregon. If you don't know the area, it's arid. Yet, on the outskirts of Madras, green fields were irrigated by spray every morning.

What crop was so valuable that they would use precious water in a near desert? They were growing Kentucky bluegrass for lawn seed.

Yeah, stop subsidizing agriculture in arid lands.
by rkagerer | 2025-05-11 15:50:48+00:00
I asked ASUS if they offered bug bounties. They responded saying they do not, but they would instead put my name in their “hall of fame”. This is understandable since ASUS is just a small startup[1] and likely does not have the capital to pay a bounty.

[1]: https://companiesmarketcap.com/asus/marketcap/
by motohagiography | 2025-05-11 15:50:49+00:00
the reaction to them. If the Irish govenrnment enforced loitering and vagracy laws instead of making up new hate speech laws or accepting them from the EU, they wouldn't have an integration problem. the homes and hotels in ireland being filled with people from EMEA nations are being filled by new colonists.

the cause of the hate speech is not actually race based, but behavioral. all that standing around and loitering in public is anti-economic activity, where not only is it unproductive, but nobody wants to invest in anything (property improvements, homes, businesses) where these men gather to loiter. it destroys economic value in the towns and broader society when people no longer want to invest in local economies because of mass anti-economic activity. the flight from US cities like SF is a useful control example.

enforce loiting and vagrancy laws instead of inventing "hate speech" laws, and the underlying integration problems vanish almost instantly.
by 90s_dev | 2025-05-11 15:51:05+00:00
> These properties were never proven but simply asserted.

I wasn't talking about whether they were proven, only where the assertions came from.

> Anything asserted without evidence can be dismissed without evidence.

No one here claimed they never tried to provide evidence, we just didn't refer to such attempts since it wasn't relevant to the conversation you joined.

> Also why draw the line between human and animal souls, what about bacteria and viruses?

In context of Catholic theology, those would probably fall under "animal" souls. Just because we didn't use those words doesn't mean they aren't considered.

> That is disingenuous, we have an overwhelming amount of evidence that the Earth is round whereas the concept of souls and their supposed differences have been asserted for centuries but never proven.

They have not been proven to your satisfaction, but in context of Catholic theology, evidence is provided for these, and many find it satisfactory.

> That's my problem with the concept of religion. When the tough questions are asked, the only answers given are of the special pleading kind and/or simply asserting that something is correct in a tautological way.

Maybe you're reading the wrong authors. I wonder what you think of Trent Horn. He seems like a fairly sound apologist.

> No proof necessary, how convenient!

It sounds like you've only read fluffy Protestant books from the last 30 years. No Catohlic theologian I've ever read attempts to make claims without providing evidence, even if that evidence doesn't convince you personally.
by aeonik | 2025-05-11 15:51:56+00:00
Well theoretically if you compiled the whole system with Zig or Rust, you could eliminate that undefined behavior of invalid pointers right?

You'd need an OS that supports it, but it seems viable that the OS using allocators could know what happens at any given pointer.

To do it statically though, and with enough detail, I suppose it would take something like Idris with dependent types, and I'd imagine at that point it would be a pretty tough exercise.
by kentonv | 2025-05-11 15:52:00+00:00
Obviously a $5 VPS would give you more raw compute than the Cloudflare Workers free tier.

However:

1. It would run in a single location in the world, whereas Workers (even on the free tier) will run in Cloudflare locations all around the world, close to the end user, reducing latency.

2. If you're going to compare against a $5 VPS, the $5 Workers paid tier is probably a better comparison? It can instantly scale to millions of requests per second.

(Disclosure: I'm the tech lead for Cloudflare Workers.)
by dagmx | 2025-05-11 15:52:04+00:00
Way to start of the comment by being uncivil. You could have made the exact same point without being a jerk about it.

But it’s common to only want to support specific response codes in a context, and people do use enums for that. It’s a fairly common paradigm, and an enum will do all those validations for you so you don’t forget.
by jacob019 | 2025-05-11 15:52:06+00:00
The consensus around here seems to be that the protocol itself is fine, but the transport is controversial.

Personally, even the stdio transport feels suboptimal. I mostly write python and startup time for a new process is nontrivial. Starting a new process for each request doesn't feel right. It works ok, and I'll admit that there's a certain elegance to it. It would be more practical if I were using a statically compiled language.

As far as the SSE / "Streamable HTTP" / websockets discussion, I think it's funny that there is all this controversy over how to implement sockets. I get that this is where we are, because the modern internet only supports a few protocols, but a the network level you can literally just open up a socket and send newline delimited JSON-RPC messages in both directions at full duplex. So simple and no one even thinks about it. Why not support the lowest level primitive first? There are many battle tested solutions for exposing sockets over higher level protocols, websockets being one of them. I like the Unix Philosophy.

Thinking further, the main issue with just using TCP is the namespace. It's similar to when you have a bunch of webservers and nginx or whatever takes care of the routing. I use domain sockets for that. People often just pick a random port number, which works fine too as long as you register it with the gateway. This is all really new, and I'm glad that the creators, David and Justin, had the foresight to have a clean separation between transport and protocol. We'll figure this out.