MurphyA/hacker-news huggingface dataset:
by rohankhameshra | 2025-12-18 17:29:59+00:00
Hi HN,

OLake just added Kafka as a source, allowing data from Kafka topics to be written directly into Apache Iceberg tables (open source, no proprietary format).

Why this was added:

Many teams today land Kafka data into warehouses or custom storage layers, then later rewrite it into Iceberg for analytics or AI workloads.

That adds latency, cost, and operational complexity.

With OLake:

- Kafka -> Iceberg is a single step

- Tables are standard Iceberg (queryable by Spark, Trino, Presto, Athena, etc.)

- Supports schema evolution and high-throughput ingestion

This is early and we’re actively looking for feedback from teams running Kafka at scale or experimenting with Iceberg-based lakehouses.

Happy to answer questions or discuss trade-offs.
by lanstin | 2025-12-18 17:30:23+00:00
If you don't push your system to failure, you can't really say you understand it. And anyways the precise failure modes under various conditions are important characteristics for stability/resiliency. (Does it shed load all the way upto network bandwidth of SYNs; allocate all the memory and then exit; freeze up with deadlocks/disk contention; go unresponsive for a few minutes then recover if the traffic dies off; answer health check pings only and not progress on actual work).
by ZebusJesus | 2025-12-18 17:30:29+00:00
It is becoming more and more important that people learn to encrypt things locally themselves, its not end-to-end if the users are the ones encrypting and decrypting manually and then sending that message over unencrypted methods to comply with this draconian invasion of privacy. It would probably be a matter of time before they try to make using PGP usage illegal as well but they haven't yet.
by adamzwasserman | 2025-12-18 17:30:40+00:00
The state encapsulation concern is exactly what DATAOS addresses: dataos.software

The premise is that React's "UI=f(state)" creates a synchronization problem that doesn't need to exist.

If the DOM is the authority on state (not a projection of state held elsewhere), there's nothing to sync. You read state from where it already lives.

I built multicardz on this: 1M+ cards, sub-500ms searches, 100/100 Lighthouse scores.

If you have time to read, I would very much like to hear your thoughts; genuine technical pushback welcome.
by mschuster91 | 2025-12-18 17:30:42+00:00
Apple darn well knew what people want - even the first iPhone, the one that didn't even have an App Store (which got invented as a concept by jailbreakers proving it was possible!), came with YouTube and Maps from the start.

What I don't know however why Microsoft insisted on the ability to not show ads and download videos when copying that concept. They had to know that they were directly cutting into Google's bottom line.
by Ygg2 | 2025-12-18 17:30:42+00:00
I think Blow and Muratori are pure engineers (as defined here: https://www.seangoedecke.com/pure-and-impure-engineering/).

Pure engineers deliver perfect and fast software somewhere along the Black Hole Era. Not quite heat death of the universe, but almost there.

Impure engineers deliver "working" code in a deadline, for an arbitrary definition of working. Basically, The Worse is Better™.
by btilly | 2025-12-18 17:30:43+00:00
All true, but on the flip side they get free room and board...

Joking aside, read the 13th amendment https://constitution.congress.gov/constitution/amendment-13/ and pay close attention to the bit that reads, except as a punishment for crime whereof the party shall have been duly convicted. In the United States, involuntary labor, slavery, and locking someone in a cell are all equally not allowed. And all equally allowed - as punishment for crimes of which you have been convicted.

If you think that this is ripe for abuse, you'd be exactly right. See https://en.wikipedia.org/wiki/Convict_leasing. We got rid of chattel slavery - and immediately accomplished the same effect with the black codes and convict leasing. As the name suggests, this was overwhelmingly directed at the same black people who had just theoretically been emancipated.
by Johanx64 | 2025-12-18 17:30:45+00:00
> Some people don't have the luxury of preaching for whatever ideals they have without a need to release anything in 10 years

Wait, how did they gain this "luxury"? Are they trust fund babies or something?

Or did they earn their big stash of money by producing "garbage" and now retroactively are preaching ideals that they themselves didn't follow or what?

This line of "criticism" doesn't make any sense whatsoever.

After all both in question live off money they've made and/or are making from their (arguably) uncompromised quality work.

That is to say their uncompromised quality work has directly resulted in them being able to not release anything for close to 10 years, and practice their ideals in software they ship even if the "shipping" takes 10 years to do.

It would be more fair to say, that most people don't have the craftmanship and skill (and not the luxury) to be able to produce high quality work and software that enables them the so called "luxury".
by acituan | 2025-12-18 17:30:56+00:00
> compilers only got better and better

At no point compilers produced stochastic output. The intent user expressed was translated down with a much much higher fidelity, repeatability and explainability. Most important of all, it completely removed the need for the developer to meddle with that output. If anything it became a verification tool for the developer‘s own input.

If LLMs are that good, I dare you skip the programming language and have it code in machine directly next time. And it is exactly how it is going to feel like if we treat them as valuable as compilers.
by db48x | 2025-12-18 17:31:02+00:00
Many games these days come with explicit terms allowing streaming of the game content, including the music. But this, and your argument, is not really very related to the case at hand.

In addition to the alleged GPL violations, there is a real contract dispute here. Vizio also included a written offer of source code to the GPLd components of their software with the television. The SFC tried to avail themselves of that offer by writing to the address given, but Vizio denied their request. It’s a straight forward open and shut contract case: Vizio made a credible offer (and thus created a contract) and then failed to uphold their end of the deal.
by ChrisMarshallNY | 2025-12-18 17:31:03+00:00
I'm skeptical of that. I think I'd need to see some hard data on it.

I spent most of my career in the hardware business. It's really odd to see so many folks unable to understand business models that make money, besides "sell data."

It really seems as if folks can't grok that companies that make money, can do so without necessarily selling data.
by advisedwang | 2025-12-18 17:31:16+00:00
If there is a high-demand tourist location (like many parts of Spain) and tourists are more wealthy than locals (like many parts of Spain) then new housing stock will also be soaked up by AirBnBs. In this situation the "just build" argument means you have to build enough housing to house every single wealthy tourist that wants to come before you start seeing any relief to local housing issues. Not only does that mean locals have to wait thought, say, 10 years of construction before their issues are addressed, but in the mean time the tourism sector will have dominated the economy, which is not healty either.
by dredmorbius | 2025-12-18 17:31:19+00:00
That's ... somewhat freighted as well (less in the positive than the implied negative framing).

"G-n", where n is typically in the range of 6--20, and most canonically refers to the G7 nations of Canada, France, Germany, Italy, Japan, the United Kingdom and the United States, is another formulation, though that omits Australia (reasonably significant) and NZ (a small country, though quite "western" in a cultural sense). Other significant exclusions are of course China, as well as South Korea, any South American states (Mexico and Brazil would be the most likely candidates), as well as numerous European states which aren't as dominant but are still internationally significant commercially and politically, though those last can claim some inclusion under the EU, the "non-enumerated member".
by vikp | 2025-12-18 17:31:51+00:00
Hi, I'm a founder of Datalab. I'm not trying to take away from the launch (congrats), just wanted to respond to the specific feedback.

I'm glad you found a solution that worked for you, but this is pretty surprising to hear - our new model, chandra, saturates handwriting-heavy benchmarks like this one - https://www.datalab.to/blog/saturating-the-olmocr-benchmark ,and our production models are more performant than OSS.

Did you test some time ago? We've made a bunch of updates in the last couple of months. Happy to issue some credits if you ever want to try again - vik@datalab.to.
by mullingitover | 2025-12-18 17:31:54+00:00
> expects the “code review” process to handle the rest.

The LLMs/agents have actually been doing a stellar job with code reviews. Frankly that’s one area that humans rush through, to the point it’s a running joke that the best way to get a PR granted a “lgtm” is to make it huge. I’ve almost never seen Copilot wave a PR through on the first attempt, but I usually see humans doing that.
by bigbadfeline | 2025-12-18 17:32:10+00:00
> he will meet NATO tanks with open hug... I got what he said... better death in short war [than] long tortures.

That's the same argument suicidal maniacs use: "kill yourself now to avoid the problems of life" - otherwise known as the "silver lining of shit".

However, it's not clear why that should happen at the expense of NATO taxpayers, they are better off without maniac-serving wars.

Assange is the man though, sometimes I wonder if he's the only man in the West. Far too many don't seem to understand that sooner or later, the morbid obsession with wars is going to get back at them and bite their heads off.
by gaigalas | 2025-12-18 17:32:13+00:00
It does not eliminate code reviews.

In practice, you should have at least one independent reviewer who did not actively worked on the PR.

That reviewer should also download the entire code, run it, make tests fail and so on.

In my experience, it's also good that this is not a fixed role "the reviewer", and a responsability everyone in the team shares (your next task should always be: review someone else's work, only pick a new thing to do if there is nothing to review).

This practice increases quality dramatically.
by giardini | 2025-12-18 17:32:20+00:00
">If the cops don't care about something, it's defecto legal.<"

Ahhhh! A new English expression, "defecto legal". I like it! It could be the name of a popular website.

The proper term is "de facto": https://www.merriam-webster.com/dictionary/de%20facto

A defect is a flaw, an error, and "defecto" is Spanish for the English "defect". The meaning of "defecto legal" (English) thus remains in the wind, TBD. But I look forward to it's landing.
by nkohari | 2025-12-18 17:32:34+00:00
> I know exactly what those layers of abstraction are used for. Why so many? Jobs making layers of abstraction.

This is a perfect example of Chesterson's Fence. Is it true that there are too many levels of abstraction, that YAML configuration files are a pain in the ass, and so on? Yes. But it's because this stuff was created organically, by thousands of people, over decades of time, and it isn't feasible to just start over from first principles.

I don't know enough about electrical engineering to speak to it (funny how that works!) but I'm sure there are plenty of cases in EE that just come down to "that's how it's been done forever".
by 9rx | 2025-12-18 17:32:35+00:00
Automated testing (there aren't different kinds; to try and draw a distinction misunderstands what it is) doesn't catch bugs, it defines a contract. Code is then written to conform to that contract. Bugs cannot be introduced to be caught as they would violate the contract.

Of course that is not a panacea. What can happen in the real world is not truly understanding what the software needs to do. That can result in the contract not being aligned with what the software actually needs. It is quite reasonable to call the outcome of that "bugs", but tests cannot catch that either. In that case, the tests are where the problem lies!

Most aspects of software are pretty clear cut, though. You can reasonably define a full contract without needing to see it. UX is a particular area where I've struggled to find a way to determine what the software needs before seeing it. There is seemingly no objective measure that can be applied in determining if a UX is going to spark joy in order to encode that in a contract ahead of time. Although, as before, I'm quite interested to learn about how others are solving that problem as leaving it up to "I'll know it when I see it" is a rather horrible approach.
by lcnPylGDnU4H9OF | 2025-12-18 17:32:51+00:00
> Your code is unambiguously better than any LLM code if you can comment a link to the stackoverflow post you copied it from.

This is not a truism. "My" code might come from an LLM and that's fine if I can be reasonably confident it works. I might try to gain that confidence by testing the code and reading it to understand what it's doing. It is also true of blog post code, regardless of how I refer to the code; if I link to the blog post, it's because it does a better job of explaining than I ever could in code comments. Whether LLMs make one more productive is hard to measure but it seems to be missing the point to write this.

The point is, including the code is a choice and one should be mindful of it, no matter the code's origin. At that point, this comes off like you just have something to prove; there doesn't seem to be a reason not to use the LLM code if you know it works and you know why it works.
by ckastner | 2025-12-18 17:32:52+00:00
A lot of this coincides with my own experiments I did to pass-through consumer AMD GPUs into VMs [1], which the Debian ROCm Team uses in their CI.

The Debian package rocm-qemu-support ships scripts that facilitate most of this. I've since generalized this by adding NVIDIA support, but I haven't uploaded the new gpuisol-qemu package [2] to the official Archive yet. It still needs some polishing.

Just dumping this here, to add more references (especially the further reading section, the Gentoo and Arch wikis had a lot of helpful data).

[1]: https://salsa.debian.org/rocm-team/community/team-project/-/...

[2]: https://salsa.debian.org/ckk/gpu-isolation-tools
by UniverseHacker | 2025-12-18 17:32:59+00:00
I'm not talking about specs on paper, I'm talking about the actual experience of driving it in the real world. As the saying goes, “people buy horsepower but drive torque.” Horsepower on an electric motor vehicle is often effectively a software setting based on what RPM or top speed they allow, and the eGolf is set with a low rev limiter/top speed from the factory probably to limit battery temps.

For example, in the eGolf you have a flat torque curve with 100% of the power available instantly at any speed, without shifting.

A basic crossover SUV with a 4 cylinder engine and slippy/slow responding automatic can easily have more horsepower, and a faster 0-60, but still feel gutless in normal driving compared to the e-Golf because you have very little torque at normal RPMs, and you need to rev the engine to the redline to actually use the horsepower, which typically involves a lot of lag time, and then a lot of jerking and noise in your typical basic low end car.

You could for example compare it to a Nissan Rogue from the same era, which has 170 horsepower. The Rogue sometimes feels scary slow like it can’t get out of its own way and has to be floored and ran to the redline to get it really moving, whereas with the eGolf it takes some finess to launch it smooth without wheelspin due to the instant on torque. Most people would be shocked to hear that the Rogue technically has a more powerful motor.

Consider that the ALH TDI Golf and Jetta (diesel) had literally only 90 horsepower also with a totally flat torque curve, way less than the e-Golf, and are also feel a lot more sporty than your typical 4 cylinder gasoline economy car, despite being radically slower on paper, or floored in a straight line drag race.

Extend this to other cars- take an early Porsche Boxster with only 200 horsepower, one of the best drivers cars in history, but on paper slower than a lot of low end economy cars nowadays. But the amazing handling, and wide torque band let it hang with a lot of supercars in a real world track race. It would literally lose a drag race against a modern low end economy car, yet it feels way faster and is way faster on say, a track with turns.

The eGolf isn't a sports car, but it will never feel like it's lacking in power for normal driving.
by ee64a4a | 2025-12-18 17:33:10+00:00
The "in reverse" framing was largely in reference to the fact that Apple built the software ecosystem after getting loyal hardware consumers, whereas Valve got loyal software users first and is now selling hardware to them.

Otherwise, I do think a lot of what you say is true, and some of it is in the article (e.g. the software "just works").
by rpdillon | 2025-12-18 17:33:25+00:00
Do you have evidence, or is it mostly vibes?

EDIT: Decided to dig up the source: https://github.com/algal/pleasejusttryhtmx/commits?author=al...

Looks like the initial commit might well have been generated, and then the document touched up in several following commits.

But there's clearly a person behind it: algal.
by npn | 2025-12-18 17:33:39+00:00
This is a retarded advice. Author clearly never tried to develop any serious web development.

> the build time is over 30 seconds!

that's silly. 30 seconds building time is nothing compare to the accumulated time you wait for micro changes to your frontend.

for typical web development using react/vue/svelte you have hot code reloading, which can reload the current website < 1 seconds after you hit [Save] on your favorite editor.

for htmx to update, you have to wait for your whole server to reload (which can be way slower even you use interpreted languages like ruby or python, due to complexity of the framework you use).

not to mention it does not keep any state of the current website, make debugging way more troublesome compare to a js mature framework.

only people who never have to improve their website incrementally think htmx is a viable option. or insane people.

obviously, for some small websites with minimal interactions or no need to change the content very often, then htmx can be good, but for that case, vanilla js also works, and they do not need 14kb of excess baggage.
by mariusor | 2025-12-18 17:33:48+00:00
I am not an expert on Notch's slide into craziness, but I'd argue that the episode you mention it might not be the start. His start was as a "anti-SJW" game developer which got him hated and vilified by his former fans.

I'm not saying these people were rays of sunshine before, I'm saying they could be talked to without them foaming at the mouth and you face palming at how unhinged they were. I was using the meaning of benign attached to tumors.
by breppp | 2025-12-18 17:34:20+00:00
I think that's an overly simplistic and false view of Israeli-Iranian relations since 1979.

Israel had tried to help Islamist Iran negotiate with the US through the Contra debacle, shared intelligence with Iran against Iraq (failed reactor bombing) and outright sold weapons to Iran to support them against Iraq.

There was a naive belief in Israel that the daily "Death to Israel" chants are just rhetoric like in the arab countries it used to deal with, and Iran can be a quiet ally like before 1979

At the same time Iran fought Israel through their mercenaries in Lebanon up to the point where all of Iran's resources were consumed by the failed attempt to encircle Israel, which has collapsed completely in the last two years
by ncruces | 2025-12-18 17:34:27+00:00
Yes, in the only successful OSS project that I “maintain.”

Fully vibe coded, which at least they admitted. And when I pointed out the thing is off by an order of magnitude, and as such doesn't implement said feature — at all — we get pressed on our AI policy, so as to not waste their time.

I don't have an AI policy, like I don't have an IDE policy, but things get ridiculous fast with vibe coding.
by alphazard | 2025-12-18 17:34:27+00:00
Quality is not rewarded at most companies, it's not going to turn into more money, it might turn into less work later, but in all likelihood, the author won't be around to reap the benefits of less work later because they will have moved onto another company.

On the contrary, since more effort doesn't yield more money, but less effort can yield the same money, the strategy is to contract the time spent on work to the smallest amount, LLMs are currently the best way to do that.

I don't see why this has to be framed as a bad thing. Why should anyone care about the quality of software that they don't use? If you wouldn't work on it unless you were paid to, and you can leave if and when it becomes a problem, then why spend mental energy writing even a single line?
by torginus | 2025-12-18 17:34:42+00:00
I am not from the US. I don't have a horse in this race. Please do not imply I am somehow 'carrying water' for the Republicans, whatever might that mean. I do not have any negative feelings toward you for who you are, and I assume you're a competent individual, although I would prefer if we were having a technical debate instead of whatever this is.

I apologize if I come across as impolite, but I assure you that has not been my intention. Please understand that that there is no hidden meaning behind my posts.

In fact I enjoy the fact that Blow can talk shop about things he disagrees with (such as enterprise software with call stacks 50 levels deep).
by margalabargala | 2025-12-18 17:35:22+00:00
Not to the same extent.

Iran is somewhat special in that a culture of highly valuing education and producing high quality scientists has persisted among the populace, despite a half century of despotic religious rule.

There are no other countries that come to mind that manage to do this despite such a large, long period if government-populace mismatch. Other countries that produce large quantites of scientists generally have a government that actively supports the pursuit of science. Those countries aren't immune to flareups of anti-intellectualism but they are generally short-lived.
by rootusrootus | 2025-12-18 17:35:28+00:00
One thing I've pushed developers on my team to do since way before AI slop became a thing was to review their own PR. Go through the PR diff and leave comments in places where it feels like a little explanation of your thought process could be helpful in the review. It's a bit like rubber duck debugging, I've seen plenty of things get caught that way.

As an upside, it helps with AI slop too. Because as I see it, what you're doing when you use an LLM is becoming a code reviewer. So you need to actually read the code and review it! If you have not reviewed it yourself first, I am not going to waste my time reviewing it for you.

It helps obviously that I'm on a small team of a half dozen developers and I'm the lead, and management hasn't even hinted at giving us stupid decrees like "now that you have Claude Code you can do 10x as many features!!!1!".
by protimewaster | 2025-12-18 17:35:42+00:00
Another issue is, how do you get your games when you're banned? Most people don't have all their games installed at any given time.

With GOG, there is at least an unofficial, supported way to get an offline installer for each of your games. With Steam, there's no officially supported way to do this, so it's likely to be a bigger PITA to archive all your games ahead of time.

In reality, though, almost nobody is thinking ahead so that they have all their games archived, and, given the size of games and collections, it's a difficult thing to do on the cheap.