MurphyA/hacker-news huggingface dataset:
by galangalalgol | 2025-07-30 17:06:03+00:00
But China is, and western countries including those in the EU have frequently ignored such things. Looking closer this really only affects diffusion models which are much cheaper to retrain. The exception is integrated models like Gemini and gpt-4v where retraining might reasonably cost more than the fine. Behemoths like google and openai won't bail over a few 100M, unless they see it is likely to happen repeatedly, in which case they would likely decouple the image models. But there is nothing to say some text database that is widely used isn't contaminated as well. Maybe only China will produce models in the future. They don't care if you enforce their IP.

Edit: After more reading. Clearview AI did exactly this, they ignored all the EU rulings and the UK refused to enforce them. They were fined tens of millions and paid nothing. Stability is now also a UK company that used pi images for training; it seems quite likely they will try to walk that same path given their financial situation. Meta is facing so many fines and lawsuits who knows what it will do. Everyone else will call it cost of business while fighting it every step of the way.
by reaperducer | 2025-07-30 17:06:16+00:00
This is nostalgia for the world before a series of "Eternal September" events.

The good news is that we're headed right back to the old days before there was an "internet."

Back then, all information was paywalled and siloed in CompuServe, GEnie, Delphi, Quantum Link, American People Link, and a dozen other services.

Today, all information is quickly migrating back into paywalls and silos. Only the names have changed.
by Anamon | 2025-07-30 17:06:16+00:00
I think it's just that there's been enough time and the magic has worn off. People used it enough now and everybody has made their experiences. They initially were so transfixed that they didn't question the responses. Now people are doing that more often, and realising that likelihood of cooccurrence isn't a good measure for factuality. We've realised that the number of human jobs where it can reach 8%, let alone 80% of quality, is vanishingly small.
by freedomben | 2025-07-30 17:06:19+00:00
I don't disagree, but I also don't think that gives the article a pass to make whatever claims they want without getting any pushback. Especially where they posted it to HN, they should be expecting to be challenged. I could (and probably should) have been nicer instead of calling it "terrible", but I don't think we (a site like HN dedicated to intellectual curiosity) should give bad claims a pass just because they are "opinion." We don't let journalists make unsubstantiated factual claims that are self-contradictory just because they listed it under the "opinion" section of the paper/site, and I don't think we should have different standards for a self-published piece. I'm not advocating censoring it or taking it down, I'm just critiquing it.
by variadix | 2025-07-30 17:06:20+00:00
Some other things you can do to improve packing are using integer indices/offsets/relative pointers instead of absolute pointers (especially on 64-bit machines), overlapping fields for unions (as an example you may have a tag that can share some bits with another field in each member of the union), using a structs position in memory to encode information (for example, if you have a binary tree of array allocated nodes, you can specify that the right child always follows the parent in memory, then you only need to store the index of the left child), and of course structure packing pragmas/attributes.
by potato3732842 | 2025-07-30 17:06:21+00:00
Going 30 on anything that resembles a bike in geometry and construction is not a leisurely activity one engages in casually. 40 is pushing it, 50 you know is unsafe. 70 is a publicity stunt in a controlled environment. Yes, I know road bikes (with or without electricity) hit high speeds in certain situations, but those situations are away from traffic or potential traffic, a big downhill in the middle of nowhere or a race course or something like that.

This is a self solving problem. It doesn't need a law. Nobody is going lightening fast on anything that resembles a bike except in the few situations where a) they can b) doing so is less sketchy than not (e.g. going faster than the bike "likes" is can be less sketchy than going too slow for traffic).

The fact that there is a huge pent up demand for "totally not a moped" type stuff really goes to show you the degree to which not laughing these people out of town has already perverted the personal transportation market.

Edit: The above are Philly speeds. Add 5-10mph for Miami or somewhere else wide, smooth and flat with great visibility. But the cars are going faster there too and the pedestrians are fewer and/or more removes so I don't think it actually matters.
by sigbottle | 2025-07-30 17:06:24+00:00
> But this is also again the danger of having an advanced bullshit generator - of course it sounds reasonable and logical, that's what it is designed to output. It's not designed to output actually reasonable and logical text.

Always easier to produce bullshit than to verify it. Just had it produce a super elegant mathematical proof, for it to claim that n + 1 =0 for only positive n. Right. o3 mode, thought for 10 minutes btw.

If you want to use LLM's you have to use it in a targeted manner. This means having mental loads not encodable in the LLM's space.

Even when I'm learning on my own I'll frequently spin up new context and/or work out things in my own notes, not revealing it to the LLM, because I've found too many times if you push the LLM too hard it will make up bullshit on the spot.

Advanced, really good google search. That's what it is right now.
by epiccoleman | 2025-07-30 17:06:39+00:00
For me, the workflow that Claude Code provides via VSCode plugins or even IntelliJ integration is great. TUI for talking to the agent and then some mild GUI gloss around diffs and such.

I like terminal things because they are easy to use in context wherever I need them - whether that's in my shell locally or over SSH, or in the integrated terminal in whatever IDE I happen to be using.

I use vim if I need to make a quick edit to a file or two.

Idk, terminal just seems to mesh nicely into whatever else I'm doing, and lets me use the right tool for the job. Feels good to me.
by amirhirsch | 2025-07-30 17:06:39+00:00
Being dismissive of the Bible is not as cool as you think it is: those who do not study the Bible are doomed to repeat it.

I understand the instinct to treat Bronze‑Age literature like fanciful fiction: engineers are wired to put "myth" in one bucket and "hard data" in another. But for better or worse, the Bible isn't just an ancient novel. It's the source code for a huge fraction of the world's legal systems, ethics, holidays, and political claims, including the one we are discussing. Dismissing it as "Harry Potter" misses the point:

If we're serious about reducing violence, we need to debug the real code people are running in their heads, not the straw‑man version.
by doctorpangloss | 2025-07-30 17:06:45+00:00
One POV is their model doesn’t work for small purchases period. It’s not so much a hardware or software vendor so much as an IT agency. Which can be good venture businesses! Of course, everyone looking at this problem thinks, to make a small cost offering: that’s what a cloud is. Oxide’s problem statement says something like AWS doesn’t “make sense.” It makes way more sense than Oxide. The problem with AWS isn’t that it is bad, it’s that Amazon is greedy.
by zdragnar | 2025-07-30 17:06:53+00:00
> Israel has absolutely zero intention of handing over control of Gaza,

The charter for Hamas for years called for the total destruction of Israel. That's been recently removed, but their actions haven't changed.

Why would any nation allow such a government to be their neighbor? The best that anyone could hope for would be a North / South Korea or CCP/KMT divide, but those only work because both sides share a common identity.
by nipponese | 2025-07-30 17:07:47+00:00
Take a look at the Super73 mentioned in the piece: It has pedals directly connected to a chain. That's the difference between a motorcycle and an e-bike, not speed.

Edit: I am not saying these things aren't crazy fast and dangerous, but if you go into an electric motorcycle store and they try to sell you an e-bike with a pedal assist, it's obvious they are not the same thing. The form-factor is just different.
by viccis | 2025-07-30 17:07:49+00:00
That's still speculation.

>The reason Palestine may be important for them

When I said they did 9/11 over US support of Israel, I didn't mean that they did it because of Israel's occupation of Palestine. They did it because Israel is the inventor of modern terrorism (Lehi and Irgun, the head of the latter was even an Israel PM!) and has terrorized every single surrounding nation since its invention by the British over a century ago.
by rayiner | 2025-07-30 17:07:51+00:00
The one-way ratchet results from the very factors you mention. To your EPA example: the nation’s environmental laws all reflect compromises between protecting the environment and minimizing impact on businesses. They wouldn’t have gotten through Congress otherwise. If you have an EPA full of employees who, to use your words, think of one side of those compromises as “exploit[ing]” the environment, they are naturally going to push to effectively undo those compromises, in a direction that generally aligns with the party that federal workers overwhelmingly vote for. That’s the one-way ratchet. It’s a typical principal-agent problem: https://en.wikipedia.org/wiki/Principal%E2%80%93agent_proble....

But that’s not how the system is supposed to work in a democracy. Ideally, executive branch policies would track the pattern of presidential elections, without any detectable aggregate influence from the political preferences of federal workers.
by zer00eyz | 2025-07-30 17:08:04+00:00
> Do the people making buying decisions at this scale care if their sysadmins have better tools?

Look at who oxide is selling to and for what reasons.

It's about compute + software at rack scales. It does not matter if it is good it matters that it's integrated. Gear at this level is getting sold with a service contract and "good" means you dont have to field as many calls (keeping the margins up).

> Everything we hear about Oxide sounds like an impressive green field implementation of a data center, but is that enough?

Look at their CPU density and do the math on power. It's fairly low density. Look at the interconnects (100gb per system). Also fairly conservative. It's the perfect product to replace hardware that is aging out, as you wont have to re-plumb for more power/bandwidth, and you still get a massive upgrade.
by Sayrus | 2025-07-30 17:08:07+00:00
> I'm sure teenagers would love this loophole to drive a motorcycle without a license

In France, you can drive without a license once you're 14 (you need the BSR but it's basically impossible to not get it). If I remember correctly the motor has to be a 50cm3 or equivalent and go under 45 (or 50?) km per hour.

So effectively, if you put the right motor in a Harley, you can. The bikes discussed here have large motors but only a speed limiter which is very different.
by eatonphil | 2025-07-30 17:08:15+00:00
In their data modelling pages they mention you should break up rows into separate keys per column. Or separate keys per field in a document. This is indeed how many databases model rows on a distributed kv store. So this might be how they achieved 100TB.

However you still have the issue of any single key-value needing to be in their limit. (But it's not like people typically store enormous blobs in Postgres or MySQL either I think?)
by rayiner | 2025-07-30 17:08:17+00:00
> Like, why should anyone who is a Republican even apply for a job that their own party actively campaigns for to go away?

Why is that relevant? In a democracy, the voting public has a right to have the federal government reflect what people voted for, regardless of whether any of them choose to work in government or not. Federal workers should be like “dumb pipes” to use an analogy.
by droopyEyelids | 2025-07-30 17:08:23+00:00
"Connecticut already uses the common three-class system that codifies legal e-bikes as up to 20 mph (32 km/h) and 750W (one horsepower) for Class 1 and 2, or up to 28 mph (45 km/h) for Class 3 e-bikes.

But now the state is updating its e-bike laws, adding that any e-bike with over 750W of power will be considered a “motor-driven cycle” and require a driver’s license. Over 3,500W? That will be considered a motorcycle and require a motorcycle endorsement to legally ride, as well as registration and insurance like a motorcycle. "

I love PEVs and this basically makes sense to me.
by westurner | 2025-07-30 17:08:27+00:00
Is it possible to apply these optimizations to Arrow?

Arrow's struct is called StructArray. Fields of StructArray have a StructType.

StructType has .bit_width and .byte_width attrs in Python and probably the other implementations too: https://arrow.apache.org/docs/python/generated/pyarrow.Struc...

Arrow supports bitfields with BooleanArray, and enums with categoricals but

"BUG: Categorical columns using the PyArrow backend requires 4x more memory" (open) https://github.com/pandas-dev/pandas/issues/58062 :

> On disk Parquet appears to store the category data as logical type String which is compressed with snappy and encoded

Arrow Flight RPC handles nested structs with enums over the wire somehow too FWIU
by Aachen | 2025-07-30 17:08:46+00:00
It was the compression format, not the scanner, right? Same would have happened if you store in that format (with the same quality settings etc.) on a computer or smartphone

Not that that helps anyone who's affected, but that situation is more like if you'd have an .aip file, AI Photo storage format, where it invents details when you zoom in, and not a sensor (pipeline) issue
by WorldMaker | 2025-07-30 17:09:00+00:00
I still haven't found a use-case for the websocket Blazor Hybrid and it still smells so much like the worst mistakes of the original ASP (before .NET) and the `runat="client"` versus `runat="server"` confusions.

Blazor WASM makes some sense if Silverlight ever made sense for a project: it's a way to ship C# directly to the browser for maximal code sharing with other C# projects in a C# ecosystem. It's basically "what if Angular/React was just Razor Pages running on the browser?"

It's absolutely the opposite of KISS, it's lifting and shifting the entire .NET runtime in WASM to the client. Outside of corporate networks and packaged apps like Electron or Tauri, I'm not sure it makes any sense. But if you like writing Razor Pages and wished they ran closer to the client metal, and you can afford the bandwidth of an entire .NET application soup-to-nuts as your SPA framework, there is a sense to it.

If all you think you need is Razor Pages with HTMX that's probably all you need.
by dspillett | 2025-07-30 17:09:05+00:00
> it doesn't appear to truly be zero cost if you log variables that can't be eliminated.

I'd say it is fair to call it zero cost, if the costs you are seeing are due to the way you are using it. If the values being logged are values you are already computing and storing, constants, or some mix of the two (concatenated via its printf function), by my understanding (caveat: I've never actually used Go myself) all the logging code should be stripped out as dead code in the link stage.

Obviously if you are performing extra computations with intermediate values to produce the log messages, your code there might produce something that is not reliably detected as eliminable dead code so there would be cost there.

> The only way (I believe) to implement zero cost is some type of macro system which go does not support.

That looks to be effectively what it is doing, just at the link stage instead of in a preprocessor. Where C & friends would drop the code inside #ifdef when the relevant value is not set (so it won't be compiled at all) this should throw it out later in the process if DLG_STACKTRACE isn't set at compile time.

So there will always be a compile-time cost (unlike with a preprocessor macro, something will be produced then thrown away and the analysis of what to throw away will take longer with more code present), but not a run-time cost if the logging is not enabled, assuming you don't have any logic in the trace lines beside the calls to this module.
by verdverm | 2025-07-30 17:09:08+00:00
All of the IDEs already have the AI integrations, so there's no work to do. It's not like you don't have to do the equivalent work for a TUI as an IDE for integration of a new model, it's the same config for that task.

> works with no dev environment at all

The terminal is a dev environment, my IDE has it built in. Copilot can read both the terminal and the files in my project, it even opens them and shows me the diff as it changes them. No need to switch context between where I normally code and some AI tool. These TUIs feel like the terminal version of the webapp, where I have to go back and forth between interfaces.
by roadside_picnic | 2025-07-30 17:09:20+00:00
PGMs are a great topic to explore (and Koller+Friedman is a great book), but, as a word of caution to anyone interested: implementation of any of these more advanced models remains a major challenge. For anyone building production facing models, even if your problem is a pretty good match for the more interesting PGMs, the engineering requirements alone are a good reason not to go too far down that path.

The PGM book is also structured very clearly for researchers in PGMs. The book is laid out in 3 major section: the models, inference techniques (the bulk of the book), and learning. Which means, if you follow the logic of the book, you basically have to work through 1000+ pages of content before you can actually start running even toy versions of these models. If you do need to get into the nitty-gritty of particular inference algorithms, I don't believe there is another textbook with nearly the level of scope and detail.

Bishop's section on PGMs from Pattern Recognition and Machine Learning is probably a better place to start learning about these more advanced models, and if you become very interested then Koller+Friedman will be an invaluable text.

It's worth noting that the PGM course taught by Koller was one of the initial, and still very excellent, Coursera courses. I'm not sure if it's still free, but it was a nice way to get a deep dive into the topic in a reasonably short time frame (I do remember those homeworks as brutal though!)[0].

0. https://www.coursera.org/specializations/probabilistic-graph...
by zamalek | 2025-07-30 17:09:28+00:00
Hot on the wheels on the vibe-coded Tea breach. Things are looking great for vibe coding.

Don't get me wrong, I have been been more hands off (though not completely, and very prescriptive) with an SPA side project and it's going great. Claude makes way better looking UIs than my dog ugly developer UIs. But vibing auth? That should seriously count as _legal_ gross negligence.
by bee_rider | 2025-07-30 17:09:49+00:00
I don’t want to impose my preferences on other random people. I think sites loaded up with JavaScript are garbage and the people who make them are bad at their jobs, but whatever, that’s their business. I can hold negative opinions about things without suggesting we ban them.

But I do think it should be considered totally unacceptable for things like government services to be gatekept by JavaScript. Same for entities that receive lots of public funds, like universities.
by zozbot234 | 2025-07-30 17:09:50+00:00
Their rack scale from-scratch redesign includes fans big enough that they've reportedly managed to cool CPU hardware that was actually designed for water-cooling, with no expectation for air cooling (though admittedly, they say they only achieved this just barely, and with a LOT of noise). That seems like something that's going to be objectively verifiable as a step up in efficiency.
by steveklabnik | 2025-07-30 17:09:50+00:00
> I keep quality notes that make it easy to recap a quarter or half. (But like I said, I'm good at my job.)

The point is not that my friends don't do a good job, the point is that this is work that does not actually further the organization's goals directly, but is necessary in order to keep their job. They'd rather be doing the actual work they are hired to do.
by shivasaxena | 2025-07-30 17:10:25+00:00
In case your haven't noticed, with remote work and globalization we do compete with people from developing countries, and even westerners nomading in asia.

In most of my jobs I have had team members based out of eastern Europe, Ex-USSR, India, Israel, nomads from SEA etc.

And still pre-AI most people in our industry did amazingly well despite these cost of living and wage differences since often than not they are also motivated enough to dedicate over 70h+ to our jobs when required(for me this week will end up being a 70h week).

So unfortunately I can't support our inefficient domestic middleman retailers push to block foreign competition so they can bleed us dry by selling 2eur wine opener at outrageous 5x markup.
by Alupis | 2025-07-30 17:10:34+00:00
It's a curious thing, the .NET ecosystem. The overwhelming majority of it's ecosystem seems to be dominated by Microsoft first-party libraries and frameworks. 3rd party libraries and frameworks seem to either get swallowed up by Microsoft, killed, or never reach critical-mass.

Often in the .NET ecosystem, it seems there is exactly one library or framework for thing $X or $Y. Whereas in the JVM ecosystem, you have 30+ logging libraries, 87 different MVC frameworks, etc. (yes, I'm being a bit facetious, but you get the point).

I imagine .NET developers often think this is a good thing, in regard to their ecosystem. No guessing what to use, just go with the "blessed" path and don't think about it. And, to that end, there is some obvious merit to this.

However, I feel the .NET ecosystem loses out on cross-pollination of ideas. There's zero possibility Microsoft's employees just happen to make the best frameworks and libraries... there should be many web frameworks - each competing for mindshare and trying to out-innovate each other, each with their own pro's and con's, etc.

So, while .NET might be technically open source, it still feels rather like a closed source ecosystem, controlled by a single corporate entity.
by Catbert59 | 2025-07-30 17:10:37+00:00
LoRa is absurdly robust.

Someone maxed out the ranging mechanism of the Semtech SX1280 with a 5dBi rubber antenna. He reached 60km with LoS. And there's a report of 90km in a ballooning project.

(https://github.com/StuartsProjects/SX1280_Testing)