MurphyA/hacker-news huggingface dataset:
by padolsey | 2025-10-06 05:13:04+00:00
Thanks for your work on this! It's a very legit domain of problem for LLMs to optimize for. I've produced a comprehensive eval based on your post and run it against 30 models, each tasked with recalling specific data from 500 rows in different tabular formats. Have a look at the results here: https://weval.org/analysis/table-format-sensitivity__combine...

As you can see it's near 100% recall across all formats for a good chunk of frontier models, with a few (curiously, mostly Claude) failing a basic prompt adherance ("Return just the number") but still returning the right answers. The major failures are from Mistral Medium, Llama Maverick, Llama 3 70b Instruct, Mistral Nemo, Gemma 3 12b It, GPT 4o/4.1 Mini etc.

Based on these limited tests, here's the leaderboards on formats FWIW:

CSV: 84.25% Markdown Table: 82.65% YAML: 81.85% JSON Lines (jsonl): 79.85% Markdown key-value: 79.83% Pipe-delimited: 79.45% Natural language summary: 78.65% JSON: 77.73% HTML table: 75.80% XML: 73.80%

So, the biggest takeaway really is: Use the best model you can reasonably afford, then format will matter less. The cheapest 100% coverage models are Gemini 2.5 Flash and Deepseek Chat V3.1

And if you have no control over model, then use CSV or Markdown Table.
by A4ET8a8uTh0_v2 | 2025-10-06 05:13:45+00:00
I think, and I would like to think it was covered in civics, that state sanctioned violence is one of the few types that society allows for practical reasons. What I personally think the problem in this conversation is oddly simple: severe conflation of various related issues.

You may be well-intentioned, but you are not exactly convincing me to 'your side'.
by vouwfietsman | 2025-10-06 05:14:18+00:00
I am no expert here what I remember is mostly from CS courses, but isn't the entire point of a formal program proof that you can reason about the combinatorics of all data and validate hypothesis on those?

It's one thing to say: "objects of this type never have value X for field Y", or "this function only works on type U and V", but its a lot more impressive to say "in this program state X and Y are never achieved simultaneously" or "in this program state X is always followed by state Y".

This is super useful for safety systems, because you can express safety in these kinds of functions that are falsifiable by the proof system. E.g: "the ejection seat is only engaged after the cockpit window is ejected" or "if the water level exceeds X the pump is always active within 1 minute".
by userbinator | 2025-10-06 05:15:17+00:00
As a contrast, in the DOS world the file COMMAND.COM provided both the shell as well as most of the basic file management commands which would be separate files on Unix-like systems (cp, ls, mkdir, mv, rm, rmdir, etc.); and some specialised DOS-compatible systems had the whole basic OS including the kernel, device drivers, and shell along with its builtins in a single flat-loaded binary.
by worik | 2025-10-06 05:15:35+00:00
> who, do you believe, the perpetrators are

Masked, no ID, claim they are from ICE. Thugs.

> the crime of those perpetrators is ( again, be as specific as you can )?

Assault an kidnapping.

> who or what is, in your mind, ultimately responsible for the issue that has embroiled both victims and perpetrators?

Interesting question: Probably capitalists who want cheap labour and are willing to cut corners to get it
by slow_typist | 2025-10-06 05:15:57+00:00
It happens already. Lease for green land (probably wrong terminus) and arable land went up by more than 30% in ten years [1]. PV is arguably a very small factor of influence yet. But the pressure is real.

[1] https://www.bmel-statistik.de/landwirtschaft/landwirtschaftl...
by A4ET8a8uTh0_v2 | 2025-10-06 05:16:11+00:00
Friend, whether I know or not is not relevant to this discussion. If you were following my conversation with parent then you know the questions were for his benefit, not mine.

<< As a libertarian, I've had enough with people feigning condemnation for government/police overreach/unaccountability while writing comments that condone it.

That is fair. What would you propose to do about this?
by socalgal2 | 2025-10-06 05:16:20+00:00
Just because AI found an answer doesn't mean it's not true

Elon Musk’s business empire is built on $38 billion in government funding https://www.washingtonpost.com/technology/interactive/2025/e...

Chevy Volt Costing Taxpayers Up to $250K Per Vehicle https://www.michigancapitolconfidential.com/16192

Subsidy Tracker: General Motors https://subsidytracker.goodjobsfirst.org/parent/general-moto...

etc... etc... etc...
by zevon | 2025-10-06 05:16:58+00:00
Why not approach the problem from all sides? There are big renewable projects in Germany as well, of course, but they take time to build, the grid needs to be adapted to handle them and there are many, many people/organizations who oppose all big installations that "block their view of nature" or whatever, so the big projects take even longer. By the way, this (nasty neighbours) would be a big issue for Balkonkraftwerke as well if they had not added them to a list of privileged things you are allowed to equip your house with (without permission process).
by Uehreka | 2025-10-06 05:17:10+00:00
It’s a lot easier if you (I know I know) stop thinking of them as algorithms and anthropomorphize them more. People frequently say stuff like this, and its pretty clear that our minds process thoughts differently when we directly articulate them than if we act on “latent thoughts” or impulses.

Yell at me all you want about how “LLMs don’t think”, if a mental model is useful, I’m gonna use it.
by jesterson | 2025-10-06 05:17:16+00:00
Same here. Dont wanna piss on your party but I don't see any particular pride. Prime minister or any minister to that matter are pretty pathetic positions in my books, but that's totally different conversation.

No delivery problems if you set up everything correctly. It's not luck, just the same reason why well maintained car runs smoother than something that's seen last maintenance 100,000 miles ago.
by grumpy-de-sre | 2025-10-06 05:17:41+00:00
The fact that balcony solar has such short payback periods really emphasizes the scale of the failure. Why can't utility scale operators use bulk purchases of the exact same panels, in a more optimal installation (south facing, unshaded etc) to achieve similar or better payback periods?

Balcony solar is a whole lot like Uber, a way to side step onerous regulators, landlords that won't permit/invest in rooftop installations, planning approvals, transmission bottlenecks (eg. SuedLink [1] being forced to use underground cables) etc. The German government tolerates it because it keeps voters happy and helps reduce dependence on foreign gas.

At the end of the day though balcony solar is better than nothing, so let's not let perfect be the enemy of the good.

1. https://www.jacobs.com/projects/Germany-SuedLink
by zilyova | 2025-10-06 05:18:48+00:00
I'm working on graph insight, a semantic graph tool for exploring research papers. It extracts keyphrases, builds a 3D graph, and lets you navigate from documents > topics > clusters.

So far: ~28k papers processed, 100k+ topics mapped. Use case: faster literature review, spotting hidden links, and seeing research areas as a connected landscape instead of isolated PDFs. I think this tool applicable for news/media streams too.

Example (Text-to-Speech papers): https://www.reddit.com/r/deeplearning/comments/1nic3ft/3d_se...

I’m curious - would this be useful as a standalone tool for researchers/engineers/other domain areas?
by tehlike | 2025-10-06 05:20:01+00:00
It's the joy that counts. It's my "homelab" but i serve pricetracker.wtf on it.

I also have M920Q 8500t, HP prodesk with 10500t, and a lenovo P520 -> these three are truly for home purposes.

IF i were to do the pricetracker machine again, i'd go much smaller, and get a jbod + and probably a P520.
by sbinnee | 2025-10-06 05:20:18+00:00
Yes and no. They used to prefer everything on premise. Many try to move towards cloud especially newer companies. Major cloud providers you mentioned are not the usual choices though (maybe aws is the most common). They do have data centers in Seoul and try to expand their markets for South Korea. But government offers generous incentives for using domestic cloud providers like NHN which was mentioned in the article or Naver cloud. Why does this work? Because Korean services rarely target global markets mainly due to language barrier. Domestic cloud usage is sufficient enough.
by jesterson | 2025-10-06 05:20:25+00:00
> Postfix can easily be configured to reject incoming emails from senders without a reverse DNS mapping for their IP address, which makes it reject a lot of spam

Historically some corporate domains ignore that rule (yea, in 2025!), so I would advise not to reject any email and run everything through spam analysis daemon. This way you won't lose any email at expense of elevated load on your server
by nowittyusername | 2025-10-06 05:21:14+00:00
Your post is making me think maybe there is quite a lot of lost knowledge out there somewhere that maybe has pertinence in modern day agentic AI system building use. I am currently experimenting in building my own AI system that uses LLM's as the "engine" but the "harness" around the said LLM will do most of the heavy lifting. It will have internal verification systems, grounding information , metadata, etc... And I find myself making a lot of automated scripts as part of that process as I have a personal motto that its always better to automate everything possible with scripts first and only use LLM's as a last resort or for things you can script away. And that is making me look more and more in to old techniques that have been long established way back when...
by arp242 | 2025-10-06 05:21:36+00:00
I just use sshfs for most things today. It's by far the simplest to set up (just run sshd), has good authentication and encryption (works over the internet), and when I measured performance vs. NFS and Samba some years ago it seemed roughly identical (this is mostly for large files; it's probably slower for lots of small files – measure your own use case if performance is important). I don't know about file locking and that type of thing – it perhaps does poorly there(?) It's not something I care about.
by padolsey | 2025-10-06 05:21:43+00:00
Interesting. Curious to reproduce across models, I made a comprehensive eval based on your post and ran it against 30 models, each tasked with recalling specific data from 500 rows in different tabular formats. Have a look at the results here: https://weval.org/analysis/table-format-sensitivity__combine...

As you can see it's near 100% recall across all formats for a good chunk of frontier models, with a few (curiously, mostly Claude) failing at basic prompt adherance ("Return just the number") but still returning the right answers. The major failures are from Mistral Medium, Llama Maverick, Llama 3 70b Instruct, Mistral Nemo, Gemma 3 12b It, GPT 4o/4.1 Mini etc.

Based on these limited tests, here's the leaderboards on formats FWIW:

CSV: 84.25% Markdown Table: 82.65% YAML: 81.85% JSON Lines (jsonl): 79.85% Markdown key-value: 79.83% Pipe-delimited: 79.45% Natural language summary: 78.65% JSON: 77.73% HTML table: 75.80% XML: 73.80%

IMO the biggest takeaway really is: Use the best model you can reasonably afford, then the format chosen will matter less. The cheapest 100%-coverage models are Gemini 2.5 Flash and Deepseek Chat V3.1 FWIW. However, if you have no control over model, then use CSV or Markdown Table as these have highest chance of success.

The MAJOR issue that we might not want to admit is that there are a thousand confounders that prevent any meaningful canonical learning here. Crucially: The data within the tabular structure itself matters HUGELY. The scary probabilistic nature of LLMs mean the very subject of your queries can affect how the query is run, which is quite absurd from a IO/computing purity perspective. This is why tooling is so important. Enable the LLM to write and execute code safely, and you don't need to worry about such free-prose frailties.
by A4ET8a8uTh0_v2 | 2025-10-06 05:23:09+00:00
Eh, um, I would personally invite you to the discussion at gp level, where I dismiss this line of argumentation outright. It doesn't do much for me. Honestly, it does not advance your argument either. What I would or would not do is rather irrelevant in a grand scheme of things. However, in aggregate, it would be rather problematic. And it does not appear to be happening at that scale.

Do you know why?
by MilnerRoute | 2025-10-06 05:23:11+00:00
Over the years I've seen cases like this where a company was unresponsive to a single account's breach.

- One user took it to the media. The bad publicity got the attention of top executives, who pressured the accounts team to resolve the situation.

- One user actually just made contact with a well-placed executive and explained the situation. (In your case, that might even be a moderator.)

Also, you're not the only person I've heard who's had trouble with Reddit's account policy. If you could find others like yourself, it'd be a more interesting story for the media, or more likely to get an executive's attention.

I wondered if it could be an "inside job". (Someone disabling 2FA just long enough to log in?) Reddit ticked off its moderators earlier this month, though I'm not sure they'd have have the power to do this.
by brucehoult | 2025-10-06 05:23:31+00:00
I use a battery -- 6kWh, 3600W inverter, with 6x 440W panels -- and don't feed power into the house wiring, but simply power the appliances in the same room as the equipment: Starlink, Mac Mini with 32" monitor, 16" i9-13900HX laptop, half a dozen small SBCs (5-15W each), fridge, espresso machine, air fryer, microwave, toaster, kettle, 4kW (output, 900W electricity) portable air conditioner, dehumidifier (250W). some LED lighting.

At the moment (spring) in half-decent weather all the above stuff is 100% off-grid. I'm still using grid power for hot water heating, dish washer, clothes washer -- all of which I do for free in my daily "Free Hour of Power" -- and for intermittent incidentals such as the water pump (e.g. runs for 15 seconds when I flush the toilet) and lighting in usually non-occupied rooms such as toilet, bathroom, and bedroom -- which together means I'm paying around 10c-20c per day over and above the fixed daily charge.
by slow_typist | 2025-10-06 05:24:03+00:00
Plus the time getting the material, driving to the hardware store another time to get something you forgot, doing the registration, plus the time needed for planning/ calculation of economical feasibility/ decision making. Even at a very moderate 50 € per hour rate (for the typical Gamer) the material cost is the smallest part of the project. Treat it as a hobby, but don’t tell me it is an investment.
by hochstenbach | 2025-10-06 05:24:16+00:00
There are other studies on this topic with similar results across LLM systems:

Y. Sui, M. Zhou, M. Zhou, S. Han, and D. Zhang, “Table Meets LLM: Can Large Language Models Understand Structured Table Data? A Benchmark and Empirical Study,” in Proceedings of the 17th ACM International Conference on Web Search and Data Mining, Merida Mexico: ACM, Mar. 2024, pp. 645–654. doi: 10.1145/3616855.3635752.

C. Pang, Y. Cao, C. Yang, and P. Luo, “Uncovering Limitations of Large Language Models in Information Seeking from Tables,” June 06, 2024, arXiv: arXiv:2406.04113. doi: 10.48550/arXiv.2406.04113.
by Amekedl | 2025-10-06 05:24:26+00:00
No, this "observing" argument has already been beaten to death by a multitude of creatives explaining way better than I could how they learn and operate.

If you really think all they do is observe, form a gradient from millions of samples and spit out some approximations, you are deeply mistaken.

You cannot equate human learning with how genai learns (and if it did, we'd have agi already imao)
by worik | 2025-10-06 05:25:43+00:00
Revolutionary Socialists (e.g: USSR, China - both back in the day) and Democratic Socialists might seem the same from a distance. But the nature of violence is to lead to more violence, and both the USSR and China have great deals of state violence (as does the USA - I think it is the history of revolution, perhaps?)

Democratic socialists have to convince you. Not so much th Bolsheviks, they just make you.

> all examples of pure socialism that I'm aware of end up as a total failure

"Pure socialism" is a bit silly. How could there ever be such a thing? The Bolsheviks and the CCP were fascists to my way of thinking.

In Western Europe , France had a number of revolutions but recovered. The rest of them went the Democratic Socialist route.

Democratic Socialists, by necessity originally and these days as a positive policy, believe in a mixed economy.

Point is I do not think that Western Europe can be classed a "total failure" nor as "pure socialism".

> "real" socialism (like the idea the grocery stores are owned by the state

Yes. Mixed economies work better. It comes down to culture for a lot of places.
by A4ET8a8uTh0_v2 | 2025-10-06 05:25:50+00:00
This is, by far, the only rational argument put forth so far, but even here I feel obligated to nitpick. What exactly is 'simple detention'? Are they separated in terms of severity or is it just one giant class of detention that is subject to an opinion of the officers on the ground? One would think that a massive crackdown like this would be at least 4h of one's life.
by saurik | 2025-10-06 05:26:57+00:00
> nor is there a simple way to target an older Glibc version without spinning up a docker container

? I feel like you might be falling into the trap of assuming that the compiler always targets the current running system, but you 100% should always always always be doing a Linux-to-Linux "cross" compile with a sysroot... you don't need a docker container: you just extract an old Linux distribution into a folder and tell your current/modern compiler to target it.
by mamp | 2025-10-06 05:27:07+00:00
To be fair the performance of rules or Bayesian networks or statistical models wasn't the problem (performance compared to existing practice). DeDombal showed in 1972 that a simple Bayes model was better than most ED physicians in triaging abdominal pain.

The main barrier to scaling was workflow integration due to lack of electronic data, and if it was available, interoperability (as it is today). The other barriers were problems with maintenance and performance monitoring, which are still issues today in healthcare and other industries.

I do agree the 5th Generation project never made sense, but as you point out they had developed hardware to accelerate Prolog and wanted to show it off and overused the tech. Hmmm, sounds familiar...
by skacholia | 2025-10-06 05:27:21+00:00
Analogy Group | Founding Engineer; Founding Product Designer | Remote | Full-time

Analogy Group is an early-stage startup building AI-enabled political intelligence tools. We ingest data from across the news, web, and social media and create in-depth reports and visualizations. We are mission-driven, working with nonprofits, advocacy organizations, and companies working on of the world's most pressing challenges, including democracy, climate, and AI policy. We are currently hiring for a Founding Engineer (https://app.dover.com/apply/analogygroup/9379bd18-a8e5-4f6f-...) and Founding Product Designer (https://app.dover.com/apply/analogygroup/a91b7e28-4fda-4b79-...) as we scale our business to help more organizations make sense of messy and complex data.
by hsbauauvhabzb | 2025-10-06 05:27:25+00:00
A Torrent would probably suffocate under the small file distribution. I’m not sure how the romset torrents work but I thought they were versioned.

But torrent is probably the wrong tech. I’m sure there would be many players willing to host a few TB or more each, which could be fronted via something so it’s transparent to the user.

But a better option might be a subscription model, anything else will be slammed by crawlers.
by Swizec | 2025-10-06 05:28:29+00:00
> The odd thing is why it would output its own mistakes, instead of internally revising until it's actually satisfied.

Happens to me all the time. Sometimes in a fast-paced conversation you have to keep talking while you’re still figuring out what you’re trying to say. So you say something, realize it’s wrong, and correct yourself. Because if you think silently for too long, you lose your turn.
by FooBarWidget | 2025-10-06 05:30:57+00:00
The point is not "criticism of XYZ". The issue is asking questions to an LLM like a catholic priest interrogates a heathen. Bad faith questions are those that seek to confirm one's own worldview instead understanding another worldview. Bad faith attitudes are those that dismiss other worldviews completely and out of hand.

There’s also the issue that practically nobody actually uses LLMs to criticize political entity XYZ. Let's face it, the vast majority of use cases are somewhere else, yet a tiny minority is pretending like the LLM not giving them the responses they want for their political agenda is the only thing that matters. When it comes to censorship areas that matter to most use cases, many people have found that many Chinese LLMs do better than western LLMs simply because most use cases never touch Chinese political stuff. See thorough discussions by @levelsio and his followers on Twitter on this matter.
by worik | 2025-10-06 05:31:37+00:00
> It is very hard to understand how people who have been alive more than a couple of decades can believe that there is a system which can objectively determine everyone’s needs and capabilities.

What is the relevance of that comment?

Objectively measuring "everyone’s needs and capabilities" is unnecessary in most cases (excluding a "total war" economy, or at times of famine, when it becomes very important, albeit imperfect) and a more free market economy does a very poor job for some goods (e.g. housing)

Free markets work well if participants are free to come and go, and have adequate information. Then price discovery in a Free Market is quite a phenomena. But when people cannot leave a market (e.g. in a famine) or when information is distributed unevenly Free Markets lead to all sorts of terrible outcomes.

Capitalism, without intervention and redistribution by the state (or some other powerful agency - there can be others) leads to concentrations of wealth and impoverishment of many. This is because the second dollar is easier than the first, and that idea scales.
by southernplaces7 | 2025-10-06 05:31:42+00:00
This is a nation state in a state of perpetual tension, formal war and persistent attempts at sabotage by a notoriously paranoid and unscrupulous next-door enemy totalitarian/crime family state.

SK should have no shortage of motive or much trouble (it's an extremely wealthy country with a very well-funded, sophisticated government apparatus) implementing its own version of hardcore data security for backups.
by sparkie | 2025-10-06 05:32:49+00:00
Are we certain that it didn't exist though? Unicode only got emoji in 2014, after ~5 year standardization effort. There were many different, incompatible formats around for about a decade before that, plus non-emoji like Kaoani.

Perhaps there was a seahorse somewhere that never made it to Unicode.

Or maybe people are just misremembering - perhaps mistaking the emoji for a unicorn or a chess's knight piece as a seahorse.
by A4ET8a8uTh0_v2 | 2025-10-06 05:33:04+00:00
Friend. The truth is some people should not be in US. And now, after years of kicking a can down the road, we are in a painful process of rectifying this oversight. It is being confronted. I think your concern is that is not being confronted in the manner you find desirable.

That is fine, but at least be honest about it. Don't hide behind 'I am suddenly concerned about people breaking into my house at 3am'.