MurphyA/hacker-news huggingface dataset:
by minimaxir | 2025-10-21 00:14:11+00:00
There is a flaw with the base problem: each tweet only has one label, while a tweet is often about many different things and can't be delinated so cleanly. Here's an alternate approach that both allows for multiple labels and lower marginal costs (albeit higher initial cost) for each tweet classified.

1. Curate a large representative subsample of tweets.

2. Feed all of them to an LLM in a single call with the prompt along the lines of "generate N unique labels and their descriptions for the tweets provided". This bounds the problem space.

3. For each tweet, feed them to a LLM along with the prompt "Here are labels and their corresponding descriptions: classify this tweet with up to X of those labels". This creates a synthetic dataset for training.

4. Encode each tweet as a vector as normal.

5. Then train a bespoke small model (e.g. a MLP) using tweet embeddings as input to create a multilabel classification model, where the model predicts the probability for each label that it is the correct one.

The small MLP will be super fast and cost effectively nothing above what it takes to create the embedding. It saves time/cost from performing a vector search or even maintaining a live vector database.
by wakawaka28 | 2025-10-21 00:15:23+00:00
I'm not talking about the government itself lol. I mean the people and businesses in each state collectively, obviously. Even with the huge national debt and budget deficit, I think most states on net contribute more in taxes than they get back. That's the entire point of taxes, otherwise it would be called a gift or something instead. The federal government could not pay out more than it takes in indefinitely to the entire country without just running the printing press to pay the difference. That is what they do, in fact, but clearly they aren't printing everything they spend.
by president_zippy | 2025-10-21 00:15:41+00:00
I like to think I'm halfway decent at my job, and I wouldn't work there once. During undergrad, my landlord working for AMZN on the opposite end of the country offered me an interview, but it was during final exam week.

I asked if I could schedule the interview after my final exams, and his arrogance really showed when not only did he refuse, but then insisted my exams are not don't even register on the same scale of importance as the opportunity to work for Amazon.

Somewhat related: a recruiter at Google cold-called me a couple months into my first job out of undergrad back in 2016 and was similarly condescending about "the chance" to work for Google compared to everything else. I already had a low opinion of them when they gave my then-girlfriend an introductory O'Reilly book on Java after she failed their interview.

I regret being born too late to work somewhere like Bell Labs, SGI, or Sun. I had a ton of graybeard wizard coworkers from these places, and they were all a pleasure to learn from and even better friends. For the first 2 years of my first job, every day of work was like walking into the Shire and talking magic spells with 20 Gandalfs.

That job was great until I got put on a team with a guy who was a former middle manager at some IBM-like company and went from being surrounded by people lightyears ahead of me to being surrounded by Dilbert characters. The messed-up part was that it wasn't even punishment. I was rewarded after completing a project with my choice of which team I joined next, and I joined the wrong one. I assumed that joining a new team to utilize this newfangled "cloud computing" thing would be trailblazing, and I didn't do any diligence on who I would work with.

To this day, I still regret not rejoining the first team I worked for, otherwise I would still be at that company and happy about it. Then again, the boredom and discontent while being on that sucky team is the reason I started investing, and now I can buy a house in cash and fund myself to do whatever I want for at least a decade. Hard to complain about the way things turned out.
by Fade_Dance | 2025-10-21 00:15:46+00:00
>it’s going to end with an unpleasant surprise for many. Investors who bought the yellow metal as a hedge are going to find it was anything but, as gold falls along with AI stocks.

We already saw a hint of that last week, with gold and silver and miners selling off aggressively alongside risk assets.

It will be a while before the speculative risk-on aspect of the gold trade stops dominating the price action.
by pdt409231 | 2025-10-21 00:16:11+00:00
Bear in mind these people are very much pro-gun and believe the 2A is there to protect against the govt. If they had intended to violently overthrow the govt, it would have been very apparent. Yet not a single bullet was fired from the protestors. As you pointed out, the only ones doing the shooting was from the police towards the pro-trump people. That lady was unarmed, and was shot while climbing thru a window. (Considering this [1] was the standard for 'peaceful protests' at the time.) Hardly qualifies as self defense, and had this been any other situation the policeman would be stripped of his badge and jailed. But of course, Biden's DOJ declined to prosecute.

[1] https://www.reuters.com/resizer/v2/SNVVJFX2IVP2NLXEUPMJJMH2S...
by chaboud | 2025-10-21 00:16:49+00:00
I agree. It’s pretty easy to put-up or shut up.

I recently vibe coded a video analysis pipeline with some related arduino-driven machine control. It was work to prototype an experience on some 3D printed hardware I’ve been skunking out.

By describing the pipeline and filters clearly, I had the analysis system generating useful JSON in an hour or so, including machine control simulation, all while watching TV and answering emails/slacks. Notable misses were that the JSON fields were inconsistent, and the python venvs were inconsistent for the piped way that I wanted the system to operate with.

Small fixes.

Then I wired up the hardware, and the thing absolutely crapped itself, swapping libraries, trying major structural changes, and creating two whole new copies of the machine control host code (asking me each time along the way). This went on for more than three hours, with me debugging the mess for about 20 minutes before resorting to 1) ChatGPT, which didn’t help, followed by 2) a few minutes of good old fashioned googling on serial port behavior on Mac, which, with an old sitting on the shelf Uno R3, meant that I needed to use the cu.* ports instead of tty.*, something that Claude Code had buried deeply in a tangle of files.

Curious about the failure, I told Claude Code to stop being an idiot and use a web browser to go research the problem of specifically locking up on the open operation. 30 seconds later, and with some reflective swearing from Opus 4.1, which I appreciate, I had the code I should have had 3 hours prior (along with other garbage code to clean up).

For my areas of sensing, computer vision, machine learning, etc., these systems are amazingly helpful if the algorithms can be completely and clearly described (e.g., Kalman filter to IoU, box blur followed by subsampling followed by split exponential filtering, etc.).

Attempts to let the robots work complex pipelines out for themselves haven’t gone as well for me.
by tredre3 | 2025-10-21 00:17:17+00:00
If you're worried that this is going to prevent you from peeking and poking, I think you're mistaken. This is to protect a process against itself, not the outside. It will also likely be a single bit flip away of being unenforced at runtime, as most x86 protections already are to be to make debugging tools feasible.

By the way, there are already systems in place to prevent you from accessing certain memory zones. Yes, even on Linux, it's possible to make memory regions inaccessible even to root or the kernel itself. The time to be worried about that was 10 years ago.
by giobox | 2025-10-21 00:18:44+00:00
> I’ve seen some crazy stories on YouTube about people trading in cars they’re already underwater on just to finance an even more expensive one.

This has happened for as long as there has been car finance (i.e. practically since the dawn of private vehicle ownership), it's nothing new.

Given most folks cannot purchase a vehicle outright, the customer only really cares about the monthly payment, a sizeable amount of whom do not even understand the concept of being "underwater" on a trade in. The industry has always preyed upon the financial stupidity of most car buyers.
by Dig1t | 2025-10-21 00:19:00+00:00
To be honest I’ve been having the opposite experience. There are lots of cool niche playlists on YouTube that cater to specific ideas.

Like “40’s gangster jazz”, or “studying in the Hogwarts library”, etc

It’s the majority of what I listen to lately and it’s been pretty good.

On a related note, I was working with someone recently and he put on a jazz playlist he found on YouTube. We both enjoyed the music and neither of us realized it was AI until about halfway through the playlist.

I don’t think it’s a big deal that it’s AI, as long as you enjoy the music.
by Aaargh20318 | 2025-10-21 00:19:22+00:00
You may want to check if you have one of the app listed here[1] on your system.

Electron based apps cause a huge system wide lag on macOS 26 due to the use of a private macOS API[2]. This bug has been fixed in Electron but not all Electron-based apps have been updated yet.

[1] - https://avarayr.github.io/shamelectron/

[2] - https://github.com/electron/electron/issues/48311
by OneDeuxTriSeiGo | 2025-10-21 00:20:17+00:00
ARM has an extension called the "Memory Tagging Extension". It works by borrowing 4 bits per 16 byte block of memory to color the allocation. Pointers are given a color "key" inside the pointer during allocation and if that pointer's key isn't the right color as the underlying memory block's during deref, then the hardware throws an MTE segfault.

It's a neat system with pretty much no overhead and it's pretty easy to integrate into code as long as your underlying language and libraries are at least semi-intelligent about how they handle pointers and memory allocation (i.e. as long as you aren't doing any long range pointer punting then things "just work").

https://developer.arm.com/-/media/Arm%20Developer%20Communit...
by panic | 2025-10-21 00:20:46+00:00
Apple relies on internal feedback and executive reviews rather than user testing. They likely received a lot of different feedback internally, but the execs decided to ship it anyway. I think they would rather ship something half-baked than change the yearly release process that has been continuously operating since the early days of iOS, and at the scale of the whole platform, it's hard to turn back once you've committed to making the changes.
by potato3732842 | 2025-10-21 00:21:15+00:00
Some poor fucking secretary has to read all that shit so that their boss can be advised whether the application is compliant. It won't actually be analyzed unless those sections are sub-par at which point bickering over them becomes a lever the government can pull to extract more flesh. The applicant is forced to go back and say "well we'll hire a minority" or whatever to shore up that section.
by redwall_hp | 2025-10-21 00:21:42+00:00
My increasing fear is that EVs just have mechanics' eyes on them a lot less frequently, so preventative maintenance on brakes and the other mechanical parts doesn't get done. Which means, on a heavier vehicle as well, more risk of catastrophic failures during use and vehicles on the used market being junk.

A heavier vehicle also will wear tires faster, and my observation of other cars on the street is that people as a whole are very bad about not replacing tires on time.
by OutOfHere | 2025-10-21 00:21:50+00:00
Some people tolerate ibuprofen just fine. Some people tolerate it fine for decades, and then one day they don't.

It is easy to tell if ibuprofen is the cause of an ulcer or not. If it is, the ulcer pain will likely start after say 72 hours of taking ibuprofen. If a week goes by without such pain, then it's not a cause in that dose. In those vulnerable, a single dose can be enough to cause it if strong preventative measures aren't taken.

If your friend persistently has an unhealed ulcer, then it's worthwhile to get it healed asap before experimenting with ibuprofen. I have had it a few times, also healed it every time.
by alexfromapex | 2025-10-21 00:22:48+00:00
I think you are conflating relative meritocracy where the USA is better than some of the worst meritocracies from absolute meritocracy where IQ alone will help you succeed. There are tons of research articles (https://harvardlawreview.org/wp-content/uploads/2008/05/myth...) on the subject.

Some of the high IQ individuals are succeeding in USA but definitely not even close to all of them.
by tomvault | 2025-10-21 00:23:00+00:00
CEO at Ona (formerly Gitpod) here. Every ephemeral environment Ona creates can directly connect to your Desktop IDE for easy handoff. Our team goes from prompt -> iterating in conversation -> VS Code Web -> VS Code Desktop/Cursor depending on task complexity and quality of the agent output. We call this progressive engagement and have written about it here https://ona.com/docs/ona/best-practices#progressive-engageme...
by cogman10 | 2025-10-21 00:23:45+00:00
But wait, how do you know that's what this is?

The reason I'm negative is the entire article has zero detail on WTF this instruction set is or does. The best you can do is guess from the name of the instruction set.

Compare the linked iPhone article to this blog and you'll quickly see the difference. There's very real discussion in the MTE article of how the instructions work and what they do. This article just says "Memory safety is hard and we'll fix it with these new instructions that fix memory safety!"
by kingstnap | 2025-10-21 00:27:37+00:00
The YouTube demo is hilarious.

https://youtu.be/s-avRazvmLg?si=eQqY6w8kbxv3TFhQ

The dev just types in a prompt, scrolls down the bottom and makes a PR asking others to review without even looking at what they just did.

Lmao. Know their target market for sure.
by OneDeuxTriSeiGo | 2025-10-21 00:27:47+00:00
Memory coloring (what is to my knowledge being proposed) is certainly probabilistic however it really does a lot towards memory hardening more than memory safety. It makes successfully pulling off ROPs, etc far harder.

Even if you are using a memory safe language, memory bugs still pop up in various places (cough FFI & ABI cough) so this is a massive step in the right direction towards blocking attacks even when the developers have done "all the right things" short of formally verifying their stack from top to bottom (and even then).
by tredre3 | 2025-10-21 00:28:04+00:00
The video is definitely more interesting than 28 fps but it's also not really 2B fps.

It captures two billion pixels per second. Essentially he captures the same scene several times (presumably 921,600 times to form a full 720 picture), watching a single pixel at a time, and composite all the captures together for form frames.

I suppose that for entirely deterministic and repeatable scenes, where you also don't care too much about noise and if you have infinite time on your hands to capture 1ms of footage, then yes you can effectively visualize 2B frames per second! But not capture.
by torrmal | 2025-10-21 00:28:22+00:00
we have been trying to make it so that people dont have to reinvent the wheel, over and over and over again, and have a very straight forward all batteries included that can scale to many millions of documents, combining the best of RAG with traditional search and parametric search, https://docs.mindsdb.com/mindsdb_sql/knowledge_bases/overvie... Would love your feedback.
by yubblegum | 2025-10-21 00:28:45+00:00
> when there is news about experts saying something about technology, one would naturally think that they are at least somewhat technical experts.

But the experts here are not "saying something about technology". Rather they are saying something about uses of technology. So they don't need to be cloud engineers or know anything about datacenters, at all, really. What would be required (and here you may have a leg to stand on) is expertise in social and economic aspects of (now) critical infrastructure.
by oatsandsugar | 2025-10-21 00:29:07+00:00
Author here—this article was meant to highlight how you can optimize writes to CH with streams.

If you want to directly insert data into ClickHouse with MooseStack, we have a direct insert method that allows you to use ClickHouse's bulkload methods.

Here's the implementation: https://github.com/514-labs/moosestack/blob/43a2576de2e22743...

Documentation is here: https://docs.fiveonefour.com/moose/olap/insert-data#performa...

Would love to hear your thoughts on our direct insert implementation!
by fanf2 | 2025-10-21 00:29:14+00:00
At a quick skim this looks like they reinvented something very similar to phkmalloc, but they didn’t cite phkmalloc nor include it in their benchmarks.

https://phk.freebsd.dk/sagas/phkmalloc/

https://cgit.freebsd.org/src/tree/lib/libc/stdlib/malloc.c?h...
by JumpCrisscross | 2025-10-21 00:30:29+00:00
> If only there was a country selling cheap, reliable electric vehicles with extremely low running costs

The missing middle in discussions around Chinese EVs is import quotas (and disconnection mandates).

Americans buy over 15 million vehicles a year [1]. Letting China export up to 150,000 EVs into America a year, subject to anti-surveillance measures (e.g. no phoning home), paid for by the importer and thus--ultimately--consumer, would not bankrupt American producers. It would, however, show American consumers what they're missing out on while increasing competition in the American car market. Hell, it might even give some stateside auto engineers some good ideas.

[1] https://fred.stlouisfed.org/series/TOTALSA
by Retric | 2025-10-21 00:30:36+00:00
Think in terms of banks not borrowers.

Houses are a much better long term bet for buyers, but car depreciation is more predictable. Lend someone 500k to buy a house and during a recession it might tank in value by 20-40% while a bunch of people walk away. Worse the’ll likely pull out their equity before defaulting in mass.

Cars value on the other hand is more counter cyclical. When the economy is bad people still get into accidents etc but they now want to buy used cars instead of new ones. Even better it’s just less money being lent out at higher interest rates.
by nntwozz | 2025-10-21 00:30:36+00:00
You know it's a sad state we're in when this passes for news these days.

What's next? iOS 26.1 lets users control Liquid Glass color?

Woweeeee, what's up with designers like Ive and Alan Dye going off the deep end in their late careers?

I don't how much Craig Federighi has been involved but it's definitely tainted his reputation too I'm afraid.
by oatsandsugar | 2025-10-21 00:30:47+00:00
Author here: commented here about how you can use async inserts if that's your preferred ingest method (we recommend that for batch).

https://news.ycombinator.com/item?id=45651098

One of the reasons we streaming ingests is because we often modify the schema of the data in stream. Usually to conform w ClickHouse best practices that aren't adhered to in the source data (restrictive types, denormalization, default not nullable, etc).
by exasperaited | 2025-10-21 00:30:52+00:00
In case you aren’t familiar (and with apologies for my verbosity if you are): VSCode Remote can be best understood as a sort of hybrid of a local text editor and a remote web-based or X11 view of an editor for a remote session.

When you use a remote, the code is on the remote and all your editing functions (search, version control, terminal, extensions) happen in the remote via a worker process.

So in a remote session, everything is “local” to the remote. You may have no file “mount” of the thing at all on your host desktop machine. If you do a git commit, it’s running inside/on the remote. If you do a file search the files are searched on the remote, rather than downloading them over some network filesystem and searching locally.

The GP’s point is, I think: if you implemented Yaak as a VSCode extension, it could be made to function either in a local session or inside a remote (on a server accessed via SSH, a docker container, on the linux side of WSL etc.) and therefore have fast rather than slow access to the code, git repo etc.

I do essentially all my dev work (apart from compiling the odd mac app) inside remotes of various kinds to create reproducible environments, avoid cluttering the host, sandbox the tools, give me freedom to work from more than one machine etc., and I run into this sort of thing quite a bit.

There are at least two clients like this for VSCode —- Thunder Client and EchoAPI, and I believe both function in a remote session.

P.S. I loved Insomnia before the bad happened; it really helped with learning APIs. Thanks.
by ninetyninenine | 2025-10-21 00:31:36+00:00
You are missing the ground truth. Humanity does not understand how LLMs work. Every major lab and every serious researcher acknowledges this. What we have built is a machine that functions, but whose inner logic no one can explain.

References like Golden Gate Claude or the latest interpretability projects don’t change that. Those experiments are narrow glimpses into specific activation patterns or training interventions. They give us localized insight, not comprehension of the system as a whole. Knowing how to steer tone or reduce hallucinations does not mean we understand the underlying cognition any more than teaching a parrot new words means we understand language acquisition. These are incremental control levers, not windows into the actual mind of the model.

When we build something like an airplane, no single person understands the entire system, but in aggregate we do. Aerodynamicists, engineers, and computer scientists each master their part, and together their knowledge forms a complete whole. With LLMs, even that collective understanding does not exist. We cannot even fully describe the parts, because the “parts” are billions of distributed parameters interacting in nonlinear ways that no human can intuit or map. There is no subsystem diagram, no modular comprehension. The model’s behavior is not the sum of components we understand, it is the emergent product of relationships we cannot trace.

You said we “know” what is going on. That assumption is patently false. We can see the equations, we can run the training, we can measure activations, but those are shadows, not understanding. The model’s behavior emerges from interactions at a scale that exceeds human analysis.

This is the paradigm shift you have not grasped. For the first time, we are building minds that operate beyond the boundary of human comprehension. It is not a black box to laymen. It is a black box to mankind.

And I say this as someone who directly works on and builds LLMs. The experts who live inside this field understand this uncertainty. The laymen do not. That gap in awareness is exactly why conversations like this go in circles.
by DaveZale | 2025-10-21 00:31:37+00:00
hehe good question. But I believe that we are addicted to AI hopium at the moment. You know the drill, circular financing a la Enron, smartest guys in the room stuff. Your intuition will play out but there may be a delayed effect. Seriously I owned TSLA stock for many years. It was boring and frustrating, and I sold. So the Muffler Noise Index may be predictive of what happens years from now ;-)
by mat_epice | 2025-10-21 00:32:02+00:00
There are several other systems I would recommend before TernFS for your environment. If you're looking at Lustre versus this in particular, Lustre has been through the wringer, and ANL/DOE has plenty of people who understand it enough to run it well and fix it when it breaks.

However, you are right. Your bandwidth needs don't really require Lustre.