MurphyA/hacker-news huggingface dataset:
Show HN: I built a vector store from scratch (and you can too)
by novocayn | 2025-10-16 18:09:51+00:00
I wrote a hybrid vector store from scratch in Go. Supports hybrid retrieval over BM25, Flat, HNSW, IVF, PQ and IVFPQ Index with Quantization, Pre-Filtering, Reranking, Reciprocal Rank Fusion, Soft Deletes, Index Rebuilds and much much more.

It's called Comet. Built for hackers, not hyperscalers. It's tiny enough to fit in your head, and good enough to blow it :D

It packs everything you need to understand how modern vector databases work internally, from indexing to rank fusion, querying, and even persistence.

https://github.com/wizenheimer/comet

https://pkg.go.dev/github.com/wizenheimer/comet

Star it, fork it, break it, fix it — make it your own
by NickC25 | 2025-10-16 18:10:32+00:00
Just seeing this!

Re: shipping -yes that's where we're trying to get to. Right now going through traditional distributors is what we are doing because that helps us get retail footprint but one day, yes, we want to be D2C.

Re: siblings - oof, it's tough my man. Some days can be easy, others hard if not impossible. Not everyone gets to be as simpatico as the Collison brothers.

Re: ad concepts, yes absolutely - I'm more than happy to discuss. Did you have something specific in mind? What about costs?
by beyarkay | 2025-10-16 18:10:34+00:00
> With mixture of expert systems we’re introducing dedicated subsystems into the llm responsible for specific aspect of the llm

Common misconception, MoEs do have different "experts", but the model learns when to send input to different experts, and the model does not cleanly send coding tasks to the coding agent, physics tasks to the physics agent, etc. It's quite messy, and not nearly as intepretable as we'd want it to be.
by siglesias | 2025-10-16 18:11:49+00:00
@Kim_Bruning The point of the experiment is that there is some opaque boundary where the behavior is indistinguishable--that's the empirical stance of behaviorists, what goes on inside "doesn't matter." The empirical boundary of a husband and wife might be home life and time together. If you "pierce" the Chinese Room, you see a guy with an exotic setup. If you pierce a native speaker, you see a brain that electrochemical that has microtubules that collapse the wave function (or whatever), just like YOU have, and YOU know you understand (at least relative to English)...these are VERY different things even if they are, externally, yielding the same behavior. So yes, you could hire a private detective and so-on, but the whole point of the "empirically indistinguishable" is that it is empirically indistinguishable relative to some boundary (hence, room). If the Chinese Room was TRULY empirically indistinguishable, then inside it would be a human producing Chinese, not a non-native speaker and a program.

btw--if you'd like to keep the conversation going, email is on my personal webpage in my bio.
by mschuster91 | 2025-10-16 18:12:01+00:00
There are independent implementations of x86 at least in software - QEMU can do full emulation at the cost of it being dog slow, which is about the only choice for running fully x86 virtual machines on ARM - no aid from Rosetta for anything.

The problem is the hardware magics you need to make x86 actually performant, there's a lot of patents surrounding that area.
by uyzstvqs | 2025-10-16 18:12:01+00:00
That applies to AAA games, where you make awful games for awful companies. Being an indie dev is great, and you can make millions by yourself if your game gets popular.

Recent example: "Megabonk" was made by a solo indie dev in a few months. It has reportedly sold around 2 million copies at $10 in 1 month.
by satellite2 | 2025-10-16 18:12:52+00:00
At least if you don't encrypt and those are jpeg it doesn't matter. I lost two discs at once with theWD debacle a few years back and couldn't recover anything as I encrypted the disk. Another drive that got bad, I easily recovered 90% of the files using foremost.

So no encryption on the local backup for me, only the emails dump by encrypting the zip that contains them. It's not perfect but that's the compromise I (think I) have to make. (The remote one is encrypted though)
by kmeisthax | 2025-10-16 18:12:59+00:00
> given strict immigration controls

Why is this the case? I hear this come up time to time, but the only case in which the American working class actually is having their wages lowered by foreign competition is through global trade, which does not need to go through immigration control. In fact, if anything, making it harder for poor workers to move to rich countries guarantees that poor countries will always have a supply of underpriced manufacturing labor to do arbitrage on, and that's what actually happened since America switched from the pre-1970s "high tariffs and whites-only immigration" regime to the post-CRA, post-Reagan regime of "low tariffs and restrictive immigration unless you have family that can sponsor you".

You're entirely correct that the elites see us as cattle, but the whole point of immigration control is to keep your cattle in fences. The elites can always buy their way into a country - in fact, most countries have "immigrant investor programs" that make this an official, on the books thing that anyone with enough capital can do. So if you want to oppose the power of the elites, you need an immigration policy that benefits the people - i.e. one loose enough that the average person can move to another country as easily as one moves to another state.
by volkl48 | 2025-10-16 18:13:05+00:00
Were you actually visiting what Americans would consider a grocery store?

I'm not saying this is specifically the case for you, but it is remarkably common for visitors from other parts of the world to visit, go into what we consider a "convenience store", and then be confused that there's basically nothing in terms of actual groceries in there, with probably 80%+ of the "consumable" shelving devoted to snack/"junk" items.

Those stores are intended pretty much entirely for stuff people want while on the go, and the few "groceries" they stock are basically aimed at the kind of things a drunk/stoned person is craving at 3AM when nothing else is open (say, a frozen pizza), or the few things you might run out of by surprise in the morning/when about to eat and be willing to greatly overpay for being able to grab somewhere close by before your meal/schedule is ruined. (ex: milk, condiments, maybe eggs).
by arjie | 2025-10-16 18:13:23+00:00
It's pretty neat that they're adding these things. In my projects, I have a `bin/claude` subdirectory where I ask it to put scripts etc. that it builds. In the claude.md I then note that it should look there for tools. It does a pretty good job of this. To be honest, the thing I most need are context-management helpers like "start a claude with this set of MCPs, then that set, and so on". Instead right now I have separate subdirectories that I then treat as projects (which are supported as profiles in Claude) which I then launch a `claude` from. The advantage of the `bin/claude` in each of these things is that it functions as a longer-cycle learning thing. My Claude instantly knows how to analyze certain BigQuery datasets and where to find the credentials file and so on.

Filesystem as profile manager is not something I thought I'd be doing, but here we are.
by tracker1 | 2025-10-16 18:13:39+00:00
To me, that seems like a pretty reasonable approach... adding a password change at the end would probably be a good last add.

I tend to generate my passphrases for sites now, my only complaint is a password field should accept at least 100 characters. Assuming it's salted+hashed anyway, it's almost irresponsible to limit to under 20 characters. I'd rather see a minimum of 15 chars and a suggestion to use a "phrase or short sentence" in the hint/tip.

I wrote an auth system and integrated the zxcvbn strength check and HIBP as default enabled options. The password entry allowed for up to 1kb input, mostly as a practical limit. I also tend to prefer having auth separated from the apps, in that if auth fails via DDoS, etc, then already authenticated users aren't interrupted.
by the_panopticon | 2025-10-16 18:13:43+00:00
This is great to see. Google has role-modeled open source hardware/silicon with efforts like https://opentitan.org/ and https://developers.google.com/silicon in the past, too. I wonder how this AI Coral NPU IP will differ from Nvidia's NVDLA https://nvdla.org/ effort with the ecosystem?
by bitpush | 2025-10-16 18:13:53+00:00
> everyone involved if they went to get their food

Remember, food ingredients and people move around in large multi-ton vehicles as well. If you think people going from A-B is OK, then food going from B-A should be similarly OK.

Infact, once you can pool together food, then the equation flips and favors food moving from B-A, rather than many people taking different paths from A-B
by buildbot | 2025-10-16 18:14:23+00:00
"So I fired up a fresh Claude instance (fun fact: Code Interpreter also works in the Claude iOS app now, which it didn't when they first launched) and prompted:

Create a zip file of everything in your /mnt/skills folder"

It's a fun, terrifying world that this kind of "hack" to exfiltrate data is possible! I hope it does not have full filesystem/bin access, lol. Can it SSH?...
by tredre3 | 2025-10-16 18:14:31+00:00
> This is distinctly not a superpower c++ has and why the complexity

I guess you don't have that much experience with actual C++ development? Because there's a plethora of static analysis tools and any serious IDE come with refactoring tools on top of that, both assistive and automated, that will suggest fixes as you type. Rust didn't invent anything with clippy, however good the tool might be...
by Spoom | 2025-10-16 18:14:33+00:00
To be fair, a handful of large companies have explicitly said[1][2] that their layoffs were largely about individual performance. All my experience as a manager in a large tech company says that that's almost certainly not the whole story, and unfair to many of the folks getting let go, but official word from the companies say otherwise.

1. https://www.cnbc.com/2025/01/14/meta-targeting-lowest-perfor...

2. https://www.cnbc.com/2025/01/08/microsoft-confirms-performan...
by miloignis | 2025-10-16 18:14:35+00:00
For me, the key problem being solved here is to have reasonably trustworthy web implementations of end-to-end-encrypted (E2EE) messaging.

The classic problem with E2EE messaging on the web is that the point of E2EE is that you don't have to trust the server not to read your messages, but if you're using a web client you have to trust the server to serve you JS that won't just send the plain text of your messages to the admin.

The properties of the web really exacerbate this problem, as you can serve every visitor to your site a different version of the app based on their IP, geolocation, tracking cookies, whatever. (Whereas with a mobile app everyone gets the same version you submitted to the app store).

With this proposed system, we could actually have really trustworthy E2EE messaging apps on the web, which would be huge.

(BTW, I do think E2EE web apps still have their place currently, if you trust the server to not be malicious (say, you or a trusted friend runs it), and you're protecting from accidental disclosure)
by stared | 2025-10-16 18:15:11+00:00
Depends on the task, our tastes, and our workflow. In my case:

For writing and editorial work, I use Gemini 2.5 Pro (Sonnet seems simply worse, while GPT5 too opinionated).

For coding, Sonnet 4.5 (usually).

For brainstorming and background checks, GPT5 via ChatGPT.

For data extraction, GPT5. (Seems to be the best at this "needle in a haystack".)
by xutopia | 2025-10-16 18:15:27+00:00
In the local Rails community where I live we haven't used Heroku for a while now. Most of us have moved on to using Kamal with a VPS of our choice. The surprising benefit is that you can even host multiple rails app on a single VPS so it is ideal for playing around with multiple hosted apps.

As for raw performance I'm sure you'd get better deal with Elixir out of the box than Rails out of the box but if you wanted to keep all the benefits of Rails and scale websocket usage look into AnyCable.
by mediaman | 2025-10-16 18:15:28+00:00
We're going in the opposite direction.

High minimum wages are making it nearly impossible to run small restaurants. We're seeing restaurant apocalypse happening in places like Seattle and Denver, because high wages result in high prices which causes lower customer volume which causes higher fixed costs per unit, which causes a death spiral. Denver, for example, has 30% fewer restaurants now, because it's so hard to run one profitably.

Lots of little tasty restaurants and high wages for service staff are basically incompatible. Many people in the city don't realize this and advocate for both.

Of course, high wages are desirable if they can be accomplished without tradeoffs, but the tradeoffs are there.

High minimum wages favor high-volume, fast service chain restaurants that are more labor efficient.

Perhaps eventually automation will relax this tradeoff, but I would expect automation to primarily benefit corporate restaurant chains over small local eateries, unless the automation is so general that any restaurant can start using it without technical expertise or R&D.
by tomck | 2025-10-16 18:16:03+00:00
I have tried a model on my laptop+GPU before, and it is incredibly unusable. Incredibly slow and just bad output for exactly the work you describe

If you're looking for a cheap practical tool + don't care if it's not local, deepseek's non-reasoning model via openrouter is the most cost efficient by far for the work you describe.

I put 10 dollars in my account about 6 months ago and still haven't gotten through it, after heavy use semi regularly.
by dllthomas | 2025-10-16 18:16:30+00:00
For some monads the "wrap" gets awfully metaphorical (for State it's a function that produces the value and updated state, for Const there is no value, etc) but I don't think that's actually a problem, just a thing to be aware of. There is certainly no expectation that you can actually get your hands on the thing.

A bigger issue is that you're missing a piece. If you can "wrap" values and "wrap" functions such that they operate on wrapped values, you (probably) have a functor. To be a monad you also need to have the ability to turn multiple layers of wrapping into one layer of wrapping. For lists, that's "flatten".

I said "probably" above because there are rules these pieces need to follow to behave well. They're pretty simple but I don't think we need to dig into them at this level of discussion.
by erichocean | 2025-10-16 18:17:07+00:00
I use GPro 2.5 exclusively for coding anything difficult, and Claude Opus otherwise.

Between the two, 100% of my code is written by AI now, and has been since early July. Total gamechanger vs. earlier models, which weren't usable for the kind of code I write at all.

I do NOT use either as an "agent." I don't vibe code. (I've tried Claude Code, but it was terrible compared to what I get out of GPro 2.5.)
by jandrese | 2025-10-16 18:17:47+00:00
We used to have several companies in the US that mined and refined the materials. They shut down because they couldn't compete with China, but if supply became constrained over a long period of time they could restart operations.

It's one reason the Chinese threats of cutting off rare earths is not quite as scary as the media makes it out to be. They can't do it for too long before alternatives get spun up and they lose their leverage entirely.
by morshu9001 | 2025-10-16 18:18:12+00:00
I get how even for multithreaded workloads, having a few fast cores is often better than the equivalent many slow cores. Or NUMA. There can be value in a test like 8 threads full load regardless of how many cores there are. But Geekbench 6 isn't that either, at least according to the chart showing sharply diminishing returns after 2 cores.
by lesuorac | 2025-10-16 18:18:30+00:00
> 1. Browser fingerprinting or ip bans. They used advanced fingerprint-shifting browsers and residential proxy ips.

Don't you typically use that for valid users? As-in, you allow access when the fingerpint matches their existing fingerprint and when it doesn't you require additional information to be presented (i.e. security code).

So if somebody shifts their ip around they end up needing more information than just user+pass to login but somebody that doesn't (i.e. a normal person at home) does have the easy way to login.
by talkingtab | 2025-10-16 18:18:40+00:00
People in the US are so trained by the food industry, that they do not know what good food is. Yogurt for example. Here is an experiment you can do at home if you want to disbelieve my statement.

Step #1 Make good yogurt and eat it.

1. Go buy a quart of milk, full fat. 2. Buy some yogurt culture. Bulgarian preferred. 3. Follow the directions. You need to keep the temp at around 110F, warm water bath, heating pad, hot water bottles, put it in a cooler, whatever.

This is one of the best foods there is.

Step 2. Go to your grocery store or stores and try to find some yogurt that is as good.

You can repeat these steps for other foods. Coffee - roast your own. Cheese. Just go to a gourmet cheese store. Get something that does not come in a plastic bag.

Or go to Europe and try real croissants. Everyone in Paris can get real croissants almost anywhere every day. And not to mention real bread - again the plastic bag.

We are so used to what is available here that we have come believe it is "food" when really it is just adulterated to have a long shelf life. Sorry, but really just try it.
by EthanHeilman | 2025-10-16 18:18:47+00:00
LD_PRELOAD is so useful for non-malicious stuff that I hope it doesn't get a reputation as a bad thing to find on your system. That being said, I agree with you and also disagree.

From a defenders perspective, you have lost if an attacker has root access on your system. You are right. Consider instead the attackers perspective.

To an attacker compromising and system and gaining root is just the first step of a many step process. One of the hardest steps is modifying the system to silently collect and exfil secrets and data that is valuable to you. Let's say you want encryption keys and only keys, how do you get them? For the sake of example say they are stored on the file system and you want to exfil them as they rotated weekly. Do you write a program with a cron job that checks once per day and uploads them? What if three months later they switch from rotating their keys once a week to once every two hours?

1. How long does it take you to notice your missing most of the keys and what is the cost of this failure?

2. Once you notice you aren't getting all the keys, you need to figure out why. This can take time and money. Do you access the compromised machines again? What if you can't get back into the machine again to figure what happened?

3. Once you figure out why, you need to deploy a patch to your exfil kit. This again costs time and money. What if you didn't test it properly and it breaks the compromised host and exposes your entire operation? You might have to push this one to thousands of compromised machines.

Instead, use LD_PRELOAD to hook filesystem writes, pattern match the key format on and exfil the keys as they are written. Since the hook is environment variable based, it can survive changes to the targeted program. Granted there are other approaches as well, but LD_PRELOAD is simple, powerful, flexible and often used for non-malicious things so it doesn't immediately trigger alarm bells.
by stetrain | 2025-10-16 18:18:55+00:00
The delivery option is more convenient and takes less time out of your day than driving to a restaurant. My suspicion is that most frequent delivery app users are ordering food more frequently and from further away than they would drive to if the delivery apps were not an option.

In a similar vein, widespread full-autonomous driving cars will likely lead to more people taking longer commutes by commoditizing the cost of a ride and freeing up the time that would otherwise be spent driving.
by Isamu | 2025-10-16 18:19:29+00:00
The observation that other CA can be equivalent is a weak critique at best, this CA may be a nice compact way of describing types of CA that have interesting properties. It is not terribly interesting that it may be subsumed by some other CA. It may be some interesting unstudied subset.

For instance the Game of Life is a subset of 2-d binary state CA, the rule only takes the totals of neighboring cells, and so is a subset of those CAs with rules that care about specific patterns of neighbors.
by michaelrbock | 2025-10-16 18:19:31+00:00
We tested models with knowledge cutoffs in 2025 so expect them to have knowledge of Tax Year 2024 forms in their weights. We also tested models with ability to do web search to get any other forms it thinks necessary: https://github.com/column-tax/tax-calc-bench

That all being said, we agree, which is what we've built with our internal tax coding agent, Iris: https://www.columntax.com/blog/introducing-iris-our-ai-tax-d... (ability to get just the right Tax form context on a per-line basis to turn the tax law into code).
by ruralfam | 2025-10-16 18:19:34+00:00
Not sure this is a good post, but might be so taking the risk. I am snacking right now on some UPF - my 10% vice. However, my 90% is pretty good. One NOT-UPF staple is steel cut oats that are slow cooked. Very easy, healthy and likely as NOT-UPF as you can get. Recipie: 3 cups steel cut oats (I use Bob's Red Mill Organic), 1+ Qt water, 1 Qt Skim Milk, 1+ Teaspon salt. Combine everything into a suitable pot. Slow cook at 150F for six hours. Stir occasionally. Explore ways to eat. E.g. warm in microwave with some blueberries, and a bit of brown sugar. Stores in the Fridge for a long time. HTH, NSC (+ means "a bit more than")
by fvgvkujdfbllo | 2025-10-16 18:20:22+00:00
You can’t always select the bottom 20%. Sometimes, whole teams or departments are eliminated. Employees are simply a number with cost and only thing matters is cost. They almost never look at individual performance or productivity.

If your manager or director is not getting laid off with you and you have a good relationship with them, then they might fight to keep you.
by xp84 | 2025-10-16 18:20:28+00:00
Isn't that one of the main points of React and its ilk? The state is just a big JSON object, and sometimes you might be fetching a bunch of data that makes up that state, and streaming it in. If latency is high and volume of data is high, seems perfectly reasonable to get the UI rendering as the state comes in instead of waiting for the last byte to do anything.

For instance, imagine you don't fully control the backend to split up a large response into several smaller API calls, but you could render the top part of the UI, which may be the most useful part, from the first couple of keys in the JSON, while a large "transaction history" after that is still downloading.
by watwut | 2025-10-16 18:20:59+00:00
They are let go. Frequently who gets fired geta decided from top or by consultants that dont know anything about people.

They you have firings of whole sections.

Aaaand people with highest salaries are let go to save more movey. Some of them are actually high performers.

And then you have layoffs by managers who decides who stays based on printed code people presented ...
by supportengineer | 2025-10-16 18:21:08+00:00
Heh, in Mountain View you also have these choices:

- La Plaza Market

- 99 Ranch

- Grocery Outlet

- Rose Market

- Nob Hill

- Lucky

- Smart & Final

- Walmart

- Target

- India Cash & Carry

- Bharat Bazar

I'm probably leaving out a ton.