skysight-inc/HackerNews huggingface dataset:
Show HN: Chromem-go – Embeddable vector database for Go
Hey HN!

When I wanted to build a RAG app in Go end of last year, I was surprised about the lack of options for a simple, embeddable DB.

- Pinecone is proprietary / hosted ony, Qdrant and Milvus not embeddable, Chroma only embeddable in Python and Weaviate only embeddable in Python or TS/JS.

- SQLite with the sqlite-vss extension and DuckDB can only be used from Go with CGO. Same for the C++ libraries Faiss, Annoy and USearch.

- Some of the LangChain-style Go libraries have a rudimentary implementation, but either lacking persistence, aren't performance optimized or just generally bring a ton of dependencies due to their nature of being an orchestration library and trying to support all kinds of LLMs and third party vector stores etc.

This lead me to create chromem-go, which initially took inspiration from the simple Chroma interface, but now deviating more from it:

- Embeddable in Go. No need for running a separate server. (A.k.a. in-process)

- Zero dependencies on third party libraries

- Multi-threaded processing for adding and querying documents. After some performance optimizations in v0.5.0, a query on 100.000 documents runs in 40 ms on a 1st gen Framework Laptop (see benchmarks)

- The DB can optionally create embeddings and offers convenience implementations for common providers (OpenAI, Cohere, Mistral, Jina, mixedbread, but also local Ollama and LocalAI)

- Similarity search is exhaustive via cosine similarity. As mentioned above that's quick enough for 100k documents and probably more. HNSW or IVFFlat start to make sense when scaling to millions of documents, where you likely go with a client-server solution anyway.

- Optional persistence, either per document, or a DB export/import with optional gzip compression and AES-GCM encryption

The repo contains examples for semantic search over arXiv abstracts, as well as a simple RAG app for Wikipedia entries using the models "nomic-embed-text" and "gemma:2b" locally in Ollama [1].

I'm using the project at work for demoing a simple locally running semantic search over our company Jira and hopefully more soon.

I think and hope it can be useful for some of you as well. Like the LLocalSearch "Perplexity clone" that was posted two days ago [2], which has a Go backend and probably doesn't need a Chroma instance running (as embeddings are created on the fly for search results and not in advance on a million documents).

Shoutout to HN user @eliben whose blog post [3] motivated me to create the project.

[1] https://github.com/philippgille/chromem-go/tree/v0.5.0/examp...

[2] https://news.ycombinator.com/item?id=39923404

[3] https://eli.thegreenplace.net/2023/retrieval-augmented-gener...
Avoid syndicated content

Actual article: https://www.reuters.com/technology/new-york-city-defends-ai-...
Group Chat Theory as an operating model for change.
That is the way, but the UX is pretty ass because the lock ID is a 64 bit number instead of a string. How the heck are you supposed to keep track of what lock ID you should be checking in a given situation across multiple client apps?
I fully ditched Outlook because of this crap. Been using eM Client (emclient.com) for a few months now and love it.
CableLabs.com, the creators of the DOCSIS standard for cable modems are part of an industry wide push towards 10G internet for ISPs. According to Neilsen's law, we should see 10G internet become more common than 1G internet is today within 10 years.

https://www.cablelabs.com/10g
https://www.nngroup.com/articles/law-of-bandwidth/
> There exists no mail client that is as full featured as outlook

Possibly. It may also be the most feature-bloated unintuitive UI. Using Linux myself, but always astounded when helping my non-technical mother with the latest murky weirdness thrown at her by Outlook. Some people just need simple mail facilities, not a Rube Goldberg 'ribbonware' cube. And on Windows maybe most people want easy & simple.
It's not exactly string-based as it accepts bigint key, but I guess it's possible to hash a string when you pass it to the function.
To be fair, "less than 2 drinks a day" covers any range below the upper limit of 2 a day, and hence also includes what you consider light drinking in your culture.

I suppose that the root of the matter is whether or not the range '>0 to <2 drinks a day' on average is too broad and may be hiding a significant difference of outcomes between the top of the range at 2 a day and the (non-abstinents) at the bottom who drink an average of, say, 2 drinks a week.

And that's not even going into regularity. I'm sure that 2 drinks a day on the regular has different health impacts and social implications than 14 drinks a night only on Fridays.
I and my ex had to provide ADN samples to justify that her baby wasn't mine. We had lived separately for nearly 2 years, but the baby was born before our divorce was official, hence without a father's name government was saying it was mine. Both of us were agreeing to the judge it wasn't mine, but she didn't want to reveal the real name of the father, because it was an abusive person.

As much as I dreamed to have an afro haircut as a kid, the baby was obviously not mine with darker skin, dark frizzy hairs typical of black people while I and my ex are both whites and blonds.
The "new" outlook is a disgrace. Using it to access a third party email provider results in Microsoft transferring your credentials to their server so the server can sync all your emails... for reasons, of course.
Whats grammar support?
According to my mother I was a rather happy kid and smiled to everyone before getting into school. She taught us reading, writing, drawing and some numbers before getting into it.

They promoted me to the following grade after 15 days because as soon as the teacher asked something I already knew the answer. But in the following two years something happened and I changed completely.

The thing is that I can't recall almost anything previous to that point. My mother signed me to music lessons in hopes to revert my shyness and stuff but little changed.

Until in a conversation with an aunt my sister made me remember - I was seriously bullied in those first couple years of school, apparently because of being "smart" and my accent. Like there was some kids that hitted me so hard sometimes I couldn't even sleep because of the pain in my legs. The dance teacher bullied me too, screaming things at my ear and ashaming me in front of the whole class because I sucked at dancing (and I got an absurd abversion to it, in fact never learned to dance). Even the principal made fun of my mother because she asked them to do something about it but apparently rubbed it as something without importance so my mother took matter in her own hands, but that's another story.

Even at university I had to endure some bullying too because I grew to be kind of awkward and introvert and shy. But I just didn't remembered why I am like that - for all those years I thought that I was born like that - still feels like it's too late to do changes but at least I can understand myself.
I work with news data professionally, and have found two broad categories of suppliers: the buyers and the scrapers.

Buyers are often a bit old school and frankly far more expensive than it's worth. Also good luck getting a usable, affordable API. I'm looking here at people like Meltwater, LexisNexus etc., who have licencing agreements with publishers.

Then there are the scrapers. The one I use is newsapi.ai, and I can broadly recommend them. They've got a decent selection, are happy to add stuff for you, and have lots of nice goodies baked in (e.g, NERD).

Most of the other ones you'll find with a cursory "news api" search also fall into this category AFAICT, but few, if any provide full text, which is what I need.

From conversations I've had with my supplier, I believe they've got a scrapy box running somewhere pulling largely off RSS feeds. I wouldn't want their job to be honest, so much to look after.

This approach is fine for some needs, but you can literally see the gaps in the time series where something has fallen over.

I'm very interested in this space and would love to hear other's experiences.
It looks very similar if not identical to OpenAI?
In the US, credit, a private system, is used for everything. If you know how to use it, though, you can get things you'd never be able to afford, be allowed memberships to clubs and organizations, or even hold jobs that others with lesser credit are deemed unfit for.

I've been the victim of identity theft eight times since the Equifax breach, and at some point, I felt like I was just feeding cats to coyotes [0] and stopped fixing it. Unsurprisingly, it stopped. Why spend the effort maintaining excellent credit and not getting credit for it?

The only thing people used my credit to do in all cases except the last was open retail credit cards and max them out at baby clothes stores and lingerie shops. You couldn't believe the trouble I was in when those first bills came.

[0] https://www.reddit.com/media?url=https%3A%2F%2Fpreview.redd....
Well I wouldn't be defending books if I didn't like them :)

I need to keep Goodreads updated though, I've been losing the habit over the last years, because lately none of my choices come from Goodreads recommendations, but I love being able to see all I read. Thanks for the reminder!

I don't think it's weird to acknowledge people have different preferences though, I don't like running marathons but I can see how people who run them would appreciate the benefits it brings them in health and discipline! I think there's maturity in acknowledging the things you think are right for you might not be right for everyone, but still be comfortable sharing your preferences in case others see value in them. I don't see it as looking down on others which you seem to imply I'm doing.
If you configure any IMAP account in Outlook, it will store your password and cache mail data in Azure.
>Just like crypto, AI has recently seen a seismic grift shift

Also seems to miss the fact that crypto was grifty from near the start. I don't think it's quite as bad now as it was in the 2017 ICO boom.
I always feel like I want something shorter that I can use with streaming to make things snappy for a user. Starting with speech output.
On Mac You can still use the old Outlook. You have to switch back everytime there is an update but it's very easy.
The new one is awful because it does not have tabular list view, with sortable columns such as: datetime, from, to, cc, etc which are critical for me.
Also posted ten hours ago, at a pessimal time of day here in Europe, so let's give it another chance.
[dupe]

Actual article from January

Outlook is Microsoft's new data collection service

https://news.ycombinator.com/item?id=38953618
The fear is that we will be impacted. E.g. Whatsapp is required to meaningfully engage with many social activities and communities in Europe. If Whatsapp decides to switch entirely to an alternative app store, I have no choice but to follow. And as a result, I'm no longer protected by the Apple app store's security measures (feeble as they may be.)
Interesting Airbus omitted it from their report, Yeti sure appears to be a commercial airline:
https://www.airbus.com/en/newsroom/stories/2024-03-2023-a-ye...
the intellitone pro 200 looks promising, any experience with it?
"Look what a competitive market made me do."
Looks at notes:
"Increase the payment of my employees."
I absolutely do. Now let's see that random Python program handle 1M connected players each sending and receiving 1384 byte UDP packets at 244HZ, while also running game logic and simulation in the background.
Anthropic's Claude Opus is king of the LLM these days. Personally, I closed my ChatGPT Team account down the day I tried Opus.
But are LLMs really better at algorithm writing than you? I’ve found that they work best when I’ve already pseudocoded the algorithm.
Why don't you keep a text file with the 3 commands you want to regularly run in the ffmpeg directory? fast. easy. cheap.
> CrystalDiskInfo[1] can be used for this purpose over on Windows

Only if you need a fancy GUI or guide some non-tech person to read the values to you over the phone/IM.

Otherwise just use win32 port of smartmontools.
Path matching, as the other comments say, but also if you have a corner, at >Ghz frequencies it will emit RF.
That's what exactly what I did a fairly basic distributed cron and it worked fine.
Running, protecting and supporting these shadow libraries is one of the biggest service to contemporary's humankind's written culture that can be done nowadays. Sometimes the discussion is just on "copyright" and "for knowledge to be free", but some older material is actually realistically impossible or extremely hard/time consuming to find out of these shadow libraries. Money is not the only problem that makes certain material inaccessible. Having these places shut down and their material disappear by copyright predator firms would be catastrophic in a way that has probably not happened since events like the burning of the library of Alexandria. The current state of AI just makes it even more important.
Here's the only reason you need to avoid Anthropic entirely, as well as OpenAI, Microsoft, and Google who all have similar customer noncompetes:

> You may not access or use the Services in the following ways:

> ● To develop any products or services that supplant or compete with our Services, including to develop or train any artificial intelligence or machine learning algorithms or models

There is only one viable option in the whole AI industry right now:

Mistral
It's so satisfying to watch. Creating a musical instrument is akin to creating a work of art.
I don't have an axe to grind against cars. I'm usually commenting in defense of cars. However, improving the driving tests could improve safety. Most crashes are the result of poor judgement or a lack of understanding the rules.

"Personal experience aren't stereotypes."

How do you think stereotypes start? It's personal experience coupled with group think. A perfect example is how people think nice sunny days are safer for driving. Yet in reality they are risky because people pay less attention and drive faster than in the rain. So yes, there are common stereotypes of the safety of various conditions.
[dupe]

More discussion: https://news.ycombinator.com/item?id=38953618
I really like Mutt.

Vivaldi’s mail client isn’t bad.

I think Evolution is okay.
Most schools have entire departments of IT people with Director level people that have job responsibilities to do what you describe. If it is a US public school they are probably restricted in dealing with specific vendors and/or a formal RFP process. Also you're dealing with the state/local government essentially with US public schools so be prepared for a lengthy process, background checks inclusive of checking the background/validity of your company as well as any people. That is even if the school would consider outsourcing this, again they have staff that do this work and support it.

If you feel that compelled to help your local school(s), a donation would be much easier logistically.
probably because the documentation (of which there's a lot) is very good.
Qdrant lib project https://github.com/tyrchen/qdrant-lib, Qdrant SDK has also support for local mode, which means embeddable https://github.com/qdrant/qdrant-client
Or just use FAISS https://github.com/facebookresearch/faiss
Curation serves a purpose, Google is one, there are more

We want competition and options in this space. It's one of the things I really like about Bluesky, which I only discovered recently. They enable competition and options for all core components of social media
Alternative name: BackdoorOS
Currently this is a moral issue not a legal one - the users consented to Facebook snooping (capturing analytics) when they accepted the privacy policy and terms of service when they installed the VPN and root certificates.
Let’s do a test. Write a hello world application and make a subscription for it for $1/mo. Publish it in git and offer it on the web, Windows, iOS and Android.

Beyond your time investment, which platforms costs more than $0?
Do you think C has a better syntax compared to Rust? I'm honestly not sure about this. It surely heavily depends on your preferences, though. Generally speaking, what do you think?
I cannot disagree more. This hypothesis is extremely dangerous to people suffering and on the brink.

Trigger warning for violence to children. I'm an adult who has suffered immensely from anxiety. It was hard to make it through my 20s alive. I recently remembered several traumatic incidents from my childhood that I'd completely forgotten (I grew up in a really violent area: middle school crush almost kidnapped in front of me, gay friend taken to "pray away the gay" and never coming back, friend held up at gunpoint, was personally mugged, sexually assaulted, and almost kidnapped, all before the age of 17 when I moved out on my own). Let me tell you that "closing the stress loop" on those events was _extremely_ important for my ability to move on. Before, when I could not remember the events, it was a struggle to get through life at all. One day I had a specific nightmare, and the memories came rushing back. I confirmed with my family these had happened, so it's not my imagination.

For the last two years I've used CBT, talk therapy, and journaling to process that trauma and resolve those issues. It's been a lot of remembering them, talking them through, and just what is called "closing the stress loop". I've read books about PTSD, I've talked to people about it. I've cried, yelled, gone for long runs, and had long walks in the woods. And now for the first time in my adult life I'm not feeling that crushing sense of impending doom. Sure, it still comes back sometimes, but generally it is "resolved". Sometimes I feel a stab of pain about it, but then I feel sad, process the feelings, and move on.

Perhaps for you and your trauma, moving on without processing it is the right choice, but for me it absolutely was not. If you'd asked me in my twenties and early thirties, I would've have said "no thanks, talk therapy is dumb". I'd tried it a few times with bad providers who just drugged me up but things didn't improve. Meanwhile I had A Plan that I considered several times an hour, was spending at least a hour a day crying without knowing why, and was a functioning alcoholic. I'd tried some talk therapy, and it wasn't until I found a CBT therapist at a research program who takes outcomes extremely seriously that I felt like I was getting measurable improvement.

I'll leave it with: there's a huge difference between ruminating and processing trauma. The dose makes the poison. Just like there's a difference between binge drinking a bottle of jack every night and 100ml of wine with dinner once a week. (Although I'm completely sober from alcohol now, good riddance).
The relevant part is that they moved from another city to Munich, which means that certain company taxes would be paid in Munich instead of Unterschleißheim (the city where the HQ was located previously).
This means a increase of tax revenue for the city of Munich of tens of MEUR/yr from this tax alone, without even considering secondary effects.

The small physical distance just means that this would be quite cheap for Microsoft to implement, compared to trying to pull the same stunt with another city.
Love your approach! Can't wait to try this out.
also a non us founder, any thoughts on brex / mercury?
Looks like the way to heaven
> I hope they can create some good

You mean backdoors? Don't forget these are not optional in China
You don't need to give money to a cop to make that happen. People that have no money are an easy target for any kind of abuse, including from cops. They have no lobby. No media outrage if a poor person is falsely imprisoned. No lawyers coming to hound you. The person may even not be in a state alert enough to understand what's going on.

A wealthy person has favors to call in, lawyers on call, all the things that entirely legally make a cops live hard.

So now, you're a cop and under pressure to arrest someone in a case. Homeless or mansion owner, who do you pick?
only "The Bat" !
The economics of American lotteries
Most “apps” are wrappers around web pages though, or written in cross-platform technologies, making them not really apps.
That's very anti-enlightenment values of you. Do you think everything is better handled by committee or just capital allocation?
They must have been jealous of Alphabet’s profits.

Honestly, they need to change or they’ll lose the market. Apple has grown quickly, and Linux is actually seeing decent growth thanks to SteamDeck. There’s also been Chromebooks, but I don’t know how common those really are.
Because the new outlook is literally the https://outlook.live.com/ website.
demo https://www.lepton.ai/playground/chat?model=jetmoe-8b-chat

Just had a quick chat about kubernetes, very simple discussion. It held well
If you're risking jail time to distribute as much of the written word as possible, you're going to include AI-generated stuff as well. Because the alternative is to waste time checking every single book.

LibGen already has plenty of garbage: books that were already garbage when they were written, blurry or truncated scans, OCRed text in the wrong script without the original scans etc. etc.

If someone hacks Google Books and downloads the entire collection, are they going to laboriously filter out the AI garbage? No. Just throw it on the Pile.
that seems even more perverse than the potential productivity land-use tax that georgists usually suggest.
Comparing a marathon with walking your dog is clearly implying a negative or lesser perception of the "walking your dog" activity. That is not a neutral statement of preference.

If you intended for it to be a neutral comparison about preference I would have gone with something like triathlons, sprinting, athletics, etc.
You don't need a loopback decoder for that. The periodic extraction will depend on a filter, and you can just clone and send the output of that filter to the tiling filter.
Paul Graham on X: "I always prefer ordinary voice calls to Zoom calls
Using Poetry for Python dependency management
I assume "free email" refers to Outlook.com email service. It contains ads and probably some level of data sharing. However this article is mostly about the Outlook desktop email client -- in theory you could use this email client without actually using Microsoft's email service (i.e. only used with Gmail etc), although difficult with Windows 11 Home edition.
If you can't disconnect all of them, then disconnect the one you want to find and look in the end which one isn't carrying current. So you somehow need access to start and end of the cables. Or you need a professional equipment with (inductive) tone generator.

Or, if you have access to the end of the cable in question, you can try to connect it to a pulsed current source (on off on off) and at the start simply check with a tester which one has on off on off..

Similar possibly is it to switch on off load in the end (like having pair of 2k W hair dryers) .. then in the start it's possible to measure the amperes with a Amperemeter or something with volt that should also change a little bit rhythmically?

Indirectly measuring the energy consumption (inductively) :)

Modulation of a signal on top a current, nahhh I don't know. To dangerous. Ask a professional, may be? Make your work be magically someone else' problem hahaha
How does a software engineer get into this line of work? Sounds lucrative.
Mario kart doesn't have weight as a metric for speed in turns?
>$50B in, $3B out. That’s obviously not sustainable.

Though there will probably be massive value, greater than $50bn in AI in the future. I'm not sure if this plays out like the dot com crash where there was obvious long term value but capital got misallocated to a bunch of pets.coms (https://en.wikipedia.org/wiki/Pets.com) which got wiped out in the crash after 1999 or not. This time most of the $50bn seems to be going to large companies that will probably stick around.