skysight-inc/HackerNews huggingface dataset:
Show HN: Doc Retrieval/RAG as a Service
Hey HN! We're Mael and Rohith, the team behind Memoire, a document retrieval pipeline "as-a-service" (https://astarlogic.com/blog/announcements/launching-memoire).

Document retrieval pipelines have many applications, from search and recommendation systems to enabling Retrieval-Augmented Generation (RAG) for LLMs. RAG is especially powerful for securely providing proprietary or internal knowledge to LLMs, improving context awareness and reducing hallucinations.

However, building a fully functional RAG pipeline is far from simple. Beyond just choosing a vector or search database, you need to:

1. Pull and parse data from various sources (PDFs, Office files, CRM records, chats, etc.)

2. Chunk and embed documents for vector search or keyword extraction.

3. Choose databases, algorithms, and sync solutions for seamless CRUD operations.

4. Ensure scaling, maintenance, and compatibility with your main application.

Even with a great developer, building this takes 3-6 weeks. That's just for a proof of concept—staying up to date with rapidly evolving industry standards requires ongoing investment.

We built Memoire to simplify all of this. Our pipeline takes care of the heavy lifting and here's how it works:

Send us your documents -> Our system analyzes and indexes them -> Start searching

Here is a demo: https://www.youtube.com/watch?v=eVD1GNVRygs

Our alpha is a self-hosted version, but soon we will propose a cloud API with volume-based pricing.

Why did we build this?

We realised that like login pages, AI has some already-solved problems where teams spend too much time on repetitive infrastructure rather than focusing on innovation.
We want to build APIs as a service focused on AI use cases, so teams can deliver faster and focus on what truly matters: improving their customers' experience.

We're launching on HN to get your honest feedback. What challenges have you faced with RAG pipelines? What features or improvements would you like to see? What AI features are you building repetitively?

Thanks for checking us out—we're excited to hear what you think!
Been seeing a lot of negative posts surrounding experiences with Hetzner of late. Definitely facing issues and losing reputation.
Just gonna point out that the Nintendo going after fanworks bit is a tad blown out of proportion, especially online. They're definitely known for being way too heavy handed (especially compared to the likes of Sega), but they're not exactly going after every fan project they see on the internet. Large sites whose entire purpose is to host fan games and mods for the Mario, Zelda, Pokemon, etc series have been up for decades without any issues, and most mods and homebrew projects for consoles older than the Wii U or Switch are going fine.

Unless a project is going viral in the media, raking up in a significant amount of money via a paywall or is directly competing with a current game, the chances of it getting shut down are incredibly low.
>If they collectively decide stock price matters more than anything else

So an oligopoly that presents the illusion of free market?
As I started reading this, I nodded in agreement and was going to suggest picking up a used Pixel 4a (my phone) until I read the rest of your comment :-) I also agree that it's already a little big. I remember the memes when the iPhone 5 came out, about how big it was compared to the iPhone 4. Those are considered incredibly tiny right now. There used to be one scenario where I loved the larger size of my 4a, which was when using it as a GPS in my car, but I recently bought a car that has Android Auto, so a tiny phone would be perfect now.
> apps will keep up with the performance development and in a blink of an eye

Web apps gang here.

I don't know about the rest of you folks, but I rarely install an app unless I have to or there is no other option.

The few apps that do get installed aren't all that taxing.
N100 box is new and cheaper. 256GB, 16GB RAM HDMI, 2.5 Gb network, case, charger etc. Raspberry Pi is pointless as a "cheap" computer. It's good if you you are building something which requires GPIO.

So perhaps you are the one out of touch.
Electronic trading and passive investing drove commissions to zero so Blackrock helped create ESG because ESG requires paying commission for the service of certifying an investment as ESG.
Not great) Tried replacing my laptop with a Samsung phone+monitor combination on a trip, didn't really work out. Phones are not built for continuous load.
You extend the expiry of your domain. Make sure it's 3-4 years, so that you have lots of time to figure things out (ie: credit card expired, account locked, etc...).

Your registrar might kick you out, but is unlikely to seize your domain. If the government seizes your domain, it means you have other gigantic problems.

Overall, having your domain + DNS + Email provider all separate, gives you enough protection. Having your email as gmail has some risk but it's really a very small risk that most people just run on gmail just fine. The setup outlined by mmh is way enough.
Hi, This is rohith, will be here and happy to answer your questions!
Stripe is much more flexible IMO. PayPal is all about customers having a PayPal account, and will really push non account holders to create an account when paying.

Stripe supports a lot more payment methods: both global and region specific wallets, bank transfers, etc - there's even a beta (I think in EU only for now) to accept PayPal payments via stripe.

If you wanted to compare stripe you'd really need to compare it to Braintree (which is owned by PayPal), which offers a similar concept: integrate once to support multiple payment methods, but from memory it supports less than Stripe.
Trump Is on Collision Course with EU over Big Tech Crackdown
In the end it still boils down to how much you care about others and your environment.
I don’t see the point of a Sawstop-type system for an Altendorf-style panel saw. The whole point of that saw design is that your hands are nowhere near the blade!
This thread is not really interesting because we don’t have the Hetzner’s side of the story.
We're talking about phones here, not TVs.

Or are you saying this is built into phones too?
It's the length of an MD5 hash, which I'd wager isn't a coincidence. It's not "salmagundi", "Salmagundi", or "salmagundi.h" though.
OP here, are you asking about hardware or cloud instance type ?
I would recommend using GPUs at least to initialise the DB. You need a lot of compute once at the start to vectorize all the data, and then regularly (but less intensely) to sync the updated changes.
You can check out the Weaviate docs here if you want more info : https://weaviate.io/developers/weaviate
The Nazis utilised the best information-management tools of the time, including IBM computers (fully supported by IBM throughout the war) and punch cards (as another commenter notes: <https://news.ycombinator.com/item?id=42359352>). Those tattoos worn by concentration camp survivors were IBM-assigned identifiers.

Nazis also used census and other civil data sources. Deliberate destruction of such records in the Netherlands is one of the legacies of WWII:

<https://en.wikipedia.org/wiki/The_Holocaust_in_the_Netherlan...>

This and other legacies of 20th-century genocide are chief reasons why European attitudes toward rampant data collection and exchange are far harsher than in the United States. Though I'd argue still not nearly harsh enough.
Since the resignations, the PSD candidate was resurrected and is back on course to become president, after the result of the democratic vote was .. cancelled.
How is that "understanding" looking now ?
> But this as just a matter of time.

Confidently stated without any evidence.

All AI proponents use this phrase repeatedly. Yet I still can’t get these tools to stop making up APIs that don’t exist, and they hey constantly produce face-palm security issues like hard-coded credentials and SQL injection.
I started my first job writing software for investment banking in 1998, in London. Right from the start people were talking about Y2K and we probably had a couple of million lines of pl/sql and vb code in our regulatory and risk management. There were a lot date checks/conversions which were often implemented differently and using different format masks. It was surprisingly common to use the YY and RR formats at that time rather than YYYY. Maybe this was a hangover from programs written for mainframe in assembly. We did spend a lot of time scanning code, and standardising and retesting stuff.

Interestingly, when we went out in London for NYE (some people couldn't go as they were on support!) I remember going to an ATM and seeing the unexpected error "organization unknown" when I put in my card at about 12.15. I really remember thinking EVERYTHING was broken, but on reflection it seems more likely that someone consciously decided to turn off a few global links around that time to reduce chance of failures.
Indulge me and let me be lazy and answer this question: Is Nyxt _NOT_ just a front-end to one of the Big Tech web engines? (blink|geeko|webkit)

I would be super pleased to be wrong...
Either you innovate and cannibalize existing business or squeeze existing customers and ride the decline. Broadcomm is the latter.
Laylo (YC S20) Is Hiring an Account Manager in EU/UK
I need a great deal of help. This world is overrun by a combination of the cruel and those indifferent to its cruelty. We need as many people as possible to learn how selfless compassion is the solution to all our problems.

As to help, I get it every day from a place you deny exists. And I spend all my time on this site helping others.

And you are deliberately misquoting me, please don't.

Once the ad hominems begin, I know the contest is over, the opponent's resignation has been signaled, and my hand is raised. If you don't like the bitter taste of your defeat, you can learn from what I've written here, and become a winner.

The key to the Dunning-Kruger true-experts is their humility. You should learn from that, too. We love you.
Hang on, Hetzner literally deleted all their data without warning?

That’s actually insane and business killing. Both for Hetzner’s reputation and potentially for their customer.
also negative experiences here. if they get a copyright-violation request from someone, they won't contact you about it. they'll just take your server down immediately and ask you to respond. obviously thats not a sane course of action and i cannot recommend using them for any kind of production systems.

i am always angry if i see articles about them here on HN because such a vendor should be blacklisted and not promoted.
Measure Your Traffic and Stripe Income in a Single Tool
When you ride the cloud/ai hype wave you end up with making fast and not very healthy decisions. Same things happen with other providers so whatever is your choice you must have disaster recovery and replication in place. If you wanna go cheap just make some s3 backups on R2, BackBlaze, Wasabi.
I went from S20 to S21 to S24. Before that every Android phone I had was good but qc issues would pop up or some new phone would come out with much better features (eg camera quality is really important to me). Since I switched to Samsung have had 0 qc issues and every camera has been amazing. The only reason I upgrade is because it's free with my carrier so why not? Staying with Samsung if/until it changes.
There’s no \U in JavaScript: it is spelled \u{10ffff}
> You want thousands of people to do useless and potentially unpaid work?

I think this is an extreme interpretation of what I said. I want software that is maintained. Android has a problem with apps refusing to update to hold onto legacy permissions that are restricted in newer versions (or at least it did when I moved back from android to iOS in ~2022). Apps that don't work with biometrics, or handle the notch properly are other examples.

> I want the opposite: that I can write the code once and it will work forever,

That only happens if the environemnt the code is run in is frozen, and if the underlying API was prescient enough in the first place. Device resolutions and aspect ratios have changed dramatically in the last few years. Access to buttons/input methods have changed on iOS and Android. Hardware has chagned dramatically.
spending 80k in montreal sounds so much fun, are you kidding me? that place is in touch with its death drive.

jokes aside, sounds like both you and him have valid ways to spend your money. i honestly don't care which is right because either way you're gonna spend that 80k and will ultimately end up dead.
I agree. Also, some system assumed that 99 was a special code like not-available. [1] And I have a faint memory that some apps assumed that xx<20 means 20xx and xx>20 means 19xx. So the risk of a transition into caos was smoother and weirder.

[1] The national ID numbers here in Argentina for foreiners started from 95, then 96, ... My university gave them fake internal ID numbers starting from 99 until they fill all the paperwork to get a real one. The national ID numbers used all the range do they decided to jump to 60, 61, ... (I'm not sure what happened with the 99 duplicates. I expect to see some weird collisions reports.) Anyway, the ID number for newborns reached 59 and then, the ID number for newborns jumped to 70.
is there an up-to-date tutorial that could help me implement stripe?
Your way of thinking is why things like safety glass, headrests, and seatbelts were kept of of cars for so long.

It’s a fine principled argument, but stay the hell away from product management.
A CHEAP PHONE WITH ROOT IS FAR MORE BETTER THAN EXPENSIVE PHONE LIKES ROG,

BUT GOOD SMARTPHONE MANUFACTURERS LIKE SAMSUNG AND ALL DONT ALLOW EASY ROOT, NOT WITHOUT RISK OF BRICK AND LOSS OF DATA

AND PHONES LIKE PIXEL AND ONE PLUS THAT ALLOWS FOR ROOT ON THEIR OLDER MODELS ARENT THAT GREAT IN TERMS OF UI AND PERFORMANCE LIKE SAMSUNG

BUT SAYING PERFORMANCE ISNT NECESSARY IS FALSE

I GOT MY FIRST PHONE AND SINCE 7YRS I DID NOT TOUCHED MY PC OR LAPTOP,
WITH PHONE + ADB + TERMUX I HAVE LINUX DISTRO IN POCKET,

WITH PROOT BASED DISTRO YOU CAN ALSO DO MINOR IMAGE EDITING AND VIDEO ENCODING

THOUGH BATTERY OPTIMIZATION OF ANDROID MIGHT CRASH
In both income and expenditure-based GDP calculations income or consumption by households are part of the calculation (which means the calculations will not give the same result).

You can make an argument that if the hypothetical workers are salaried they're not technically paid for any given task, while I'd argue that there was an opportunity cost (they could have done other work than digging/filling it in), so there's some subjectivity to it.

My stance is that if it was done as part of paid work, they were paid to carry out the task as there's at least in aggregate if not per every one individual event an opportunity cost in having them do that work instead of something else, and so part of their consumption was paid for by the labour for those tasks, and hence they affect GDP.

That the output does not add value for the procurer of that labour does not nullify the expenditure on that labour. Whether you're calculating GDP on income or expenditure, those add to GDP either as income for the workers or an expenditure for the employer.
Writing is an art, and some enjoy producing or consuming verbose prose. I hope AI doesn't change this.

Personally, I don't appreciate verbosity while reading blog or news articles.

However, I don't think its bullshit. If a author is sharing, they likely are doing so in a manner that they find enjoyable.

The way I see it, you don't need to read communications like this if you don't enjoy it. Much of what gets said repeats what has been said elsewhere.
Even if 18A can catch TSMC, which I highly doubt, what does it matter if they don’t have any of the big chip designers like Apple and Nvidia?
>Like what use would that have been?

Advertising, PR, virtue signaling and maybe getting some kids into some embedded linux development who will then grow up and use the Pi in commercial products at work.

Win on all fronts for the RPi corpora-, sorry I meant foundation.
The lack of response from Hetzner is part of what does make it interesting.
Kiwix does not operate Mastodon servers.
You can use any registrar with R53, so it's more like:
if you really need to have domain registration written in Terraform and the other registrar doesn't provide it
> if they get a copyright-violation request from someone, they won't contact you about it. they'll just take your server down immediately and ask you to respond

That’s not my experience. We get these emails about once every 6 months, we act and respond, and they don’t take anything down.
This is such a tiresome cliche I can only assume you intended it to be humorous.

Reagan’s “nine most terrifying words in the English language” works just as well when you replace “government” with “corporate” or “church” or “mob” or even “next door”.
Yes you can mate. In fact less then a £100 for n100, 256GB SSD, 16GB RAM, just look it up on AliExpress. You have promos on hotukdeals all the time.
Tax man: Did you earn your daily bread by working your arse off? Gimme some of that money.

Also tax man: Oh did you get that money by luck? Good for you, man.

Also tax man: Did you get inherit money by having been born into a wealthy family? Gimme some of that money.

Also tax man: Were you born into the royal family? Good for you, man. Pardon me, I mean, your highness.
That sucks. I was literally trying to download some files into kiwix and it didn't work.

Some of the files they host are pretty big, so maybe Hetzner just decided it wasn't worth hosting any more.

I've been using Hetzner for years though and never had an issue. But I don't get anywhere close to the 20TB traffic limit.

This reminds me that I should set up some backups though.
Killing Arc would be very MBA brained. They already have to develop GPU IP for laptop chips. It's a volume game and AMD realized that developing one CPU chiplet for the whole portfolio.
There is market for cheap new things. But this is at price point that for most people in the world it is not anymore "cheap". Around 100 is at level you kinda need to think about it. If it was half of that like Pis used to be back in time I would agree for it to be cheap.

Specially when you start adding up things. Like monitor, mouse, power. The total adds up and somehow it doesn't feel like great deal for most income levels.

Same goes for their other products. Numbers just don't make sense for lot of people.
This is not good.

It does raise an interesting question of how to reliably contact a customer if email is broken?
The requirement in the contract is nowhere near that specific. Contact info validation is sufficient for almost all registrars. It's possible a given registry has higher standards, or maybe one registrar got some order to be more thorough, but great reason to avoid given this is a commodity and there are actually good alternatives. (I broadly like Tucows and Cloudflare)

Namecheap is on my NO NO NO list, along with GoDaddy (and a bunch of others). Google Domains was also on this OH GOD NO list, but thankfully Google did the Google thing and killed the product.
Well, Windows has a lot of svchost.exe processes running. /s
It makes it intriguing, not interesting.
Ask HN: Is YouTube Listening to Private Conversations for Recommendations?
Recently, I experienced something unsettling. My wife and I were having a heated discussion about our neighbors (offline, no phone or device usage during the conversation). The discussion involved their habits of wasting water in front of our house and parking cars in front of it.

A few hours later, I opened YouTube and was recommended a video titled "How to fix neighbors who trouble you".

I hadn’t searched for anything related to this topic online or discussed it over text. It was purely an offline verbal discussion.

This left me wondering:

Could YouTube (or Google) be using microphone access to listen in for personalized recommendations?
Is this just a wild coincidence, or do algorithms really work this well with indirect indicators like past searches, location, etc.?
What are the best practices to safeguard privacy in such cases?
I’d love to hear thoughts from the HN community. Have you had similar experiences, and how do you ensure privacy from invasive recommendation systems?
Or you can use your track-record of discovering CVEs as a stepping stone to a cushy infosec job
On fairly isotropic irregularity:

(Well then, Joseph As Sabra technicality resolved itself, it seems)

Chris Isham[0] in his 地獄楽 chapter only (the first one), hinted at the geometric applications of locales, which, I've heard elsewhere, quantales are one noncommutative generalization of. Not familiar? Nothing in Tanya's brother's slides indicate any connection, however, so I'll have to peer at his student's..

[0] https://ncatlab.org/nlab/show/Modern+Differential+Geometry+f...

Irreversible (& hence useful) quantum XOR-gate? I love microcosms (gradschool, insurance industry) where something so banal as [rethinking] accounting [principles from scratch] has macrocosmic implications.

How can we incentivize the CoMartha to care about the mandalas instead? [Or introduce fairly bluecollar isotropic irregularities into accounting.] Not marketing, what then? Good faith nondeterministic obsession inducers, tearing a microblackhole at the origin of the Bartle Chart?

More TK on what "the sword" refers to in the context of weird/hypernormal/healthy/unhealthy/imbecile: I have something more than just vibes, but needs cleaning up..

Placeholder for when I find that Science article:
https://www.jstor.org/stable/25054007

I'd've assumed the Finn was expressing his inner Shu:
https://youtu.be/J3_sovfY2uA

>在三星堆遗址中发现的乐器除了玉石磬可以肯定为乐器之外，铜铃、似锣铜挂饰等是否是乐器还需要更多的研究

https://m.fx361.cc/news/2009/0703/5821451.html

>有的学者认为：艺术本身起源于巫术，因为艺术旨在施行某种巫术来招引部落赖以维生的动物
>
(Editor’s note: During the reporting of this story, a representative for Cognizant repeatedly asked Bloomberg to disclose its own H-1B data. Since 2009, when the US government began disclosing the numbers, Bloomberg has successfully sponsored 3,082 new H-1B visa petitions, according to the most recent data from the US Citizenship and Immigration Services.)
Most of the times you hear people complaining about Hetzner shutting down someone's servers, it's because they were hosting content going against their ToC or similar.

But this seems to be about Kiwix (which in short is "offline Wikipedia" in various ways) and doesn't seem to be about questionable content in any way.

Eventually I guess we'll get Hetzner's perspective on this, as they tend to start writing publicly about issues once the other side starts writing publicly about it as well.

Personally I've been a happy user of Hetzner for many years, with no issues that weren't my own doing. But reading about people having their servers deleted in the middle of the night on a Sunday (Berlin time) and all data wiped immediately, with no recurse, does sound a bit aggressive. Luckily it seems like both me and Kiwix has mirrors for the data we care about.
Threads in browsers sounds like an absolute nightmare of new browser bugs and dev issues
"Hetzner" isn't a monolith. I have a feeling these things depend on which country your servers are in.

f.ex. the situation with egress costing money in the US, but it's free on all EU location.s
Tbh this is the most German shit. Germany has borderline neurotic copyright laws, so likely they are doing this to cover their asses legally. Still insane that they don't even notify you!!
Not my experience as well. They have previously given me 24 hours to respond, or they will remove the server.
I don't care for it but at least it's something besides an empty suit.