skysight-inc/HackerNews huggingface dataset:
Ask HN: Resources for learning RAG best practices?
What are some of the resources that will help me understand the best practices of AI agents using RAG? What are some of patterns and theory that one need to know? I'm open to: books, blogs, articles, papers, videos, literally anything.
Thanks HN!
Since when were casual references to murdering people acceptable on here?
Ok, thanks for this latest reply. I thought your 7-point jest syllogism was a sarcastic response to my two most recent comments (made 2-3 days ago) so I didn't bother adding to what I'd already said; so if I seem to have ignored half of what you wrote, that's why.

I agree, let's keep everything here from now on. I will reply to this comment soon.
If you want to hear the music, which I had in my head when I implemented Luon, here is the link: http://rochus-keller.ch/?p=1317 ;-)
Chrome on iOS also uses WebKit as backend, as iOS restrictions don’t allow other engines. Same goes for Firefox, Brave, etc…

Edit: Actually not fully true anymore, as of iOS 17.4, you _could_ bring your own engine (https://developer.apple.com/support/alternative-browser-engi...) - with restrictions, of course.
Khairullin's piece serves as a stark critique of U.S. military practices, focusing on alleged human rights abuses. While the article raises important ethical and legal questions, its effectiveness in conveying its message could be bolstered by more detailed evidence and less reliance on broad, inflammatory language. Readers should approach such content with an awareness of potential bias, seeking to corroborate claims with multiple sources for a well-rounded understanding.
Wait, so if you cut out the middleman, doctors would make more money keeping people alive and the government would pay for it? Huh that's the opposite of "death panels".

Meanwhile private insurers definitely deny coverage to people with chronic illnesses (not everyone who is sick or dying is on Medicare/Medicaid). In a single-payer system those folks wouldn't slip through the cracks and .... the doctors would be incentivized to keep them alive! (assuming doctors are profit-motivated sociopaths like your average HN poster)
Counter-argument: code does not exist in vacuum yet we have small and mid-sized LLMs that can already output reasonable code.
Try it now. I'm sure you'll be back within 24h.
The optimal route means picking up multiple people on the same route, and dropping them off elsewhere on the route, and then making the vehicle large enough so that they can do this comfortably, i.e. a bus.

It ends up being another form of public transport — perhaps one with no predictable timetable, or perhaps timetables are themselves a useful Schelling point, I wouldn't want to guess.

But as fixed bus routes make it possible to plan things like bus shelters, I think I'd prefer a bus over the logical progression of self-driving "taxis" that constantly move rather than finding parking spots.
Map that lets you discover Wikipedia pages around the world
Drones / Aliens over NJ
at any given time over a major metropolitan city (and NYC is the largest in the US), there will be any or all of the following types of airborne products:

Human-Operated Airborne Products:

Commercial Airliners
General Aviation Aircraft
Private Planes
Charter Flights
Cargo Planes
Business Jets
Helicopters
News Helicopters
Medical Evacuation (Medevac) Helicopters
Police, Fire, and Rescue Helicopters
Tour and Sightseeing Helicopters
Training Aircraft
Aerial Advertising Planes
Agricultural Aircraft
Military Aircraft
Aerial Survey Planes
VIP Transport
Gliders
Ultralights

Delivery Drones and VTOL/eVTOL:
Amazon Prime Air
Walmart Delivery Drones
UPS Flight Forward
Zipline
Flytrex
Wisk Aero
Archer Aviation
Beta Technologies
Volocopter
Elroy Air

Scientific and Testing Balloons:
College/University Scientific Balloons: Used for atmospheric research, air quality testing, etc.
Urban Air Quality Testing Balloons: For monitoring pollution levels in metropolitan areas.
Advertising and Non-Winged Craft:

Advertising Balloons: Large, floating banners or shapes for promotional activities.
Tethered Aerostats: Used by agencies like U.S. Customs and Border Protection for surveillance.

High-Altitude Surveillance Balloons: Including those used for military or security purposes.
Hot Air Balloons: For tourism, advertising, or personal enjoyment.

Weather Balloons: Released by weather services and research institutions for meteorological data.
I was intending to release the information, so releasing it when I'm dead seems fine.

So why didn't I immediately publish it all while alive? Perhaps I preferred to control the flow of information, redact certain parts, or extort the organisation I was blowing the whistle on. None of those seem all that important to me compared to deterring people from assassinating me in the first place.
Are you trolling this thread?

I took that test:

Current Test Results

Reading speed: 1560 Words per Minute (WPM)

Comprehension: 100% of questions answered correctly

Most of my few seconds spent "reading" was actually spent deciding if I even had to read it at all. I correctly concluded that the test was garbage, and then skipped to the questions, and answered the 4(!) questions using only basic common sense.
More of a tool that exists for 15 years or more, and is an important tool for some of us. When my mac broke down in, hmm, maybe 2010-ish, my superduper-created bootable clone allowed me to instantly continue my work on a freshly bought mac (just boot from the clone). No Apple utilities give you that.
You team knows Python/Ruby/PHP/Elixir/C# and uses Django/Rails/Laravel/Phoenix/ASP and doesn’t have a need to hire dedicated frontend people. You can leverage your existing talent to drive the frontend from the backend.

It has limitations (not going to use HTMX to build Google Maps) but handles the 80% of use cases well for little added skillset required.
Plus kids follow makers on social media and video sites.
No, but someone did impersonate him on YouTube.
Godot Engine – 2024 Showreel [video]
Is there something like this which is still maintained and isn't needlessly tied to crypto?
CPT Corporation
A Knowledge Graph and LLM-Driven Approach for Conversational Recommendation
Open Quantum Safe Project
Radiologists probably like the gray noisy image better anyways!
As someone whose transition to being more of a consultant, entrepreneurship is such a broad term that gets misinterpreted. There is no real job title called entrepreneur. What it sounds like you're really describing is that you want to capitalize on your skillset in order to generate additional income in which case it would be useful to think about what sort of activities do you actually want to do with your time? What fulfills you the most?

Here are some ideas that generate income but are quite different in terms of activities:
- fractional CTO advisory services
- engineering team coach
- teaching at a local collage
- writing a book
From a thermodynamics point of view only the differential of the entropy matters, so if there is only a fixed difference between the two computations they do not influence the physics.

If the way one does the coarse graining of states results in different differentials, one way should be the correct one.

There is only one physics.

If I remember one of Plancks relevations was that he could explain why a certain corrections factor was needed in entropy calculations, since phase space had finished cell size.
From [0]:
“We’ve historically used venture capital to fund Electric’s development costs—4 team years, do the math!—but the seed market has tightened, and we realized that it’s in everyone’s interest to maintain a strong and ongoing investment in Electric that is decoupled from VC. That’s why with v3 we’re changing the licensing model to a source available business license:

1. Free “community” license for non-commercial use (e.g. FOSS toolmaker, enthusiast, researcher). You’ll need to login to activate, i.e. it will “phone home” and we will receive light usage analytics, e.g. to count active Electric users and projects. We will of course comply with privacy regulations such as GDPR. We will also use your email to send project updates and community surveys, which you want to participate in, right?

2. Commercial use costs $480/month/developer (33% startup discount). No login or analytics (obviously unacceptable for security and privacy), instead you’ll validate a license key (like Datomic). We also offer support and project implementations and are flexible with fee structure (i.e. services vs licenses). For free trials at work, use the community version with your work email. Talk to us, we will arm you to make the case to management.

Special deal for bootstrappers: FREE until you reach $200k revenue or $500k funding. Just use the community license, and come tell us what you’re doing.”

[0] https://tana.pub/lQwRvGRaQ7hM/electric-v3-license-change
How long does that memory of the text last?
Agree, and I often derange the conversation to cut their story shot lol ( sorry ). Unless they're really determined to continue.

I notice other people do this to. And there are even different skill levels to how smooth they can cut into the story tellers.
For me CS with Physics BSc, it's always fascinating to still see how entropy is still sich a wild measure.
I'm an Arch guy, but for the M1 I am using the official Asahi Linux distro which is based on Fedora. Documentation and information about compatibility can be found on their site: https://asahilinux.org/

I previously used the Arch based Asahi distro when it was official, but Arch on ARM is a 3rd party project and it was not very well maintained and lacked some packages, so they switched. Fedora could also be considered more stable and better supported. But there are Ubuntu, Debian versions for Asahi if you prefer those.
I enjoy using Generative AI but have significant moral qualms with how they train their data. They flagrantly ignore copyright law for a significant amount of their data. The fact they do enter into licensing agreements with some publishers basically shows they know they are breaking the law.
Controversial UN cybercrime treaty clears final hurdle before full vote
I don't think that's really true. ChatGPT has a fairly neutral style of writing. It may vary a bit on the prompt I guess.
Wait, so the Verge is upset that the PfP player removed a link that would take the user to the video on YouTube. But if they use the normal YouTube player that has the link, the Verge gets less ad $. But the users who click the link would be watching on YouTube, where again, the Verge would be earning less ad $.

Am I understanding this correctly? Because it sounds like the Verge is complaining about a change that should net them marginally more(?) ad $ (and is to YouTube's disadvantage) because a few readers complained, and they're just trying to blame YouTube instead.

I'm confused.
Digesting is part of reading. So you're not reading that fast at all.

Imagine if someone said they could eat super fast because they could shove food in their mouth fast, but still took a long time to chew and swallow.

Same thing.
> But it's not clear from the article how critical this guy is in the upcoming lawsuits

If he was the key piece to the lawsuit the lawsuit wouldn't really have legs. To get the ball rolling someone like him would have to be critical but after they're able to get the ball rolling and get discovery if after all that all you have is one guy saying there is copyright infringement you've not found anything.

And realistically, the lawsuit is, while important, rather minor in scope and damage it could do to OpenAI. It's not like folk will go to jail, and it's not like OpenAI would have to close its doors, they would pay at most a few hundred million?
HP-RT Real-Time VME Operating System
Makes sense. If we knew the theory of everything and the initial conditions of the universe, then we could just compute the next episode of a series instead of streaming it.
SeekStorm does currently not use io_uring, but it is on our roadmap.
Challenges are the cross-platform compatibility. Linux (io_uring) and Windows (IoRing) use different implementations, and other OS don't support it. There is no abstraction layer over those implementations in Rust, so we are on our own.

It would increase concurrent read and write speed (index loading, searching) by removing the need to lock seek and read/write.

But I would expect that the mmap implementations do already use io_uring / IoRing.

Yes, lazy loading would be possible, but pure RAM access does not offer enough benefits to justify the effort to replicate much of the memory mapping.
Turn it around: require a 3/5 quorum to disarm the public-release deadman switch. Buying off 3 people whose friend you have just murdered isn't going to be trivial.
I think it's a bit much to say that there's no advantage to being German, either in today's world or historically.
The real problem is that they can’t fix the morality behind the original issue, money over lives is just wrong
Because Pascal/Modula/Oberon is the one true language. TypeScript? Blasphemy!
I think this is almost impossible to really do without some kind of metaphysical ingroup belief.

As someone without a religious bone in my body, it seems obvious this is what non-religious people have never really figured out how to do well.It is the achilles heel of the non-religious, rationalist.

The network almost needs to be based around some borderline ridiculous beliefs or it just ends up as a boring business networking cocktail party.

Burning Man is probably the best example of how to do all this well.
I don’t think you should have to hold the entire canon of programming history in your head to avoid these types of footguns. Conventional design choices of the past that lead to bugs and security vulnerabilities should be replaced.
I have a suspicion that radiologists themselves may not know what's going on. Essentially if you give a scan (with cannot be easily interpreted by a semi-trained layman) to more than one radiologists, you may get several different interpretation.

Can some radiologist reading this confirm what I'm saying?
I don’t need the media or anyone else for that matter to explain to me why we shouldn’t accept someone shooting dead on the street someone they disagree with who was not engaging in any illegal activities (and even if they were doing so that’s up to the state to prosecute, not the individual).

Otherwise why not shoot dead the next BMV employee that made you mad or the claims adjuster who is specifically responsible for denying your medical claim, or anyone else who “screwed you over”?

Maybe we should remove access to firearms so incidents like these don’t continue to happen, right?
One of my relatives was put in an honors track in 2nd grade years ago and the intro talk to parents was:

"We are separating your child because they are exceptional. To put this in perspective, the children as exceptional on the other end of the learning spectrum cannot tie their own shoelaces."

Regimenting all children the same is obviously a horrible idea to anyone that cares about the child ...
I recently experienced an issue with YouTube + Firefox + macOS where not only did parts of the UI lag bug the queue wouldn't advance at the end of a video unless I refreshed the page. It resolved when I allowed google.com and a few others in NoScript. I wonder why your disabling of extensions didn't resolve your issue. I haven't had any more problems in the last few weeks. Also, I'm on an M3 CPU.
A Historical Analysis of a True Invasion of Taiwan
Subsequently republished by RAND sans stock photos:

https://www.rand.org/pubs/commentary/2024/12/a-historical-an...
Perhaps it does some similar grouping of content, but this more directly incentivizes longer term gripping of tokens into abstract concepts. I agree that it's not obvious this would perform better than letting the model build it's own structures for grouping tokens, but the proof is in the pudding; the technique led to improved results for a given model & training size. This newer approach gives the model the freedom to build it's own breakpoints, but still bakes the idea into the algorithm itself.

What it means is a harder question. Perhaps transformers are simply an inefficient computational structure for this process? Perhaps a more flexible computational structure would integrate this step more efficiently? Perhaps Transformers are efficient enough, but our learning/densifying isn't? Or perhaps it's such a core powerful step that it might as well be built into the algo regardless? Much to learn.
Inertia 2.0 Released
I don’t think this paper says what you claim. It says chain of reasoning and its length can improve transformer performance. Not that this represent a significant fraction of human reasoning or that it’s even reasoning
Except for above where you say you 'read' but don't 'digest'.

Reading implies digestion, if you're not digesting you're not reading 'in full'.
I meant the network admin costs, if you're having to run dual stack, and especially if you're getting a network setup where you can't fearlessly combine/add routes between any two subnets that you have. To my mind the key benefit of using IPv6, the thing that makes it worth doing at all, is to stop having to worry about address assignment and address collisions and local addresses; obviously you do still probably want to talk to v4-only outside resources, but if you can't get away from having to give all your hosts individual v4 addresses and keep track of them then frankly you might as well just stay v4-only (except at the load balancer or what have you - which might be what you meant, but it sounded like you were talking about using a mix of v4 and v6 within the VPC).
> derange the conversation

I was expecting to read "derail" there, but that's not bad either - I mean, it's bad, but in a deranged way ...
Not quite faster, but skipping more.

Speed reading works well on texts that are highly redundant with internal "error correction".

Try reading a YA novel quickly (the content motivates you to go faster :) ) and then try to read a physics paper at the same speed.
I’d be curious to see an example.
You are incorrect, Wikipedia [1] cites [2] to suggest that the expected lifespan at age 15 was 28-33.

1. https://en.wikipedia.org/wiki/Life_expectancy#Variation_over...

2. https://pubmed.ncbi.nlm.nih.gov/5791021
We are? It's just you here, making a bizarre nitpick in a thread on a persons death.
https://archive.is/jFGfB
adversary-in-the-middle == MITM
Great exterior, too busy inside. Also, go yoke go broke.
Reviewer: Can you add some tests with this changeset?

Dev: I can, when the cash rolls in flashes chains
>exceptionally smart at making predictions

Is anyone though? Genuine question. I don't have much faith in predictions anymore.
Are people in the US really that literal? It's no wonder social media is in such one hell of a mess.

Doesn't anyone realize that the point I was making is that this story is just so bad and terrible that it's almost unbelievable—even by US health standards? In fact it's so bad that it would seem infeasible even in the worst of third world countries.

I say that as someone who has lived and worked in the US for periods and who has relatives living there. Even by my understanding what happened in this story it is so outrageous that people ought to be rioting in the streets over it.

What much of the world finds completely unfathomable about the US is why its citizens—citizens of a supposed first-world country—actually tolerate a health care system that's actually worse than in many third-world ones.

Edit: on further thoughts given that so many (presumably US) posters took umbrage at my comment tells me the situation with the US health care system is even worse that I thought. What beats is why so many couldn't see what I was driving at.
Does YouTube have a future if its creators have to make money elsewhere?
What a stupid talk.

They gave 15 minutes to one of the most competent scientist.

A joke.
The Madrileños who move into Toyko-style capsules
>> consultants are cya and political support for things the management class allready know they want. That seem about right.

That is the most valuable job in virtually every profitable industries including tech.
If only there was a distinctive feature of mammals by which mothers feed their infants and through which the diet of the mother could be inferred, as noted in the article.
maybe they did save specific foods for infants.
That's kind of going in a different direction. The big picture is that LLMs have until this point gotten better and better from larger datasets alone. See "The Bitter Lesson". But now we're running out of datasets and so the only way we know of to improve models' reasoning abilities and everything, is coming to an end.

You're talking about fine tuning, which yes is a technique that's being used and explored in different domains, but my understanding is it's not a very good way for models to acquire knowledge. Instead larger context windows and RAG works better for something like case law. Fine tuning works for things like giving models a certain "voice" in how they produce text, and general alignment things.

At least that's my understanding as an interested but not totally involved follower of this stuff.
Where's your evidence that infants didn't hunt and butcher mammoths? I need you to write me a dissertation before I believe this claim.
I phrased that badly, so that's fair.

If you follow the rest of that paragraph, my meaning may be clearer: there's a market for what they do right now — the OpenAI financial reports that have been bandied around say that if they were only offering this as a paid service, not also developing new models, they'd be making a profit — but it's not obvious how this will change going forward.

The first spreadsheets were easy to market: here's a solution to your problem, give us money and you can have this solution. But as time goes on, you need more than the original solution, because that's too easy to replicate.

ChatGPT was easy to replicate, and has been replicated.

The "needing more" to stay in the game is what I meant by the Red Queen race. What exists now is fine, it's a good fit, but the question of the long-term is still open.
That's fair, but also just as interesting. What are the chances that language is older than we thought? And if decent chances, how much older? Were early hominids capable of speaking?

Wild to think about.
You're using HTML when you go from a street view from NYC to Osaka. You exit NYC street view, use the HTML <input> tag to enter Osaka, maybe you even click the man in the bottom-right to enter street view again. You should be considering the maps canvas as an interactive element in an HTML-CSS page.

In a three.js-only webpage, will ads be embedded properly? Will the user be able to select the paragraph he is currently reading? Why reinvent the wheel when so much effort has been put into creating HTML/CSS/JS. Much of the page is rendered on the GPU anyway.

Also, in my case, just looking at the demo [1] makes my GPU work at 10%+15% vs 1%+0% of a normal static page (iGPU+dGPU, Intel UHD 630+NVIDIA Quadro P620). Though the linked page does apparently use a rendering loop, while the other examples are just as inexpensive as normal HTML+CSS pages.

[1] https://svader.vercel.app/landing-page-bubbles/webgl/