skysight-inc/HackerNews huggingface dataset:
It's next to impossible to strong arm China into another Plaza Accord, unlike Japan.
They literally bend and sway to the voters, it's their job.
I mean it depends on the project and scope, but if you just write C-style code but use unique_ptr, vector, string, and <algorithm>, you're already at an advantage.
Our tool sadly also fails on this:
https://url2text.com/u/KYkpBj

The challenge there is that the content is in an iframe.

If you get the URL used for the iframe you can get the content:
https://url2text.com/u/kJWaZY

But that's frustrating as it requires two steps.

We might be able to help you get the content from URLs like these in one step. We have quite a bit of power in the Urlbox API that url2text isn't using.

Drop us an email: support@urlbox.com and we'll see what we can do.
I wouldn't call it the "future of LLMs". I do see it as both the present and future of one of the application areas of LLMs, which is answering questions against a custom collection of content.
Is there any condition with as broad a definition as autism?

It can cover anywhere from a non-verbal 9 year old with an IQ of 70, to a popular attractive valedictorian genius with incredible masking skills. A slow developing 3 year old labelled early and for life, or a perennial loner 80+ year old finally discovering that their traits are shared with many others.
Does this or Garnet have more coverage of Redis commands? I'm looking to embed a Redis-compatible subset of functionality in a program for local debugging purposes, and there will be an API in between that can protect against Redis commands that lack coverage.
It's certainly the near future; it's the main option that offers parameterization of behavior outside the initial prompt and training data.
We call those guys the canaries and we keep them deep in the mineshaft
Converting websites to markdown comes with 3 distinct problems:

1. Throughly scraping the content of page (high recall)

2. Dropping all the ads/auxilliary content (high precision)

3. And getting the correct layout/section types (formatting)

For #2 and #3 - Trafilatura, Newspaper4k and python-readability based solutions work best out of the box. For #1, any scraping service + selenium is going to do a great job.

Could you elaborate on what your tool does different or better? The area has been stagnant for a while. So curious to hear your learnings.
RAG will have a place in the LLM world, since it's a way to obtain data/facts/info for relevant queries.

Since you asked about alternatives...

(a) "World models" where LLMs structure information into code, structured data, etc. and query those models will likely be a thing. AlphaGeometry uses this[1], and people have tried to abstract this in different ways[2].

(b) Depending on how you define RAG, knowledge graphs could be a form of RAG or alternatively an alternative to them. Companies like Elemental Cognition[3] are building distinct alternatives to RAG that use such graphs and give LLMs the ability to run queries on said graphs. Another approach here is to build "fact databases" where, you structure observations about the world into standalone concepts/ideas/observations and reference those[4]. Again, similar to RAG but not quite RAG as we know it today.

[1] https://deepmind.google/discover/blog/alphageometry-an-olymp...

[2] https://arxiv.org/abs/2306.12672

[3] https://ec.ai/

[4] https://emergingtrajectories.com/
My ISP is from communist country and my VPN is Mullvad.

Guess.
> I believe RAG is a temporary hack until we figure out virtually infinite context.

I'd assume "large enough" context is the actual goal here, not "virtually infinite".
Neither for 90% of tax payers.
I got two masters degrees a few years ago for $10k each. It's still possible to get an education without spending a fortune.

And the feds still give out grants:

https://studentaid.gov/sites/default/files/federal-grant-pro...
Similar to cryptocurrency in this respect. People would often tout nebulous benefits for hypothetical legitimate use cases, when in reality they were only ever really good at ponzi schemes and conducting illicit transactions.
Oil and gas refining, paper and pulp industry, food processing (e.g. grain milling), textile production, plastic manufacturing, mining, ... basically everything that's a commodity?
If only the Great Firewall were so easy. ExpressVPN seems to be "OK" once/if it connects but it's not very fast when websites load megabytes of crap via a bazillion tiny requests (which is a problem in any bandwidth-limited and/or high-latency environment: use your browser tools to simulate a slow connection, website devs!).
Take strings for example. In C you have to manually manage memory and there are a million pitfalls. Lots of programmers are lazy and use fixed-sized arrays and "unsafe" functions like strcpy which results in security vulnerabilities and large-input bugs. But even if you do it correctly you have all this mental overhead and lots of lines of code.

In C++ you just drop in std::string and go.
> You're just trading your ISP for a different third-party

Yes.

> who has all the same incentives.

And no. The ISP has little to no competition or incentive to not sell my information, while the VPN provider has loads of competition and often has user privacy as a core part of their value proposition.

Besides - even if both of the did have the same incentives, one openly says they're selling my data and one says they're not. At worst it's a gamble between the VPN lying and the ISP telling the truth.
What did you understand from the matrix?
I guess you're equating being an early employee to being an angel investor in that startup? In some sense, that's kind of true. But still, not how most employees of the company are going to think about it. You have to work somewhere.

> If exercising your shares is a trivial cost, then it doesn't matter.

Well yes, that was my point. That's why you'd ideally join very early, so you can early exercise and buy all the options up front for very little money.
I believe DynamoDB uses MySQL under the hood as it’s storage engine. Or, if it doesn’t currently that it did for several years.
proposing Danielle of Purrvice
Why? I'm not trying to troll, but I am wondering what the goal is? To me it seems like encouraging fair competition and letting deserving smaller companies survive is a sort of efficiency. A lot of big companies seem to be big because they're doing something shady - like the US steel example, or Microsoft with browsers (and now AI), or Apple with app stores and payments.
A lot of it is simply that people don’t update their knowledge from when they initially learned it.

I still have relatives claiming that poor countries such as the Philippines, Thailand, and Egypt, and India are having 6+ kids per family.
They don't need a monument, just a re-election slogan. "I blocked the doomsday bill" works fine.
I have a couple customers who use keycloak to handle SSO integration with my product. Almost every single time we do the configuration on a screenshare it is painfull. The gist is they all seem to have different setup with various configuration and asking me how to fix it but what works for someone doesn't work for someone else. Most of the time when things don't work, they start clicking things everywhere and that either make it worse or in some case make it work. As a vendor, I would love to have a way to give them a configuration that just work on both SAML and OIDC
Kinda need them now. The oligopoly game is currently bleeding the middle class dry (what was left of it anyway).
As an adult:
- Under The Skin - especially when I read excerpts of the book

As a teenager:
- Syriana
- The Matrix
- Fight Club
- Before Sunrise
I do have an unfair advantage: a decade of Mac and iPad app usage data at a large multinational.

My only assumption is that Apple knows who and what they're making computers for.
Biden talked about it last month and there have been a couple of small grumblings in Congress since: https://www.reuters.com/markets/commodities/us-senator-urges...
I remember when Nucor was the scrappy small competitor. It's quite a story, that company.
Traffic in the US is so absurdly deadly. You have one of these posts and people come out of the woodworks everywhere saying they also have a friend that died in a traffic accident.

I have zero. I cannot even think of a far off acquaintance ever killed in traffic. Why is traffic such a deadly thing in the US compared to the rest of the world?
you don't want to know how much of America the Saudis own.
That's going to be quite a while then because LLMs don't even perform well at anything close to the current context limit. They will miss important details when the context gets over a couple thousand tokens.
I love design by committee!
Great comment!

I'll look this up myself too, but do you have things I could read on the relative risk level of transmission vs distribution lines? They seem risky in different ways to me.

At least in the case of what (possibly) started the Marshall Fire, I thought that seemed like a distribution line that was knocked down, not a transmission line that arced. But that could be wrong (and of course it's disputed that it was a cause of the fire at all).

> At least in my immediate area, the substations that were shut down were exactly the ones I would have shut down

First of all, how did you determine which ones were shut down? A big part of the problem, in my view, is that information of the form "this is what we're shutting down, and why we think it's high risk" did not seem to be forthcoming anywhere. To put it more broadly and with a finer point to it: there was no communication and nobody, including, apparently, the municipal emergency services organizations, had any idea what was going on, or why.

But secondly, from cobbling together information from their website, gossip, social media, and driving around that day, my impression was the opposite of yours, for my surrounding area. My impression was that the pattern was extremely mystifying.

But sure, maybe the communication issue is the first order problem to solve. I certainly hope you're right that they based the decisions on a good risk analysis. But if so, they didn't tell people what that was. And lacking information on that, few will be willing to give them the benefit of the doubt that you're giving them on this, even if they deserve it.

And I don't just mean communication in the period of time just before during and after the storm. Did I ignore an email from them in the past few months announcing that they are planning on incorporating emergency preemptive shutoffs during this fire season? I don't think so! (It's also weird to me that they seemingly didn't need to make the PUC aware of this ahead of time, with an announcement like that being required as part of approving that plan; it isn't only Xcel that I think messed up here.)

It's easy for monopoly service providers to come off as arrogant and aloof, and lose peoples' trust!
It's a common rate limiting algorithm. Here's an interesting article from Stripe on how they use it in their APIs. [1]

[1] https://stripe.com/blog/rate-limiters
Just read lots of different books, about life in general from as many different perspectives as possible and come up with your own strategy to help yourself with whatever it is your goals are.
Fight Club in my late teens.
https://arxiv.org/html/2404.07143v1

“This work introduces an efficient method to scale Transformer-based Large Language Models (LLMs) to infinitely long inputs with bounded memory and computation”
Indexes cost memory. It could push other indexes out of RAM. Or updates could increase IOPS, pushing them over an expensive threshold.
Is anyone familiar with how this differs from 'animation' ?
But not unreasonable when considering how most people act when on it?
Synecdoche NY, specifically this scene: https://www.youtube.com/watch?v=Z9PzSNy3xj0

But there is also a scene (which I cannot find online) where the main character (a playwright) is explaining that the only way to make his play work is to make everybody a main character. He realizes that everybody, everywhere, is living out a rich life and that they're the main character of that life.

It is a fantastic movie and i highly recommend it.
Yes, this is why I usually set mine to look-forward. A 360 degree north-up view is nice, but seeing more streets ahead of me shows me more possible routes if mine becomes blocked unexpectedly.
Typical package managers also can't tell you if an app bundles its own library. Whether an app runs on a flatpak runtime or directly on your host system, some reliable eyeballs need to inspect the app's bill of materials.
Thanks, I mistyped. 1ST_READ.ME
Hello all, creator here. Some of you might know me as creator of HackerWeb.

Happy to answer questions and hear feedback.
To this day, I cannot tell what Kubernetes is designed to do. I hear about it constantly from this website, and based on the conversations you would think it was designed to do anything and everything, and all at the same time.
I have a feeling you might enjoy this conversation: https://www.econtalk.org/a-users-guide-to-our-emotional-ther...

You are not alone in that path of thought. I think that yes, happiness is fleeting, but I tend to think something like satisfaction or contentedness is within reach for many people. Because people aren't going around being actively sad I don't think either. It seems like most folks (and research backs it up) are "getting by" so to speak. Not elated but also not constantly mopey or whatever.

Anyway I think it's a deep and interesting introspective path you've taken.
Is there any indication Linux is going to adopt a pledge/unveil api in the near future? It's hard to place faith in systems like app armor that rely on system administrators to implement security guarantees.
Looks like what they did to buffy
> Why? No challenge or palpable purpose.

A healthy dash of entitlement as well.
Except the yen is the third most traded currency globally and Japan has the 4th largest economy in the world. It's true that their military strategic position is heavily dependent on the alliance with the US, but they performed exceptionally well with their 'fig leaf' of 'self determination.'
Here's the code I use: https://github.com/jart/cosmopolitan/blob/master/net/http/to...
#1 motivation for RAG: you want to use the LLM to provide answers about a specific domain. You want to not depend on the LLM's "world knowledge" (what was in its training data), either because your domain knowledge is in a private corpus, or because your domain's knowledge has shifted since the LLM was trained.

The latest connotation of RAG includes mixing in real-time data from tools or RPC calls. E.g. getting data specific to the user issuing the query (their orders, history etc) and adding that to the context.

So will very large context windows (1M tokens!) "kill RAG"?

- at the simple end of the app complexity spectrum: when you're spinning up a prototype or your "corpus" is not very large, yes-- you can skip the complexity of RAG and just dump everything into the window.

- but there are always more complex use-cases that will want to shape the answer by limiting what they put into the context window.

- cost-- filling up a significant fraction of a 1M window is expensive, both in terms of money and latency. So at scale, you'll want to filter out and RAG relevant info rather than indiscriminately dump everything into the window.
Require Department of Homeland Security agents be given access to systems at TikTok to monitor and modify the algorithm to their liking instead of just shutting the whole thing down.
The package manager can't, but the distro can. AIUI it's perfectly common for flatpaks to bundle things in, whereas ex. Debian has explicit policies against doing so (with caveats, yes, but generally).
Cloudflare’s CEO said they got 1.2 million applicants. You’re mostly likely not the one lol Most that were rejected probably weren’t even read by a human
Cannot use Torrent on my ISP.

Can use Torrent on VPN.
I am a bit worried your plea to accept human nature doesnt lead to the outcome you probably want and instead gets people to realize the logical thing to do is just find a humane way to euthanize these people and codify it in law after a certain amount of bs from them.
Glad you pointed that out, because literally all the “after” images look dreadful.

But then im also of the opinion that most HDR content is too damn dark anyway.
Sure, people are prescribed psychotropic medication for depression. But as more stringent scrutiny has been paid to those, the effect sizes have gone down over time and with more adjustment for publication bias.

There's no shortage of demand for psychotherapy services, and head-to-head they are comparable and both in combination fare best.

There is no blood test for depression, and if there is, no one uses it in practice. Sure, we're seeing this sort of thing with alzheimer's dementia but that's one thing that has never been amenable to psychotherapy, and even then there's a lot of psychotherapy around it in a palliative and coping sense because it's still uncurable.

FWIW, I was involved in the creation of DSM-5 so I'm very familiar with the whole area of mental healthcare.
There's also the focus. A long context means the LLM is more easily distracted. Context "gets the right neurons firing" and why RAG does well. It's also why reranking with RAG improves output, in further increases the quality and/or relevance into a smaller context.

Which is all to say really, data quality is probably the most distinguishing factor in LLM/RAG systems... to get back to OP's questions
> We didn’t reply, though in retrospect, it could have been fun to try to troll them.

Not replying is the only valid answer. Trolling them could potentially put you more on their radar and get targeted for other attacks. And for what?
you can build flatpaks as OCI containers using nix.

I’m not sure how that helps the issue of bundling dependencies though.
"Alone in the Wilderness" 2004

Made me move out of the city and off grid, buy a dog and find satisfaction in the simple life.
Ran, Eraserhead, Paths of Glory, Dersu Uzala, 2001, High and Low, They Live.
WireViz: Easily document cables and wiring harnesses
It is no different than the US Congress granting ASML, a Netherlands company, a license to produce EUV lithography technology. Japan and the Netherlands are closely integrated geopolitically with the US for all practical purposes. China, by contrast, is aggressively adversarial in its geopolitical ambitions.

The difference really couldn't be more stark.
> so you need to have the basic understanding to handle it yourself

No they don’t. This idea that people need to become System Administrators to use Linux really needs to die.
I think this guy is like Shadow in this video: https://youtu.be/n__GJuqLb00?si=4kqBifugIQGSdp2q
> Mental illness could also be defined by a person's ability to function in their community and social constructs.

Are you suggesting rebelliousness and non-conformity should be considered mental illnesses, defects to be cured?
I knew a guy who worked on that film and still didn't know what it was about. I personally enjoy the scene where she's touring a house with a broker while it's on fire.
In terms of privacy, there is one aspect you can gain:

Privacy from your ISP and government. Even the UK now mandates ISPs collect data on user behaviour "just in-case" (snoopers charter), and it has been confirmed one of the big three mobile networks has implemented this, but not which. It's bad enough trying to put up with big tech.
Ask HN: What would attract you to attend a 1day course on a tech of your choice?
I'm going to be delivering a 1 day irl intro course to d3.js. I'm trying to put together a format and offering that will stand out.

Regardless of the tech, what would (or wouldn't) attract you to attend?

E.g. Credentials of the instructor? Supported time to work on a self-directed project? 1 on 1 time? Etc.
You don’t have to, the car will stall out. Another scenario: you are in 5th gear and the cruise control slows down to 15mph. The car stalls. My manual did that 25 years ago
Both RAG and infinite contexts in their current states are hacks.

Both waste compute because you have to re-encode things as text each time and RAG needs a lot of heuristics + a separate embedding model.

Instead, it makes a lot more sense to pre-compute KV for each document, then compute values for each query. Only surfacing values when the attention score is high enough.

The challenge here is to encode global position information in the surfaced values and to get them to work with generation. I suspect it can't be done out of the box but we it will work with training.

This approach has echoes of both infinite context length and RAG but is an intermediate method that can be parallelized and is more efficient than either one.
There’s always a chargeback.
I'm not sure I follow? If you rule out any other motive, someone stabbing someone else in broad daylight, unprovoked may be attributed to mental health issues.
Phanpy is an elephant Pokémon,
I haven’t thought about this before but is this why drug names are so semi random? I always through the fake names were trying to invoke some similar idea to their name but is it basically just for SEO type purposes?
I am an American and also don’t have anyone I know, nor far off acquaintance killed, therefore I conclude the US is actually fine with it comes to traffic.

Why are you using an anecdote to define your data here?
Because we like to blame scary things like guns, rather than confronting the fact that giant SUVs and distracted driving habits are far more dangerous.
Similarly interesting development: "green lightning" electricity + air + ammonium => ammonium nitrate fertilizer
Not every app needs to be run with "full privileges" (or "as root" as some might call it), but it does usually end up being a binary decision on most distros if you're not careful. Either it can change everything or it can only affect the entire user profile it's running under. Bwrap and friends allow you to do a lot of extra isolation and get much more granular, but non-root console-only apps are generally safe to run (and safer still to run under their own user instead of yours).
ASIC, RTL, tapeout, FPGA and Verification are all keywords you can use to find job descriptions. Each company is a tiny bit different, so there is a fair bit of variation.
I agree, most people watch the movie for the story that unfolds. Few are looking at things like framing the subject, the pull of the focus, subtle lighting differences between scenes, they are interested in the story, not the art of filmmaking. The people offended by this are the ones that are crying about the art being taken out of it.
Pink Floyd's "The Wall"
> what the goal is?

Economies of scale.
> I kinda think having a tool to invoke `bwrap` is overkill for most cases.

It sounds like you built yourself some tooling that consists of miscellaneous shell scripts/functions/aliases.
I'm prompted to login
Completely agree. Most of his content appears to be clickbait garbage.
Aguirre, The Wrath of God.

I studied it at uni and wrote an essay where I explained that the main character couldn't be a symbol of both fascism AND a film director, because that would mean the director was calling himself a fascist. My lecturer's response was something like "why not?".

I was a very black-and-white thinker at that time, and his response was eye-opening for me.
This “SQLite isn’t good for production” mentality really needs to die. It’s a myth.
Good point! If datasets get that large that is an argument in favor of RAG