skysight-inc/HackerNews huggingface dataset:
Has anyone built a search engine that uses LLMs to pre-grade every page with metrics such as:

- Commercial bias (content compared to the source, which it learns about)

- Insincere motives

- Bloat (how many words it takes to say how little to penalize SEO bloat)

I would assume that using LLMs, we can get a pretty good idea of what is SEO bloat and who the bad actors are by this point, and just penalize those results.
I didn't think you need to find that many bugs to make code reviews useful. Even if you only find a handful of bugs it is probably with it.
Keep in mind the longer the code exists the more expensive it is to fix it. Finding a bug early can save a lot of time and money down they line.
Also as someone else pointed out they can help with code quality. So they can help prevent someone adding a bug later.
The US money supply is property of the US Treasury. Congress just needs to call those puppies home by increasing taxes and aggressively pursuing illicit and off-shored wealth.
I made a graph of GPT-3's and GPT-4's price history
Loopt
> AI is tremendously bad at working with Humans who actually have taste. You generate an AI image with the subject on the left; you ask for a revision, same image, but move the subject to the right side of the image; it changes too much, or generates new images entirely rather than iterating. Its not-obvious that this will get better because it is somewhat antithetical to the way the AI works.

You can mark parts of a generated image in Dall-E/ChatGPT and tell it how to change it. That’s generally called inpainting.

And you can iterate on the same image. For example by leaving the seed unchanged while experimenting with the prompt. Or by using image to image generation instead of text to image.

And then there are the endless ways to change the style of an image to get a desired effect.

And so on. So I personally wouldn’t subscribe to your hypothesis that these tools just show the average taste and people with their own taste can’t use them.
This is a fantastic example of clear technical writing! The NTSB goes out of their way here to define domain-specific terms (in the footnotes) to ensure this report is digestible by a public audience, which I think is really neat. We need more examples of this type of technical communication from government agencies.
I’m not involved in the space, but it seems to me that having a model, in particular a massive model, exposed to a corpus of text like a book in the training data would have very minimal impact. I’m aware that people have been able to return data ‘out of the shadows’ pf the training data but to my mind a model being mildly influenced by the weights between different words in this text hardly constitute hard recall, if anything it now ‘knows’ a little of the linguistic style of the authour.

How far off am I?
It’s possible for the system to last hundreds of years or go really bad over a decade. Generally if debt is increasing but debt to GDP is decreasing then that’s no problem as the economy can out grow the debt. Much of US history falls under that umbrella.

Unfortunately, slowing GDP growth associated with a developed economy has pushed us into the red more often and for longer.
Thank you. Had no idea this existed.
Is that defense spending? Or healthcare spending?

And if it is defense spending, I assume you should at least discount the large portion of VA that would otherwise be Medicare if it didn't exist.
But the headline compares it to defense, which also tends to grow with GDP. So it's a substantive fact that debt service is more than defense spending.
Even as a very inexperienced musician I think I can say these are not very compelling examples? They sound like unfinished sketches that took a few minutes to make each, but with no overarching theme and weirdly low fidelity. An absolute beginner could make better things just by messing around with a groovebox.
Oblivious HTTP is such a joke. The idea that an "independent organization" is your "partner" is a non-starter for me. How can you put those words in the same sentence? And then base the entire security of the whole feature on this premise?
> A century more?

No one knows because it depends on a lot of variables that cannot be predicted in advance. The only major short term threat is that we default due purely debt ceiling debates / brinkmanship, not because of the burden of the debt itself.

The debt becomes a very real problem if hegemony of the US dollar as a reserve currency is ever disrupted. I don’t see that happening anytime soon, though.

> What's the future of the state as an institution?

Very high tax rates, unfortunately. Although there’s worse outcomes (currency destruction). These are the possible long term consequences.
But this is also misleading because we don’t agree on what counts as defense, so we call everything defense.

The armies of theoretical physicist working on new optical devices to study fusion could fall under the defense department if their work has some slight application for nuclear weapons, even though the economy benefits much more having a skilled workforce With strong science backgrounds.
We don't need to. We have LLMs now
Mutlimodal neural networks converge to a shared statistical model of reality
If you like this kind of stuff, CUE(lang) is highly influenced by Prolog and pre 90's NLP. The creator Marcel worked on a Typed Feature Structure for optimally representing grammar rules to support the way NLP was approached at the time.

The CUE evaluator is a really interesting codebase for anyone interested in algos
Except all the big tech CEOs have head AI honchos who are huge names in their own right, eg yann for meta and demis for Google. Probably couldn't bring him into those places without ruffling some pretty big feathers
This has been understood for a couple decades now.. the headline should be a little clearer about the innovation.
Debt to GDP is what matters and many are far worse than the US. A huge percent of US debt is domestically held too so it’s just kind of pumping money around.

Not saying this is a great way to do things, just that we are nowhere near the worst off.
The leading hypothesis right now is that a Ukrainian special ops team blew the pipeline, I believe.
GPT-4o is pretty fast, especially with the desktop app that lets you use option-space to just start talking to it.
Were you around for the late 90s?
Never use de Bruijn indices, especially if you program I
HN post re: FABLES: https://news.ycombinator.com/item?id=39982362

FABLES/booklist.md: https://github.com/mungg/FABLES/blob/main/booklist.md

/gscholar_related? FABLES:
https://scholar.google.com/scholar?q=related:Y-Hx-kplbEUJ:sc...

/gscholar_citations? BoookScore:
https://scholar.google.com/scholar?cites=1796862036168524911...

...

From that one day awhile ago: https://news.ycombinator.com/item?id=38347868#38354679 :

> "LLMs cannot find reasoning errors, but can correct them" [ https://arxiv.org/abs/2311.08516 ] https://news.ycombinator.com/item?id=38353285
My argument wasn't that there was a cabal of shady investors trying to influence perception here. your observation is certainly valid there is general disdain for Google but specifically I'm calling out people that were blatantly telling lies and making outlandish claims and attacking others who were simply pointing out that some of those people have financial motives (either being backed by YC or seek to benefit from the work of others).

None of this is surprising to me and shouldn't shock you. You are literally on a site called Ycombinator. Had this been another platform without ties to investments or drawing from crowd that actively seeks to enrich themselves through participation in a narrative, this wouldn't even be a thing.

Large number of people who read my comment seems to agree and this whole worldcoin thing seems to me just another distraction (We've already been through why that was shady but we are talking about something different here).
I have been using Google AI search results more and more.

I'm worried for HowTo websites because they will probably lose a ton of traffic.
Matt Levine likes to say that the big Wall Street banks are socialist paradises that funnel almost all of the returns to the workers.

It happens everywhere
Don’t forget that rubbish cleaners throw the most rubbish on the streets. If there would be no rubbish on the streets, they would be out of a job.

Now think crime and police: without crime, the police would be out of a job.

A consultant has no interest that the project they are consulting on is ever completed.

Of course these examples aren’t to be taken seriously, they merely illustrate some potential conflicts of interest of roles within society.
Investors also know they'll be among the first the government calls upon to foot the bill.

Capital gains and unrealized gains taxes are among the increases the current administration is pitching (the unrealized gains is technically more of an advance than an increase, but because it is owed before it is realized, it will feel like an increase).

Add to that the perennial desire to increase corporate taxes (again, directly affecting investors) and it's probably safe to say that if you're an investor, you are the last person to feel good about the prospect of a fire sale shoring up the government.
Total wealth of all US billionaires is 4.8 trillion.
Tax it at 100% and the US still owes 30 trillion.
US accrued over 2 trillion in debt just in 2023.
So give it 2 years and all the billionaires are destitute, companies and employment collapses because owners had to dump all of their shares on the market and the US still owes the same or more.

Then what?

The US has a spending problem, not an income problem.
Stock prices go up and down. A stock downswing very rarely has economical consequences for the company whose stock it is, and even more rarely does it have such consequences for other companies.
I still would like to search and not get the dog crap that is Google's Internet, in addition to using LLMs myself.
A lot of people in my demographic have amassed roughly "fuck most people" money rather than "fuck everyone" money. Beyond a certain point, it's easier to coast on your nest egg and do other things like family, volunteering, or living a slower life rather than relent to reactive, rudderless corporate bullshit like RTO.
You're all over this forum spreading white nationalist and fascist sentiments, aren't you? Hard to miss you with a username like that.

The Soviet Union was an authoritarian regime and lost the technological arms race in silicon. Why?

The PRC is an authoritarian regime and lost every technological arms race it's ever participated in, often to its tiny little democratic neighbor, Taiwan. Why?

Japan built an HSR. So did Taiwan. What's so special about the PRC?

The PRC has become mall-ified. When was the last time you went? It's a static and sterile place. Alleys in Shanghai I used to love for the food stalls are now simply malls with chain food courts. Is that progress? Yuck. Not every country needs to go down the path of the USA.

Also it's simply not true that places like the PRC are culturally homogeneous. It is true that ethno-nationalist interests sell this lie, which is why the CPC propagandizes about international Han Communism and does genocide in Xinjiang. In reality, the PRC is composed of literally hundreds of ethnic groups. Every city has a language they speak alongside mandarin, and each is distinct from the other.

Elsewhere you're arguing that past societies were also culturally homogeneous, and I can't imagine what society on earth had the kind of innovations you'd acknowledge that was anywhere near culturally homogeneous. Ford's era was one of huge amounts of immigration to America (a peek into the white nationalist/ han chauvinist lie - remember, the Irish and Italians weren't white back then!), both Greek and Rome were flush with "foreigners," the enlightenment era was kicked off by European encounters with indigenous people, who then visited Europe and mocked them for their rigid social structures. So I just can't envision what you mean.

Basically, what you're saying isn't rooted in reality.

Why did you choose that username?
That's hilarious. Your comment clearly got seen by someone.
More common than you think. Cross reference the list of Betty McCollum’s donors and Congressional allocations in the defense budget.

That’s an open secret in defense tech startup circles. Want money from Congress? Open an office in Minnesota and hold a fundraiser for the Congresswoman.
Not yet. Meta is currently offering hardly any COLA while demanding RTO. Fuck 'em and the horse they rode in on.
This kind of wild speculation is not encouraged over here, and most people don't want garbage in the comments that they have to sift through, so "just ignore it" is not a valid defense. See the comment section of the guidelines: https://news.ycombinator.com/newsguidelines.html

> Literally the same people are left with the bag after each bubble

People who buy stocks based on hype, feed bull runs, and proceed to hold and try to time the market, "coincidentally" are usually left holding their bags. That in no way implies any kind of rigging beyond the basic dynamics of the stock market.
I would like a bit more convincing that the text watermark will not be noticeable. AI text already has issues with using certain words to frequently. Messing with the weights seems like it might make the issue worse
The post you replied to didn't say anything about the Internet being sick.
Those poor investors. Sad! /s

Tax rates are incredibly low. Investors should be happy the free for all lasted as long as it did.
This sounds dumb - but what if you give it all the limericks MINUS the one you want it to answer about?

I think it will fail, but this actually seems like the cleanest way to demonstrate it.
Office Space, The Matrix, Fight Club

Arguably all the same movie
Sitting on the roof?
If you look at FRED data, even complete confiscation of all wealth from the top 0.1% is about $20T. IOW about 7 years of deficit spending at the current rate, if that, at the cost of decimating the underlying tax base - a lot of that $20T are productive assets which you can’t really sell on the open market in the absence of buyers, all of which you’ve just stripped of capital
Clinton presidency is what comes to mind. Higher taxes, lower deficit, there was a real concern what would happen if the government stopped borrowing money.

More taxes and lower defense spending made a huge impact, though solid economic growth obviously helped. We had an actual budget surplus from 1998 to 2001 though it was quickly ended by Bush.
I still can't get search in my own bookmarks most of the time, because they pushed bookmark tags hard, then have not implemented them on mobile after a decade. But at least they have a state-of-the-art snooping mechanism...
> What matters is how the debt burden is changing over time

It is increasing. (Namely, to greater than the defense budget.)

> Understanding the impact of national debt is a lot more complicated than a single number,

As single numbers go, interest as % of GDP is a good one.

For the last 20 years, it's been <= 1.8%. Last year it was 2.4%. [1]

[1] https://fred.stlouisfed.org/series/FYOIGDA188S
It's PR for sure. A genuine announcement would have addressed the elephant in the room.
IMHO a major part of the problem is that the Internet never had a mechanism for paying for good content. Everything is “free” therefore ads emerge as the only monetization strategy and you did a good job outlining the rest.

I’ve started trying to pay for good journalism, especially good indie journalism. I also Patreon a bunch of podcasts, buy high quality software if the price is reasonable, buy albums of my favorite music, buy films, and so on, while actively avoiding both gratuitous subscription models and the ad web.

Pay for it or it either doesn’t get made or it pays for you. Free is a lie and piracy undermines quality.

Edit:

All the paying for good stuff I outlined above averages out to around $100-$150/month. It’s less than I usually spend on restaurants and coffee shops and far less than groceries for our family. Restaurants in particular feel like a far more frivolous expense.
Don't private destructors in c++ enable this?
> This is actually misleading. You’re only right if the US stops spending

This is actually misleading, your statement is only correct if “spending” is replaced with “additional borrowing”. (Assuming the federal government has non-zero revenue, “spending” does not imply “additional borrowing”.)

Moreover, GP’s broader point – that the burden of federal debt can be reduced even if the total amount is not – applies more broadly than just the static-total-debt case, it can be true with additional net borrowing, so long as the debt service cost at year y+1 is a smaller share of the GDP than in year y (assuming debt service relative to debt for simplicity, this would hold if the debt: GDP ratio was the same or less, irrespective of the nominal, or even real, level of debt increasing.)

E.g., suppose the US has $25 trillion GDP and 37.5 trillion national debt. Over the course of one year, it reaches $26.25 trillion nominal GDP, $38.625 trillion nominal national debt, and has experienced 2% annual inflation, so that, in base year terms, real GDP is $25.735 trillion, real debt is $37.828 trillion. Nominal debt is up, Real debt is up. So is this worse? No, because debt:GDP dropped from 1.5 to 1.47, so – again, assuming constant debt service costs per $ of debt – the share of output needed to service the debt is reduced.
but physical card packs have had this "issue" since inception of magic the gathering. Understandably, the digital cards don't have the same physical manifestation and thus feel like it could be taken away at any time, but the loot box mechanic is no different to the random booster packs you'd buy.
They sell the shovels and the buckets, they're not digging for gold.
All major public facing organizations are slowly bought out by extremely wealthy and influential groups when they get big enough for narrative control purposes because ultimately mind control is the largest source of wealth and power.
I know that feeling, living life without affine types is awful.

How far are you with variants? Have you looked at Hare's union types?
> There is also no security around the systems that change traffic lights for emergency vehicles.

Yeah, when I saw the article I assumed it was about Chrome Boxes [1]. Pretty sure I was behind a guy once in San Jose that had one.

[1] http://www.textfiles.com/phreak/BOXES/chrome
Choosing a name isn't the bulk in the cost structure.
Blogspam sites are made by the exact same kind of "hustle bros" who run dropshipping companies.

The business model is very simple and requires 3 ingredients: web design, SEO, and copyediting. The first two are one-time costs. The 3rd one is a COGS and there is a whole market of professional blogwriters who charge something per 1000 words.

To answer your question, once you create a blog that starts printing money, it's in your best interest to just replicate it while changing as little of the "template" as possible, because you don't really know what element made it click.
a recent white paper aimed at the business crowd solved a lot of technical nuance debate by simply declaring that "General Artificial Intelligence" is when an AI can do better than fifty percent of humans on the tasks that they define as important -- mostly white collar desk job contents -- more than fifty percent of the time (!). The boldness to make this declaration (in the footnotes IIR) and then wax on about GAI this and that is the future.. really makes it clear that some writers will say anything for money.
Google Gemini's GPT Search Update: Self-Revolution and Evolution
Tesla is buying ads to promote Elon Musk's record $52B pay deal
What’s the horse gotta do with it? /s
I highly recommend Lyn Alden, who spends a lot of time on analysis of the macro conditions and potential outcomes, expressing her findings and opinions in clear, engineering language.
It is also important to remember that the money isn't borrowed out of thin air. Other nation states, corporations, and individuals have lent all this money to the US government. Lenders lend when and where they believe they will receive a return on their investment.

If and when the US approaches a position where it cannot pay the interest owed, you'd expect that to coincide with a reluctance by the lenders to continue lending.

So, you could argue that the US is not defying any odds, but rather it is consistently performing at or near the odds that have been predicted by the global public.
Non LLM efforts include alternative and even self hosted search engine indexes. I'm also curious if brave search's concept of "goggles" could work out, where you can write your own indexing logic and share it with others.
> But, like, people aren't entirely stupid. Consumers generally won't keep repeatedly going back to the same business if the service is kinda sucky. And businesses generally figure out that reputation matters and the most economically viable long-term strategy is just to give people what they want.

This isn't a law of nature. It's the result of particular conditions. Businesses in high-trust and low-trust cultures behave differently, and the descent of the US from a high-trust to a low-trust culture is going to have consequences.
What information led to your opinion?
Gotta say, on first glance I thought this was a new thing being added to Godbolt.
Yes, but we all get what the author means. UDP or TCP, SMTP or HTTP — most of it is transporting low value sludge whose purpose is to exploit its consumers. It involves everything from somewhat benign forms of surveillance/profiling to aggressively malicious scams.

You could use the infrastructure for better and many people do. But most of the content on the internet isn’t that.
They have a lot more narrative control over the artwork now.

A thing I disliked (as a kid) about the old cards, as they transitioned to these more homogenised styles, was how wildly different the cards looked. It didn’t feel like one game, and there were many artistic styles I simply didn’t like.

But looking back now, the old cards artwork is so much more iconic; in part because of the nostalgia, but in part because each card is different from those drawn by other artists, you remember them better apart.
> We send all the flattened Magic packaging and booster packs to the prison and the inmates do the product fulfillment.

Was that a joke or serious? I was enjoying the article until that abrupt end and it just felt dark. A company forcing imprisoned humans to distribute their product?
I agree. My issue with LLMs is that it isn’t clear when it is hallucinating versus when it isn’t.
Saying that the USA is in trouble because of US-dollar-denominated debt is like saying that Dwight Schrute is in trouble because he owes too many Schrute-Bucks.

https://www.youtube.com/watch?v=vPeRElll3Hw
I thought a camel's gait is much closer to two legs moving almost at the same time. Granted, I don't see camels often. Out of curiosity can you explain that more?
At this point, most of the people still using Firefox desperately want a private browser. It would be nice for Mozilla to come up with innovative new features as they did in their heyday, but everything they have attempted for the last several years has broken beloved features and betrayed the privacy of users.
"We make the network"
What’s the con? Aren’t they constantly delivering frontier models?