skysight-inc/HackerNews huggingface dataset:
The problem with microtransactions is, who defines the minimum unit? Instead of just publishing a $0.25 article, a site could publish a $1.25 five-part series, each part duly ending in its own cliffhanger. And they'll do it as long as enough readers still keep reading it. (It doesn't matter how you'd prefer to read it, it only matters what they can get away with before profits start to decline. And it wouldn't have to be as drastic as this example, it would be a more subtle trend of less information expressed in more words over time.)

Also, with 10x or more value on each reader's copy of the article, say hello to more stringent copyright enforcement (either legally or socially: how dare you replicate the work of this beloved blogger and deprive them of income!). And the complete death of independent search engines.

I just don't see ubiquitous microtransactions leading to anywhere good on a social level. And of course, without a ban on advertising (however that's supposed to work), you'd just end up with sites full of ads on top of microtransactions.
You mean the American language
Sophie Scholl and the White Rose
I'm not sure what comment you meant to reply to, but it certainly wasn't mine, as you have my ideology backwards there.
Some of us actually go as far as ban billboards, electronic billboards, or even during elections - some counties in Germany limit all kinds of election related propaganda to a few large billboards at the entrance roads, and the rest is kept clean from the bullshit.
> So we have some annoying advertising. Small price.

Ha. Tell that to the millions of victims from false advertising of Big Tobacco and Big Pharma.

That prosperous society and veritable wonderland is not looking so great these days. Perhaps the fact that the tools built for psychologically manipulating people into buying things can also be used to manipulate people into thinking and acting a certain way could be related to your current situation? Maybe those tools shouldn't have been available to everyone, including your political adversaries?

But hey, glad you're enjoying it over there.
https://www.llama.com/llama4-reasoning-is-coming/
I think prompt processing also needs all the weights.
I'm surprised at the lack of guidance in that prompt for topics such as helpfulness, critical thinking, scientific reasoning, and intellectual honesty.

Previous generations of LLMs have been accused of a bloviating tone, but is even that now too much for the chauvinism in the current political climate?
I don't think open source will be the future of AI models. Self hosting an AI model is much more complex and resource incentive than traditional open source SaaS. Meta will likely have a negative ROI on their AI efforts
And we could make those catalogs more appealing to the general public by inserting a lot of exclusive content like news, essays, or short stories.

I basically agree with the spirit of what you're saying but the line is not clear.
So far I’ve had a Roomba, a Eufy and now a Roborock. The Eufy was quiet but was tearing up our trim and furniture so it got retired. The Roomba tore up trim/furniture, was incredibly loud and it was extremely expensive for having no special add-ons. The Roborock is laser guided, clearly mapped our house to gain efficiency, empties itself and is reasonably quiet - cost about $500. Roomba with some of those and arguably lesser features is several hundred dollars more. iRobot is getting the outcome it built for itself.
10 million token context window? Damn, looks like Gemini finally has some competition. Also I'm a little surprised this is their first Mixture of Experts model, I thought they were using that before.
I assume they're getting these massive windows via RAG trickery, vectorization, and other tricks behind the curtain, became I've noticed the same as you- things start dipping in quality pretty quickly.

Does anyone know if I am correct in my assumption?
The Rekursiv Chip–A Smalltalk Machine
That a significant proportion of advertising involves deceit, coercion, and captive audiences says a great deal about the nature of it. The First Amendment codifies the right to say what you want, to print or otherwise make public your thoughts. That doesn't give anyone, or anything, a right to force their ideas into the minds of the public or a subset thereof. And while advertisers are not quite yet forcing anyone to consume their product at the proverbial "barrel of a gun" they are far beyond the norms of human communication.

It is not acceptable for a stranger to come up and start shouting at you while you're trying to read, or hold a conversation, do your shopping, or put gas in your car. So why is it somehow acceptable for advertisers to do so? Would you want to pay for a course of instruction, some unknown percentage of which was not instruction, but was actually conducted at the direction of unknown others, who, with no regard or concern for your life, liberty, well-being or happiness were trying to extract wealth from you? Yet that is exactly what happens with much of our media-mediated experience of the world.

I think the underlying changes in the technology of communication have allowed advertising to grow without sufficient thought on whether such expansion was actually a public good. Like license plates - the impact of which changed radically when the government could, thanks to advances in technology, use them to monitor the position of virtually all vehicles over time, instead of being forced to physically look up who owned what vehicle - the explosion of media over the last century has been accompanied by an immense shift in the impact and capability and intrusiveness of advertising. And it's legality needs to be reassessed in that light.
In our field (AI) nobody can see even 5 months ahead, including people who are training a model today to be released 5 months from now. Predicting something 5 years from now is about as accurate as predicting something 100 years from now.
What a delightful little question!
Depends on quantization. 109B at 4-bit quantization would be ~55GB of ram for parameters in theory, plus overhead of the KV cache which for even modest context windows could jump total to 90GB or something.

Curious to here other input here. A bit out of touch with recent advancements in context window / KV cache ram usage
It's a joke made by Steven Colbert at the 2006 White House correspondents' dinner which referenced the Bush Administration's low poll numbers and the tendency of that administration to attribute bad press to "liberal media bias." This is also the administration that brought us the use of the term "reality based community" as an anti-leftist pejorative.

It is not meant to be literally interpreted as attributing contingent political preferences to the universe, but rather to be a (politically biased) statement on the tendency of conservatives to categorically deny reality and reframe it as leftist propaganda whenever it contradicts their narrative. One can extend this "bias" to include the rejection of mainstream scientific and historical narratives as "woke" by the right in a more modern context.

[0] https://en.wikipedia.org/wiki/Stephen_Colbert_at_the_2006_Wh...

[1] https://en.wikipedia.org/wiki/Reality-based_community
Not heard of this movie before but it reminds me of Clubbed To
Death, another French movie based on a popular electronic album.

I’ll be sure to check out Eden too.
I think the most important thing to note here, perhaps more so than the context window, is that this exposes some serious flaws in benchmarks. Per benchmarks, Maverick is competitive only with older models like GPT-4o or Gemini 2.0 Flash, and not with anything in the last few months (incl. reasoning models).

However, the LMArena head to head leaderboard ranks this as 2nd place overall:
https://lmarena.ai/?leaderboard

This would indicate there is either a gap between user preference and model performance, or between model performance and whatever benchmarks assess.

Either way, it is surely a huge deal that an open source model is now outperforming GPT 4.5.
According to Economist:

Trade deficit in physical goods: $1.2T

Total services exports, including finance and IT: $1.1T

Trade surplus in services: $295B (just 25% of what is needed)
You do anyway afaict
Having lived overseas, the US isn't a "veritable wonderland of consumer choice". There are 5 grocery store chains, for the great majority of the country there is one way to travel: car. At the store (Kroger), I can buy 2 kinds of salt on the shelves. Where is the "veritable choice"? It has been told in the advertising but the reality is very limited.
How? I can't find it in the docs.
Continuous Integration ≠ Continuous Delivery
> No money is exchanged when I promote my own product through my own channels

This is not really advertising, but it’s not really a problem either. People expect you to promote your own products and take it with the grain of salt they should. Besides, there are only so many channels you can possibly control.

> nor when I promote my friends products, whether I disclose it as promotion, or disguise it as my genuine unaffiliated opinion. Sometimes it really is a genuine opinion!

Sure. Maybe this is advertising that slips through. If all were down to is people advertising their friends’s products for no money then we would have eliminated 99.99% of the problem.

Further, if you have a highly influential channel, the cost of promoting a non genuine opinion about a friend’s product would almost certainly hurt your reputation, providing a strong disincentive to do such a thing.
I've got a roborock s6 from 2019 and it's still going very well. I I've had it dismantled a few times, once when the cat pissed on it, once to clean the vacuum motor, and most recently when one of the wheels got clogged. It's really easy to replace individual parts, this is how consumer electronics should be.

Unfortunately I've read the later models are harder to repair, and I would like to upgrade for the better mopping and self emptying.
I'd claim services being ad-funded is not dissimilar from being funded by a JS crypto miner - which is to say while it does move money to that service, it's on net a waste of resources and average affordability would be better without it.

For instead of your ISP spending 20% of their resources advertising (because otherwise they'd lose market share to ISPs that are advertising), they could likely offer email hosting and basic web hosting without you paying any more than you do currently. Competition between companies should be directed towards productive ends (improving their product) else it just becomes a giant zero-sum game of resource wastage.
And given that some people are afraid of malicious software in some brands of mini-PCs on the market, to have some more trusted product around will also be an asset.
Postgres does have "reset" support.

There are several ways commands depending on what you want to reset. If you're only interested in mutable state changeable with SET, you can use RESET ALL instead. This resets configuration settings such as the time zone, statement timeout, and so on.

Postgres has different fine-grained ways to reset other aspects of a session, such as closing cursors (CLOSE ALL), unlistening from notifications (UNLISTEN), deallocating prepared plans (DEALLOCATE), and so on. Finally, there's DISCARD ALL, which resets everything.

I agree about error handling. Most clients just disconnect on a connection error.

One gotcha about Postgres queries is that running queries do not get cancelled when the client disconnects. This has always been a weird one that's quite dangerous, as it can lead to dog-piling — if a client starts a slow query, then times out or cancels its connection, the query lives on; then if another identical request starts, same thing happens, and soon you have 100 queries running that are doing the same thing and getting slower and slower. You have to be very careful with retrying.
There is a key distinction and context: caponation has a productive purpose from the pov of farmers and their desired profits.
the needle in a haystack benchmark looks good but at this point I think we need new benchmarks to test actual understanding of content in such a large window.
Everything is possible with math. Just ask string theorists.
Well yeah, nowadays high-end micro-controllers may have an integrated USB HS PHY (notably STM32F7's and the MIMXRT1060 used in Teensy 4, and many others), but the basic cheap attiny-like or ice40-like hasn't and most usually require going through an external PHY. I've been wanting to get into using the CH32V305 cause it is in a hand-solder-friendly TSSOP-20 package and has integrated USB HS PHY but I hear it doesn't have a software support and I don't see it on microchip/digikey/etc. Though we may soon have easy access to 20-cent microcontrollers with USB HS, but still the protocol feels incredibly complex and way overkill for simply interfacing a peripheral to a computer.
> Gur fvmr bs gur pbyyrpgvba jbhyq punatr!

Ubj vf guvf n ceboyrz gubhtu? Vg qbrfa'g frrz gb ivbyngr nal bs gur shapgbe ynjf!
I don't want to hunt the details on each of theses releases, but

* You can use less GPUs if you decrease batch size and increase number of steps, which would lead to a longer training time

* FP8 is pretty efficient, if Grok was trained with BF16 then LLama 4 should could need less GPUs because of that

* Depends also on size of the model and number of tokens used for training, unclear whether the total FLOPS for each model is the same

* MFU/Maximum Float Utilization can also vary depending on the setup, which also means that if you're use better kernels and/or better sharding you can reduce the number of GPUs needed
> LeCun consistently states LLMs are not the right path yet LLMs are still the main flagship model they are shipping.

I really don't see what's controversial about this. If that's to mean that LLMs are inherently flawed/limited and just represent a local maxima in the overall journey towards developing better AI techniques, I thought that was pretty universal understanding by now.
Nvidia GPUs can natively operate in FP8, FP6, FP4, etc so naturally they have reduced memory requirements when running quantized.

As for CPUs, Intel can only go down to FP16, so you’ll be doing some “unpacking”. But hopefully that is “on the fly” and not when you load the model into memory?
yep, looks like it!
Why do I have the feeling my subscription to Github Copilot Pro since day 1 is going to feel a downgraded experience very soon?
I agree with this. And it doesn’t help that the President uses it like one would usually use ‘furthermore’ when he’s vamping one more element to a list.
Let me explain the joke for you: liberals are less likely to believe that verifiable facts and theories are merely contingent political preferences.
Frankly, the first order effects as well.

Right now we're seeing the 0th order effects.
> Can’t let the plebs bypass Xcode to develop on their Macs!

AFAIK, they support that. https://www.swift.org/swiftly/documentation/swiftly/getting-...:

“Overview

To get started with swiftly you can download it from swift.org, and extract the package.

On macOS you can either run the pkg installer from the command-line like this or just run the package by double-clicking on it (not recommended):

installer -pkg swift-x.y.z.pkg -target CurrentUserHomeDirectory

Now run swiftly init to finish the installation:

~/usr/local/bin/swiftly init

Swiftly will install itself and download the latest available Swift toolchain.”
I find it impossible to discuss bias without a shared understanding of what it actually means to be unbiased - or at least, a shared understanding of what the process of reaching an unbiased position looks like.

40% of Americans believe that God created the earth in the last 10,000 years.

If I ask an LLM how old the Earth is, and it replies ~4.5 billion years old, is it biased?
the large context windows generally involve RoPE[0] which is a trick that allows the training window to be smaller but expand larger during inference. it seems like they have a new "iRoPE" which might have better performance?

[0]https://arxiv.org/pdf/2104.09864
Will you open source this by any chance? I'd be curious how it was built!
> there is no probabilistic link between the words of a text and the gist of the content

Using n-gram/skip-gram model over the long text you can predict probabilities of word pairs and/or word triples (effectively collocations [1]) in the summary.

[1] https://en.wikipedia.org/wiki/Collocation

Then, by using (beam search and) an n-gram/skip-gram model of summaries, you can generate the text of a summary, guided by preference of the words pairs/triples predicted by the first step.
Uhm no, I don't think so, the method consists of illuminating fiber optic cables in the sky to identify possible drones in flight.

Another info: https://militarnyi.com/en/articles/fiber-optic-hype-research...
This is a classic: https://www.destroyallsoftware.com/talks/wat
Stop spamming the thread, sheesh.
I apologize. I didn't provide additional context, and unfortunately you made an flawed conclusion about my premise wasting your time with an irrelevant argument.

I'm not lamenting wealth inequality, nor discussing other advantages (real or perceived).

I think that achieving success and wealth (e.g. not simply being born with it) has an impact on the development of a human brain, based in large part the behavior of rich/famous/successful young adults, AND what their personalities ultimately become once the have fully formed brains (~27 years old).

Specific to these teenagers, how will effectively becoming "rich" and successful at such a young age change the final formation of their brains, and ultimately shape their behavior?
The stance of always taking the opposite because fuck tribalism makes it hard to identify what one’s actual values and opinions are.
Yeah, FB got this bad over the last years. I was a big advocate for Facebook, I really saw the value in having a feed based on posts of people/pages I choose to follow. These days, it's full of absolute garbage, if I open it by mistake, I'm disgusted.
Like so many things, it depends on the context. You didn't want it to ask questions if you're asking a simple math problem or giving it punishing task like counting the R's in strawberry.

On the other hand, asking useful questions can help prevent hallucinations or clarify tasks. If you're going spawn off an hour long task, asking a few questions first can make a huge difference.
LLMs are great at cutting through a lot of right (and left) wing rhetorical nonsense.

Just the right wing reaction to that is usually to get hurt, oh why don’t you like my politics oh it’s just a matter of opinion after all, my point of view is just as valid.

Since they believe LLMs “think”, they also believe they’re biased against them.
Sad to see EOL coming up, but too bad NASA's budget has been cut so back over the years.

We just had a smaller planetary alignment a few months ago. Would have been nice if NASA had the budget to send out a more robust craft a few years ago. But I guess science no longer means anything to the US. Especially now.

Maybe China will take up the mantle, I heard they are about to send out a rather long term interesting craft, but I forgot the details.
Have you tried dropping the "can you"? I haven't had a problem using minimal verbiage - for instance I prompted it with "load balancer vs reverse proxy" yesterday and it came back with the info I wanted.
You've just described how laws actually work - but we have created modern judiciary system so that it will tend to produce outcomes considered fair by the majority. Algorithmic enforcement of justice without human deliberation of case-by-case specifics would be worse that the worst horror stories about soulless bureaucracies.

That's why we have judges and lawyers, so that the outcome can be decided as a communal process instead of just one person deciding what is punishable - even if the person is the developer building the automated justice dispenser and they'll be not around when the decision is taken, it would still be made by the whims of a single enforcer.
Remind me why corporations are protected by human rights such as free speech.
There's a system for describing that - the "Game Cruelty Scale": https://www.ifwiki.org/Cruelty_scale

A lot of early adventure games were Cruel - requiring the user to replay the game over and over because they got something wrong was a cheap way to extend play time without having to add more content. Thankfully, most modern developers have realized that players hate having to do that.
You seeem pretty confused about what the US is(was?).

The CDC has a program that works with local departments in relation to local laws, maybe you can get things like this cancelled so Mexico and and Canada can finally share a border.

https://www.cdc.gov/restaurant-food-safety/php/investigation...
Just from the headline alone: oh please dear god yes.

The internet became usable after implementing the Pi-Hole. So much noise, so much wasted bandwidth, so many unnecessary lookups, gone with a Raspberry Pi and a few packages.

While other commenters are getting into the technical weeds of things, the reality is that the OP is right. Ads don’t inform, they manipulate. They’re an abusive forced-marriage that we cannot withdraw from even with ad and script blockers, because so much of society is built upon the advertising sector that it’s impossible to fully escape them. People like the OP and us are mocked for moves to block billboards in space as being “alarmist” or out of touch, yet driving along any highway in the USA will bombard you with ads on billboards, on busses, on rideshares, on overly-large signs with glowing placards, in radio and television, on streaming providers who raise our rates on what used to be ad-free packages.

Advertising is cancer, and I’m tired of pretending it’s not. Let’s get rid of it.
Here's how not constitutional this idea is: municipalities can't even ban circular flyers, which is essentially junk thrown onto the doorsteps of everybody's houses, junk nobody wants, because the First Amendment proscribes those ordinances.
Yeah, and LVDS is something that really cheap ice40 FPGAs support with not much of an area cost.

(In my original comment I should have said to use differential signaling for going off-board.)
I’m not understanding why this is a good standard: right now, anyone who sees a billboard or a TV ad has no incentive to act according to the business’s demand, yet you want to ban those. So you think it would be OK to advertise to discoverers, but not to final purchasers.
It’s going to take a while to see how good this window is for real use; they’ve used a couple new ideas to get to 10M token context. Right now the only really good long token model out there is Gemini Pro - and its effectiveness does start dropping maybe in the 200k token range. I imagine insiders at GOOG have access to more than the published 1M token range there.

It will be fun to see what we get here, but I have no doubt the extra tokens will be useful - lots of use cases can do almost as well with summary-level accuracy memory.
A start would be banning of misleading statements and half-truths.

A panel of randomly selected 100 people will be the judge and jury.
I've been saying this for years. It would be great to make advertising illegal.

Advertising is just psychological manipulation. Any argument that there's "good" advertising that respects the target and is merely informative... well, maybe there is, but it's overshadowed by the other 99.9% of the garbage.

Implementing this feels impossible, though. There would be disagreement as to what constitutes an ad. I disagree with the author that advertising isn't an exercise of free speech; I think that would be a huge roadblock in any country that enshrines free speech rights.

But man, that would be great.