skysight-inc/HackerNews huggingface dataset:
> North Korea is the only country that bans advertising.

Outright banning, yes maybe. But many countries or local governments severely regulate advertising in one form or another, and no one is crying foul either.
Go back to the Grid in TRON: Ares trailer
Compiling queries is one of those things that is both Make it Right and Make it Fast.

Because bind variables and Prepared Statements go hand in hand, you want to do everything you can to coax your users into doing the right thing. If each unique query has to be compiled before first use, that’s an extra inducement to using prepared statements properly.
Needing less memory for inference is the entire point of quantization. Saving the disk space or having a smaller download could not justify any level of quality degradation.
From model cards, suggested system prompt:

> You are Llama 4. Your knowledge cutoff date is August 2024. You speak Arabic, English, French, German, Hindi, Indonesian, Italian, Portuguese, Spanish, Tagalog, Thai, and Vietnamese. Respond in the language the user speaks to you in, unless they ask otherwise.

It's interesting that there's no single one of CJK languages mentioned. I'm tempted to call this a racist model even.
I think so as well. Also isn’t the internet in general quite an extreme place? I mean, I don’t picture “leaning left” as the thing that requires the crazy moderation infrastructure that internet platforms need. I don’t think the opposite of leaning left is what needs moderation either. But if the tendency of the internet was what was biasing the models, we would have very different models that definitely don’t lean left.
I understand but the bug is closed now.
How much smaller would such a model be if it discarded all information not related to computers or programming?
Well, and Flynn's taxonomy is from 01966.
I don't think the time grows linearly. The more context the slower (at least in my experience because the system has to throttle). I just tried 2k tokens in the same model that I used for the 120k test some weeks ago and processing took 12 sec to first token (qwen 2.5 32b q8).
Or that, you know, most academic works tend to be much more progressive.
I responded to a specific assertion about a Finnish law. The US has a whole different dynamic.
Disjointed branding with the apache style folders suggesting openness and freedom and clicking though I need to do a personal info request form...
"I'd normally lie to you but," is not what's actually implied when "Honestly," is used conversationally. If you overthink things like this you're going to have a tough time communicating with people.
So some of the most critical public goods of our age, which are currently mostly ad-funded, like web search, video hosting, email hosting, smartphone navigation, etc. would become publicly funded? Great, I'd like to live in that world too. But this article says nothing about how to get there (actually it considers the demise of Google et al to be an argument in favor without even considering the fact that in the absence of advertising, Google's services would need to be either restricted to those who could afford them or taken over by the government).

Advertising certainly has plenty of negative externalities, but the positive externalities of the free ad-funded services I mentioned are absolutely mind-boggling. Try to imagine living without them (if you couldn't afford to pay for them yourself).
Many countries transitioned to democracy without a major revolution. And even when they did, virtually all reused the same state infrastructure that was established during the monarchy.

Communism was a failure because it was incompetent. But the authoritarian-capitalist government China has had since the late 1980s was nothing short of a miracle.

In the 1970s, China was as poor per capita as Bangladesh. Today, Bangladesh is still a deeply impoverished country, while China is an advanced middle income economy.
It's interesting that there are no reasoning models yet, 2.5 months after DeepSeek R1. It definitely looks like R1 surprised them. The released benchmarks look good.

Large context windows will definitely be the trend in upcoming model releases. I'll soon be adding a new benchmark to test this more effectively than needle-in-a-haystack (there are already a couple of benchmarks that do that).

All these models are very large, it will be tough for enthusiasts to run them locally.

The license is still quite restrictive. I can see why some might think it doesn't qualify as open source.
With 2T params (!!), it better outperform everything else.
It's not an excellent article.

It's basic and confuses uses abstractions with not knowing fundamentals.

It goes into all the common places of "AI will replace you if you don't think" and pretends you fundamentally don't reason or think if you interact with an abstraction or AI.

The examples are so rudimentary that I very much suspect this person is not particularly good at software engineering.

People will read this title and comment because doom posting about AI is what people want to do if they're uncertain about "losing value" but it's very low quality.
> So, if you’ve been keeping track, the journey looks like this:

> Bear / Apple Notes --> iA Writer --> Google Docs --> Scrivener --> Google Docs --> Microsoft Word --> Adobe Acrobat
The title says Database Protocols, but the author writes only about MySQL and Postgres. There are other databases out there, for example Oracle that I’m the most familiar with and it has had a break/reset mechanism built in to its protocol for at least 30 years [1]. Its a 2 step operation (2 roundtrips), one sending an error back to the client instead of the expected result and the second step will reset “current call” (not current session or connection) state on the server side and then request the client do the same.

Databases/protocols that differentiate between connection, session and call scopes, can reliably perform resets without requiring to tear down the entire connection.

Retrying is safe with no client side transaction idempotency tokens needed, as the error handling will roll back any changes done only by the failed call, not the entire transaction or session.

[1]: https://tanelpoder.com/2008/04/10/sqlnet-breakreset-to-clien...

Edit: added the comment about retry and idempotency.
"Honestly" and "literally" are now used in English for emphasis. I dislike this, but it's the current reality. I don't think there's any way to get back to only using them with their original meanings.
I don't understand Framework's desktop offerings. For laptops their open approach makes sense, but desktops are already about as hackable and DIY as they come.
Quantization by definition lower memory requirements - instead of using f16 for weights, you are using q8, q6, q4, or q2 which means the weights are smaller by 2x, ~2.7x, 4x or 8x respectively.

That doesn’t necessarily translate to the full memory reduction because of interim compute tensors and KV cache, but those can also be quantized.
their huggingface page doesn't actually appear to have been updated yet
> while pre-training our Llama 4 Behemoth model using FP8 and 32K GPUs

I thought they used a lot more GPUs to train frontier models (e.g. xAi training on 100k). Can someone explain why they are using so few?
It seems to be comparable to other top models. Good, but nothing ground breaking.
How do grocery stores work in this model?
They're only called trade "deficits" because the term was created by economists asserting the primacy of their own modeling over the real world. In terms of the real world, we're talking about trade surpluses, as in we're getting more stuff from other countries than we have to send to them. Any five year old can tell you that's a great deal. The destructionists think they are independent thinkers, yet they are actually still so thoroughly steeped in the system's propaganda that they're mixing the two and coming to some absolutely boneheaded conclusions.
Indeed, one of the notable things about LLMs is that the text they output is morally exemplary. This is because they are consistent in their rules. AI priests will likely be better than the real ones, consequently.
Thanks for sharing this here. At first I loved the simple Apache-style directory listing, very classic and utilitarian way to navigate new information. Then I tried clicking the FAQ and it wouldn't load anything until I allowed two different sources of JavaScript.
One of the links says there are 4 different roles to interact with the model and then lists 3 of them.
So fund it in a way less corrosive to the human experience.
> But humanity had been free of current forms of advertising for 99.9% of its existence

The key word here is "current forms of advertising". Advertising as a concept has been around since the invention of commerce and trade, so pretty much since the beginning of human civilization.

So sure, you can have specific issues with browser popups or data collection or billboards or whatever else, but saying "any form of paid and/or third-party advertising" should be illegal is nonsensical. Unless you can make money and trade illegal advertising will continue to exist.
The rub is that we don't know if intelligence is anything more than "just predicting next output".
Heh, you can't handle the truth so you downvote me and try to insult me, this is expected. Any non-leftist thought gets downvoted and flagged here immediately.
We did a video on Coolify vs Dokploy
https://www.youtube.com/watch?v=1POdazLoiRE
They don't need to directly. They have multiple levers of products to get more money if they wanted to.

Threads for example is introducing ads and is likely being used to train their Llama models.

That is only one of many ways that Meta can generate billions again from somewhere else.
We took the Ryzen AI Max, which is nominally a high-end laptop processor, and built it into a standard PC form factor (Mini-ITX). It’s a more open/extensible mini PC using mobile technology.
> Knowledge cutoff: August 2024.

Could this mean training time is generally around 6 month, with 2 month of Q/A?
I am not surprised to see you get downvoted like this. Leftists are not tolerant to opposing viewpoints and they live in their own self-reinforcing bubble.
Not that I agree with all the linked points but it is weird to me that LeCun consistently states LLMs are not the right path yet LLMs are still the main flagship model they are shipping.

Although maybe he's using an odd definition for what counts as a LLM.

https://www.threads.net/@yannlecun/post/DD0ac1_v7Ij?hl=en
Respectfully, what the fuck are you talking about?
These countries typically ban alcohol, gambling, children and pharma ads. They still let a large number of ads through.
or decided to increase consistency at some point. It will be interesting to see other generations approach to changes.
Yes, this announcement was a nice surprise for us. We’re going to test out exactly that setup.
> that no one would spend it to completely update their information about the world.

You don't need to "completely update their information about the world" to take in a new idea.

Second time you're not making any sense.
It’s had that for I feel like. Close to a year tho, 6 months at least
The networks themselves wouldn't be banned, but they wouldn't be permitted to endorse or give airtime to a candidate in exchange for money, I'd assume is the idea.
Errrr that’s a 671B model.
For all intents and purposes cache may not exist when the working set is 17B or 109B parameters. So it's still better that less parameters are activated for each token. 17B parameters works ~6x faster than 109B parameters just because less data needs to be loaded from RAM.
It is sufficient when you admit that you actually have no data to back up your claims.

And if you can't tell, or don't care about, the difference between police overreach and the police enforcing the law of the land, we don't have anything further to discuss.

Have a good day.
That is a very strange omission...
Indeed. Maybe the learned circuit does something like the following. For each token's feature vector, compute a representation of positions where it appears in the sentence. This could be made possible by the positional embeddings.

Token Features 0 => list[1, 5, 6, 10]

Token Features 1 => list[7, 8]

...

These "list features" would be invariant to Caesar cipher. So then the LLM could pass these list features to a learned Caesar cipher decoder unit to spit out the decoded text.

It's still unexplained, however, why the Byzantine Music Notation would trigger the this circuit while other Caesar cipher's wouldn't.
This is a normal routine topical in Epistemology in the perspective of Lakatos.

As I said, it will depend on whether the examples in question were actually substantial part of the "core belief".

For example: "But can they perform procedures?" // "Look at that now" // "But can they do it structurally? Consistently? Reliably?" // "Look at that now" // "But is that reasoning integrated or external?" // "Look at that now" // "But is their reasoning fully procedurally vetted?" (etc.)

I.e.: is the "progress" (which would be the "anomaly" in scientific prediction) part of the "substance" or part of the "form"?
I heard reality has a well-known liberal bias.
Wikipedia isn't funded by ad revenue. Kagi isn't funded by ad revenue. Anna's Archive isn't funded by ad revenue. The Internet Archive isn't funded by ad revenue. You can torrent all the knowledge you'll ever need and all you need is an internet connection.

I think we would be fine without ads.
This already happened with TikTok. The congressional law had very specific terms for a 90day delay. Trump just signed another 75day extension after the last failed .
Is this an excuse for His Higheness and Deputy His Highness?
Case Study: Automating Code Changelogs at a Large Bank with LLMs
Advertising was originally illegal on the internet. It was for non-profit activities only (university and industrial research and educational activities). When the world wide web first deployed in 1989, web advertising was illegal. The rules changed some time in the early 1990's.

I do remember a major scandal that occurred in the 1980's when somebody posted an advertisement to usenet. At the time, there was a lot of online discussion about why this was prohibited. I looked this up, and found that the internet backbone (the NSFNET) was funded by the NSF, who enforced an acceptable-use policy, prohibiting Backbone use for purposes “not in support of research and education.” [https://dl.acm.org/doi/pdf/10.1145/253671.253741]

So yes, it's possible, because we already did it once.
> I can say all the racial slurs I want on TV, and it would be quite illegal to put me in jail for it.

This is not true.

Under 18 U.S.C. Section 1464, “[w]hoever utters any obscene, indecent, or profane language by means of radio communication shall be fined under this title or imprisoned not more than two years, or both.” Under 18 U.S.C. Section 1468(a), “[w]hoever knowingly utters any obscene language or distributes any obscene matter by means of cable television or subscription services on television, shall be punished by imprisonment for not more than 2 years or by a fine in accordance with this title, or both.” Likewise, under 47 U.S.C. Section 559, “[w]hoever transmits over any cable system any matter which is obscene or otherwise unprotected by the Constitution of the United States shall be fined under Title 18 or imprisoned not more than 2 years, or both.”
https://www.wikihow.com/Leave-a-Cult
As per Dennett, it's useful for us to adopt the "intentional stance" when trying to reason about and predict the behavior of any sufficiently complex system. Modern AIs are definitely beyond the threshold of complexity, and at this stage, however they refer to themselves, most people will think of them as having an "I" regardless to how they present themselves.

I definitely think of them as "I"s, but that just always came naturally to me, at least going back to thinking about how Ghandi would act against me in Civ 1.
Why don't they support such assertion with examples instead of leaving it up to debate by it's readers? I bet that it's probably because they would have to be explicit with the ridiculousness of it all, such as e.g. evolution=left, creationism=right
All trade agreements are about surrendering some domestic power. What act or other domestic legal instrument is used is irrelavent.

In context it seems very unlikely this is about mexico, as carney is running on a platform of closer integration with mexico and strongly distancing canada ecconomically from the united states. Carney's ecconomic policies are not identical to the previous administration - it makes about as much sense to refer to trudeau/freeland's statements as it would to try and explain trump's policies by referencing things biden said/did.
the author condones public protest for the public sector; why not private protest for the private sector? had trump been master of ceremonies i suspect the author would support some protest.

as a unix hacker whose peace is often ruined by micros**t warez, i really dont care about bill nor gates. as a worker who can have my livelihood taken away at the whim of any myriad capitalists, i admire the will of american workers to risk their own livelihood to defend the lives of the many palestinians who will not live to the "precocious age of 19," which incidentally is older than the girl epstein procured for bill gates.
We've been taught about this in bioinformatics 20 years ago. That's the eventual goal - to simulate human biochemistry close enough, so you can test novel drugs without using actual humans or animals. We're getting closer and closer to that every year, but yes, it's a very hard problem to solve.
Product catalogs are advertising... The Sears catalog was full of products made by other companies, and Sears paid a ton of money to get those catalogs to as many people as possible
Emperor's logo is indeed iconic. Shame that just like most of the bands he's made logos for, he can't live on his art.
They're not endorsing candidates in exchange for money. They do use their money to run their networks, which they use to promote certain candidates and positions.

Re: "The line is clear: is money being exchanged in order to promote a product? That's advertising."
Well those sound like a great place to start.
Aligned with global population would be much more in line with China's and India's politics. And they are definitely not "as woke" as US politics.
Legend! Seems like he might be a bit of a savant type though. Sad to hear that he's working at a supermarket. He started getting attention about a decade ago thanks to social media and had an artbook published, but despite his cult status and having some big name clients he would charge like 30 bucks to draw them a logo.
perhaps but what they are referring to is about mitigating double standards in responses

where it is insensitive to engage in a topic about one gender or class of people, but will freely joke about or denigrate another by simply changing the adjective and noun of the class of people in the prompt

the US left leaning bias is around historically marginalized people being off limits, while its a free for all on majority. This is adopted globally in English written contexts, so you are accurate that it might reflect some global empathic social norm, it is still a blind spot either way to blindly train a model to regurgitate that logic

I expect that this is one area their new model will have more equal responses. Whether it equally shies away from engaging, or equally is unfiltered and candid
LeCun fundamentally doesn't think bigger and better LLMs will lead to anything resembling "AGI", although he thinks they may be some component of AGI. Also, he leads the research division, increasing context length from 2M to 10M is not interesting to him.
AI Python debugger (Open Source fork of pysnooper)
snooper-ai is a simple fork of PySnooper. It sends the entire execution trace (variable values you'll typically examine in a debugger) to an LLM for debugging, so it fully understands what happened in your code!
Quite the opposite. You can easily get a state of the art LLM to do a complete 180 on its entire moral framework with a few words injected in the prompt (and this very example demonstrates exactly that). It is very far from logically or ethically consistent. In fact it has no logic and ethics at all.

Though if we did get an AI priest it would be great to absolve all your sins with some clever wordplay.
Businesses will then send the discoverers free samples, provide literature, and send “advisers” to talk with the discoverers, and you’ll be right back where you started.
My initial reaction to this is typically negative too, but more than once, on a second thought, I found its question to be really good, leading me to actually think about the matter more deeply. So I'm growing to accept this.
Anyone know how the image encoding works exactly?



...


...


...


...

Describe this image in two sentences

assistant


Is "..." here raw 4 bytes RGBA as an integer or how does this work with the tokenizer?
Cactus (Diablo II Version Switcher) Now Supports Wine (FreeBSD, Linux, etc.)
I wrote 'multiple codegen architectures' instead of 'multiple architectures for codegen'.

As far as I have done in the toy compilers and seen the things in actual production ready compilers, the codegen is still very much tied to the one thing or the other rest llvm.
How would this work for a personal blog? Would I need to be careful not to endorse or even talk about companies and products? And if I didn't have to, wouldn't that open the door for advertising masquerading as news or opinion? Genuinely interested in this.
An Introduction to Statistical Learning: https://www.statlearning.com

It is a free, easy introductory text by leading researchers that covers all the classics and includes many "Lab" sections with code.

It has a chapter on deep learning but doesn't cover any of the recent advances. You will need other sources for that.
Oil Price in Freefall Reorders Global Energy Landscape
In fairness to Irving Fisher: if you bought into the market at its peak in 1929, you wouldn't recover your original investment until about 1960.
I'm ignorantly curious of what type of math will work in your view. Genuine question, I just want to be educated.
Anyone know if it can analyze PDFs?
And it's 50% off right now...
I’ve been using Dokku for 7 years and counting, both professionally and for hobby stuff. It’s a very mature project that has never gotten in the way, and keeps getting better.