skysight-inc/HackerNews huggingface dataset:
Yep, I was not excluding muscle memory when I said it had to do with muscle. It is true that breathing through the nose seems effortless (at least when resting).

The "reeducation" consisted in a few 30 minutes sessions (probably around 5, not sure) and I don't remember having done any conscious effort to breathe through my nose after that. It just seemed easy.

That said, I still have to breathe through my mouth when running.
I've tried learning German with 45 min podcast + 1h netflix every day, but the acquisition of new vocabulary was just sooo slow I've switched to flashcards.
That leaves loads of stuff unexplained.

If the LLM is capable of rewording the MIT license into a set of hard-hitting rap battle lyrics, but the training dataset didn't contain any examples of anyone doing that, is the LLM therefore capable of producing output beyond the limits of its training data set?

Is an LLM inherently constrained to mediocrity? If an LLM were writing a novel, does its design force it to produce cliche characters and predictable plotlines? If applied in science, are they inherently incapable of advancing the boundaries of human knowledge?

Why transformers instead of, say, LSTMs?

Must attention be multi-headed? Why can't the model have a simpler architecture, allowing such implementation details to emerge from the training data?

Must they be so big that leading performance is only in the hands of multi-billion-dollar corporations?

What's going on with language handling? Are facts learned in an abstract enough way that they can cross language barriers? Should a model produce different statements of fact when questioned in different languages? Does France need a French-language LLM?

Is it reasonable to expect models to perform basic arithmetic accurately? What about summarising long documents?

Why is it that I can ask questions with misspellings, but get answers with largely correct spelling? If misspellings were in the training data, why aren't they in the output? Does the cleverness that stops LLMs from learning misspellings from the training data also stop them from learning other common mistakes?

If LLMs can be trained to be polite despite having examples of impoliteness in their training data, can they also be trained to not be racist, despite having examples of racism in their training data?

Can a model learn a fact that is very rarely present in the training data - like an interesting result in an obscure academic paper? Or must a fact be widely known and oft-repeated in order to be learned?

Merely saying "it predicts the next word" doesn't really explain much at all.
It quacks pretty much like a standard though.
Ruby Object Model – Comparison with Smalltalk-80
It's like a fractal; the closer you look, the more details you notice affecting what you see. It's like we're creeping to 100% physically accurate rendering, but we'll probably never get to 100%, instead we'll just keep adding fractions.
Will you consider expanding more export methods in the future?
In the age of analog you could adjust brightness, contrast and color of the image. Still there and there are even presets, but not used much.

I imagine in ten years you will be moving AI sliders to adjust brightness and contrast of the movie. Want to have everything super sharp? Art house? You can do that.

At the same time, directors may spend more time on the actual story and less on the picture.
Congrats on the launch!

I have a question - what if I want to integrate Stack with React and NestJs app?
I couldn't find any docs for a backend authentication.
That's quite fishy.
That's not a thing in the UK. The bulk of tenancies here are ASTs, which make most sense over a period of a few years (rather than decades). Our society is predicated on buying your own home while you're young, so a culture of tenancies where the tenant owns the fixtures and fittings doesn't really make sense here.
But that’s unrelated to the “racism” comment above. European Canadians came and destroyed the indigenous Canadian population, scattered their population and upended their societies. But Canadians today might treat indigenous people without any prejudice.

Generally speaking, crime isn’t a matter of economics. My dad’s village in Bangladesh in the 1950s—when 1/4 of kids died before the age of five—was safer then than Toronto is today.
Beware of Base64 Encoded Strings
Perhaps a probabilistic FSM describes the actual computational process better since we don’t have a concept equivalent to superposition with transformers (I think?), but the framework of a FSM alone doesn’t seem to capture the specifics of where the model/machine comes from (what I’m calling the Hamiltonian), nor how a given context window (the subsystem) relates to it. The change of basis that involves the attention mechanism (to achieve context-awareness) seems to align better with existing concepts in QM.

One might model the human brain as a FSM as well, but I’m not sure I’d call the predictive ability of the brain an implementation detail.
> influence governments

Healthcare providers spent the most money lobbying the US government for decades:

https://www.opensecrets.org/federal-lobbying/top-spenders?cy...
> But learning a language isn’t particularly hard

I'm very curious about what makes you think that. I belive it's true only if you already speak one or two other similarly rooted languages, or if you learn the language before you're 10.

Did you learn your first foreign language as an adult and found it "not particularly hard"?
If you're using KDE, they have a native permission manager: https://github.com/KDE/flatpak-kcm

It's under System Settings -> Applications -> Flatpak Permission Settings
What the actual FUCK is that???
It's not about making people suffer. Eich used his wealth to lobby for something that many people find objectionable. Mozilla is quite an ideological company (many who work there are probably somewhat driven by the "mission" rather than necessarily the company's financial performance), and so the CEO publicly supporting criminalising same-sex marriage could affect hiring and staff morale.

It's not like his career has been destroyed. He's still incredibly wealthy, and has a new browser company. People can use that, and work there, if they want.
> That's why we laugh at the "zoom -> 9 pixels -> enhance -> clear picture -> zoom ->.." trope in movies..

> AI does not change this..

It kind of changes it in some cases. The information might be there, but superhuman pattern recognition might be needed to extract it.

And of course, in case factuality doesn't matter, the missing information can be generated and filled in. This obviously doesn't work when you are looking for a terrorist's license plate or when you want to watch an original performance in a movie.
I borrow DVDs from the library. Great selection.
~100 MB/s write speeds?

what use case needs an SD card that can be written for 40000 seconds?
I wonder if the CEO will be amongst the layoffs...
The rapid succession of new standards obviously overwhelms the compiler developers. Personally, I prefer code that is compatible with as many toolchains as possible and therefore stick with old standard versions. There is hardly a feature of the new standards that I miss. In the case of embedded systems with limited resources, I continue to work with C (and soon Micron).
Earthlings (2005)

as we are born into a civilisation taking for granted that exploitation of other live beings is something natural and ethically acceptable / neutral.

Unfortunately, our lifestyle decisions tend to support a machninery of suffering only comparable to nazi concentration camps.

oh, and speaking of, if you lived far enough (temporarily / culturally / geographically) it's good to recall once in a while what atrocites humans are capable of, even in regards to other humans:

"Zone of Interest" - fresh movie about everyday life in proximity of death camps
why not sign in with google?
A quick way to find out how many digits are in a number
Google joins the custom server CPU crowd with Arm-based Axion chips
Distributed Grok-1 (314B)
I wonder what percentage of home movie watchers have a centre speaker that they can turn up the volume on? Or is the thinking more that if you don't have a centre speaker you can turn up the volume on, you're not really into movies and thus not part of our target audience?
Singapore had 8 thousand cases in 2022. Brazil has 3 million cases of dengue in 2024. Is not the same thing.
Well, you can't do O(1) part for most commands :) redis can do a lot of stuff at near constant (and superfast) speed. Databases do become slower when your dataset is big
Which conditional probability sequences can be exploited for engineering utility cannot be known ahead of time; nor is it explained by the NN. It's explained by investigating how the data was created by people.

Train a NN to generate pictures of the nightsky: which can be used for navigation? Who knows, ahead of time. The only way of knowing is to have an explanation of how the solar system works and then check the pictures are accurate enough.

The NN which generates photos of the nightsky has nothing in it that explains the solar system, nor does any aspect of an NN model the solar system. The photos it was trained on happened to have their pixels arranged in that order.

Why those arrangements occur is explained by astrophysics.

If you want to understand what ChatGPT can do, you need to ask OpenAI for their training data and then perform scientific investigations of its structure and how that structure came to be.

Talking in terms of the NN model is propaganda and pseudoscience: the NN didnt arrange the pixels, gravity did. Likewise, the NN isnt arranging rap lyrics in that order because it's rapping: singers are.

There is no actual mystery here. It's just we are prevented form access to the data by OpenAI, and struggle to explain reality which generated that data -- which requires years of actual science.
Don't assume! The basic mantra of software development.
I want a circular one of these on a lazy Susan so I can use macros like some kind of extreme sport
I wonder how he works...?
Causality, Interaction, and Complexity
> This is probably an unpopular opinion

There's a reason The Illustrated Transformer[1] was/is so popular: it made the original paper much more digestible.

[1] https://jalammar.github.io/illustrated-transformer/
Reading this article, I was I itially surprised to read to Japan had to import raw material given their strong paper tradition (shoji , washi, origami, etc.). But then the article states that

> Shrinking rural populations and climate change were driving Japan’s farmers to abandon their labor-intensive plots.

Makes sense to try to conserve this resource somehow.
That and also the physicality of the process of playing that media. Opening a file or a stream just doesn't feel the same as taking a cassette or a disc out of its box and inserting it into the player. Vinyl records take that aspect to the extreme because the songs themselves are visible on the surface of the record and you yourself put the needle next to the song you want to play.
I think the concern was with the plastic money shedding micro plastics or threads as it slowly degrades over time, like we're finding other plastic does like our clothing. Not saying enough to take out of circulation, but does it shed any particles during its life?
The Missing Features of iOS
Sure, most are when it's at that distance from the Sun. Looking forward to seeing Dragonfly sport it's RTG https://nssdc.gsfc.nasa.gov/nmc/spacecraft/display.action?id...
Yes, but you get lab snacks :)
Also increasingly recruited into the russian army for use as cannon fodder, you don't hear much fierce invincible Ghurka news about those for some reason.
All very well, the question is, how will you know? And if you can’t reliably differentiate between ai or human contributions how could this be enforced?
What works quite well for iOS/macOS apps is breaking the project into a barebones Xcode project plus a Swift package that contains all of the code. SPM projects work well with VSCode and you get full auto-complete support with the official Swift plugin.
I tried this out today. While it works (no longer a pre-split step required), it makes the CUDA kernel run ridiculously slow. I believe it's because of the while loop:

while (i < end_byte) {

Comparing it to my original solution, 50X divergent branches are introduced! (ncu profiling)

The only difference between the two is that the for loop could deterministically iterate, yet this while loop iterates for an unknown amount (at kernel launch time).

I admit, I don't perfectly understand the reason. But this is the most likely culprit.
> Dengue is just a difficult thing to fight

Singapore had 8k cases in 2022. Brazil has 3 million cases of dengue in 2024. Is not the same thing.
Nicer adb shell and Jonathan Levin's (and more) tools
(Deep Learning Based) Opportunistic Screening to Improve Statin Rates
I'm a Bay Area native. Grew up in San Jose and took my first paid tech job in 1999. I left CA after 30 years and with the exception of Tahoe and a few people, I can't find anything to miss.

Care to share what you consider "deal-breakers" because I've found parity for less money, pretty much everywhere I looked.
Great post. This exact limitation of web LLMs is why I'm leaning strongly towards local models for the easier stuff. Prompt caching can dramatically speed up fixed tasks.

But frontier models are just too damn good and convenient so I don't think its possible to fully get away from web LLMs.
Japan has a long tradition of advanced papermaking.
> The styles don't change of its own sake, they change as people come up with ideas on how to address the problems of the last one.

I don't think this bit is true, or at least I don't believe these are "problems" being solved, when it comes to art. There are no problems, only changes. That's why being derivative is bad. It's a drive for change for its own sake.
I loved my video store, $1 for a day. Not a binge watcher, so this was good enough for me.
This is from February, is there any update or progress?
It's *pored over BTW
Not to be too snarky, but this is exactly the proposal and associated conversation that I’d expect to see around Gentoo. It is as impractical as it is unnecessarily standoffish.

There are multiple repliers that very clearly don’t understand how LLMs work. “It’s computers, so I can intuit it!” is typical techie hubris.
Most of it is lost countering atmospheric drag. Gravity only starts to become an issue when you want to go beyond low earth orbit.
Singapore had 8 thousand cases in 2022. Brazil has 3 million cases of dengue in 2024.Is not the same thing. The poor distribution of water and the lack of sewage are fundamental to dengue fever in Brazil.
RFC: Banning contributions written on systems with proprietary software
Ah, yes, quietly and faithfully paying for a campaign to keep people like me second-class citizens. Ah, well, that's fine, then, as long as it's nice and polite and Christian.

(Back when equal marriage was a live political issue here, I must say I think I _preferred_ the out-and-proud homophobes to the ones who hid behind religious claims. At least they were honest in their hatred.)
Korea-Russia Friendship House – Google Maps
Notepad++ is based on Scintilla, for which Scite is sort of the demo program. Scintilla is also the basis of Geany.

I explained this recently on the Reg. Read the Reg. ;-)

https://www.theregister.com/2023/12/06/veteran_editors_notep...
Does it depict twisted pairs? Often needed to disambiguate colors.
None of the people I know uses iMessage in Canada. In fact, majority of the people I know uses Android.
Yeah, Microsoft absolutely should've made their containers use throwing move-constructors in violation of the standard, in order to better adhere to the standard.

In reality, it's a defect in the standard, plus a quality-of-implementation issue in the Microsoft's C++ Standard Library.
Specific nasal cells protect against Covid in children
Quite understandable. Would 2 days be minimum?
> they are lot more scalable context length wise

Sure, we're agreeing. I'm just being less specific.
iMessage is pretty big in Australia and New Zealand too.
> CEO is a very political position and he made a politically bone-headed move

No, that is not what happened. Political activists inside companies have gained power as a result of the 'long march through the institutions [1] which they have been using to enforce their ideology in rigid fashion. This started in the lunch rooms but eventually reached all the way to the top. Eich, like many other CEO's was replaced by a political activist - in this case Mitchell Baker - who used her position to further her ideological goals while simultaneously enriching herself. She is only one of many who is guilty of this type of fiduciary breach of confidence.

The fact that these 'champagne socialists' strut their virtue while filling their coffers - in Dutch this this is called 'links lullen, rechts vullen' (talk left but hoard right) - only makes it all the more galling and clear that their ideology is only a thin veneer over a lust for greed and power [2].

[1] https://www.marcuse.org/herbert/scholarship/2020s/2022-kimba...

[2] That same ideology sees everything in the world as an eternal power game between the oppressive and the oppressed and calls for a permanent revolution against the powerful - i.e. against themselves.
I agree. "AI-enhanced" is just the latest badge to put on content in the hope that some suckers will pay more money for the "same" content they already have. There's no striving for a better version here, just a drive for more profit.
The Linux sandboxing features are mostly quite poor tbh. Compare to Apple's stack (if you include the private SBPL) and it doesn't come close. Apple is way ahead of both Windows and Linux when it comes to pervasive sandboxing.
Ok so you'd be happy with it just being online. That's fair enough.
This is a very fair point! Another way they could be given credit is that the radius of the earth (another way to view "halfway across the globe") is 6371km so again the quoted distance would be more than this half.
I spoke absolutely fluent French, when I was a kid, living in Morocco. You could say a sentence; half in English, and half in French, and I'd not notice the difference.

I've forgotten almost every word. It would be quite difficult for me to relearn, at 61, and I'd likely not have anywhere near the efficacy, that I had, then.

People say how easy it is to learn new programming languages. I've probably written in a half-dozen different ones, over the years.

IME, learning the basics takes a week or two, but it takes years to really grok the language, at the fundamental level.
Oh I had no idea I'll check it out.
I've been thinking about his a bit lately. If time is non-continuous then could you model the time evolution of the universe as some operator recursively applied to the quantum state of the universe? If each application of the operator progresses the state of the universe by a single planck-time could we even observe a difference between that and a universe where time is continuous?
In completely unrelated news (/s), supposedly Microsoft is silently (?) installing Copilot on Windows Server 2022 systems ?
I did find the recommendation for the OWC Express 1M2 very practical, though.
That's because there's a floor to HDD prices regardless of size.

If you want maximum storage per unit of currency spent, you'll be looking at 16-20TB drives which go for 15-16€ per TB in my area.

By comparison, 4TB drives tend to go for 20€+ per TB.

But I agree that SSDs have moved much more rapidly and am looking forward to them finally surpassing HDDs on the price front too.
That's literally what it's called and has nothing to do with being "inclusive". It refers to someone "outside of the established art scene" and if you study anything related to art, you'll usually encounter it in the form of works created by people in mental asylums: https://en.wikipedia.org/wiki/Outsider_art

E.g. when studying digital archival this was mentioned in the context of digitizing text because there were examples of "outsider poetry" that were written in highly irregular places all over the page and included layers of annotations. That creates interesting problems when trying to serialize and index the text.
Ok keep it simple before doing any zany stuff
Imagine a world where every piece of poetry, novel or literature would be forced to be written in English. Our literature would be much poor and many new points of view would be dismissed just because "not enough Anglo Saxon". This does not happen because editors take care of the translation, hire professional translators for that, and let the creator alone to keep creating while happily selling the novel in 40 different languages. That is the right way to do it.

Science still lives in a previous, less sophisticated, age. We should be grateful for them not expecting us to knit our own tunics also.

The idea that somebody somewhere could have a possible solution to our urgent problems but we'll need to wait until this people learns English and "earns the right to be heard", is a disaster.
I can't take time to fiddle with raytracing (however much I'd want to!) but I skimmed the first half of that book and alias sampling is a very elegant and nice technique. Wish I had known about it earlier! It is useful in a far broader context than graphics.
The Beauty of OLAP SQL
No, "AI" is absolutely not uncontrollable magic that does something you don't want sometimes. It's not an issue really, you always have arbitrarily granular control of the end result, with ML tools or not. You can train them properly, you can control the application, you can fix the result, you can do anything with it. It's the usual VFX process, and it's not the only tool at your disposal.

The problem is that remasters don't make a lot of money, so instead of a properly controlled faithful representation (or a good rethinking) it's typically a half-assed job with a couple filters run over the entire piece. Another issue is that you now have two possibly conflicting intents - one from the original and another from the remaster. ML haven't changed anything in here, it's always been like that.
Wonderful model with depressing applications; for instance I find the motivation for Brexit to have been motivated by (even if not physically so) lose-lose thinking.
people often move to places with a language that is needed to exist in that place and then manage to learn that language. I would say becoming proficient in a language with small effort and no especial facility in languages should take no more than 2 years. With a good deal of intensive effort, focus and natural 3-6 months.

this also depends a lot on the language, many of the Romance languages are relatively easy to learn, many of the Nordic ones seem quite difficult.

Difficulty of course may depend on what you are moving from to what you will be using.
Are you comparing 8k cases (Singapore) with 3 million cases per year (Brazil)?
Of note of course is termux, which is a proper terminal, complete with a custom apt repo.

For cases where an adb shell is needed (modify external storage, slightly more permissions if not rooted) it's approximately possible to just copy necessary executables and .so files from termux to /data/local/tmp/ for adb (with some LD_LIBRARY_PATH & co setup), allowing running bash, htop, etc.
QNX 8.0 was just released. The version bump represents a rewritten microkernel.
Human-generated and AI-generated aren’t mutually exclusive categories anyway. For example, a person writing a document (or software package) can start out with some rough human-generated notes, pass them to an AI to flesh out, and then edit the AI’s output to improve it, fix anything the AI got wrong (or even that they just don’t agree with, e.g. “this code is correct but it’s not how I’d write it”)

What’s the fundamental difference between that and a human doing it without an AI’s help at all? It could be essentially the same outcome, just more time and human effort