skysight-inc/HackerNews huggingface dataset:
Llama2 inference can be implemented in 900-ish lines of dependency-free C89, with no code golfing[1]. More modern architectures (at least the dense, non-MoE models) aren't that much more complicated.

That code is CPU only, uses float32 everywhere and doesn't do any optimizations, so it's not realistically usable for models beyond 100m params, but that's how much it takes to run the core algorithm.

[1] https://github.com/karpathy/llama2.c
> Please also feel free to join our Discord: https://discord.gg/JmThYcyG

FYI, I get an "Invalid Invite" error.
Good luck with that... currently we are failing to muster a global effort for tackling climate change, which is a much more pressing issue than an asteroid which may or may not hit us. I know https://en.wikipedia.org/wiki/Don%27t_Look_Up is satirical, but reality often outdoes satire, so I wouldn't be surprised if things would play out exactly like in that movie...
Related thread:

Google Pixel 4a old firmware is gone, trapping users on the buggy battery update

https://news.ycombinator.com/item?id=42865619
If those pre-compiled binaries aren't based on GPL software, I don't think you'll have much luck getting their sources.

Android's source code is a maze of branches and tags, unfortunately. The change can have been made in the generic cross-device kernel tree, or it could've been a separate module, or it could've been a binary.

One thing you could consider is checking out the kernel for a project like LineageOS: https://github.com/LineageOS/android_device_xiaomi_sm6150-co...
They usually pull+filter changes from upstream. For instance, these changes may be of interest: https://review.lineageos.org/c/LineageOS/android_device_xiao... https://review.lineageos.org/c/LineageOS/android_device_xiao...
These kernels are used for a variety of devices with similar hardware, so not all changes have anything to do with the Pixel 4a, but it could prove useful in your search.
Atari 8-Bit Display List Interrupts: A Complete(ish) Tutorial
OpenAI made a lot of contributions to LLMs obviously but the amount of fraud, deception, and dark patterns coming out of that organization make me root against it.
I assume they mean they build their projects by typing in the terminal commands directly, not that they have vim rigged up to build stuff via keyboard shortcut. I don't think most people use their IDEs like a text editor with a built-in terminal.
> they don't state in the article

Thank you for pointing this out. I updated the essay to mention how long the pause took explicitly:

After about a 3.5 second pause [^13], the failover function completed smoothly! We had a new Postgres instance serving requests, and best of all, nobody noticed.

[^13]: About 2.5 seconds to let active queries complete, and about 1 second for the replica to catch up
Ask HN: Why GitHub isn't open sourced?
Reliability peaked 2016. I would imagine if it stripped all the electronics you would find wonderfully tuned mechanical parts.

I am not a mechanic but modular systems are great. Transmission and engine. That's all I want in computers to be involved in.
Trademarks in some jurisdictions have to be actively enforced to be maintained.
I'm semi homeless and Google's forced update on the Pixel 4a ruined it

https://news.ycombinator.com/item?id=42871613
Fastmail lets you make as many redirects as you want, no + in them.

You can even get an api key for it and plug that into bitwarden, so that when you sign up for whatever, you click bitwarden, generate password, generate email, sign in and it's all set. So smooth. (I sound like an ad, but internet pinky promise no affiliation)
It's an interesting model but in practice I don't think anyone is really all one way or all the other. A better way to approach it might be to find out which narratives are most important to someone and how far they'll go to protect them.

In the end, being a fact-based person might just be a narrative you hold about yourself.
Even better then. I’m glad they did that.
What are people using for email?
I'm founding and my email inbox is a disaster zone. I've never had to manage this much email in my life lol

I'm completely ootl on what tools (AI or not, idrc) might exist out there to make this better. Anyone have anything they absolutely love?
The ball is starting to roll. My non-IT org had the question asked to the director on last years company all hands meeting. A month later, we now have official guidance that allows bsky and suggests using both. I presume this will shift some more now Musk/Trump are in office, especially if they do loud distastefull things.
Sorry could you expand / clarify this comment? What would make this more likely to hit near the tropics?
> The drum beat is just the Rock 1 preset of the Suzuki Omnichord

I wonder if you need to pay royalties or get permission for that kind of thing... or is license to use it commercially included in the price of the instrument?
Vim Roadmap 2025
Cool features from zed's Vim mode
Leasing is mostly just a financing model for people who like to have new cars. It hasn't been economically sound for individuals maybe ever. The shortest I've owned a new car was 5 years and that's because it was a dog from Dodge.

Exception may be some European cars which have a reputation for very expensive dealer maintenance after the warranty period.
Security concerns perhaps
He's a great advocate for right-to-repair . we have a crisis that few people are concerned about.
Thanks for posting this. I 'member seeing this video originally on MTV at like 3AM. Instantly captivated. I'm a huge fan to this day, but there's something uniquely special about all the Phase 1 stuff: the album, the B-sides (or “G” Sides lol), the explorable Flash Kong Studios site, the DVD, Jamie Hewlett's art†, the fact that the eponymous album as originally released is 55:55 (iykyk)

There's also a track on Deltron 3030 (an album I liked a lot more when it was new than I do now) which I have tagged as “feat. 2-D” instead of “feat. Damon Albarn” because come on :p https://www.youtube.com/watch?v=pxd_eDTbBMQ

It's also kinda funny that 2D's entire existence is just a stupid pun on Robert Del (lol) Naja a.k.a. “3D” (a.k.a. Banksy?) from Massive Attack, although the later Gorillaz albums strayed from the trip-hop thing https://www.youtube.com/watch?v=unTP4rn0nc4

And RIP Gorillaz-Unofficial https://web.archive.org/web/20071222221958/http://www.gorill...

† https://drive.google.com/drive/folders/13ub5EfL6YHel5_Gn36v4...

edit: and the art Jamie Hewlett is editing in the article's photo was part of the 19／2000 single: https://www.discogs.com/release/66714-Gorillaz-192000/image/...
Such cool videos. I listened to Gorillaz a lot when they first came out. Incidentally I’ve been listening to them lately as I’m learning to play the bass and the “Feel good inc.“ riff is super cool yet beginner friendly. By listening to it I got back into the band again
Oh weird, let me take a look at that
"Likely" when we don't have anything besides the race can refer to race-related statistics - people can do it, LLMs shouldn't pretend to be dumber. Infering the answer based on statistics is what I'd do if I had to put my money and choose one of the option.

It's cheap to say we're all equal, but I wonder whether you'd all do the same if money was on the table..
> JPL Horizons

A slight tangent.. but my favorite thing about Horizons is that they still maintain a telnet interface to their system. Once you learn to use it it's quite a bit of fun to play around with it.
People posting comments without caring whether they are true or false undermines the presumption of good faith that underlies rational discourse. Please stop posting such comments on this site. Instead, only post comments that you have some reason to believe are true.
I think it is rather up to those making the claims to show that these stories are more than just selection bias.
It's funny though. There seem to be a lot of commenters on Hacker News who don't really get the sense of humor thing.
Maybe anyone can copy any LLM with sufficient querying. There are still ways to guard one.
Interrupted or fixed? And lemme get that regiment?
> isn't it just saying that governments spend more when economic shocks happen?

And that the revenue may be lower. Look at 2008 and 2009. Major increases in unemployment which also resulted in reduced revenue. Which created a double whammy, spending increased because the social safety net did what it was supposed to do (carry people through tougher times) and revenue dropped because there were fewer people paying taxes and many people reduced spending (beyond just those who lost their jobs). Then the deficit drops while the employment rate increases and revenues increases while spending again decreases commensurately.
Pause all writes > let 16 to catch up > resume writes on 16

Isn’t that….. downtime? Unless you mean downtime to be only when reads are also not available.
Some concerts have tickets that refresh every N seconds, ostensibly to prevent counterfeiting. https://conduition.io/coding/ticketmaster/

In this case, if you don’t have a phone that can display Ticketmaster’s code, you’re just SOL, since they decided to break being able to just print out your code.
Parent mentioned Monte Carlo simulations, which allow you to simulate across a range possible scenario parameters and see what % result in some outcome (like a collision with Earth or the moon).
I have a Google Pixel 4a and planned to use the phone until it physically no longer worked. I loved it, especially with its wired headphone jack and small size.

It has worked for 3+ years and held a charge for 2-3 days easily until the other week when they pushed the battery patch. Now it dies in a few hours with light usage.

I asked Google support on what will happen if I get a battery replacement and it's still draining fast. They won't answer.

Google reps at a repair center said a battery replacement is unlikely to fix the drain issue since the drain behavior is attached to an OS update you can't opt out of.

This is really frustrating to be ignored by Google after they essentially bricked a fully working device that I paid for.

This is a type of move where I'm tempted to de-Google myself over this, including deleting my YouTube channel with 20k subs that I've been regularly posting to for almost a decade.

My whole business (selling courses and contract work) depends on SEO from Google and YouTube and I'm close to saying fuck it and destroying all of that out of principle on how poorly they are treating folks over this issue. I haven't made that decision yet but it's close to be honest. Close enough that I'm openly posting this message.
Why is this desirable? Because it adds utility in a western business context. In other words this adds in the west’s own set of propaganda that be accepted Prima facie as true.

In absolute terms this is as weird as whatever ever is politically sensitive for the Chinese regime.
> This isn't an oligarchy yet, right?

The richest man in the world has a government office down the street from the white house, which the taxpayers are funding. He's rumored to sleep there.

What do you think?
I see this as China fighting U.S. of A (or the American Dollar versus Chinese Renmibi if you will)

and this is good because any alternatives I can think of are older-school fighting

modern war is seeped in symbolism, but the contest is still there

e.g. whose dong is bigger? Xi Jingping's or Dnld Trump's
I love doing research so I tried to answer the question for myself, "why does iodine deficiency cause cognitive impairment"? I have no background here.

Then I discovered that brain cells walk around during brain formation. MindBlown!
You bring that crap to nyc and we’re making a special new waymo congestion price
Colonialism is not that same as imperialism.

Historians do not consider mongol or Inca empire colonial . I would say mongols were probably polar opposite of colonizers they were extremely open and integrated extremely well into every region culture they occupied, there was no classical markers of colonization.

I specifically added Mediterranean later in my parent post to cover Egypt , Phoenician and Arab colonization which are considered as examples of pre modern era colonizing.

The hard separation of North Africa is sadly a modern view of the region that I have to do that explicitly, for most of history empires always had some land on both sides of the Mediterranean. This view is either promoted and exploited by far right in southern europe to justify many policies.
It's like the claim "they showed anyone create a powerful from scratch" becomes "false yet true".

Maybe they needed OpenAI for their process. But now that their model is open source, anyone can use that as their cold start and spend the same amount.

"From scratch" is a moving target. No one who makes their model with massive data from the net is really doing anything from scratch.
Meta to pay $25M to settle 2021 Trump lawsuit
Rebooting on the early PC was so common, they had a hotkey for it—Ctrl+Alt+Delete.

David Bradley, an engineer who worked on the original IBM PC, invented the combination which was originally designed to reboot a PC. "I may have invented it, but Bill made it famous."
Parametric Subtyping for Structural Parametric Polymorphism
nice to see my hometown mentioned on hn :)
5 seconds pause on queries would make our app server drop connections and throw errors under cyclical high load - which would result in a incident.
There is open doubt as to whether climate change, as presented, is truly a near-term existential issue.

There is no doubt that an asteroid hitting earth is.
New asteroid discovery suggests how life on Earth started
I still like BBEdit, and I've been using it for over 30 years.

https://www.barebones.com/products/bbedit/
Deltron 3030 is one of the most amazing things ever!
When was the last time this happened to you?
Replacing API with scraping sounds like a great idea…
This argument only barely holds water for those big SOTA models like llama derivatives, and that's only because of practical costs involved.

Or should I say, it held water until few days ago.

Personally though, I never bought it. Saying that weights are the "preferred form of the work for making modifications to it" because a) approximately no one can afford to start with the training data, and b) fine-tuning and training LoRAs are cheap enough, is basically like saying binary blobs are "open source" as long as they provide an API (or ABI) for other programs to use. By this line of reasoning, NVIDIA GPU stack and Broadcom chipset firmware would qualify as open source, too.
Not that DeepSeek is luigi mangione, but it's pretty funny OpenAi getting the dead ceo treatment.
> The excuse is usually vague licensing reasons but, sadly, I bet the real mentality is "if I/we can't profit from my/our hard work, then nobody should enjoy it."

I'm 100% certain that the primary reason boils down to "we don't have the rights to all of the source code, and we don't want to deal with any of the options for moving forward."

As sibling comment points out, a lot of console SDKs are pretty heavy in the "this code must never be open-sourced" space (hell, even talking about what's in them can run afoul of NDAs). But it goes beyond that. Building assets might require a suite of proprietary tools and custom extensions for those tools, where your ability to release those extensions may be legally unsound. Many games will have several libraries, not all of them open source (and some of them probably under pretty strict don't-even-think-about-asking-us rules--can't imagine many anticheat or DRM packages are going to say yes to allowing source to be released).

If the company doesn't have the rights to large chunks of the source code, their options boil down to:

* Release just the bits they have the rights to, which isn't going to be compilable. And hope that nobody complains about residual references to their code in the released stuff (litigation risk!).

* Spend time going through the code to sanitize references to unreleasable code, but still just release the not-working code drop.

* Do the above, but also replace the unreleasable bits with working releasable bits.

* Do nothing.

One option involves no work and no risk. One option involves minimal work but incorporates small-to-medium risk, but also sacrifices much of the benefits of open-sourcing (there is likely to be community blowback if the product is unusable!). Two options involve a lot more work to mitigate the risk.

It's going to be rare to find the corporation that's going to go for the no work/no risk route. If you want to change that, the best way is to create legal mechanisms to make the no work option much higher risk than the other options.
How should such a study even look like?

I mean, some people are perfectly fine with labeling other people NPCs.
The creation of the federal reserve December 23, 1913
St Vincent DePaul in your city can help you.
There's going to be some degree of measurement error, which will likely be greater for objects which have not been observed many times. Multiple observations should allow both better estimation of the object attributes (average out the noise), and allow some judgement of the quality of predictions given what you think you know about it.
What do you mean? Linux has multiple excellent packaging solutions, apt/dpkg, yum, PKGBUILD/pacman

If a developer can't be arsed to package their software, it's not the Linux community's fault
I think the more interesting claim (that Deepseek should make for
lols) is that it wasn't them who trained R1. No, it was O1's
idea. It chose to take the young R1 as its padawan.
An update on Dart macros and data serialization
They did do that themselves it's called o3.
Yeah I'm not buying that Trump supporters are disappointed Obama voters, given that Trump was one of the main promoters of the 'birther' conspiracy theory.
Didn’t he pardon all of the J6 folks, even the ones who committed violent crimes?
In the context in which you said it, it matters a lot.

>> The idea that they used o1's outputs for their distillation further shows that models like o1 are necessary.

> Hmm, I think the narrative of the rise of LLMs is that once the output of humans has been distilled by the model, the human isn't necessary.

If deepseek was produced through the distillation (term of art) of o1, then the cost of producing deepseek is strictly higher than the cost of producing o1, and can't be avoided.

Continuing this argument, if the premise is true then deepseek can't be significantly improved without first producing a very expensive hypothetical o1-next model from which to distill better knowledge.

That is the argument that is being made. Please avoid shallow dismissals.

Edit: just to be clear, I doubt that deepseek was produced via distillation (term of art) of o1, since that would require access to o1's weights. It may have used some of o1's outputs to fine tune the model, which still would mean that the cost of training deepseek is strictly higher than training o1.
It does have, just like us. "Subjective experience" isn't a real thing. A rock also has it. Non-sentient organisms also do.

The thing is, what you perceive as conscience is just a controlled hallucination.

While you are taking a shit, your brain is actually doing a lot of things, but you mostly perceive the input / output, similar to an AI.

We do have emotions, feel pain and other things that AI isn't able to feel, so it doesn't make sense to consider the AI, at the present, as a sentient being.

Also, this is why we humans should accept that for that reason, we deserve to be treated with dignity, so does animals and other sentient beings.

We understand what it means to suffer, we also die and for most of our lives, live very miserable and challenging lives, going through hardship. The AI doesn't.
You will note I said "at least" rather than "at most" or "about" ;-) ... we're all familiar with the phrase I believe
Their new goal is just 20ms.

https://www.pcmag.com/news/spacex-tries-again-to-reduce-star...
The federal reserve creates inflation through printing fiat currency
Airflow is by far the fastest and most reliable AirPlay implementation I've seen. It's lightning fast. Truly excellent. The app is also super fast for things like video scrubbing.

I wish the app was a more native feeling UI, and I feel they could be doing deeper integration to enable more video playing. I'm a little worried that the app is out of development, but hoping they keep it going for new versions of macOS and AirPlay.
This reminded me the time I bought a brand new HDD only to notice at home it was labelled as “refurbished”, next day I returned it, they guys from the shop didn’t want to admit this wasn’t a new part, after much back and forth they agreed to refund me. If my memory serves me well that was a Seagate drive, I hope they didn’t become sloppy with labelling.
Largest was the Tsar Bomba at > 50 megatons! https://en.wikipedia.org/wiki/Tsar_Bomba
>"So I bought an 80 Series Toyota. It only gets 1mpg less than the Grenadier. 30 years, all that complexity, and we gained 1mpg."

The Grenadier complies with many emissions, collision, and other regulatory requirements than the Toyota, and it probably costs less than the series 80 did new (compensated for inflation).
I never suggested anything of the sort.

I’m suggesting it will be happening now and any past efforts will be retroactively analyzed by the appropriate CCP apparatus since everyone is aware of the scale of success as of Monday. It has become a political success, thus it is imperative the CCP partakes in it.
I can't believe they took the time to make such an amazing write-up. With formatting and everything. Normally I just grab whatever broken crayon is closest and scribble on the back of an overdue bill "don't fsck up next time"
I really like Zed, especially its attitude of starting from the scratch.

But if you want to be commercially successful, maybe it's worth providing some free trials. In comparison, Cursor has 50 trials.

At least it can give people more motivation to download.

Haven't looked into the detail but a privacy mode is also important for providing R1.
Some AIs have vision and hearing though.
That's just an overview for paper for those new to the field. The transformer architecture has a better claim to being the origin of LLMs.
It's almost certainly not true.
Another useful issue filter: https://github.com/astral-sh/ruff/milestone/20
> 30 years, all that complexity, and we gained 1mpg.

We also got far lower tailpipe emissions, less expensive manufacturing processes, far better rust prevention, and far better passenger and pedestrian safety features. Not to mention a more comfortable ride, almost zero water intrusion, lower cabin noise and vibration, less wind and tire noise, and longer lasting consumables such as plugs, oil, tires, and filters.
Unfortunately, while more accurate, a headline like “data protection arm of Italian gov sends polite disclosure requests to DeepSeek, as per their purview” isn’t very dramatic :)
LLMs write long-winded replies because more token output = more chances for the AI to reason its way to a satisfactory response. The model architecture for these systems has no recursive compute - i.e. they take in tokens, do a fixed amount of compute, then spit out more tokens; so the only way for a model to take longer and think more is to spend more output tokens on thinking.

o1, DeepSeek-R1, and the like formalize this with a hidden scratchpad and additional tuning to make the model write out an entire thought process. I suppose this would also mean that the output doesn't have to be as long - i.e. maybe reasoning models could give you just the answer, and a few reasons why, and then you open up the thought process if you want the nitty gritty. But that also goes against OpenAI's whole "we can't tell you what's in the reasoning tokens because they're uncensored" shtick.