skysight-inc/HackerNews huggingface dataset:
The $5M was the cost of the training itself.

You can rent 10k H100 for 20 days with that money. Go and knock yourself out because that compute is probably higher than what DeepSeek received for that money. And that is public cloud pricing for single H100. I'm sure if you ask for 10k H100 you'll get them at half price so easily 40 days of training.

DeepSeek has fooled everyone by telling them that they need only so less money and people think that they only need to "buy" $5M worth of GPU but that's wrong. The money is the training costs of renting the GPU training hours.

Somebody had to install the 10k GPUs and that's paying $300M to Nvidia.
I would argue that lies are inevitable, but in a modern society with somewhat democratized messaging, it is harder to keep them in a "saintly", foundational status.

State religions and state ideologies such as North Korean juche were easier to maintain in the pre-Internet era.

Nowadays, nonsense will get called out by people who aren't official "opinion makers". Which makes it harder to get some collection of lies established as orthodoxy, much less for generations.
The AI industry isn't pausing because DeepSeek is good enough. The industry is in an arms race to AGI. Having a more efficient method to train and use LLMs only accelerates progress, leading to more chip demand.
Isn't the largest model still like 130GB after heavy quantization[1] and 4 tok/s borderline unusable for interactive sessions with those long outputs?

[1] https://unsloth.ai/blog/deepseekr1-dynamic
At the end of the day, it all boils down to value.

Do AMD chips offer more value than Nvidia chips?
If you are young enough, your aging may look different.

Frailty comes from lack of stem cells, and stem cell exhaustion may be reversible.
Because it still takes 5 mins for it to output the minimum viable change whereas it’d take me an hour
If you are not a member of the tech club then you don't have the tech risk. So, yes, while that may mean it will take longer for you to pay off the mortgage without a high tech salary, you aren't under the pressure that necessities the high tech salary to get the mortgage paid ASAP.
In EU in 2022 19% of electricity came from natural gas [1].

Gas, like money, is fungible — you can use gas you don't use for heating for electricity production, and electricity is also fungible and transmissible, so you can transmit that to Germany from outside Germany.

[1]: https://ec.europa.eu/eurostat/statistics-explained/index.php...
They have been censoring lefty things for ages… It's well known how you could be openly nazi but never openly communist.
I think it's a bad addition since it pushes people towards a worse solution to a common problem.

Using "go tool" forces you to have a bunch of dependencies in your go.mod that can conflict with your software's real dependency requirements, when there's zero reason those matter. You shouldn't have to care if one of your developer tools depends on a different version of a library than you.

It makes it so the tools themselves also are being run with a version of software they weren't tested with.

If, for example, you used "shell.nix" or a dockerfile with the tool built from source, the tool's dependencies would match it's go.mod.

Now they have to merge with your go.mod...

And then, of course, you _still_ need something like shell.nix or a flox environment (https://flox.dev/) since you need to control the version of go, control the version of non-go tools like "protoc", and so you already have a better solution to downloading and executing a known version of a program in most non-trivial repos.
One of most beautiful and arguably the most comfortable city to live in China. Every time I come there, I do enjoy it a lot.
And you think China, which had started for a very poor place after their civil wars, and had been ravaged by the Japanese invasion and occupation (including the only mass scale biological warfare in modern times), weathered WWII better than Europe?
I go back until I reach the ones I read before, not rare 1000 submissions back
I am looking for suggestions too, I am thinking of doing internships by side, which will atleast get me into ecosystem
why not just say private location? My house is a private place, but it's not a secret.
China is merely the largest of a wide array of entities that may not necessarily like the status quo of Silicon Valley being our tech overlords. There are plenty of places with bright people. Easy to say because a lot of them immigrate to California. But of course the places they come from (China, Europe, India, Russia etc.) have ambitions as well. You'll find natives of each of those in the likes of OpenAI, Google, Microsoft, etc. And quite often at executive levels even.

Silicon Valley has mo moat other than money. It kind of runs on openness and freedom of movement of people. Companies constantly poach people from each other. And there's a constant movement of people (and knowledge) in and out of the area. Money is what attracts these people and keeps them there for a while. But of course that status quo was upset a little bit with VCs turning into penny pinching misers lately and lockdowns proving (to them) that it was cheaper to host your tech teams remotely. Which means knowledge is now more distributed than it used to be.

So, it's not surprising that people outside of Silicon Valley are not waiting patiently for OpenAI to do whatever it is they are doing in between having moral existential crises, trying to oust their CEO, pontificating about AGIs, etc. They are taking things into their own hands. The brute force / VC funding driven approach that OpenAI has used yielded massive results in the last few years. But ever since Meta opensourced their models, OSS models and optimizations have been catching up.

On a hardware resource usage basis, these models started to outperform their bigger peers last year and now the game is up for the training process as well. Meaning they get better results for the same money. A major hurdle here was the model training process. Which the Chinese seem to have proven can be massively optimized as well. Cutting cost by a few orders of magnitude is a big deal. And at the same time doing the same thing at larger scale (aka. throwing more money at the problem) seems to have diminishing returns.

Until that changes, that means the playing field has somewhat leveled now. That's a good thing.
This is what I've been leaning towards after initially renouncing the experiment for its arbitrary nature. "Alpha" behaviour emerge in zero-sum/artificial scarcity situations, yet contemporary society is full of zero-sum situations and artificial scarcity due to market inefficiency and gatekeeping. It's not just Western society either. If anything, Western-aligned industrialized societies experience far less scarcity. So the behavioural pattern shouldn't be entirely dismissed as pseudoscience, but worthy of critical inspection and reference.
Lunal.ai – Software that pays websites when LLMs use their content
My current approach has been setting GOBIN to a local project bin via direnv and go installing bins there. install commands themselves are cached by me with a naive checksum check for the install script itself when I run my commands. Therefore all `go install`s run in parallel if I edit the install script, and go decides what to reinstall or not. At this point I don't feel it's worth migrating to `go tool` having this setup, we'll see when it's stable
> interesting how much of what we consider "human nature" is just us reacting to the cages we put ourselves in?

Or that we aren't dogs. Chimpanzees do have an alpha male who commonly achieves his role through violence.
Where is the evaluation numbers? without it you can’t call it reproduction.
What kind of quality of content can Meta theoretically mine with all the vast data that they collect? They have a good advertising and a content algorithms but does it approximate general intelligence? And the content you see on Facebook, Instagram, Whatsapp, that's just a lot of average content that might actually be great for AGI.
there are cheap, new analog TV modulators/broadcasters available on ebay now
I worked at one of these. Turned out it was a nepotism grift that flew under the radar. CEO came out of retirement to get an ironclad contract through his college buddy to do basically nothing and get paid for it.
> they should be able to digest every book, every magazine, every piece of art in history with [as if] zero compensation so that

? That is the state of facts. «So that» is "so that you build up". It does not limit machines: it applies to humans as well ("there is the knowledge, when you have time, feed yourself"). We have built libraries for that. It is not "zero compensation": there is payment for personal ownership of the copy - access is free (and encouraged).
Show HN: I built a tool to manage deployments across your VPS through a web UI
There are plenty of ways to deploy your apps. PaaS options like Vercel or Netlify are convenient but can get pricey as projects scale. VPS hosting is cheaper, but setting it up (Linux, networking, SSL, etc.) can be daunting.

That’s why glueh-wyy-huet (https://github.com/glueh-wyy-huet) and I (https://github.com/biersoeckli) built QuickStack during our bachelor studies at Eastern Switzerland University of Applied Sciences. QuickStack simplifies deployment by letting you deploy directly from a Git repo or Docker registry to any VPS. It’s free, open source, and installs with a single command on your VPS.

Unlike great tools like CapRover, Easypanel or Coolify, QuickStack is built on lightweight Kubernetes (k3s) and uses Longhorn for distributed storage, enabling multi-VPS clusters managed through a single UI. Persistent app volumes are distributed across the cluster automatically.

Features include Git deploys, live logs, web-terminal, SSL cert generation, backups, monitoring, and single-VPS setups for smaller needs.

We’d love your feedback. Check it out on https://quickstack.dev and have fun deploying with QuickStack!
Stochastic processes
Great link, thanks!

What do you do postgres for consuming old events and smoothly transitioning to consuming new events? Anything like an event ID allocated at commit time that is usable? As I talk about in sibling comment..
Soo maybe the "alpha" behaviors we see are a natural response to unnatural conditions and it's more about how we behave when we're stuck in systems
And yet, Blackwell is sold out.

What does that tell us?

The industry is compute starved and that makes totally sense.

The tranformer model on which current LLMs are based on are 8 years old. But why took it so much time to get to the LLMs only 2 years ago?

Simple, Nvidia first had to push the compute at scale strongly. Try training GPT4 on Voltas from 2017. Good luck with that!

Current LLMs are possible thanks to the compute Nvidia has provided in the past decade. You could technically use 20 year old CPUs for LLMs but you might need to connect a billion of them.
Unless you want to fine tune your custom model and/or have strict on prem requirements… shit gets expensive fast, but it’s probably worth it for some
is this script working
Share a Tiny Space of Your Freezer to Preserve Seed Diversity
> Official Dictionary Definitions Oxford English Dictionary (OED): Alpha (in social contexts): "A person who assumes a dominant role in a particular group, especially one who is respected or influential."

Do you have a link for this definition? I'm unable to find it or the one you attribute to Merriam-Webster on their websites.

(Their websites are shit. I'm curious about the dates around those definitions.)
That is OK, guess I would write a job to listen to the logical WAL and use it to do an update that writes an event sequence number.
> Using "go tool" forces you to have a bunch of dependencies in your go.mod that can conflict with your software's real dependency requirements, when there's zero reason those matter. You shouldn't have to care if one of your developer tools depends on a different version of a library than you.

Heh, were the people who made 'go tool' the same people who made Maven? Would make sense :P
How are you running it, can you be more specific?
OP probably means "the largest distilled model"
Note: This is not an actual model but rather an announcement of an effort to reproduce the R1 model.
Given DeepSeek's open philosophy I wonder what their response is to simply being asked for access to the code and data that this project intends to recreate?
Google Maps in the US Will Change to Gulf of America and Mount McKinley
Ah shit I guess they’ve been storing my browsing history then…
Welcome to the agentic age, where prompting can be just barely automated, but tokens are so cheap it doesn’t matter. Fresh off the presses as of last week
I did buy:-) although the amount bought isn't impressive because I have other temporary cash flow constraints for a few months.
great stuff! nice to see that remotion is becoming more popular on such projects.
Is a static site hosting platform required to proactively monitor which content paying users host in your jurisdiction?

Wouldn't a solid set of processes to handle content complaints and knowing who your customers are in case the hosting country's law enforcement has a case suffice?

Or are you having some free tier where users can anonymously upload stuff?

In the latter case — a free place to stash megabytes — you'll need to detect password protected archives in addition to unencrypted content. Get ready for a perpetual game of whack-a-mole though.
Battery replacement is difficult, not impossible, but bordering on impossible is restoring the waterproof seal. Once you've replaced the battery you basically have to keep it away from water. I wasn't careful with mine and lost two to water damage after replacing the battery, despite re-sealing with permanent adhesive.
Can you elaborate which models you are using? I‘m running an R1 distilled Qwen coder with 32B Q4, and while it’s giving useful answers, it‘s quite slow on my M1 Max. Slow enough that I keep reaching for cloud models.
I recently had a discussion with a higher ranked executive and his take on AI changed my outlook a bit. For him the value of ChatGPT:tm: wasn't so much the speed up in any particular task (like presentation generation or so). It's a replacement for consultants.

Yes, the value of those only exists mostly if your internal team is too stubborn to change its opinion. But that seems to be the norm. And the value (those) consultants add is not that high in the first place! They don't have the internal knowledge of _why_ things are fucked up _your particular way_ anyways. That part your team has to contribute anyhow. So the value add shrinks to "throw ideas over the wall and see what sticks". And LLMs are excellent at that.

Yes, that doesn't replace a highly technical consultant that does the actual implementation. Yes, that doesn't give you a good solution. But it probably gives you 5 starting points for a solution before you even finish googling which consultancy to pick (and then waiting for approval and hoping for a goodish team). And that's a story that I can map to reality (not that I like this new bit of information about reality..)

If we accept that story about LLM value, then I think NVIDIA is fine. That generated value is far greater than any amount of energy you can burn on inferring prompts and the only effect will be that the compute-for-training to compute-for-inference ratio decreases further
There's something to be said about the idea that instead of just dumping oceans of money into buying Nvidia cards they just...optimized what they had

I'd say the wider industry could learn a thing or two, but as other commentors have joked. The line must go up
Humans made a policy that said the computer system could do this, so while GP might be inaccurate, you’re not right either.
Hype. We were already plateauing with next token prediction and letting the models think out loud has simply pushed the frontier a little bit in purely test-taking domains.
But their (Chimpanzees') social dynamics aren’t solely based on violence
I like that it’s open source, but ultimately it is china so we can’t trust it.

It’s trivial to implement bias in models (hence the no-no filters in chatgpt) so if they’re smart they’ll do what they do with tiktok and make the answers different for their rivals.
Well, GPUs from the big players do give a damn as they tend to have surprisingly limited plane count and capabilities. It is often just a single primary, cursor and overlay plane, sometimes the latter is shared across all outputs, and sometimes what the plane can do depends on what the plane it overlaps with is doing.

Mobile chips are as you mention far ahead in this space, with some having outright arbitrary plane counts.
Manager vs. Craftsmen
You can't be a killer app if your competitor is just as good and free.
Much larger. Static HTML <--> AJAX <--> WebSocket, for example weren't it decades in between?
For just $10? The pricing begins at $45. Except you mean when broken down monthly?

Congrats on the launch!
> their (Chimpanzees') social dynamics aren’t solely based on violence

Correct. A book on Chimpanzees was connected to human nature by a reviewer in the Chicago Tribune, a 1999 Time article and the obviously totally-scientific pick-up book The Game [1].

[1] https://en.wikipedia.org/wiki/Alpha_and_beta_male
fwiw, National Public Radio (NPR) news in the USA said that AI experts stated it was "almost as good" as other current offerings like chatGPT and Gemini. That its real advantage is the low cost of providing the information. However, this is only a claim made by the company without any proof.
I've received a basic Garmin watch for my 5 years anniversary with the company I work for and I don't use as:

-The app has dark patterns like: you need to put a weight and height before you proceed with the setup, even though you can remove those later.

-Step counter quite simply doesn't work, as it grossly overestimates the count.

-5 day battery life. Not terrible, but also not practical.

-Notifications. All. The. Time. And about some "fitness goals" I don't remember setting. I have enough distractions from my phone thank you very much.

Who is the target audience for this?
With all the rate limits on Sonnet 3.5, people only want more of these models. We haven't even seen wide adoption yet.
This is really good news!

Wishlist for the next device:

More sensors: heart rate, spo2 and ecg...
You may also enjoy the Running Nose by Lem. Core idea is somewhat similar to the Investigation but this book offers a more satisfying ending.
what is also concerning, Go team years ago did small vote, small survey of positive occurrences, and decided to enforce it globally for anyone.

old design give people option to use `tools.go` approach, or other, or nothing at all. now they are enforcing this `tools.go` standard. Go looks to be moving into very restrictive territories.

what about surveying opposing views? what about people who did not use `tools.go`

what is going on in Google, Go team?
Ask HN: Did DeepSeek train on ChatGPT outputs?
I have quite a rudimentary knowledge of AI, but from what I know training off another model's outputs is a form of knowledge distillation. If Deepseek had done that on 4o data, could that be the reason why their base model training costs were so low?
The US companies got too greedy? How? They invented this entire space, literally. DeepSeek built their base models off Llama releases and OpenAI outputs (or so it’s thought), and while they added some optimizations on top, it seems like they’ve lied about the costs to produce their models by simply being vague about their base model and training data, and quoting the cost of their final training run.

And then there’s all the dystopian propaganda baked into these models, which threatens to misinform users at scale based on a government driven agenda. Hard to be on that team, let alone firmly, knowing that it’s giving power to a dictatorial regime.
As an aside about pure water being corrosive, ultrapure water is something else, as seen in the Super-Kamiokande neutrino detector

https://www.sciencenewslab.com/this-beautiful-golden-chamber...

>In order for the light from these shockwaves to reach the sensors, the water has to be cleaner than you can possibly imagine. Super-K is constantly filtering and re-purifying it, and even blasts it with UV light to kill off any bacteria.

>Which actually makes it pretty creepy.

>“Water that’s ultra-pure is waiting to dissolve stuff into it,” said Uchida. “Pure water is very, very nasty stuff. It has the features of an acid and an alkaline.”

>“If you went for a soak in this ultra-pure Super-K water you would get quite a bit of exfoliation,” said Wascko. “Whether you want it or not.”

>When Super-K needs maintenance, researchers need to go out on rubber dinghies (see above) to fix and replace the sensors.

>Matthew Malek, of the University of Sheffield, and two others were doing maintenance from a dinghy back when he was a PhD student.

>At the end of the day’s work, the gondola that normally takes the physicists in and out of the tank was broken, so he and two others had to sit tight for a while. They kicked back in their boats, shooting the breeze.

>“What I didn’t realise, as we were laying back in these boats and talking is that a little bit of my hair, probably no more than three centimeters, was dipped in the water,” Malek told Business Insider.

>As they were draining the water out of Super-K at the time, Malek didn’t worry about contaminating it. But when he awoke at 3 am the next morning, he had an awful realisation.

>“I got up at 3 o’clock in the morning with the itchiest scalp I have ever had in my entire life,” he said. “Itchier than having chickenpox as a child. It was so itchy I just couldn’t sleep.”

>He realised that the water had leeched his hair’s nutrients out through the tips, and that this nutrient deficiency had worked its way up to his scalp. He quickly jumped in the shower and spent half an hour vigorously conditioning his hair.

>Another tale comes from Wascko, who heard that in 2000 when the tank had been fully drained, researchers found the outline of a wrench at the bottom of it.

>“Apparently somebody had left a wrench there when they filled it in 1995,” he said. “When they drained it in 2000 the wrench had dissolved.”
One of those times fate sharing may be net beneficial.
we just have to get solar deployed sufficiently so that we no longer think of energy use as a waste of something precious
Kowtowing to the king
That's absolutely good news. The only thing I hope is to keep it thin design, which basically means no pulse measurements. But I also understand that maybe there are ppl that want this.

I tried Garmin Forerunner 245. It was the closest but OS and button placement were less intuitive. And it was thicker. Pebble time has a much sleaker design that doesn't give sport vibes but an everyday watch style.
PTR looked great too but battery life wasn't great
I wonder if Trump is aware of how many Republican voters are on SNAP.
The only one I’ve see people talk about that shares all the components is OLMo (https://allenai.org/blog/olmo2)
DeepSeek gives biased propaganda answers about Tiananmen Square and Taiwan
I was under the impression too that this would bump the retail customers demand for the 50 series given the extra AI and cuda cores, add to that the relatively low cost of the hardware. But I know nothing of the sentiments around wallstreet.

I don't feel like upgrading my 4090 that said. Maybe wallstreet believes that the larger company deals that have driven the price up for so long might slow down?

Or I'm completely wrong on the impact of the hardware upgrades.
Every now and then we still experience the power of collaborative work fueled by open source and not driven by money but curiosity and collegiality. This is the thing I miss the most from the early internet years.