skysight-inc/HackerNews huggingface dataset:
DeepSeek v3/r1 isn't based on llama architecture. It uniquely combines and contributes several novel approaches.

Meta never released a mixture of expert model (they failed to train a good one, according to reliable rumors). And MoE is just one of few ingredients that make DeepSeek v3/R1 interesting and good.
I found that the way Basecamp tries to achieve async communication is to make sync communication as painful as possible. Not a great experience.
Qwen2.5-VL Is Released
The good thing is:

Blackwell DC is $40k per piece and Digits is $3k per piece. So if 13x Digits are sold then it's the same turnover as a DC GPU for Nvidia. Yes, maybe lower margin but Nvidia can easily scale digits into masses compareds to Blackwell DC GPUs.

In the end, the winner is Nvidia because Nvidia doesn't care if DC GPU, Gaming GPU, Digits GPU, Jetson GPU is used for AI as long as Nvidia is used 98% of time for AI workloads. That is the world domination goal, simple as that.

And that's what Wallstreet doesn't get. Digits is 50% more turnover than the largest RTX GPU. On average gaming GPU turnover is probably around $500 per GPU. Nvidi probably sells 5 million gaming GPUs per quarter. Imagine they could reach such amounts of Digits. That would be $15b revenue and almost half of current DC revenue with Digits only.
Technically, all the Nvidia stock (and virtually all stocks in the US) are owned by Cede and Co. So Nvidia has only one investor.[0] There's several layers of indirection between your Robinhood portfolio and the actual Nvidia shares, even if Robinhood mentions NVDA as a position in your portfolio.

The ETF is just one more layer of indirection. You might like to read https://en.wikipedia.org/wiki/Exchange-traded_fund#Arbitrage... to see how ETFs are connected to the underlying assets.

You will find that the connection between ETFs and the underlying assets in the index is much more like the connection between your Robinhood portfolio and Nvidia, than the connection between butterflies and thunderstorms.

[0] At least for its stocks. Its bonds are probably held in different but equally weird ways.
That is actually a really good suggestion! Thank you, I did not know about this project, and it is quite close to what I'm looking for. Perhaps I won't have to write all of the software myself!
It's a major use of the watch for me also, but something like a Pebble 2 HR would tempt me to abandon payments.
Do you have any links to examples of these bands you've found useful?
The slime scroll reveals all slimes (green and purple).
Percent of new code written by aider for aider
The state of open video generation models
“Gifts to the world”?

What a strange thing to say…
It was there 3 (three) decades ago.
> Currently, this fork builds and runs successfully on MacOS and Linux.

Wow, does that mean that my Mac/Linux box has a Cray X-MP hidden inside it somewhere? I just wanted to start whining that I don't have a Cray...
A Pebble 2 HR with a colour screen would do the job for me, I think.
I 90% agree on the foreign policy stuff. I'd even go further and say advocates for invasion never considered Iraq was actually pretty good for a country in that region. Not only were they a key counterbalancing force to Iran, they were relatively religiously and culturally moderate (I'm sure there's a lot of nuance here; again I'm pretty ignorant). Advocates full on ignored or misrepresented intelligence about Iraq's WMD program though (I'm pretty sure even HRC ignored it or at least weighed it way too lightly).

I agree the Iraq War was premised on deeply faulty assumptions and complete naïveté about other cultures. Governments grow out of culture (a popular saying is "people tend to get the governments they deserve", which is maybe a little insensitive re: stuff like minority rights but not otherwise totally wrong); you can't really just poof a democracy into being; you can't just assume people will adopt your values. I do think we're way more circumspect on this now than you do though, I mean we haven't done another Iraq/Afghanistan. I'll also say that even though Republicans snicker at it, Jake Sullivan's foreign policy for the middle class is a pretty big departure for the establishment. That's a substantial positive change.

I also agree you can't 100% import "Americans". But, my worry with Trump's rhetoric here is that he ignores you can 99% import Americans, the children of the remaining 1% are fully assimilated, and that this has always been the case. There's so many ways we could make our immigration and asylum systems more humane and sustainable, but the GOP has ratfucked our immigration and asylum systems for decades to win elections (this is their move: break a part of government and then be like "look government is broken"... well yeah) so things will be trash for the foreseeable future.
Never cared about Pebble's fitness/health tracking and never used it. I don't need my health reported to me in numbers every day, I'm not a performance athlete nor a hospital patient. Living my personal life trying to hit some numbers dictated to me by some app sounds like a horrifying idea, like a second work life at home.
I wonder if a new pebble could be a bit like a dumb phone.
Makes sense. Google does not want to get into the business of deciding what's called what. They just want to take a government database and implement it so that people can complain to the government instead of to them.
There were some cases (maybe all?) where those glitchy/rainbow graphics (during load or in the border while it ran) were the program utilizing graphics RAM as program RAM during a heavy process (decompression, for instance).
Ok, what am I misunderstanding here?

If I need financing of 100 pesos for buying a house, and I go to a commercial bank which has a 10% fractional reserve requirement, they'll give me 100 pesos, 90 of which will be newly created broad money. As I buy the house, and pay the 100 pesos to the seller, the 90 newly created pesos just entered the economy.

If I go to your corner store and buy an Iphone on credit, you're not getting any new pesos right away, and neither am I. I could turn around, and sell the Iphone to someone, but again, that person will pay me with pesos that already exist in the system.

You could argue that implicitly me wanting to buy an Iphone means that someone somewhere down the line would've used a commercial bank to take a loan and hence my activity indirectly participates in broad money creation. But that doesn't mean that buying an iPhone in a corner store on credit is exactly equivalent to taking out a loan at a commercial bank when it comes to broad money creation.
The brute force approach is the expensive one ("probably, so far anyway" add these 4 words everywhere) - and impossible to make "always correct" aka "usual blindsides". They seem to be trying a bunch of specialized training ideas here and there in the system - just like a Mixture of Experts does, in different places than was obvious so far, and with an eye toward reasonning. In particular trying to build a reasonning-oriented training base from minimal seed.

It's still not going to give an "always correct" result but we are nowhere near the point where that's needed. We are only at the point where a new idea can get you a percentage point further in benchmarks. Some fundamental limits were baked into the previous assumptions - easy to get past by leaving these assumptions behind.
The USA does not have allies. It has hostages.
Thank you! X just plain doesn't work for that usecase, you'll either get blurry text on one of the monitors or a tiny window with mixed DPI. It fundamentally doesn't work.

Reading some of this thread has made me feel like I'm going insane. I have a wildly different experience of both X and Wayland from a lot of people in this thread it seems.
99% of the population see sunlight on July 8 (and on other dates, too) (2023)
But how else are you going to get the clicks?
> schools bear more than a passing resemblance to prisons.

The qualifier some needs to be applied to that too. None of the schools I have any personal knowledge of in the UK or Norway bear (or bore in the case of my own childhood) the slightest resemblance to a prison. Well, there was one. I accompanied a colleague in the US when he picked up his daughter at the end of the school day, I was astonished to find that he had to present himself at a reception desk that was guarding locked doors that were the only way in and out.
The second dotcom era was basically giving away product until you have a monopoly.

Really isn't hard to imagine a company trying to make a software happen by generating an environment around it.
Once Javascript became available there were plenty of techniques.

e.g. refreshing borderless iFrames to load new HTML and using hidden iFrames to load new state.

AJAX made it much easier but it didn't offer anything that hadn't been done before.
I don’t think “Taiwan is China” is the same kind of massaging as not telling people how to make napalm…

What a weird thing to equate, though!
It was from a time where Google's ethos was still "Don't be evil" and generally speaking the naked greed triggered by AdSense hadn't infected the rest of the company yet.

So I think a lot of nostalgia is not just for the reader but also for the company Google used to be.

I wonder if in 20 years time there will be the next generation of programmers sneering over vapour-ware Google products while middle managers still buy them products because "no-one ever got fired for buying Google".
All systems I have worked on like this has some concept of a version number for each entity / aggregate.

So you get that the account_balance was 100$ on version 10 of the account, and write an event that deducts 10$ on version 11.

If another writer did the same at exact same time, they would write an event to deduct 100$ at version 11. There will be a conflict and only one version will win.

This is exactly like any optimistic concurrency control also without event as the primary storage.

Didn't check if the system linked to supports this, I guess it might not? But this primitive seems quite crucial to me.
Or you could, you know, like just stop printing money and the problem goes away.
Related discussion:

July 8 99% of the world’s population in sunlight simultaneously? - https://news.ycombinator.com/item?id=32017952 - July 2022 (118 comments)
I love my Withings watch but I wish I didn't have to use their app and could instead get the data directly. I tried to reverse engineer their bluetooth based protocol in the past but didn't get far because I don't have much experience with bluetooth.

I then looked at what http requests their app makes which was more straightforward and actually interesting but still not what I wanted... I hope I will find the time to try again soon.
Some answers here : https://community.openstreetmap.org/t/gulf-of-america-gulf-o...
America's version of the https://en.wikipedia.org/wiki/Nine-dash_line , I guess. At least they've not started making territorial claims to go with it, this is just a renaming to appease nationalists.
It's basically impossible for Google to open-source anything built in house, because it all relies heavily on Borg and various other proprietary tools and libraries that don't exist outside the Googleplex.

Pebble, on the other hand, was built fully outside Google and only ended up there via a circuitous route (the Fitbit acquisition), so this is not a concern.
I wonder if they'll put the dashed/contested line around the Gulf of ~Mexico~ America?
I think they turned some platinum atoms into gold. In a particle accelerator.
Well, assume the non-overdraftable bank account example instead then, what do you do then?
Why not? Evolutionary pressure is likely to be the same elsewhere, why should we think that it will have different consequences?
I think their phrasing is only "if everyone relevant goes along with it."
https://www.openstreetmap.org/node/305639190

Most likely add an American English name, leaving the English name as Gulf of Mexico.

But I didn't read all 108 comments in the discussion.
Public pension schemes always end up being turned into Ponzi schemes for short term political gain, especially as birthrates keep dropping.

US social security and Medicare are a great example of this but you'll find similar examples throughout the western world.

In contrast private retirement plans put the individual in charge of their own retirement (why should the government be telling you when to retire?) and doesn't put a financial burden on unborn generations.
Ukraine I think is a pretty good example of where we've learned our lesson. We're working with allies, we aren't involving US or NATO troops, we're broadening our coalition and isolating our adversaries, etc. I think we could do better (Russia is super winning the propaganda war inside the US), but it's a positive trend from Iraq/Afghanistan.
The secret of meritocracy is it can be measured in billionaires
> he literally had financial backing from his family

I think it's because the amount he got from his family was tiny in relation to his level of success, and the success being from providing real things people bought/used, and from the real things being things that had never been done before.
This is really complicated...

- NVIDIA has probably been overvalued for a while

- But what is happening now is clearly a panic

- GPUs are still needed for training and inference, and I guess people will figure that out in the next few days

- So far, all we have is claims from one source. Seems credible enough, and I'm sure there's massive optimization potential in training LLMs, but someone else should replicate the process first before it's taken as a fact
Remind me -> in 20 mins / 1 hours / 4 hours / tomorrow / next week. Or you can click the 'save for later' bookmark icon with no time alert.

The pings are within your control. If your org has an unruly Slack workspace, get on top of your notification settings or just leave it closed most of the time and check in periodically.
I personally hope they stay well away from fitness stuff. I think all those big companies having a go at it for years has sufficiently proved that a wrist device can not be accurate enough at tracking steps, sleep or even heart rate. While GPS is better served by a phone which has a more accurate chip and also the battery to sustain it.

And orienting towards fitness means compromises for size, weight, comfort and battery life. The original Pebble was slim, light, didn't have a sensor bump, wrapped nicely around the wrist.
Thanks! :)

> Nothing fancy.

Well, right now I am seeing lots of low-level innovation for networking/storage along with RoCE, Infiniband, Tesla's ttpoe, the recent addition of devmem-tcp to the linux kernel (https://docs.kernel.org/networking/devmem.html) and wondered if there are approaches on how to plug something like that together on a higher level and what the considerations are. I surely assume EFS or S3 might be too expensive for a (large) training infrastructure, but I can be wrong?

> You missed model serving (I think ?).

I think I have a better grasp on the engineering challenges there and could imagine an architecture to scale that out (I believe!).
I think the stock market is pure evil. The only way companies can reach a high valuation is by either becoming monopolies, or convincing the investors they can become one.

This leads to all sorts of anticompetitive behaviors on their part.
In general, how do you run these big models on cloud hardware? Do you cut them up layer-wise and run slices of layers on individual A100/H100s?
You pretty much always have to waste the starting spell. Your first 5HP worth of attacks is rarely going to give you enough information to deduce a path, so you'll need that sound 6HP to try to find another scroll.
I agree, but the German one is also pretty dodgy: Basically pay the rents of the old generation from a share of the working one. It's already coming apart due to demographic change and the next few years will be disastrous.

If there's an approach to model imho it's the Norwegian one: Actually backed by stocks, but managed and distributed by a central investment fund. It's far easier if the country is smart enough to centralize oil profits as well though...
Clearly there is content that would be unacceptable to post. Anything patently illegal, for example.
Especially since he seems intent on everyone talking about him all the time. I find it questionable when a person wants to be the centre of attention no matter. Perhaps attention is not all we need.
Yes... spending thousands of $/€ to go somewhere and then focus on sleeping as long as possible instead of sightseeing, sampling the local cuisine and other stuff regular tourists do, sounds like the ultimate luxury indeed! Because it shows that you have not only the money, but also the free time to travel somewhere just to sleep there - something that a person who can maybe afford the same vacation, but has a limited number of vacation days, won't even consider.
Why is cost your only concern? You don’t care at all what data the model was trained on? The motivations of the people who trained it? I mean maybe the importance of those things isn’t super high to you, but “don’t care”?

How odd. Most Westerners I know would care…
The conflicts come later when the people that provided the money start pulling on those strings again.
The biggest trade partner of China is US...
Thanks for the run instructions, unsloth. Deepseek is so new it's been breaking most of my builds.
I think a company is small whilst all the employees could conceivably fit into a house party. That is perhaps a better metric here in the UK where there are fewer colossal houses. But hopefully you get the idea.
Mines 8 years old at this point (so old it's a Nokia branded one) and it still lasts 3-4 weeks. I wonder why it's held up better?
Mastodon is perfect for affirmation of your worldview and strengthen your social bubble because instance rules are intolerant to random kind of opinions.
It says that it was fastest airliner with 2.05 Mach, but Tu-144 was faster with 2.15 Mach
Creativity always delivers when minds are constrained.
The problem is he's only wrong some of the time and then people arguing about which one it is this time generates attention, a valuable commodity.
Well, prediction is very difficult, especially with respect to the future. But the fundamentals look good.

Current world marketed energy consumption is about 18 terawatts. Current mainstream solar panels are 21% efficient. At this efficiency, the terrestrial solar resource is about 37000 terawatts, 2000 times larger than the entire human economy:

~ $ units
Currency exchange rates from exchangerate-api.com (USD base) on 2024-11-25
Consumer price index data from US BLS, 2024-11-24
7290 units, 125 prefixes, 169 nonlinear units

You have: 21% solarirradiance circlearea(earthradius)
You want: TW
* 36531.475
/ 2.7373655e-05

IEA reports that currently (three years ago) datacenters used 460TWh/year. In SI units, that's 0.05 terawatts. https://iea.blob.core.windows.net/assets/6b2fd954-2017-408e-...

So, once datacenters are using seven hundred thousand times more power than currently, we might need to seek power sources for them other than terrestrial solar panels running microgrids. Solar panels in space, for example.

You could be forgiven for wondering why this enormous resource has taken so long to tap into and why the power grid is still largely fossil-fuel-powered. The answer is that building fossil fuel plants only costs on the order of US$1–4 per watt (either nameplate or average), and until the last few years, solar panels cost so much more than that that even free "fuel" wasn't enough to make them economically competitive. See https://www.eia.gov/analysis/studies/powerplants/capitalcost... for example.

Today, however, solar panels cost US$0.10 per peak watt, which works out to about US$0.35 to US$1 per average watt, depending largely on latitude. This is 25% lower than the price of even a year ago and a third of the price of two years ago. https://www.solarserver.de/photovoltaik-preis-pv-modul-preis...
I feel like nvidia is still a good buy haha.
Truck Nuts
The rat scroll removes points from the board (replaces monsters with 1hp rats).
Let's shed a tear for the investor class who had their wealth extraction dreams dashed a bit today.

Anyways, where were we...
This is not new or controversial. Names vary between languages and countries. What would be controversial, is for Google to decide on other names than the official one. If you're upset about the name change, blame the one who gave the order.
Are there any other groups trying this?
Under-rated problem. The decline is real, and towards the end of their life many people end up handing a power of attorney to their children or other close relative in order to run their lives. While in the meantime there are so many more internet-enabled scams.
Ideally, in LTR locales, we move from left to right. This means that objects appear from the right side of the screen (as going forward would mean going right), and a back button is more intuitively perceived on the left side.
I am wondering what reaction to them you had. I hope you are well, it sounds concerning.

I've always had an extremely anxious reaction to adhd medication that was inexplicable (on top of the usual side effects like sleeplessness and lack of appetite).
Recently it cleared up more when I was diagnosed with Aspergers syndrome as well and realized I am also sensitive to lots of other things, not just these meds. Nowadays I try to go without meds but it's a daily struggle. I wonder often if it would be a bigger struggle on meds.
Exactly, same situation as with audio. Instead of improving the OSS API we got ALSA, PulseAudio, and now PipeWire (and a bunch of less mainstream alternatives) -- all with their own weird issues. And of course it's application (or at least toolkit) developers that bear the cost of this churn, not the developers that get to work on their fancy new NIH tech that they'll then abandon before being 100% stable for yet another reimplementation.
>On the training side, there will be less demand for nvidia GPUs as meta, google, microsoft etc. extract efficiencies with the GPUs they already have given the embarrasing success of DeepSeek. Now, China might have been another insatiable market for nvidia but the export controls have ensured that it wont be.

Why? If DeepSeek made training 10x more efficient, just train a 10x bigger model. The end goal is AGI.
Yup left my java enterprise job to switch back to ruby on rails
PatientSeek, the First Open-Source Med-Legal DeepSeek Reasoning Model
Anecdotal but here's how I described using the likes of Copilot to my sceptical colleagues (they were late to the party!):

It's like having a senior software dev over your shoulder. He knows pretty much everything about coding but he often comes to work drunk...

And that was the best analogy I could come up with: I think it's sped up my work enormously because I limit what it does, rather than let it loose... if that makes sense.

As an example, I was working on a C# project with a repository layer with a bunch of methods that just retrieved one or two values from the database, e.g. GetUsernameFromUserGuid, GetFirstnameFromUserGuid and so on. They each had a SQL query in them (I don't use ORM's...).

They weren't hard to write but there were quite a few of them.

Copilot learned after the first couple what I was doing so I only needed to type in "GetEmail" and it finished it off, (GetEmailAddressFromUserGuid) did the rest, including the SQL query and the style I used etc.

To me, that's where it shines!

Once you figure out where it works best and its limits, it's brilliant imo.
> DeepSeek built their base models off Llama releases and OpenAI outputs

Those models are also trained on data that was ignoring licenses / copyrighted content.
I haven't been able to figure out what the ? in squares mean.
For USA, that is. In Europe speed has increased drastically.
meh, freenode had 90K users at its peak =P