skysight-inc/HackerNews huggingface dataset:
It's much better than sharing a binary artifact of regular software, since the weights can be and are easily and frequently modified by fine tuning the model. This means you can modify the "binary artifact" to your needs, similar to how you might change the code of open source software to add features etc.
Uh, it isn't? Pog AND Vig both had arguably the best performance of all time on stage 14.
When Did Neil Armstrong Step on the Moon?
Would the comparison not be human drivers? If it's 99% percent reliable I would say that's far safer than humans and makes far more sense already? What am I missing
Hold your horses, it's still very buggy!

Meta's Llama 3.1 models can output multilingual text which is awesome. Here are some example of 8 bit quantized 8b model with 100 token output (-n 100)...

Quantization creates some brain damage...

Sample output:

English

./run ../llama3.1_8b_instruct_q8.bin -z tokenizer_l3.bin -l 3 -n 100 -i " My cat is funny"
My cat is funny. "Funny cat," I say, walking up to it. "What are you up to?" It sits up straight and looks at me with a tilted head, as if to say, "What's wrong with you?" Sometimes I just have to laugh at how funny a cat can be. So I say, "Okay, you're funny. I'll give you some treats." It stretches out a little and I give it some treats. It eats them up quickly and starts
achieved
tok/s: 5.376052

German

./run ../llama3.1_8b_instruct_q8.bin -z tokenizer_l3.bin -l 3 -n 100 -i " Besitzen Sie einen Amiga 500?"
Besitzen Sie einen Amiga 500? Wenn nicht, werden Sie wissen, dass dies ein Computer war, der im späten 1980er und frühen 1990er Jahren für Spiele verfügbar war, die für Personen mit bestimmten Körperverletzungen gedacht waren. Manchmal müssen wir uns an frühere Zeiten erinnern, die, wie wir jetzt wissen, schwierig waren. Hier ist ein Link, der meine Geschichte bespre
achieved tok/s: 5.367599

French

./run ../llama3.1_8b_instruct_q8.bin -z tokenizer_l3.bin -l 3 -n 100 -i " Le vin français est"
Le vin français est, à bien des égards, un vin des origines, car il a joué un rôle important dans l'histoire de la France". La réputation des vins de France repose principalement sur leurs qualités gustatives et la gestion des vignobles contrôlée, ce qui rend le vin français un "produit d'exception". La France est donc leader mondial de la production de vin, avec 25 % des exportations mon
achieved tok/s: 5.43299

Thai

./run ../llama3.1_8b_instruct_q8.bin -z tokenizer_l3.bin -l 3 -n 100 -i " แมวของฉันตลก"
แมวของฉันตลกชอบเล่นบนม้วนกระดาษ และฉันก็ไม่แน่ใจว่าควรจะยินยอมที่จะให้เล่นหรือไม่

เมื่อเวลาผ่านไป ฉันเห็นว่าแมวของฉันเล่นม้วนกระดาษเป็นระยะ ๆ ฉันจึงตัดสินใจที่จะลองปรับเปลี่ยนเกมให้สนุกขึ้น
achieved tok/s: 5.376052

Hindi

./run ../llama3.1_8b_instruct_q8.bin -z tokenizer_l3.bin -l 3 -n 100 -i " मेरी बिल्ली बहुत मज़ाया है"
मेरी बिल्ली बहुत मज़ाया है और वह हमेशा अपनी शारीरिक गतिविधियों से मुझे मजाक करती है। वास्तव में, जब वह अपनी खिलौनों की चपपेट में आती है तो वह विशेष रूप से क्लासिक बन जाती है। इसके अलावा, वह एक छोटी सी च
achieved tok/s: 5.460864
Possibly because it is hard to make a video streaming service that requires over 300 Mbits of bandwidth commercially viable.
As far as I know it's not just the weights. it's everything but the dataset. So the code used to generate the weights is also open source.
Notification Buttons
Wow, a full half of Tesla's operating income came from tax credits( around $800M of $1.6B operating income).

They had a few decent misses on operating income and earnings per share.

And their operating margin is in the low 6%ish which would make it one of the worst performing auto manufacturers around at the moment.

Man things have turned quickly on Tesla.

They are still in a good cash position but their car business is really showing signs of strain at the moment.

they did announce that they'll release a more affordable model by the end of H125 so that will help, but with that timeframe its likely to be a model 3 refresh and not a new car.
Show HN: Healer – On-demand AI clinicians in your pocket 24/7
I know a bunch of women at ivy league universities that can't find a partner and would say it is definitely mostly (1). The article seems to put its main focus on men feeling their manlihood threatened if the woman has a more accomplished career, but I'd point out that these women perceive a significant social pressure that they're able to find a man that is more accomplished than them.

In fact I'm in that kind of position myself, and it doesn't feel threatening to me at all.
I think I would've just ran and not kept looking back. Screw the chance to get a video from my phone.
Come on, let’s be realistic. Startup options can have merit sure. Maybe they worked out for you, for some lucky people who make the right bet they work out handsomely. But we can do the math on this. What’s the percentage of say, Series B funded companies that make it to a successful exit, let alone an exit for multiple billions of dollars.
It’s really low.
So what’s the expected value on an option in a series B startup?
You can believe in the company all you want, it doesn’t matter. Good companies fail all the time for reasons out of their control.
Unless you’re taking options from a startup very deep in rounds that has a clear path to profitability and is obviously close to IPO there are very few situations where it would make logical sense to take an offer with options over one with RSUs.
This is kind of like saying it’s disingenuous to say that working for a salary is better than buying lottery tickets.
I don't know much about sponsorship. How would a sponsor be banned? What sort of activities or relations would be off-limits during a ban?
Sigh. Not looking forward to the website rush to get the next generation Founder's Edition.

Last time it took me a lot of doing to get my 4090 FE. And I really want the FE. I don't like the OEM cards nearly as much. They have too screamy designs with too much RGBling, are even bigger, don't have that excellent metal casing etc. It's an understated but very well performing design. I just wish they wouldn't make it so hard to buy. Just sell them in the shops in plenty. Screw the OEMs, their cards aren't nearly as good anyway.
Many misleading statements here:

1. Semi is not dependent on 4680 batteries. And that's still a minority of the battery mix they use. 4680 form factor is still limited to Cybertruck and some Model Y production.

2. Semi has been in initial and testing production, only selling to customers close to the factories and engineers so they could service them quickly, learn and adapt new models.

3. More new Semi trucks have been recently delivered to Pepsi and internally to Tesla.

4. "On track" compared to previous released information from last few quarters.

Semi is still a small part of the business and not as prioritised as it takes a lot to develop a new program for big trucks when the company hasn't been in that niche before. At the same time they are developing various charging solutions with customers and on their routes before they rollout. Still learning from customers and drivers what is the best utilisation for these products.
See Microsoft and Crowdstrike for details. /s
I ran in to all sorts of problems with Google Maps and Waze navigating me in the UK.

Google Maps cannot understand that just because a road's speed limit is theoretically 60 mph, doesn't mean it's ever possible to travel at that speed on that road. So it would keep sending me down little tiny narrow twisty, single lane country roads that you're rarely ever going to break 20mph on.

I grew up driving those roads, so in general I was fine and comfortable driving on them, but it did mean that it was sending us on the slowest possible route.

The only time it'd not try to do that was if enough people had been down in recent enough time for it to think the road was suffering from heavy traffic. There's no way to actually indicate to Google the nature of the roads, either.

It always struck me of being very indicative of a US centric perspective, written with the assumption that roads are wide and open.

edit: It has been something like 10-15 years since I last used a TomTom GPS unit in the UK, but I never had problems with them sending me down narrow roads.
I don't know why it didn't work then. I encrypted the file listing too.
The alphabet itself would still be finite, like our vocabulary.
You have to write all the code needed to do the modifications you are interested in. That is, there is no source code provided that can be used to make the modifications of interest.
One also has to come up with suite le datasets, from scratch.
Training setup and data is completely non trivial for a large language model. To replicate Llama would take hundreds of hours of engineering, at least.
I certainly don't condone cheating in sports but I have to imagine the sponsorship income and general notoriety opportunities are substantially different for someone who can make it into the top 20 or so of their division vs someone who "only" makes the top 100 or 500. Maybe you get into that top 100 and think you're _so close_ to being one of the people who are both elite at the sport and famous/paid generously for doing it, instead of just quietly and honestly elite.
Thank you!

> The term “anchor” feels kind of weird to me

This term was inherited from Anchor Modeling (https://en.wikipedia.org/wiki/Anchor_modeling). "Entity" is pervasive, but I don't want to use this word because it may bring unnecessary baggage and assumptions.

Also, this term is heavily overloaded: basically everything in CS is either an object or an entity, lol.

> The concept of defining the attributes via a question is solid, great way to get clarity quickly.

Thank you, this is an important confirmation for the validity of this approach.
That's a good point, i read this thread top to bottom because this topic has always been fascinating to me. Others have brought up how war wouldn't go from 0 to missiles flying immediately, there would be a crisis and build-up period. So I can see something like that ability to mass produce nuclear weapons and demonstrate it acting as a deterrent and therefore be useful.I can't think of an instance off the top of my head where a massive arms build up caused the other side to back down though.

To your specific point, I think if Ukraine had the keys to even one nuclear weapon and Russia believed they'd use it the invasion would never have happened in the first place.
Training code is only useful to people in academia, and the closest thing to "code you can modify" are open weights.

People are framing this as if it was an open-source hierarchy, with "actual" open-source requiring all training code to be shared. This is not obvious to me, as I'm not asking people that share open-source libraries to also share the tools they used to develop them. I'm also not asking them to share all the design documents/architecture discussion behind this software. It's sufficient that I can take the end result and reshape it in any way I desire.

This is coming from an LLM practitioner that finetunes models for a living; and this constant debate about open-source vs open-weights seems like a huge distraction vs the impact open-sourcing something like Llama has... this is truly a Linux-like moment. (at a much smaller scale of course, for now at least)
I definitely need to fix pipes in https://exaequos.com in order to play !!
What is going on here? Is the person still able to download the file at least?
> So there was a very real price to pay, in money and reputation.

Microsoft Corp. would like to have a word with you. /s
Was it the same Stalin who allowed Germans to train their troops in evasion of the post-WWI peace treaty? They trained their panzer troops over there

https://en.wikipedia.org/wiki/Kama_tank_school

and their fighter pilots

https://en.wikipedia.org/wiki/Lipetsk_fighter-pilot_school

and their chemical warfare teams

https://en.wikipedia.org/wiki/Tomka_gas_test_site

I guess it was the same Stalin who signed a pact with the Nazi Germany to partition Poland and invaded Poland on 17 Sep 1939.

https://en.wikipedia.org/wiki/Molotov%E2%80%93Ribbentrop_Pac...

It must have also been the same Stalin who ordered the extermination of 22,000 of the educated part of the Polish society and then blamed the Germans for it

https://en.wikipedia.org/wiki/Katyn_massacre

I guess he wanted to outdo the Germans, who had a special plan for the extermination of Polish intellectuals

https://en.wikipedia.org/wiki/German_AB-Aktion_in_Poland

I don't know about you, but I don't think anybody wanted to listen to Stalin. He wasn't exactly a reliable interlocutor.
Curious because I don’t have the Tesla but have been impressed by city driving in YouTube videos in SF (I think it’s the beta version).

When did you have the free trial and where was this experience?
Fairly typical or at least happens often enough that an earnings call deck is provided. I did not watch this call but this should be the slide deck they went over. Definitely more the norm for annual calls, both a formal SEC filing will be made and often the deck to go along with the presentation. From a public perspective I don't think anything in here is an "advertisement". They (mgmt) is trying to show you their narrative, how they think about the company and whats coming up. Think of it as a software roadmap. If you think this one is an advertisement you should see clothing consumer materials like Nike, they will walk through a number of their product lines in a very "ad" like tone.

Edit: Not to suggest that their narrative is correct but that's the general aim of these calls. See Snowflake below.

https://s26.q4cdn.com/463892824/files/doc_financials/2024/q4...
>PURCHASE, N.Y., May 21, 2024 /PRNewswire/ -- Today PepsiCo Beverages North America (PBNA) announced the expansion of its electric-powered fleet across California. In the next several months, fifty Class 8 Tesla Semi trucks will operate out of its manufacturing and distribution facility in Fresno, Calif., and 75 Ford E-Transit electric vans will step-change the electrification of its equipment services fleet across the state. The electric vehicle deployment will help the company progress toward its ambitious pep+ (PepsiCo Positive) goal to reach net zero emissions by 2040.

https://www.pepsico.com/our-stories/press-release/pepsico-be...
YouTube advertising revenue: $8.66 billion vs. $8.93 billion expectations

Google Cloud revenue: $10.35 billion vs. $10.20 billion expectations

Percent increase in YouTube advertising revenue from Q2 2023 to Q2 2024 approximately 13.02%.

Percent increase in Google Cloud revenue from Q2 2023 to Q2 2024 approximately 28.84%

Edit: Updated to reflect correct numbers...
“Red Bull caught cheating at $event in sprawling plot; banned for 6 years” - they might invest some dollars to avoid such a disaster. According to the quote in the article, curbing this is only a matter of will and $$$.
Looks like only about half of them have been deployed. The rest are mostly retired but not yet dismantled, or in inventory (https://thebulletin.org/premium/2024-05/united-states-nuclea...)

Apart from the absolute number, is the collection of current weapons "more effective" (whatever that would mean -- some sort of fit for purpose) than the ~23K warheads at the end of the cold war? Or is it simply a subset of the devices in 1989, with some maintenance since then?

I believe the US is designing a new warhead, maybe the first since the end of the cold war (source, discussion at the nuclear testing museum in Las Vegas last month, perhaps not the most reliable source). What about delivery?
I don't have the hardware to confirm this, so I'd take it with a grain of salt, but ChatGPT tells me that a maxed out M3 MacBook Pro with 128 GB RAM should be capable of efficiently running Llama 3.1 405B, albeit with essentially no ability to multitask.

(It also predicted that a MacBook Air in 2030 will be able to do the same, and that for smartphones to do the same might take around 20 years.)
You can't really compare the two countries. The US has 4x (531/100k) the number of prisoners per capita that China (119/100k) has.
And if you were going to validate it, why would you do so at the point of use and not at the point of entry?

(Probable answer: it’s a distributed system, with different parts built to different philosophies and standards.)
It is possible to merge two fine-tunes of models from the same family by... wait for it... averaging or combining their weights[0].

I am still amazed that we can do that.

[0]: https://arxiv.org/abs/2212.09849
As someone else pointed out in another thread: for any given sport the olympics is just one competition. For it to remain prestigious it needs to have most of the best competitors in each sport competing in it, and for that it needs to stay fairly close to the mainstream format and constraints of each sport.

Single-design classes are standard in sailing, so the olympics uses them also. They are not standard for cycling, and it would be a huge deviation from conventions of competitive cycling for the olympics to demand them.

That doesn't mean they can't or that it wouldn't possibly be worth while. But there are huge costs to doing that, like possibly few or none of the major competitive cyclists competing.
I still don't get why they prioritised the cybertruck Vs the semi... Makes no sense at all. Markets are way different in size, I guess margins too. A shame really
It did not decrease. $8.93B was what analysts were expecting.
It's an odd feeling to have seen the rapid decline of QoL on the interior, know it was to drive margins back above 30% / $25B/quarter, leave because of it, then profit from it. Feels unethical.

I guess that feeling is just having the dissonance of the nature of business in your face. Though I do hold that the decisions made to squeak out a couple extra % points will be crushing in the long run.

Even just today: reality is Google is 4th place to OpenAI, Anthropic, and Meta in AI and its not really close.

Each individual step is arguable, but the cracks are there. And leadership is too MBA-y/trend-following to do anything about it. Ex. through August '22 the line was there was going to be a special pot of increased raises to combat all the talent leaving for Meta. Then once Mark started firing, all that went far away, promo quotas to manager level were dropped to ~0, there's ceremonial cullings weekly, and its not of managers.

Edit for child comment:

I respect what you're saying: I'd advise its better to invite conversation, than say its all a simple binary option, especially in the face of me pointing out the same thing.

Ex. morale is trash, outsourcing is rampant, virtually all new headcount is overseas, and _actual_ efficiency, productivity, is lower than it ever has been.

The more simplistic view would advise companies could just fire 90% of staff and go into maintenance mode, but for some reason, they never do.

Also, note that "efficiency" on HN arguments of this form means "get the managers / slackers out of the way" -- economic effiency means "profits are 0". Neither happened here. Never been a better time to be a manager, and slackers aren't going away, if their slacking was visible to managers, they would have been gone already.
Turns out people were right and Musk had a bunch of good ideas, some of which might have a very positive impact on the world (probably EV adoption) but all predicated on getting government money.

> their car business is really showing signs of strain at the moment.

Their car business aka "their entire business"? :-)
> the classic setup that Microsoft (and Apple) have thrown away (many) years ago

I acknowledge this trend; Microsoft wants everyone in the cloud so their on-prem offerings, while entrenched, are stagnant. This could be an opening that lets me build a quality product for a modest customer base who are unable/unwilling to migrate.
Yes, but where equipment is involved it's often very personal. In tennis a top professional can't just switch rackets, for example. Even I have problems playing with other people's rackets.
Assuming Waymo is able to drive safely, it seems like a matter of time until Tesla is able to achieve the same, no? I can’t see why Waymo should be able to do it but Tesla should not given enough time.
> How to say you don't know what Unicode is for without saying it.

I know what its original mission was, which was a character set.

It's been mangled beyond recognition - by including semantic information which is in the purview of context, and presentation information (italics, fonts) which is in the purview of markup languages and layout information (backwards text) which is also in the purview of markup.

> you can't expect programmers to understand pesky little thing like languages having different writing,

But you're requiring programmers to understand all the complicated normalization rules? Normalization is a totally unnecessary feature. Just use the normalized code points. Done.

> these print the same but are semantically different!

Think about what this means. How ever did people manage to read and understand printed books? The semantic meaning comes from the context, not the glyph. For example, I can use `a` to mean the `ahh` sound, or the `ayy` sound, or mean a variable in algebra. How can I know which? The context.

It is totally impossible to add every meaning a glyph has.

> would lose semantic information

Unicode is supposed to be a character set. That's it. Characters do not have semantic information without context.

Oh, and here's some drawkcab text I wrote without any help from Unicode at all.

I had to add some code into the D compiler to reject Unicode text direction "characters" because they can be used to invisibly insert malware into ordinary code.

Adding toy "languages" should be for people having fun, not Unicode.
So... when you say "perceived inflation", you're really just saying that you, personally, perceive inflation. And therefore I can't disprove that with numbers, because numbers don't change your perception. Well, touche. I can't beat that logic.

But in the real world, you do admit that current inflation as traditionally understood by centuries of economics is a little under 3% right now, right?
In the LLM world there are many open source solutions to find tuning, maybe the best one being from Meta: https://github.com/pytorch/torchtune

In terms of inference and interface (since you mentioned comfy) there are many truly open source options such as vLLM (though there isn't a single really performant open source solution for inference yet).
As far as I remember, the caldera erupting is not an extinction level event (for humans at least)... would be bad for sure, but southern hemisphere would manage I think
Years ago there was a hurricane that made it up the New England coast. I remember a story of a father and daughter in Acadia National Park who had wandered out onto some exposed rocks (with about 40 other people) to watch these huge waves crash just below them. Eventually one wave was larger than the others and it knocked all 40 people onto their asses, while dragging the father and daughter (who were right on the edge) into the ocean. The father drowned.

All I could think was how colossally dumb you had to be to assume the waves just going to sit there crashing below you. It was clearly a huge storm surge. And then how horribly tragic and preventable the outcome was. Some people, man.

EDIT: Misremembered it. Three people were swept out, and it was the 7-year-old daughter who died. God damn, how awful.

https://www.bangordailynews.com/2009/08/23/news/three-swept-...
> This is one of those aspects which is not really touched on in most courses.

Thank you! As I was working on all of this, the more it seemed to me also that what you're saying is true. The goal of this approach is to quickly get a very concrete deliverable that you can confirm with the business people and then proceed with implementing in the specific database, using your favorite table design strategy.