skysight-inc/HackerNews huggingface dataset:
> they do have a financial position that may make it easier for them to pivot than some of the other manufacturers

Relative to a utility? Or any deep-pocketed investor who can buy Panasonic cells?

Tesla is a terrific EV company. They shouldn’t be pivoting away from their roots but reclaiming them.
Stock down 4% after hours. Still have a ways to go with that 63 PE (if Tesla is a car company, Ford's is 14, if Tesla is an AI-adjacent software company, meta's is 28)
They're a pure play now.

"It's not about how much you earn, it's about how much you're worth. And who is worth the most? Companies that lose money!"

- Silicon Valley
Alternate headline, Tesla achieves record quarterly revenues.
agree, but also slightly disagree. I was here last year and alot of these geysers erupt like clock work(see Old Faithful). Yellowstone pulls in many tourists from Asia and Europe and and also urban areas of the US and there is nothing like what is there where they come from. Also you have many a placard saying geyers erupt on a regular basis around that area, and also there is a well defined boardwalk around them (for your saftey and to not disturb the area around you) that was vetted by geologists and park rangers. So some of the tourists perhaps thought it was typical, when what happened was extremely abnormal.
They should make it more interesting by requiring a minimum age of 45 or whatever depending on sport, that will avoid the issue of damage that some of the peds can do to the young and impressionable. Plus normal athletes could come back into sports so there is a definitive before and after with a group that generally clean before. Plus what better way to demonstrate the anti aging effect than on people otherwise too old to be competitive.
Mining yellowstone for its geothermal power in order to prevent a volcanic eruption would be a Kardashev Scale Type I accomplishment.

In other words, such a thing is completely infeasible given our current understanding of science and technology.

The time required to develop such a capability would span so many lifetimes that is it effectively science fiction.
I wrote about this in a previous HN thread a few years back. Not clear that it's a great idea: https://news.ycombinator.com/item?id=28593452#28599027
Because one, it's dangerous to people's health; how far are people willing to go?

Second, not everyone has access to the same "help". I mean to a point this is true today as well as not everyone has access to universities developing snake scale outfits or what have you, but at the same time most olympic sports are still about the human performance. But this is why e.g. F1 has such strict regulations that get tightened every year; if it hadn't, the richest team would win, or the one that has an innovation this year (like side skirts) that other teams don't.
Boonen said himself that he was having no issues there. You could probably find that hill and estimate their watt output.

I wouldn't be surprised if Cancelaara is in excess of 1400w for short parts of that hill.
Attack on German forces distracted by uprising, with safe places to move through the river secured by rebels would be easier and faster than waiting for Germans to mop up and destroy the city.

And of course Stalin warned against uprising - he wanted to get Poland, any independent forces were a threat to that plan. After WW2 he imprisoned anti-nazi guerilla fighters in Poland and murdered their leaders in a show trial in Moscow (after promising them safe passage).
This, horribly, may be a current Silicon Valley view. That's the problem.

By contrast the example I gave elsewhere in this discussion is "France ages ago noticed a problematic reliance on fossil fuels and decided to actually solve that problem (for power and heating). That was a super ambitious program of building an entire, country-size industry capable of designing, building, fueling, running and reprocessing grid-scale nuclear reactors. It even worked. Growth WHILE solving problems. But yeah, in France as elsewhere, that effort was and is tied to political will and electoral moods. And so now it's in jeopardy."

That was a giant program with participation of many private companies - not even one private one dominating costs or profits that I noticed. The newly created companies forming the project started for some, and ended up for others owned by France through many different channels: national research labs, national electric utility, development banks, government agencies, etc, etc. No doubt some private companies made excellent money from that project - but that is not its most prominent feature by far.

It was an ambitious engineering and organizational effort.

So yes "ambitious" is a good thing.
Wouldn't the "source code" of the model be closer to the source code of a compiler or the runtime library?

IMO a pre-trained model given with the source code used to train/run it is analogous to a company shipping a compiler and a compiled binary without any of the source, which is why I don't think it's "open source" without the training data.
No matter how "open source" they actually will be, I'm glad this exists as a competitor to Gemini and ChatGPT to help push innovation from a different angle.

Can't wait to see how the landscape will look in 2027 and beyond.
That's why it's important to live stream the calamity.
If you're interested in getting Llama 3.1 to build software, check out https://github.com/OpenDevin/OpenDevin
That's always the case with these why-I-left-my-high-paying-job-at-$FAANG posts.
You know is Seriously Mad Science when...their experiment was to add 50 more nucleons to Plutonium 244. And they (seemingly) succeeded.
I think all three contribute, not necessarily equally. Anecdotally, I'd probably weight it at 2:1:1, but I imagine it varies a lot by individual and location.
> sorta defeats the purpose of opensource to some extent

Not in the slightest. They even have a table of cloud providers where you can host the 405B model and the associated cost to do so on their website: https://llama.meta.com/ (Scroll down)

"Open Source" doesn't mean "You can run this on consumer hardware". It just means that it's open source. They also released 8B and 70B models for people to use on consumer gear.
Pro cycling is very much a middle class sport, people are willing to put a lot of money into getting better beyond just what they themselves can do. A $5K bike is only the beginning.
It is not that big a deal. It is in fact a lot easier than mining deeper geothermal which we can also do, but at much greater expense. Yellowstone aside, exploitation of resources is one thing America is profoundly good at. If we start now, we can finish it in say one thousand years and fully eliminate the supervolcano risk, also enjoying much green energy in the process.
Related:

Tesla Q2 2024 Update [pdf] - https://news.ycombinator.com/item?id=41050278 - July 2024 (68 comments)
I had the same question and asked Claude Sonnet, see its answer below.

In the context of a workflow engine like Netflix Conductor, a workflow refers to a structured sequence of tasks or activities that need to be executed to complete a specific business process or achieve a particular goal. [...]

To give you a concrete example, imagine an e-commerce platform's order processing workflow:

1. Validate order
2. Check inventory
3. Process payment
4. If payment successful:
a. Reserve inventory
b. Initiate shipping
c. Send confirmation email
5. If payment fails:
a. Cancel order
b. Notify customer

In this workflow, each step could be a separate microservice or function. The workflow engine would orchestrate the execution of these steps, handling the flow of data between them, managing any errors or retries, and ensuring the entire process completes successfully.

Would you like me to elaborate on any specific aspect of workflows in this context? Or perhaps you're curious about how they're implemented or managed in practice?
>No.

>Something is wrong with this person's brain.

I hope we're all self-aware enough to know that we're making these comments on a website that was ostensibly designed to support the industry that is/has been responsible for convincing the collective masses that everything needs to be shared on social media and that we need to be wholly reliant on our smartphones just to make it through the day. I don't disagree that this person is responsible for their own choices, but it's not like there hasn't been a tremendous push to get people to view life like this.
You'll probably find interesting threads and links at https://old.reddit.com/r/LocalLLaMa
Alright, so you win that one lol. I glossed over my own comment. Still, I was using the term very obviously hyperbolically, and still referred explicitly to the "ideal middle class man."

So let's do something. What is the perfect adult? how does the perfect adult, not billionaire level or something like that but perfect middle class man, differ from your table stakes? I can guess tall and incredibly handsome, but beyond that, how is he better than your bare minimum requirements?
Compare/contrast:

DOOM-the-engine is open source (https://github.com/id-Software/DOOM), even though DOOM-the-asset-and-scenario-data is not. While you need a copy of DOOM-the-asset-and-scenario-data to "use DOOM to run DOOM", you are free to build other games using DOOM-the-engine.
Your hypothetical apple-grower family would simply share a handbook which meticulously shared the initial species of apple used, the breeding protocol, the hybridization method, and any other factors used to breed this perfect apple.

Having the handbook and materials available would make it possible for others to reproduce the resulting apple, or to obtain similar apples with different properties by modifying the protocols.

The handbook is the source code.

On the other hand, what we have here is Monsanto saying: "we've got those Terminator-lineage apples, and we're open-sourcing them by giving you the actual apples as an end product for free. Feel free to breed them into new varieties at will as long as you're not a Big Farm company."

Not open source.
CentML has successfully deployed Meta’s new Llama 3.1-405B model. Using CServe, our users can switch from other Llama versions with just one line of code.

Key Features:

• Single-click deployment
• Multi-node setup
• Flexible hosting options
• Quick trade-off evaluations

Try Llama 3.1-405B on our platform and see how CentML is revolutionizing AI deployment!

Check it out here: https://lnkd.in/gCkj7qPZ
From a guy's perspective, it feels like if you don't have hobbies (or the right hobbies) and you don't want to drink at a bar, you really don't have many options. For women I must imagine it must be quite similar, if you don't have hobbies that involve both men and women meeting in person, and you don't want to go to bars, in what context are you going to meet someone? Something something dating apps, something something third places. I also feel like for the more awkward/introverted guys (myself included), if I went to a bar (by myself) every Friday night and got a jack and coke and just sat there I would spend a whole lot of money talking to no one. Who knows, maybe I would, I've never done it because it's too expensive and I would feel too awkward. Let's say you go once a month. Thats 12 times a year, not too many times when you think about it. And if I went with friends, well, I feel like I would just talk with my friends!
>I don't assume that what they say is true; in fact, I think that they're wrong. It was an example of even the people in whose interests it is to deny that warehousing happens, not denying that it happens.

They're saying that happens, but only in a very specific case that doesn't apply to the claim that you're making. Claiming that developers/owners are "warehousing" units, because owners don't rent out their units for less than it costs to them, is a non-sequitur.
If USA maintains nukes in Turkey that does not mean they have enough troops in Turkey to protect the base against the entire Turkish military, should they decide to steamroll it. They rely on nuclear codes more than they rely on tanks to stop nukes falling into the wrong hands.
>With 1 hour/week/month/year you cannot go the other way, it is too vague.

It's not just too vague, it's impossible in general.

think about it, first, those who disagree.
> How is it that its now a problem?

Dealing with an average of 200k has been manageable (well, some would argue with this - we still haven't been building enough houses, but leaving that aside).

If you look at 2023 specifically the raw number of people was over 500k - more than double the average. It was a surge that the housing market - amongst other things - simply was not prepared for.

I think the job stats are starting to reflect that these people did not suddenly all become gainfully employed, as well - I have thought for a while that there might be a more serious crash if we enter a recession because of this surge.
BTW I saw your deleted reply about the point of monostate, thanks. For something that has to implement an existing interface, I can see the possible benefit.
I don't want to be like this but folks that unironically use ’woke’ makes it very easy to tell their media habits.
Tesla did what it needed to do: force the world towards EVs. If it dies, legacy auto and BYD will carry on. It will be a shame if Tesla dies because the board didn’t have the will to push Elon out (wrt the brand, its stationary storage business, and ~120k global employees), such is the peril of poor corporate governance.

I cancelled my Cybertruck res, and after buying four Teslas, I will not spend another dime on one until Elon is gone. Tesla is, hopefully, forced into self preservation by market fundamentals.
I think maybe we’re talking past each other because it seems obvious to me and others that the weights are the output of the compilation process, whereas you seem to think they’re the input. Whether you can fine tune the weights is irrelevant to whether you got all the materials needed to make them in the first place (i.e., the source).

I can do all sorts of things by “fine tuning” Excel with formulas, but I certainly don’t have the source for Excel.
Honestly, this is not surprising.

- A lot of Tesla competitors have caught up (outside of self driving) and energized their sections of the EV market. I see way more Korean EVs on the road than ever before for example.

- EV growth is slowing due to various factors, but so are cars in general due to economic issues.

- Elon opened up the NACS as a gambit for not having to change their own chargers. NACS won, but a lot of prospective EV buyers are waiting for NACS native vehicles from other manufacturers.

- Elon has really alienated massive chunks of the EV demographic. Identity politics are inherently tumultuous.

As a launch batch Model Y owner myself, I’m definitely looking elsewhere whenever this car needs replacing. I want more comfort and just a better driving experience (turn signal stalks, an instrument cluster etc in the more accessible models) and the only reason I went with Tesla is the charging network is unmatched in NA.

I do not have a very rosy outlook on Tesla as long as Elon remains in charge. He got it where it is, but he’s increasingly a liability.
I was so afraid of getting my SaaS's SAML implementation wrong that I decided to run Shibboleth SP, which is basically the reference SAML service provider implementation, even though that practically meant running Shibboleth SP and Apache httpd in a separate container, with a small Python WSGI app running under Apache to basically redirect back to an endpoint in the main app. (I didn't want to run the whole main app behind Apache just to support the SSO use case.) This was three years ago, and at the time we especially wanted to sell to the academic market, so I think SAML was still pretty much a requirement.

Are any of the big IdP's (Microsoft, Google, Okta, etc.) still SAML-only?
I just listened to their earnings webcast. It looks like it's going to be yet another earnings release season of tech companies spending billions on AI infrastructure with nothing to show for it. And they're promising continued levels of intense spending on compute. Sundar's comment was that it's better to overspend than underspend and fall behind the competition. Time to buy more NVIDIA.
The open source movement, from which the name derives, was about the freedom to make bespoke alterations to the software you choose to run. Provided you have reasonably widespread proficiency in industry standard tools, you can take something that's open source, modify that source, and rebuild/redeploy/reinterpret/re-whatever to make it behave the way that you want or need it to behave.

This is in contrast to a compiled binary or obfuscated source image, where alteration may be possible with extraordinairy skill and effort but is not expected and possibly even specirically discouraged.

In this sense, weights are entirely like those compiler binaries or obfuscated sources rather than the source code usually associated with "open source"

To be "open source" we would want LLM's where one might be able to manipulate the original training data or training algorithm to produce a set of weights more suited to one's own desires and needs.

Facebook isn't giving us that yet, and very probably can't. They're just trading on the weird boundary state of the term "open source" -- it still carries prestige and garners good will from its original techno-populist ideals, but is so diluted by twenty years of naive consumers who just take it to mean "I don't have to pay to use this" that the prestige and good will is now misplaced.
Discussions

(228 points, 19 days ago, 94 comments) https://news.ycombinator.com/item?id=40877648

(148 points, 2 years ago, 38 comments) https://news.ycombinator.com/item?id=33946425
Pulling out your phone and hitting record doesn't quite qualify as "freeze".
CrowdStrike Analysis
The woman in the white shirt, tan shorts only started running because the people behind her started running. She was strolling away from the explosion. Same with green shorts in the foreground. We don't actually see him run, just walking away.

These people have no sense of urgency around danger, or they cannot recognize danger.
The point is that he wasn’t charged for sending an email
Housing has always been expensive in cities. But the vast majority of people don’t want to live in them. The proof is how people left the cities after WW2 because technology made suburban living viable.

Of course some people want to live in the city. I did for years and paid good money for a prime address. But like hundreds of millions of people I don’t now because priorities change.
It's bad in relative terms because better ideas cannot be implemented.
Direct link to the actual video (TFA "Play Button" image wasn't clickable for for me).

https://youtube.com/watch?v=Z64etOuLZDQ
> I don't think people are aware that the majority of a yt premium subscription goes to creators

Huh? Maybe Google can claim this through some very creative accounting, but the bottom line is that Google retains the vast majority of YouTube revenue; and that the vast majority of content creators on YouTube are not getting paid at all, because the requirements for monetization are pretty steep.

That last part is deliberate, by the way: it allows them to keep a larger slice of the pie while running ads on all videos and showering a small sliver of celebrity content creators with piles cash. For me as a content consumer, YouTube is fantastic. For the average content creator, it's a miserable experience largely built on a lie.
I guess it could be categorised as a PAM (privileged access management) solution with a built-in IdP?
> Can you change the tokenizer?

Yes.

You can change it however you like, then look at the paper [1] under section 3.2. to know which hyperparameters were used during training and finetune the model to work with your new tokenizer using e.g. FineWeb [2] dataset.

You'll need to do only a fraction of the training you would have needed to do if you were to start a training from scratch for your tokenizer of choice. The weights released by Meta give you a massive head start and cost saving.

The fact that it's not trivial to do and out of reach of most consumer is not a matter of openness. That's just how ML is today.

[1]: https://scontent-sjc3-1.xx.fbcdn.net/v/t39.2365-6/452387774_...

[2]: https://huggingface.co/datasets/HuggingFaceFW/fineweb
If you program with promises and without async/await, then your language is still missing something compared to languages that have coroutines in which functions that suspend and do not suspend may be composed (used by higher-order functions, etc.) in the same ways as each other. You've moved from the situation where both types of functions were present and must be handled differently to the situation where one type of function is entirely missing.
It seems like the current board is stacked with Musk suppoters. So things will have to get very bad before they will push him out.
I've tested Q4 on M1 and it works though the quality may not likely be the same as you'd expect as others have pointed out on the issue.
Indeed, since when the deliverable being a jpeg/exe, which is similar to what the model file is, is considered the source? it is more like open result or freely available vm image, which works, but has its core FS scrambled or crypted.

Zuck knows this very well and it does him no honour to speak like, and from his position this equals attempt ate trying to change the present semantics of open source. Of course, others do that too - using the notion of open source to describe something very far from open.

What Meta is doing under his command can better be desdribed as releasing the resulting...build, so that it can be freely poked around and even put to work. But the result cannot be effectively reversed engineered.

Whats more ridiculous is that precisely because the result is not the source in its whole form, that these graphical structures can made available. Only thanks to the fact it is not traceable to the source, which makes the whole game not only closed, but like... sealed forever. An unfair retell of humanity's knowledge tossed around in very obscure container that nobody can reverse engineer.

how's that even remotely similar to open source?
It was much more than the Ghetto that got entirely destroyed, to the point where new street layout has been implemented after the war since there was no reason to use the old layout. Well, apart from property claims, some of which are still being contested in courts to this day. Around 150k to 200k people died in the Warsaw Uprising alone. But yes, the Ghetto got hit especially bad.

One of the reasons why the Germans wanted Warsaw so exceptionally destroyed was their feeling of racial superiority. The Fuhrer got extra angry when he found out those occupied Poles still dare create rebellions, and ordered a systematic levelling of the capital. I'll let you ponder whether we've actually learned a lesson from those times.
You really should be able to train a model on whatever data you choose to use though.

Training data instead source code at all, it's content fed into the ingestion side to train a model. As long as source for ingedting and training a model is available, which it sounds like isn't the case for Meta, that would be open source as best I understand it.

Said a little differently, I would need to be able to review all code used to generate a model and all code used to query the model for it to be OSS. I don't need Meta's training data or their actual model at all, I can train my own with code that I can fully audit and modify if I choose to.