skysight-inc/HackerNews huggingface dataset:
> If entropy is zero then all kinds of things break down.

Entropy is a macroscopic variable and if you allow microscopic information, strange things can happen! One can move from a high entropy macrostate to a low entropy macrostate if you choose the initial microstate carefully. But this is not a reliable process which you can reproduce experimentally, ie. it is not a thermodynamic process.

A thermodynamics process P is something which takes a macrostate A to a macrostate B, independent of which microstate a0, a1, a2.. in A you started off with it. If the process depends on microstate, then it wouldn't be something we would recognize as we are looking from the macro perspective.
One of the authors here. Short story is, check out our web demo (on desktop Chrome) for real-time music generation and editing! Music is made on the fly by our diffusion models as you control the transition between two random genres. Every time you make a change, you're creating 30s of 44kHz stereo in 0.3s on a GPU via diffusion. Genre transitions are one of the most fun use cases we've found.
Exactly, intervals are disjoint and adjacent (automatically coalesced). The ordered map I'm using will coalesce them together which works pretty well. The problem is that I'd like to accelerate range queries even further, probably by excluding certain intervals with some acceleration structure on the side (e.g., skip any intervals with a duration less than X) at the cost of slightly more expensive updates.
For webservers, our recommendation is that your ACME client queries the ACME Renewal Information endpoint to find out if the certificate needs to be renewed:

https://letsencrypt.org/2023/03/23/improving-resliiency-and-...
It's alarming that he refers to llama as if it was open source.

The definition of free software (and open source, for that mater), is well-established. The same definition applies to all programs, whether they are "AI" or not. In any case, if a program was built by training against a dataset, the whole dataset is part of the source code.

Llama is distributed in binary form, and it was built based on a secret dataset. Referring to it as "open source" is not ignorance, it's malice.
i can think of no act more deviously effective in bringing down the american empire than introducing the NPM ecosystem into its vital bloodstream, well played comrade!
> Open training data is hard to the point of impracticality. It requires excluding private and proprietary data.

Right, so the onus is on Facebook/Meta to get that right, then they could call something Open Source, until then, find another name that already doesn't have a specific meaning.

> (The way open source software, today, generally means source available, not FOSS.)

No, but it's going in that way. Open Source, today, still means that the things you need to build a project, is publicly available for you to download and run on your own machine, granted you have the means to do so. What you're thinking of is literally called "Source Available" which is very different from "Open Source".

The intent of Open Source is for people to be able to reproduce the work themselves, with modifications if they want to. Is that something you can do today with the various Llama models? No, because one core part of the projects "source code" (what you need to reproduce it from scratch), the training data, is being held back and kept private.
That’s not the scary thing here. Better to future-proof it.

Running presumably unencrypted SNMP over shared lines is sketchy.
"As soon as the Microsoft Root Program also makes OCSP optional, which we are optimistic will happen within the next six to twelve months, Let’s Encrypt intends to announce a specific and rapid timeline for shutting down our OCSP services. We hope to serve our last OCSP response between three and six months after that announcement. The best way to stay apprised of updates on these plans is to subscribe to our API Announcements category on Discourse."

Interesting to see Microsoft dragging here.
They don't "[allow] developers to modify its code however they want", which is a critical component of "open source", and one that Meta is clearly trying to leverage in branding around its products. I would like them to start calling these "public weight models", because what they're doing now is muddying the waters so much that "open source" now just means providing an enormous binary and an open source harness to run it in, rather than serving access to the same binary via an API.
Different skillsets involved. You will eventually have to give up programming and focus on developer sales/marketing/recruiting skills.

Very rare to see businesses where you're sole developer and salesperson unless you are the main SME on a niche field/technology you probably developed.

Also A LOT of FAANG is immigrants who can't start a business in the US or children of immigrants whose parents put strong pressure on them having an upper middle class job.
After I created OCSP Watch[1], I regularly detected CAs returning an OCSP response of unknown or unauthorized for certificates found in CT logs, indicating that they had basically forgotten that they had issued a certificate. I find that rather troubling. Indeed, OCSP Watch is currently reporting several forgotten NETLOCK certificates. (The certificates from other CAs are recently issued and will probably have OCSP responses provisioned in the near future.)

CRLs can't be used to detect this, because they only list revoked certificates rather than providing a definitive status for every issued certificate.

I do wish the root programs had merely removed the requirement to include an OCSP URL in certificates, but required OCSP URLs for every issuer to be disclosed in the CCADB. That would have solved the privacy problems and made OCSP responders much cheaper to operate, while continuing to provide transparency into the status of certificates.

[1] https://sslmate.com/labs/ocsp_watch/
Depends on the language. In typescript and interface can absolutely encode shape. In C# you can encode shape in interfaces via properties. Interfaces don’t even describe behavior, it’s just that we typically associate them with a man implicit contract. Strictly speaking they are just a shape.
Bald guy who shaves his head here. Some women love it. Others don’t. But it’s the same as any other physical quality. Really no point in stressing over it.
Strangely Linux doesn’t have that problem.
Capacitive controls, touch screens, etc., are typically really bad UX. Perhaps we will see more innovation in the hardware space for high quality UX -- digital encoders combined with haptics, pleasing materials, etc.

A Tesla is an example of overuse of touchscreen and it feels like one's hands have been forced to wear large gloves that inhibit the usability. This combined with nested menus and an overall clunky UX is suitable for a prototype and rapid innovation of capabilities, but as the platform stabilizes the UX should include physical switches, dials, etc.
To be honest, not having node.js on the approved software list seems like a pretty good idea.
What model? My '98 Sienna had resume functionality that I used all the time, so I'd be interested to know when and why they removed it.

I find it most useful for highway driving to resume my preferred speed after passing a slowdown.
> I'm mostly familiar with North American traffic signal control, and in those traffic cabinets there is a device known as an "MMU" (Malfuction Management Unit) which acts as a safety monitor for the rest of the traffic cabinet.

Presumably the logic for this MMU could be implemented in strictly electrical components (relays or such). That would give me the most comfort (since its functionality would be, literally hard-wired).

I worry that some enterprising manufacturer, out to save a few bucks, would implement this functionality in a microcontroller with firmware that could be updated remotely.

Does the standard specify the functionality of the MMU must be hard-wired, or at the very least not able to be changed without physical access?
> The browser vendors have learned that you have to do it yourself

Cool. We already got the internet ossified on TCP + UDP, other L4 protocols just get stuck in firewalls and whatnot. Now we're progressing in ossification of HTTP. <insert expletives here>

To be clear: this OCSP decision seems to be driven directly and only by web/HTTP consumers. Anything else is just not considered.
Most touchpads can be configured to only register clicks when you actually press and get the click feedback. It should be the default. Swipes may still come through though.
Could you give us some more details?
It is an exciting concept, there's a huge wealth of gaming hardware deployed that is inactive at most hours of the day. And I'm sure people are willing to pay well above the electricity cost for it.

Unfortunately, the dominant LLM architecture makes it relatively infeasible right now.

- Gaming hardware has too limited VRAM for training any kind of near-state-of-the-art model. Nvidia is being annoyingly smart about this to sell enterprise GPUs at exorbitant markups.

- Right now communication between machines seems to be the bottleneck, and this is way worse with limited VRAM. Even with data-centre-grade interconnect (mostly Infiniband, which is also Nvidia, smart-asses), any failed links tend to cause big delays in training.

Nevertheless, it is a good direction to push towards, and the government could indeed help, but it will take time. We need both a more healthy competitive landscape in hardware, and research towards model architectures that are easy to train in a distributed manner (this was also the key to the success of Transformers, but we need to go further).
This is being a software engineer?
> Why are (some) Europeans surprised when they are not included in tech product débuts?

We had a brief, abnormal, and special moment in time after the crypto wars ended in the mid-2000s where software products were truly global, and the internet was more or less unregulated and completely open (at least in most of the world). Sadly it seems that this era has come to a close, and people have not yet updated their understanding of the world to account for that fact.

People are also not great at thinking through the second order effects of the policies they advocate for (e.g. the GDPR), and are often surprised by the results.
Are there any free or very inexpensive certificate providers which support ACME, DNS-01 challenges, and OCSP other than ZeroSSL?
There is a lot out here.

I gave a seminar about the overall approach recently, abstract: https://shorturl.at/E7TcA, recording: https://shorturl.at/zBcoL.

This two-part AMA has a lot more detail if you're already familiar with what we do:

https://www.youtube.com/watch?v=UztfweS-7MU

https://www.youtube.com/watch?v=GOGuSJe2C6U
For regular webserver users, accessed by web browsers, no changes are needed.

Note this is still a long ways out. At this time, only people who are writing code against OCSP need to be aware of the future roadmap.
The dad of one of my son's friends told me this, and he was a computer programmer himself (as am I). "Don't get your kid into programming, it will all be outsourced to India".

I didn't give my kids any such prescriptive advice, and he got into game dev which has always been his passion and outsourcing hasn't come for his job yet.

The modern day equivalent would be "don't get your kid into programming, it will all be done by AI soon".
It seems like rocm is already fully ready for transformer inference, so you are just referring to training?
In the case of NVIDIA it's even more sneaky.

They are an intellectual property company holding the rights on plans to make graphic cards, not even a company actually making graphic cards.

The government could launch an initiative "OpenGPU" or "OpenAI Accelerator", where the government orders GPUs from TSMC directly, without the middleman.

It may require some tweaking in the law to allow exception to intellectual property for "public interest".
Longer story: The web demo is a way to earn your curiosity. The Riffusion crew is released our free iOS app today, and that's the real juice. We’re thinking constantly about how to create a new instrument with gen music, and for us this is wildly fun experience.

At the core, we’ve been training music foundation models that are high quality, diverse, controllable, and an order of magnitude faster than anything done before. This required a ton of deep investment across the whole stack from compact representations to architectures to deployment infra. The result is fast enough to enable totally new workflows for this stuff.

The primary input is to capture/upload a photo or video with optional personalization, then the app will generate original lyrics and music based on the context. The next time you see your dog or kid do something funny, you can turn that into a vibe in seconds. We’ve been having a blast creating music in moments that we never would have before.

The most remarkable part is the editing, as sampled in the web demo. In the edit view, you can go deep adding multiple prompts on a timeline and controlling their strengths and interactions. You can mix genres into something totally new or make transitions like going from an operatic aria to death metal. The near-real time editing flow is something that to me feels totally new, like trying GarageBand when it first came out.

There’s a ton more we’re excited to launch in the coming weeks as we work to create more musicians in the world. Excited to hear what you all create!
The foreign aid is mostly dealing with the fact that Israel is surrounded by hostile countries. Those countries are also hostile to the US, so it's really paying Israel to be its toe hold in the Middle East.

That is a deeply uncomfortable relationship for a whole lot of reasons.

But it's mainly aimed at the military. The country is otherwise pretty wealthy on its own terms. It's got a GDP per capita of $55k per person, mostly from manufacturing and tech, plus agriculture. So it generally has a European level of culture.
Apple and Micron Leaders Visit China as US Ramps Up Chip Curbs
Is there an argument against Open Source AI?

Not the usual nation-state rhetoric, but something that justifies that closed source leads to better user-experience and fewer security and privacy issues.

An ecosystem that benefits vendors, customers, and the makers of close source?

Are there historical analogies other than Microsoft Windows or Apple iPhone / iOS?
You didn’t actually disagree with me or my point, you just misunderstood part of what I said. That’s a typical danger of cherry-picking, and when people do that it often gets called out and leads to tangential argument, and it’s one reason why HN guidelines push for generous “strongest plausible” interpretation in multiple ways at all times. Your actual point repeated and reiterated mine, so we’re in full agreement about trench boxes and the reasons behind OSHA laws. Perhaps violent agreement, as they say, but full agreement nonetheless.

Just to try to make this tangent more constructive and thoughtful and less argumentative, it’s true that my last sentence is incomplete when taken literally. In retrospect, it’s certainly not a perfect summary of the point of OSHA’s on-site supervision rule. Keeping people out of the trench who don’t know the risks is one reason to have a supervisor, other reasons include keeping people who do know the personal risks from being allowed to choose to accept them, because they might not know the collective or company risks, or because their risk tolerance is unacceptably high. Maybe a better way to say it is that the point of the law is to prevent individual workers from having the choice to take such risks. In any case, I’m pointing out that my comment could be improved by starting with “One point..” rather than “The point..”. I assumed the context mentioning on-site supervision twice made it pretty clear, but that’s on me, my bad assumption. And it’s not uncommon for me to realize my writing is not as clear as I thought.
> I have tried several times to get Node.js into the military on approved software lists for internal development and its a huge struggle

What's on the approved stack? I imagine .Net and Java/spring are the standard, right? anything else like php, python, go etc?
> provide the data

Who? It's not their data.
Why not simply add the Must Staple restriction unconditionally to all certificates (aka "status_request")?

That will eliminate privacy concerns -- no compliant TLS implementation should fetch a OCSP ticket given a stapled response -- while still allowing for broad non-browser support.
Well, that's what an escape is for. Are we really having a serious discussion in 2024, where someone is suggesting that it's not the responsibility of the software engineer to sanitize inputs before chucking the data into some sort of database?
If you are going to block further activity, to be safe block future requests in code too (a check on the event handler that might make the request most likely) in case someone tries to automate the app via browser extension or bookmarklet. Just blocking clicks with a UI overlay doesn't always cut it.

Or in case some fool on your dev team calls the events to automate (or for other reasons trigger) something that wasn't intended to be called that way, of course, though once you start defending against iffy practise from within you are fighting a battle you are going to lose!
The main issue is that X11 is an increasingly unmaintained case and all new development happens with Wayland anyway. So as long as you can deal with lack of support - I guess no need to move, but otherwise Wayland with KDE has been well usable for a while already.
This particular method is mathematically equivalent to both of them. There's no actual difference between "You get full UBI and you pay income tax on other income" and "You get X cents less UBI per dollar of other income".

The system could be as simple as "UBI, also income tax is 50%, end of description".
And for reference: a ultra-tiny tactical nuclear bomb would still be >1 GJ.
Not just the training code but the training data as well, should be under a permissive license, otherwise you cannot call the project itself Open Source, which Facebook does here.

> is way less valuable than the weights for the vast majority of people

The same is true for most Open Source projects, most people use the distributed binaries or other artifacts from the projects, and couldn't care less about the code itself. But that doesn't warrant us changing the meaning of Open Source just because companies feel like it's free PR.

> If you want to train on top of Llama there's absolutely nothing stopping you.

Sure, but in order for the intent of Open Source to be true for Llama, I should be able to build this project from scratch. Say I have a farm of 100 A100's, could I reproduce the Llama model from scratch today?
> Knobs

And make the shape distinct enough that you can tell by feel!
Doing any of the things suggested by this headline will send you to jail.
More training data acquisition. fuckers.
Which country did you do this in? I will need a similar service soon
BMW had a wonderful mashup of these technologies for the radio memory buttons on 2014 era infotainment modules. The buttons were proper real buttons, and they could be mapped to any function on the HMI, radio station, settings menu, GPS destination, etc. But you could also rest your finger on them without pressing and the capacitive touch would activate, showing you a preview of what was mapped to that button before you pressed it. It was a physical implementation of a mouse hover. We've really gone backwards on automotive HMI since then
Source Evolution and Branches Explained [video]
Buttons and knobs in a car are fine, they do not need innovation.

The more you can operate it without looking at it, the better.
> Your median FAANG employee is probably L4 and not making $1M/yr in compensation. They're probably not even making $150K, depending on their location

While OP overestimates salaries, you are doing the opposite and underestimating salaries for most mid-career SWEs working a Software companies in the US.

Most L4/5 equivalent engineers across the US will end up earning around $150-250k Base, 10-20% Bonus, and around $50-150k/yr in stocks assuming they are working for a Software Company as a SWE (eg. Salesforce in Indianapolis or VMWare/Broadcom in RTP or Denver - let alone the Bay Area, Seattle, Austin, and NYC scene).
You can do a mini-pc with up to a Ryzen 9 8945HS. Which at 65-85W is a bit of a beast, as far as 8-cores goes on the sub-itx size. The 8(8|9)4(0|5)H(S) are all pretty good options though. Just got a Beelink SER8 (8845HS) for Chimera, and it's been running very nicely.
What are the substantial changes from 3.0 to 3.1 (70B) in terms of training approach? They don't seem to say how the training data differed just that both were 15T. I gather 3.0 was just a preview run and 3.1 was distilled down from the 405B somehow.
In the medical world “Could” means you are step 2 of 100 to a released product
Agreed. The Linux kernel source contains everything you need to produce Linux kernel binaries. The llama source does not contain what you need to produce llama models. Facebook is using sleight of hand to garner favor with open model weights.

Open model weights are still commendable, but it's a far cry from open-source (or even libre) software!
I transitioned several years ago. They are two different worlds.
> your best bet is to learn how to start and run a business

Startups are so hit and miss. It's really really hard to make $500k a year at a startup. There's many years of zero, near zero or sub-intern salary. After that there's either failure or a big payout that dwarfs the FAANG salary.

Classic businesses can get a substantial salary sooner than a startup, but do have a ceiling. If you're selling a well known need (plumbing, consulting, etc), there's competition and a ceiling at hours worked.

Having done both, a FAANG job is infinitely less effort than running a company. Also lower stress, lower risk, and immediate rewards/pay. I still have more fun starting companies though!
AI is already taking jobs in video game industry
But is node worth it without the npm packages?

I feel like it's pretty much one of the worst runtimes/scripting languages if you can't utilize it's ecosystem.
I would say yea, if it is going to be a replacement for the Google Workspace. I hate it.

For personal use I feel like we already have a very good set of email providers. For small businesses not really.
You make a good point but those are also just limitations of the technology (or at least our current understanding of it)

Maybe an analogy would help. A family spent generations breeding the perfect apple tree and they decided to “open source” it. What would open sourcing look like?
Euler.

JVM was one of the smartest ever, but Euler was there centuries before and shows up in so many places.

If I had a Time Machine I'd love to get those two together for a stiff drink and a banter.
Llama 3.1 405B is on par with GPT-4o and Claude 3.5 Sonnet, the 70B model is better than GPT 3.5 turbo, incredible.
I can't wait for when the majority of Unicode codepoints/glyphs are emojis that are no longer fashionable! That'll be a really weird relic of history, later.
> Buttons and knobs in a car are fine, they do not need innovation.

I agree. I was using the example of Tesla (Ford also does it) making UX worse.
'Dark Oxygen' in depths of Pacific Ocean prompts new theories on life's origins
Your story supports the position that it's safer to take the FAANG job.

This guy found an underserved market opportunity, built something, got some success marketing it, and made a whopping total of $40k.

Meanwhile the FAANG guys are making that every two months, without all the risk.