skysight-inc/HackerNews huggingface dataset:
Show HN: ONNX optimized SigLIP and related foundation models
Hey there Hacker News! Long time lurker but first time posting so nice to meet you all!

I have some time on my hands so I got down a rabbit hole and created a project to keep track of, and unify a bunch of optimized foundation models under one easy to use Python package. So far I have the following up and running:- SigLIP as a FP16 ONNX representation for super fast zero-shot classification image classification - quantized model support is on it’s way

Automatic pre and post processing switching - choosing CLIP as a model type falls back to cosine similarity with softmax, where SigLIP falls back to its full graph with a Scipy based sigmoid output activation.

Manual mode with exposed image and text encoders for each model - SigLIP also has it’s pre-pooled hidden output available for analysis etc

An ONNX Segment Anything representation - the plan is to have each CLIP/SigLIP model’s salient map feed directly as a multi-point prompt to SAM and its variants. More on this soon!The plan is to have the same usage wrap a TensorRT backend along the road, and tie that into Chromadb for super fast search but for now check out the example Gradio app. It’s still a little clunky but the results are pretty impressive! I’d imagine this would be great for lightweight RAG too!
Even this is wrong as that number you will give will end up being just a fraction of the actual cost to build it. The cost of waste disposal is not small either, it is easily in the trillions for the waste we have now. E.g. Sellafield is estimated to be in the 250B pound range, and that's just one country. It also doesn't include the reactor decommissioning costs which end up in the billions per reactor range also. And it doesn't include the cleanup of a meltdown. Fukushima cost 200 billion to clean up, a massive effort that in the end mostly failed. People are still measuring high levels of radiation.

It's interesting you mention carbon costs. It's a fair point but also does not end up in nuclear's favor. Germany has been deploying more than a 1GW of solar per month this and last year. This will produce as much as two reactors worth of electricity (actually more but ok). If they were trying to shutdown coal plants with nuclear it would take around 15 years for those two reactors, likely more. So instead of their coal plants running for decades as they build out nuclear, they are sitting idly because solar deployment is quick. This matters too.
>The distinction between civil and criminal liability seems minor

It is an immense difference though. Civil and criminal law differ in almost every single conceivable way.

You literally go on to name one very important difference. The threshold for civil litigation is someone deciding to file a pro se suit against you by giving something vaguely resembling a legal document to a court. The chilling effect of that is much more dramatic than criminal liability.
When all it takes is a daily pill, or an injection, to reduce the risks of drunk-driving a motorcycle to practically nil - wouldn’t you want to do it? You don’t even need to wear a helmet, you can just do whatever on your motorcycle and not worry about it.

You never have to think to yourself “hoo boy I’m at two beers, and I don’t know, should I have the third? Will that be too many? Am I going to need to get on my motorcycle in an hour? Or will it be more like three hours? What will my blood-alcohol level be at that point? Is this legal? Is this safe?”

You can just have fun getting fucked up and driving your motorcycle.

Modern medicine has given us this incredible thing, and you’re really going to be like “Naw I don’t know about all that.”
And both flavors have a base flavor of excrement... Still, since I started using Claude 3 Opus (and now 3.5 Sonnet) a couple of months back, I don't see myself switching from them nor stopping use of LLM-based AI tech; it's just made me feel like the computer is actually working for and with me and even that alone can be enough to get me motivated and accomplish what I set out to do.
Np. Happens to the best of us.

And "Mehrbani"/"Shukriya"/"Shukr" is the word for thank you in the Northwest.
I might be too cynical, but when I see governments roll out initiatives like this, all I see are campaign slogans.

Meanwhile, we’ve got kids living in poverty or in foster houses of horror and those topics don’t get the same attention.

In our family, porn is a gateway topic for us to start talking about issues like revenge porn, sexting and all that other stuff that is right around the corner for us.

So this is a tricky one for me and I guess I don’t understand why porn is so important. Its existence is helpful for me because of the topics it can help bring up, but we talk about everything from periods to child birth so I know that’s likely rare.

I’m maybe trying to impose my attitudes too much on others so I just can’t understand. I apologize if I’ve been obtuse - I am so I don’t really have an excuse. :)
I think you're describing a https://en.wikipedia.org/wiki/Dedekind_cut

(edit: oh, I see the article makes that clear. Well here's a link anyway)
Humor, the software developer's secret weapon
I addition, the industry has repeatedly attempted to kill SQL, but it lives on. The level of survivorship bias SQL has achieved is only matched by C.
Google Scholar and GitHub.
Yes and no.

Since we are talking about software written today, not just software available in 1987, X386 (which came out with X11R5 in 1991) was more than capable of running on a 386-class machine from 1987. Granted, a 386 class machine with 1MB of ram and a hard-disk would have been pushing $10k in 1987 (~$27k in 2024 dollars), so it wasn't a cheap machine.
“It would be better to never make a dime of profit than to have a product out there with a problem.”

(Today, the generator attached to David Packard powers half of California.)
CRIU, a project to implement checkpoint/restore functionality for Linux
You forgot beer brewing.
If you want to reduce maintenance costs, reduce the amount of Javascript code and tooling.

NPM-Javascript is a shitshow of constant breaking changes left and right, whether it is in your runtime framework, or your build system like gulp or more prominently webpack.

Try maintaining 10 projects with these frameworks. You'll quickly look for something that is not as maintenance intensive.

Example: No, you can't stay on Webpack version X, because (real example) it turned out that version of webpack relied on md5 which wouldn't work in newer node.js versions.
AI proceeds to use 2n3904 as a thyristor.

AI happy as it worked the first 10ns of the cycle.
The topical interests, general characteristics, experiences and opinions of HN members are too diverse to qualify as a community, IMO. There may be subsets that could qualify as a community, and if you only look at certain kinds/topics of submissions it might feel like one, but they are mixed within a larger heterogeneous crowd here.
Has anyone had success using things like the rsync or bgp feeds from Spamhaus to drop this traffic?
Tom's Hardware and Consumer Reports aren't really about ads (or at least that's not what made them popular). they were about trying to determine the truth about products and see past the lies told about them by advertising.
>The company announced Friday it would block the release of [...] iPhone Mirroring [...] from users in the EU this year, because the Digital Markets Act allegedly forces it to downgrade the security of its products and services.

Huh?
That's also the definition given in the article, attributed to Richard Dedekind.
That name threw me for a loop. 'Sonnet' already means something to EEs ( https://www.sonnetsoftware.com/ ).
Patterns (YC S21) Is Hiring to Build Analytics Agents for Finance Teams
You have a family, kids and a relatively successful career.

Please understand how lucky you are, and that what you have is a dream for millions, if not billions of people around the globe.

Maybe there's no need to change anything? Do you not feel content with your achievements?
>Have you ever wondered why farmers sell unprocessed grains to mills for millions of pennies rather than telling the mills to take a hike, processing it themselves and making way more money, all in the USofA and EU?

because it makes economic sense to do that.

but you can act locally, why do you buy clothing instead of knitting your own, and then with your spare time milling your own flour?
Trivially done with a minute-long wav file. Simply specify the source sample in your june-va config.json
I do it for a few reasons:
1. To learn by teaching
2. To have something on the CV to show how I code.
3. To give others what I felt was lacking out there; concrete guidance and motivation. I want to tell people "you can do this, let's become pro geeks again and feel really happy knowing that your code is hardware efficient"
4. To give async content for the organization im in, that you can watch this and I'll help where its unclear and I don't have to take many peoples time when it's inconvenient.

If this is the wrong forum to post this; the I appologize.
American Express buys dining reservation company Tock from Squarespace for $400M
Looks cool but I'm not sure how current those TI CC1310 devices are. I can see product release pages going back to 2015. Do you know anything about future support/availability for this model, or any newer models?
This could happen at any interest rate, or without borrowing at all, by selling stock instead. We might be seeing a bubble now?
I think you misunderstood. I built that PC for Windows back then and tried Linux on it recently.
TIL!

Thanks
Their new slate of ai products will be able to have screen reading capabilities. There are legitimate concerns for user privacy here. Their agreement with OpenAI is likely very strict.
Every dying online community I've ever seen was full of posts asking for a ban on another type of post.
Thanks for the reminder. I know this makes SEO more challenging, and it also reminds people of a certain game company, but I really love this concept, which originates from the Plato's theory of forms, and it pairs perfectly with the eidos.space domain name. While it may not be a great business name, the concept itself is exciting.

Eidos is deployed on Cloudflare Pages. it's a purely frontend project and the web is only used for distribution. In order to iterate faster, I didn't use GitHub's release yet.

There are some enhanced experience services running on serverless, but they are not necessary. For instance, adding a bookmark block to a document requires fetching extra information through a URL. This relies on https://github.com/mayneyao/link-preview . Most of the CORS related work is implemented through Cloudflare worker. These services are not necessary. Moreover, they are open-sourced and can be self-deployed. For more details, see https://github.com/mayneyao/eidos/blob/main/lib/const.ts#L64
yeah, agreed. when adding the stl to the standard library was being debated in the standards committee, microsoft forced the stl to use pluggable allocators, so you can easily make your std::vector allocate on your per-frame pointer-bumping heap, but often that's a poor substitute for not allocating at all
My goto example of a dysfunctional and bureaucratic organization is an example I saw in a finance company I worked for.

I was a on team that we were doing a major project. We basically ran Kanban but had to run "sprints" so we chose 4 week sprints to get it out of the way and we put everything on the board we had to get done that month to stay on track. Our pipeline was setup in such a way that you were required to have a jira ticket to push a commit. We were really crushing our timeline, doing 2x the work we were expected, a really great team honestly. But we opened up bugs and additional features in the middle of our sprints to track our work as we did it.

What this amounted to was maybe us saying we have to do 40 tickets this month, and wed be closing like 80. Everyone should have been thrilled by this development! Well we had a sprint review where some "Senior Project Manager" That wasn't really affiliated with our project but was some manager higher up was mad that us opening up new tickets mid sprint and closing them was ruining the org level burn down charts and expected delivery. They wouldn't give up on this, and said it was our fault for not estimating better (which sure, but we were beating expectations!). So we did the reasonable thing and improved our estimates! No of course not, we doubled our number of tickets and filled in "placeholder" on half of them, and used them as needed then closed everything out at the end of the sprint, where we were congratulated by everyone for our phenomonal estimation.
>My theory for why Google is different remains unpopular, however.

May we hear it?
I like how it's supposed to be about rescuing people, but we both remembered it as dropping bombs!
Babylon's Mystery Goddess
From the photo, "stand roughly within the cut-away mockup, and smile at the camera" is that all they're doing. (On Earth. It's supposedly a mockup of a proposed space station module.)

If I recall, the record for stuffing adults into a standard-sized phone booth is about 1/4 that number.
My understanding of the Space Shuttle program is that there were a lot of times they knew they probably shouldn't fly, or try to land, and they lucked out and didn't lose the orbiter. It is shocking they only lost two ships out of the 135 Space Shuttle missions.

The safety posture of that whole program, for a US human space program, seemed bad. That they chose to use solid rocket motors shows that they were willing to compromise on human safety from the get-go. There are reasons there hasn't ever been even one other human-rated craft to use solid rocket motors.
Is that proof or just an opinion? My opinion is that it's just different rhetoric to justify military action as the Boogeyman of communism was no longer there. Again, an opinion.
I'm not sure. My suspicion is that the fundamental issue with frameworks like LangChain is that the problem domain they are attempting to solve is a proper subset of the problems that LLMs also solve.

Good code abstractions make code more tractable, tending towards natural language as they get better. But LLMs are already at the natural language level. How can you usefully abstract that further?

I think there are plenty of LLM utilities to be made- libraries for calling models, setting parameters, templating prompts, etc. But I think anything that ultimately hides prompts behind code will create more friction than not.
Extorsion won’t help Apple, people will just use other services or platforms
The sound comes from the windings within the copper coils vibrating due to Hall effect in the alternating magnetic field. Yes, the physical construction of the coil matters as to how much it would whine; tighter and more regular windings and appropriate potting/adhesives counteract the physical effects. The easiest mitigation, however, is to just use a switching frequency much higher than humans can hear. AFAIK the Qi standard supports the charger using anything from 80-300kHz and can vary depending on what the charger decides is optimum. Any audible coil whine from Qi would be attributable to harmonic mixing within the physical system of the vibrating coil. Also note that the coil whine could come from either the Tx or Rx coil, so you might easily eliminate it with a different charger that settles on a different frequency or has a better manufactured coil. But if the problem coil is the one in your phone, you might be hosed!
Isn't https://en.wikipedia.org/wiki/CORDIC used a lot?
> I would also put medical advances in a separate category than the internet and similar tech advances.

Why? Medical advances are technology are they not?

> But when it comes specifically to reducing economic inequality, they (tech advances) have not done that -- in fact, they have possibly exacerbated it.

Yes technological advances do not necessarily reduce economic inequality, and may even increase it in some cases. However, this is a complex issue: While tech advances may exacerbate inequality, they often bring substantial overall benefits to society (e.g. improved healthcare, communication, productivity).

Technology isn't the only factor driving inequality. Other issues like tax policy, education access, and labor markets play major roles. Rather than suppressing innovation, there are ways to more equitably distribute its gains (Progressive taxation and wealth redistribution policies, Stronger social safety nets, Incentives for companies to share profits more broadly, …)

Notice also that most technologies increase inequality initially but lead to broader benefits over time as they become more accessible. Faster rate of innovation can make it look like this is not happening fast enough so yes economic gaps can grow.

> Global poverty is a separate issue from economic inequality, and the gains there have been primarily from extremely low levels, primarily in China and India.

While it's true that global poverty and economic inequality are distinct concepts, they are interconnected, especially when considering technological advancements.

> In China this was driven by political change and also globalization that allowed China to become the world leader in manufacturing.

Yes. China transitioned from a strictly communist "economic equality first" model to a more market-oriented "prosperity first" approach and lifted millions out of extreme poverty. Yes this contributed to increased economic inequality within many developed countries that have outsourced low-skill labor. But can we deny the substantial reduction in global suffering due to the alleviation of absolute poverty? Is this outcome worth the cost of increased domestic inequality in some countries? Should we prioritize the well-being of some populations over others based on arbitrary factors like nationality or ethnicity?
“If you owe someone one thousand dollars, you have a problem.

If you owe someone a million dollars, _they_ have a problem.”
One built-in UI/UX feature of LLM interfaces I'd love is proof
This feels like an excellent demonstration of the limitation of zero-shot LLMs. It feels like the wrong way to approach this.

I'm no expert in the matter, but for "holistic" things (where there are a lot of cross-connections and inter-dependencies) it feels like a diffusion-based generative structure would be better-suited than next-token-prediction. I've felt this way about poetry-generation, and I feel like it might apply in these sorts of cases as well.

Additionally, this is a highly-specialized field. From the conclusion of the article:

> Overall we have some promising directions. Using LLMs for circuit board design looks a lot like using them for other complex tasks. They work well for pulling concrete data out of human-shaped data sources, they can do slightly more difficult tasks if they can solve that task by writing code, but eventually their capabilities break down in domains too far out of the training distribution.

> We only tested the frontier models in this work, but I predict similar results from the open-source Llama or Mistral models. Some fine tuning on netlist creation would likely make the generation capabilities more useful.

I agree with the authors here.

While it's nice to imagine that AGI would be able to generalize skills to work competently in domain-specific tasks, I think this shows very clearly that we're not there yet, and if one wants to use LLMs in such an area, one would need to fine-tune for it. Would like to see round 2 of this made using a fine-tuning approach.
It’s a racist dog-whistle.
I believe this is also tied to La Subida del Monte Carmelo from San Juan de la Cruz. I'm oversimplifying, but basically it goes like this:

As San Juan climbs Monte Carmelo, he finds nothing at the base of the monte, then he finds nothing at the middle, but then, at the cusp, he finds Nothing (capital N Nothing).

See the following image for reference:
https://commons.wikimedia.org/wiki/File:Monte_Carmelo_Juan_d...

There's quite a bit of parallels between proper "Catholic Mystics" and Zen teachers...

I highly recommend both the San Juan de la Cruz works, in particular Ascent of Mount Carmel and The Dark Night, along with The Cloud of Unknowing, which was an inspiration for him.

For those curious about learning more about Koans, I cannot recommend this other book highly enough:
https://www.amazon.com/Two-Zen-Classics-Gateless-Records/dp/...

The book contains a collection of Koans along with Mumon's (et al) Commentary, Mumon's Verse, as well as modern day notes that help us understand some of the concepts hidden behind what looks like "poetical nonsense" at first, as well as giving the context for historical and mythological figures that are mostly unknown for those "outside the loop." What I love about the notes is that they still leave you with the opportunity to explore the koan further, properly, so they don't really take away all the fun.

Example Koan from the book:

##########################################################################

Case 4 The Western Barbarian with No Beard

Wakuan said, "Why has the Western Barbarian no beard?"

Mumon's Comment:

Study should be real study, enlightenment should be real enlightenment. You should meet this barbarian directly to be really intimate with him. But saying you are really intimate with him already divides you into two.

Mumon's Verse:

Don't discuss your dream
before a fool.
Barbarian with no beard
Obscures clarity.

NOTES (abridged)

- The Western Barbarian: The Western Barbarian stands for Bodhidharma, who brought Zen to China from India. He is always depicted with a beard. The case therefore means, "Why doesn't Bodhidharma, who has a beard, have no beard?"

- Meet this barbarian directly: This is not really a meeting but a becoming. You should yourself become Bodhidharma. Then if you have a beard, Bodhidharma has a beard; if you have no beard, then neither had Bodhidharma. But can you say that you are in truth Bodhidharma?

[...]

- Obscures clarity: Words, concepts, and other inventions of the mind only obscure the truth. Do not cling to shadows, but catch hold of truth itself.

##########################################################################

You get the idea.

Enjoy!
with zero prior knowledge other than its title, should one approach the sights and smells cautiously..?
It makes it simple (and uniform) to switch providers.
It is a well known fact that people (except incels & asexuals) will have sex whether you like it or not. It's part of the human experience. Policy must deal with the real world.
Yes, Palestinians will be lab rats for testing all kinds of AI - surveillance, profiling and obviously weapons - before selling it to other countries
Why User Research
> all they really need is to eat an apple, which, unfortunately, has no marketing department.

I think you'll find that apples do have a marketing department: https://waapple.org/.
I really miss working with WCF, said no one ever.
Original source: https://news.ycombinator.com/item?id=40751365
What I quoted is also from the README. You cannot use proprietary code in an open source project, and the README says you can. That is fundamentally dishonest. The sum of MIT licensed code which requires linking to proprietary code to function is not an open source project. It is a proprietary project with an open-source part. You cannot use this in an open source project. Period.

Making that section of the FAQ honest would look like this:

> Can I use Lady Diedre in an Open Source project?

> No. Lady Diedre is not available via an open source license.

> Can I use it in a noncommercial publicly-available project?

> For now. The EULA clearly reserves my right to change the terms at any time, so if that risk is acceptable to you, you have my temporary permission to do so, subject to revocation at any time and without notice.