skysight-inc/HackerNews huggingface dataset:
Show HN: Pruna AI – Inference Optimization Engine
Hello Hacker News!

I am Bertrand from Pruna AI. With my associates, John, Rayan, and Stephan, we are fellow researchers in AI efficiency and reliability coming from TUM.

We are building an optimization engine that combines compression methods (e.g. quantization, pruning, compilation, batching…) in the aim of saving compute power when running AI models. This optimization engine take one base model as input and returns a compressed model as output. It aims to help for two things:

- Make various AI models faster and/or smaller for various hardware (because they can require significant compute power to run).

- Easily apply one, but also, multiple compression methods on AI models (because it can take a lot of development time to compress models for production).

Currently, Pruna is designed only for inference optimization, not yet training. It focuses on Pytorch models and runs on Linux. It can be deployed in Docker, and is available either self-hosted via CLI (https://docs.pruna.ai/en/latest/setup/pip.html) or via the AWS Marketplace (https://aws.amazon.com/marketplace/pp/prodview-nqi4r52e2qnry).

For the last year, to ensure that our product was good enough, we did multiple things:

- We built a workflow to automatically scrape various Hugging Face models, run them through our tool, and push back the compressed version to Hugging Face (see 7,500 models available on Hugging Face (https://huggingface.co/PrunaAI).

- We also created a benchmark page (special for Flux, soon for Llama) to showcase the results of all our internal testing: Flux Pruna Benchmark(https://flux-pruna-benchmark.vercel.app/). Every company we meet asks, “Do you have numbers?”—and this isn’t just a feature, it’s our way of being transparent about what we bring to the table.

- We’ve prepared examples loaded in Google Colabs and documentation to explain what the compression methods do (https://docs.pruna.ai/en/latest/index.html). In terms of compression methods, we aimed to integrate both existing and new compression methods that lead to efficiency gains. We are naturally interested if you have suggestions for other ones.

On the backend, we’ve implemented a token system (https://docs.pruna.ai/en/latest/setup/token.html). The token serves as a unique identifier when using the package. Upon your first call to the smash function https://docs.pruna.ai/en/latest/user_manual/smash.html), your token is automatically generated and printed in the console.

FYI, for now, we’ve adopted a freemium model (up to 100 hours of runtime per month) with a soft limit (you can exceed it, theoretically, to avoid downtime – we’ll see how it goes if there’s abuse) as we’re still evaluating the best monetization strategy. Our end goal is to combine open-source with feature-gating for enterprises, but we’re not quite there yet. Think of this as an intermediate step.

I’m really happy we get to share this with you all. Thanks for reading! Please let us know your thoughts and questions in the comments.
Interesting way of looking at it. The way I’ve usually seen it is by modeling events more like “classes” where an event has a “type” and can inherit other “types” or “interfaces”. So if you want a notification to go out with a domain event, it must implement the “notify” interface.

Commands don’t belong on an event bus though, IMHO. Commands are method calls (or RPC) not messages.
Neural networks use smooth manifolds as their underlying inductive bias so in theory it should be possible to incorporate smooth kinematic and Hamiltonian constraints but I am certain no one at OpenAI actually understands enough of the theory to figure out how to do that.
And what if I can't find anyone? And what if they do 180 a week later?

And it's not like running a registrar is something what can even have a mission other than earning money.
yea, it’s called moving your fiat currency into digital currency.

Get your wallet’s private key yoinked and wallet drained? You are done.

And you get the added benefit of a highly volatile asset! Broke in 2023, but hitting it big in 2024.

I suppose you can just move assets into a stable coin, but what’s the fun in that?

(Being sarcastic by the way)

I doubt there’s any bank willing to design a custom legal agreement for those folks. The central bank system sort of relies on these systems as part of the FDIC member requirements. By opting out, you may also be opting out of insurance on your money in case of insolvency.
The cheapest iphones have been $400 or $430 for many, many years now.

Divided by the number of hours a phone is used, the amortized cost of having something you want is miniscule. This is the thing moms will be taking precious pictures of their kids with, video calling their families on, shopping for themselves and others, and even watching or listening to entertainment.

If there’s one thing that people can justify spending more on for more utility, it’s a smartphone. Obviously, I’m not referring to spending $1k more for a 1 TB Pro Max, but spending an extra $500 is going to make sense to many people for purposes outside of showing off.
PyNest is designed to help structure your APIs in an intuitive, easy to understand, and enjoyable way.

With PyNest, you can build scalable and maintainable APIs with ease. The framework supports dependency injection, type annotations, decorators, and code generation, making it easy to write clean and testable code.

This framework is not a direct port of NestJS to Python but rather a re-imagining of the framework specifically for Python developers, including backend engineers and ML engineers. It aims to assist them in building better and faster APIs for their data applications.
It's neat hack, but I'm not sure if there is much use for it. Of course this is much faster than doing CRT emulation, but in what context is that performance difference relevant? And I don't know if there are any other major advantages here.
Comment was probably rather about the 360 degree turning heads etc.
Anyone knows what software is used to create these diagrams: https://lellep.xyz/blog/images/failed_data_science_project/2...
From what I understand, David Deutsch invented the idea of quantum computer as a way to test Parallel Universes. And later people went on and built the quantum computer. Are you saying that the implementation of a quantum computer does not require any kind of assumption on computations being run in parallel universes?
I think we're also just experiencing the difference between the actual capabilities of police and the propaganda of post-9/11 police procedurals.

It's easy to forget that in previous generations american police were widely viewed and portrayed as incompetent and corrupt. Neither is completely true of course. Modern police are extremely well equipped and have an almost unfathomable surveillance apparatus at their disposal. But they are also incompetent and corrupt so it's kind of a wash.
Something about that image of the spinning coffee cup with sailing ships is giving me severe trypophobia:

https://en.m.wikipedia.org/wiki/Trypophobia

It’s a like a spider’s eyes… and also not what I would expect a latte to look like.
"I don't know" is the only correct anwser because the original problem isn't properly worded.

You need to (at least) add this statement to the original question:

> The host must open a door in any situation, and you know this rule.

Because "host" in daily language is a human being with agency to choose whether to not open a door. Without this statement, the original problem is actually a game theory problem with two players. The host might be playing a strategy where he only opens the door when he knows you picked the car at the first place, or any other strategy.

The above statement removes the ambiguity and that's what the original author meant (but failed to put in words).

(If you're interesting in this, the wikipedia page linked above actually contains a quite extensive discussion in history over it)
I’m of the opinion that you should have a cassette deck for music that never made it to CD or if they did didn’t make it to streaming. Some bands only released on cassette. True I digitize those sometimes. Also, since cassettes are two bucks a pop, it is a very affordable way to listen to music from the 90s and 80s. There is a whole different sample of music that you see in a cassette bin than that you see in CD bin. It’s older music.

I’ve got a great cassette deck as part of my stereo so it sounds great. I definitely don’t listen to it on a Walkman though.

I’m a big fan of Sarah Harmer and her first band, the Saddletramps, only released two cassettes and they didn’t release CDs. That only happened with her next band. I think this is a common occurrence for bands of the 80s and 90s.

I grant you that this is a fringe obsession that most people wouldn’t care about.
Reminds me of "The rule says, “No vehicles in the park”", https://news.ycombinator.com/item?id=36453856
Unique comparing to what?

There are other products that provide something similar,
but are not as popular, as easy (part of easy here is integration with aws) to use and require extra tooling. This will be goto tool for many people working with data, and I'd expect "load_from_s3" to be added to many tools fairly quickly. That's unique.
Do they get rid of TLDs once the country they are assigned to goes away? I assumed they'd sell them to someone or something.
The US presidential election was fundamentally about unadulterated anger with the current system.

The US is getting closer to the guillotine.
Tencent/Hunyuan-Video
You're clueless if you think adding comments to package.json - a file that regularly gets rewritten - is anything but an exercise in futility. Any time you run "npm install [whatever]" you are rewriting package.json. How exactly do you expect to maintain your random comments in this case? You expect nodejs to understand how comments are being written in package.json and not mess that up? You don't seem to understand how npm or package.json works.
Depends on the way you do constrained generation. If all you do is reject tokens using a grammar, then yeah it is bad. If your software inserts things like field names and braces instead of forcing the model to produce them token by token and then afterwards rejecting the wrong tokens, then you should be good to go.
> they require complete and ongoing access to your "primary" personal email account and browsing history to mine data for their customers. Is this normal?

No. Run.
But it is in your advantage! Code a simulator and do some numerical experiments. The simulations where you switch end up winning more.

Edit: from your other reply I see your beef is more with the wording.

Edit edit: although I disagree with your point even then. But it seems to lead to rather fruitless argument, so let's leave it here.
Yes, the liar have some hats. There are two ways how to conclude this:

1. If they don't have any hats, then any sentence about them would be truth.

2. The negation of the sentence, which must be truth, is "not all my hats are green". For this to be true, there must be some hats that are not green, so there must be some hats in general.
So what I am getting a use-case for brain-computer interface.
One of the problems with a 10-month preannouncement is that the competition is ready to trash the actual announcement. Half an hour in, I already see half a dozen barely-concealed posts ranging from downplays to over-demands to non-user criticism.
> entirely

What would you like to wager on this?
It depends on if Monty has the option to show another door or do nothing.
Account creation currently unavailable
I wish brandshield would pull this shit with someone that was large enough to sue them for fraud or tortious interference.
FYI, you are hellbanned (your comments are auto [dead], very few people will see them). Email hn@ycombinator.com to fix it :)
How does this compare to old school mblaze tools?
From the FAQ [1], too:

>> Can I purchase more credits?

> We currently don’t support the ability to purchase more credits on a one-time basis.

> If you are on a ChatGPT Plus and would like to access more credits to use with Sora, you can upgrade to the Pro plan.

Ouch. Looks like they're really pushing this ChatGPT pro subscription. Between the watermark and being unable to buy more credits, the plus plan is basically a small trial.

[1] https://help.openai.com/en/articles/10245774-sora-billing-cr...
> The astute reader will notice that float operations are not communicative

Presumably this was meant to read "commutative". IEEE 754 addition and multiplication are commutative (ignoring NaN values), but not associative.
They can figure out a fair bit of physics. It's not a "no physics" vs "physics" thing. Rather it's a "flawed and unreliable physics" thing.

It's similar to the LLM hallucination problem. LLMs produce nonsense and untruths - but they are still useful in many domains.
I'd take that bet at 10:1 odds.
Becoming (More) Afraid to Post Online
Thinking about AI and mass surveillance and where that could lead
no API = not good enough

no pay per use = overpriced
My parents have always gone for an absolutely huge number of white mini-lights on the tree. So many that they have to be plugged into a dimmer circuit so that the intensity isn’t blinding.
yea just that that too. Did anyone get in or did they get overwhelemed?
+1, I've had mine for 5+ years and it is still genuinely a joy to use. I went with the "buy your last tool first" approach and splurged on a 5HP ICS and don't regret a single penny spent on it.
A Secret Society Discovered Irrational Numbers
Incremental TT munchers: perhaps the most powerful macro parsing technique in Ru
>Filing false reports like this should count as fraud.

It does, but they never mess with anyone with big enough pockets to get sued for it.
> Is this supposed to be a thinly veiled attempt at stating marxist ideology?

Hardly. The Friedman doctrine didn't exist prior to 1970; does that make every business venture prior to that a statist-collectivist enterprise? Are privately-owned companies the expressed goal of Marxism? Of course not.

The whole "if you don't have a bunch of free riders participating in an equities market, it's Marxism" bit is an intentionally obtuse argument.

> The current share paid to shareholders is nowhere near "unlimited".

Current schools of thought essentially dictate that management and investors treat that share as if it can be unlimited. Anything that could possibly limit returns (taxes, regulations, labor movements, consumer rights, etc.) is an externality or to be eliminated. Otherwise, it gets in the way of profit, and since most economist types have a limited ability to understand anything beyond the absolute simplest of abstractions, profit has to be the ultimate measure of social good. Therefore, those things stand in the way of social good.

> In the US labor's share of GDP stands at just below 60%.

We should make it higher.
You've mentioned this in another comment. I have to point out, even if this is his opinion, and he has been influential in the field, it does not mean that this specific idea of his has been influential.
Looks like something you could create with excalidraw. It's an awesome tool!

https://excalidraw.com/
me too - nmh and MH-E still learning though
Yes, it is a counterintuitive aspect of mathematics that "for all x in X ..." is always true if X is an empty set, just like "A implies B" is always true if A is false.

I once passed a midterm by abusing the latter. The question was to prove "there exists x such that if |a - b| < x, then something". The professor forgot to specify that x should be positive, so my response was that the implication is trivially true for x = -5 because a modulus cannot be negative.

The actual proof for positive values of x was much harder but the professor respected my math hacking skills and gave me full points for that question.
David is this you?
The proposed solution misses the fact that you can't even derive that the liar has a hat because the subject of the predicate could be the lie. What if the liar had two green cars but any number or no hats? The lie is a lie then even if the statement is vacuous as there is too much ambiguity in the english language overall. Their hats could be any combination of colors or they could even be hatless if the lie was over the subject of the constraint, not the qualification of the subjects, as they were effectively miscommunicating what is green.
I wonder whether that is a more general problem. E.g., maybe technical decision-makers tend to listen to other engineers and not give enough considerations to financials and market expectations.

People tend to hug their ruts.
It is neither portable nor obviously correct.
not available in the EU = might use everything you did there against you, sell that data to the higgest bidder
https://lmsys.org/blog/2024-02-05-compressed-fsm/

I'm not trying to shill sglang specifically, just pointing out that there's a better way, btw.
Bad also in the sense once you get over the "boy, it's amazing they can do that", you immediately think "boy, they really shouldn't do that".
Yes, this is an artificial example and it uses ambiguous language. But it doesn’t really matter whether you got it right or whether the puzzle is fair. Knowing about “vacuously true” statements is useful because that’s a corner case where a bug can happen. (Or it could be a loophole in a legal document.)

When you’re writing functions that work on lists or sets, you need to decide what to do about statements that are vacuously true. Call it out in the documentation? Put in a special case? Assert that the set is non-empty? Or maybe even create a new datatype to make the corner case unrepresentable. These design choices have side-effects, making a function easier or harder to use, more or less error-prone.

Recognizing vacuous statements is pattern recognition, but it’s sometimes useful pattern recognition, and for children, learning about it might even be fun.
Not seeing anything about generated comments in there: https://news.ycombinator.com/newsguidelines.html
I can't even sign up. I assume it's a capacity issue.
Shift-T: triggers a tab switcher

D-U: is Page Up/Page Down

/: find in page
Just to be even clearer.

In the time of the original use, there were only static types. Languages had very little in terms of UDT's. Even a struct in C was barely a type of its own. I don't recall the details, but there was something about struct member names not being local to the struct. Interpreted languages didn't have records or classes at all(*), and certainly not types as first class objects.

We cannot really talk about how dynamically typed languages with rich type systems were originally labelled, back when they didn't exist at all.

(*) I'm looking forward to someone pointing out an interesting counterexample.
You just made my day - whatever the answer :)
Sorry. I don't care whether an idea was influential or not. All I care is whether someone has a better explanation.
This is not a good strategy. You're almost guaranteed to lose being pro se against corporate lawyers.
Ghost Engineers and Proof or a Lack Thereof
What are some of the open source video models?
GhostRNN: Reducing State Redundancy in RNN with Cheap Operations
The costs highly depend on the shape of the ingested logs and the type of queries, which are performed over the ingested logs.

For example, VictoriaLogs compresses typical logs from Kubernetes containers by up to 50 times. This means it needs 20GB of persistent storage for saving 1 terabyte of Kubernetes logs. A terabyte of HDD-based persistent storage cost $40/month at Google Cloud. This means you can keep 50TB of Kubernetes logs in VictoriaMetrics at $40/month. Additionally, you'll need to pay a few hundred bucks per month for CPU and RAM for efficient data ingestion and querying.
I like your way of phrasing this. Also, we can assume that this is not the only statement that the liar has ever told, so the context matters. If the preceding statement was "Every hat is my hat." Then we have a definition of "all" in the next sentence that works against the stated answer. So "we can't conclude anything" is really the answer because of undefined terms.
https://news.ycombinator.com/item?id=42368981
Imagine your civilization develops quantum computing technology and it's for... advertising.

"What is their mission? Cure cancer? Eliminate poverty? Explore the universe? No, their goal: to sell another fucking Nissan." --Scott Galloway
At least you get to even see the page! I'm seeing "Sign ups are temporarily unavailable
We’re currently experiencing heavy traffic and have temporarily disabled sign ups. We’re working to get them back up shortly so check back soon."
"""Upon closer inspection, these failures are no surprise. 7 of 11 members have no relevant semiconductor experience. Two more are accomplished in the field but as academics, not industry players. They have no experience making hard decisions, understanding critical business inflections, and are not qualified for what’s at stake. The only member with a strong and relevant CV, Stacy J. Smith, joined just this year as a replacement for Lip-Bu Tan."""

Very much like Apple just before the return of Steve Jobs.
but indie films have always existed. there have always been amateurs using film as a medium, since there was film (in high school, we wrote, storyboarded, directed, acted in, and edited our own short films for our final film class projects using camcorders and watched them at a viewing night at a local theater!).

you're saying "you must have a giant budget and tons of time to compete with the studios and AI can level the playing field" but i don't know why an artist would want to compete with a major film studio which is pushing out generic content in the first place?

you don't need a multimillion dollar production budget and $300k props to make art, in the same way a sculptor doesn't need to make statues out of gold or diamonds.
At OpenAI's $20/mo price point, you can also only generate 16 720p 5s videos per month.

Kling doesn't seem to have more granular information publically but I suspect it allows for more than 16 videos per month.
How significant is AI chatbot traffic in B2B?
How much of Palantir's business is regular law enforcement vs intelligence vs other things?

Intelligence work is, I would imagine, very dirty work at the best of times, and someone has to do it. My understanding is, what Palantir does there is kind of like CRM for terrorist groups. Not skynet or click-to-bomb software (I have no inside knowledge).

Police work doesn't have to be as dirty, not to regular citizens anyway, and I'm not sure how I would feel to be included in a Palantir-enabled all-encompassing pre-crime database.
It becomes an issue when you think of the electricity source of your power generation. Clearly storing and listening to MP3s in green electricity jurisdictions like Ontario and Quebec is better than using plastic because computers are powered by nuclear and hydro power. But in Ohio and places with coal electricity generation, you should forgo recorded music altogether and only listen to live accustic music in well lit buildings that don’t require electricity.

Yes I am joking.
Part of it might also be capacity problems.
What is the best model in your opinion right now?
It is not supported everywhere and it uses some heuristic to determine that the file is actually the same one as used before, and this heuristic sometimes fails in complicated scenarios, e.g. with multiple shared directories, link, or because a file was copied.
Doesn't look like you will.

"We’re currently experiencing heavy traffic and have temporarily disabled sign ups. We’re working to get them back up shortly so check back soon."
Interesting creative people will produce interesting creative output.

People with no taste will produce tasteless content.

The mountain of slop will grow.

And some of us have no intention of publishing any output whatsoever but just find the existence of these tools fascinating and inspiring.
What are the leading alternatives? (Open source or otherwise)
Does it integrate with any smart rings?