skysight-inc/HackerNews huggingface dataset:
Show HN: I Built Rungen.ai to Make AI Model Deployment Easier
Hello HN

I’ve spent too many hours reading GPU providers docs, renting machines, setting them up, fixing dependencies just to get a single AI model online. So a few friends and I built RunGen.AI, a platform where you paste a link (Hugging Face or CivitAI), click create and you’ve got a live API endpoint in minutes.
We’re still in beta, but here’s what’s working so far:

* Bring your own model: No vendor lock-in.

* Pay per GPU minute

* Minimal setup: No infra to manage, no complex configs.

Over the next few months, we’re adding private model deployments, autoscaling, GPU location preference (EU/US), and faster startup times. Would love to hear any feedback,what works, what doesn’t, and what you’d like to see next.

Check it out at platform.rungen.ai, and feel free to reach us at hi [at] rungen [dot] ai.
Libel, from all the models hallucinating things done by whatever your real name is.

I mean, at least I get the advantage of being overshadowed by a famous film director with the same name as me, so nobody's going to assume anything associated with my name is actually about me…

…hopefully…
a bit (un)related but is it somehow possible to resize text layers without pixelating them on Gimp? i stopped searching years ago
He seems to think the hype will do great damage to society

"I need you to fucking listen to me: everything I am describing is unfathomably dangerous, even if you put aside the environmental and financial costs."

Personally I think he's lost it a bit. I mean say he's right in that LLMs plateau and investors lose some money. Life will go on.
TFA = The Featured Article… or something.
Leaks aren’t a memory safety issue, so that’s not one of the reasons for using Rust although the modern language design does make it less prone to accidental leaks.

Unsafe has a strong name to encourage care about using it but that still doesn’t make it as unsafe as C is by default. You’re telling the compiler that there are certain areas where you have to do something which would normally not be allowed because of some information available to the developer but not the compiler. For example, Rust targets systems programming and it’s likely that you’ll need to do things such as dereferencing a pointer if you have to interact with a C API. Unsafe lets you do that without giving up other protections like the borrow checker and it confines that to specific blocks which you can audit more carefully.

https://doc.rust-lang.org/book/ch19-01-unsafe-rust.html

If I might use a car analogy, going from a mid-20th century language model like C to Rust is like buying a car which has automatic braking and lane assist. Yes, you can still crash if you turn those features off but the ratio of preventable problems to special circumstances where you know you’re doing something tricky is incredibly high.
This is my educated guess on the topic having spent time investigating the intersection of poor memory, human growth patterns etc where this topic intersects:

Norepinephrine is a key regulatory of memory. Before a certain age the body is much more in parasympathetic activation v.s. sympathetic activation, very low Norepinephrine, lower cortisol response needs, etc. Once growth slows down and this can flip over then mammals will start to form memories. Human curves for the curious:
https://obgynkey.com/growth-and-puberty-3/

Some fun notable mentions such as many earliest memories are "super scary" and those with poor ability to produce Norepinephrine and slower growth velocity will have later "first memories" than everyone else.
It says "Proposed Standard" on the RFC; maybe that's why it's not widely implemented if that's the case?

https://bettertls.com/ has Name Constraints implementation validation tests, but "Archived Results" doesn't seem to have recent versions of SSL clients listed?

nameConstraints=critical,

DNS Certification Authority Authorization: https://en.wikipedia.org/wiki/DNS_Certification_Authority_Au... :

> Registrants publish a "CAA" Domain Name System (DNS) resource record which compliant certificate authorities check for before issuing digital certificates.

And hopefully they require DNSSEC signatures and DoH/DoT/DoQ when querying for CAA records.
I'm increasingly happy we have these regulations that prevent us from being ruled by the likes of Musk.
Agreed. In a perfect world, wire-based systems should be cheaper and more reliable. But as a software engineer, I can tell you that current software development practices do not produce software that is reliable enough to entrust it with your life.

And when corners get cut, the software development lifecycle tends to be an easy target.
Svelte never sat right with me, from the very beginning, but I could never exactly put my finger on it and articulate why.

“Svelte is not JavaScript” is spot on.
I consider sites like facebook to be akin to diverting water from the Colorado river. At one point it looked like the nile delta from antiquity and today barely a trickle if that at some times reaches the sea with so much water diverted. The ecosystem diversity falls apart.
The Deep Research Problem
I am on record as loving our BMW i3 and its Range Extender. :)

The German over-engineering of stupid things has been it's primary downfall, not the ICE+EV combo. We are approaching the end of our extended warranty period, and we have had two failures -- electrically actuated rear trunk latch and our electrically actuated charge-port-cover latch. Both ridiculous and unnecessary. Both about $4K at the dealership, with no real viable alternatives. Unfortunately, we are likely to replace it due to the obscene repairs of minor and unnecessary components.

I don't think there is anything else similar coming out. We won't be considering the RAMCharger, which is at least the same idea :)
Yeah same, Having watched my machine give interesting time estimates while it was broken. I was hoping it was more about how it added up each task it was trying to do until it had to re do a task.
> While the editor component is based off Monaco, the IDE is not a vscode fork and was written from scratch.

Interesting! What are the trade-offs here?
I think the other comment had an excellent breakdown of the various factors at play, so I will start by saying I fully endorse what was said there.

To highlight a key point: “naturally” is slightly humorous because it implies that while the outcome was ironic, it should almost be expected that an ironic bad thing happens. In addition, it signals my opinion on such situations more generally, whereas “ironically” is a more straightforward description of what happened that would add less humor and signal less of my personality.
Box::leak() and std::mem::forget() are safe code. Memory leaks are unrelated to memory safety.
Okay but that's obviously a nonsense claim. Find me a computer on the https://en.wikipedia.org/wiki/TOP500 that was built 4 years after the chips it uses debuted.

H100s aren't even 3 years old.
Ukraine isn't invited to its own peace talks. History is full of such examples
I think this is more useful for HTMX + AlpineJS based model of development. ShadCN et al are tied to a frontend framework (react/vue/svelte etc). But with shoelace/daisyUI etc, one gets the same level of polish out-of-the-box for HTMX etc
I feel like concepts like "this has to a have an economic impact" really limits what discoveries can be made and adds some blinders ...

I'm not opposed to some concept of that, but what feeds science is OTHER science, often not even directly obvious how the impact plays out.

I'm thinking of the old Connections TV show where huge advances are lead by tons of experiments and failures. You don't get the big advancement without the other failures / attempts and more general science.

Similar to the article, you have to fund ALL that science, if you're going to get some applicable output. Not just "do the last step first". We didn't go to the moon JSUT because we decided sometime in the mid 20th century to do so...
luajit gets you almost all of scheme features except macros. Speed of luajit is very close to native C.
What do we do to assess the intelligence of these models after they are smarter than any human? From the kinds of questions it's answering seems like they are almost there.

Do we have a way to tell if one model is smarter than another at that point?
my bad, I'll update
It's not even a good story. "You are drinking unfiltered lake water" is not appetizing.
I agree we need to be the change we want to see. However taking about dismantling a system is probably going to introduce more pain (in the short and long run). For example capitalism doesn’t need dismantling, it has brought us far more good than bad. However we do need to figure out how to deal with bad actors and net negative behavior (deforestation, over fishing, ocean trash etc).
That's not what is happening.

What's happening is that a business gets refunded by the government for any VAT they pay. Alice charges Bob VAT. Alice remits the money to the tax authorities who then refunds Bob the money they paid.

If after paying payroll taxes, the government decided to hand all the money back, that would be VAT. The only one who doesn't get refunded is the final customer.
Thinking Machines Lab
Well, if we're ignoring everyone else's descriptions of SBF, Caroline Ellison had a tumblr on which she repeatedly self-identified as a rationalist: https://caroline.milkyeggs.com/worldoptimization
In this case more like drop, roll and stop.
Battery life seems to be looking good on modern cars - better than expected by all accounts. I've been looking at the UK second hand market for ~2-3 year old cars (mostly Autotrader) for Kia Niros, and the hybrid and electric variants are pretty indistinguishable on price, which makes EVs far more attractive. I don't know if this is true for other car types.
It's not quite "just give me a mini PC with the PS5 SOC in it", but it'll do.
Mira Murati Launches Rival to OpenAI Called Thinking Machines Lab
> For the purposes of linux kernel, there's essentially a custom superset of C that is defined as "right" for linux kernel

Superset? Or subset? I'd have guessed the latter.
Their answer to the first question is actually wrong. The correct answer is 1 less than the given answer.
If you're looking for a library to build components and apps with that does let you use plain JavaScript - to the degree that you can write working components in your devtools console - check out Lit: https://lit.dev/

For deep reactivity, we have add-on packages for signals, and we're aiming towards integration with the upcoming Signals TC39 proposal: https://lit.dev/blog/2024-10-08-signals/

Lit's used by pretty major apps like Photoshop, Reddit, Home Assistant, and The Internet Archive.
Yeah, I can agree with all of that comment.

My gut feeling is that this will play out like the dot-com bubble. There was definitely a bubble, it burst and many investors lost money, but the Internet did end up eating the world in the long run.
This hits so many feels, and so... effectively. The corporate speak. The callousness. The vapid emptiness. The confusion.

The confusion - that this thing that seems like it should be excellent, isn't, and is in fact damaging - that's a sign of gaslighting, of being convinced to ignore or dismiss your own sense of reality.

When we're in these situations, we do know something's wrong, but we doubt; that it's wrong enough, that the wrongness matters, that the wrongness is worthwhile.

When you know it's wrong enough, you quit. When you know the wrongness is worthwhile, you don't have the dazed malaise. When you doubt your sense of reality, the reality you sense... crumbles.
Don't you think using the word “harassed” here is begging the question? What does this “harassment” consist of exactly? Are the neophytes calling you at work? Are they camping out on your front steps? Have they kidnapped your mother-in-law and won't release her until you tell them how to remove a character from a string?

Get real. All they are doing is asking questions in an Internet discussion forum. EFnet #perl was on IRC. IRC clients have a mute function. If you feel that someone asking questions on IRC is “harassment”, use the mute function.
Karpathy knows Musk better than the vast majority of people - he worked for him for an extended period of time when he was head of AI at Tesla. We're likely talking personal phone number and getting invited to dinner kind of "knows", it was early enough. He also spoke about Musk and his management style favorably in various public talks. But when it comes to feedback on the model - if you read Karpathy's post, it's not all positive. It is a strong model (eval scores attest to that), but it is still deficient in some niches, and he points that out.
>I mean by the same logic the only difference between a diffusion model and a VLM is that you put the spatial transformer on the other end.

Maybe if that was the only different but it's not. There are diffusion models that have nothing to do with transformers or attention or anything like that and where using them for arbitrary sequence prediction is either not possible or highly non-trivial.

Yes, All Neural Network architectures are function approximators but that doesn't they excel equally for all tasks or that you can even use them for anything other than a single task. This era of the transformer where you can simply use a single architecture for NLP, Computer Vision, Robotics, even reinforcement learning is a very new one. Literally anything a bog standard transformer can do is anything GPT can do if Open AI wished.

Like i said, i don't disagree with your broader point. I just don't think this is an instance of it.
And yet it, and the replies, cleared up a misconception I too had about memory management, in Rust and in general. There's no value to elitism in this circumstance.
Impersonating a woman/man was a crime. See the intro to this video: https://www.youtube.com/watch?v=X__VKNw0XiI&t=234s
Nah, an engine getting ripped off will not tear off the wing since this is the level of force and flex they are designed to withstand: https://www.youtube.com/watch?v=--LTYRTKV_A

The engines are built to rip off cleanly, because when they don't, they have caused https://en.wikipedia.org/wiki/American_Airlines_Flight_191 and https://en.wikipedia.org/wiki/El_Al_Flight_1862 which were fairly serious and catastrophic accidents at least partially caused by the engines tearing off and damaging the wing in such a serious manner as to cause a stall and crash. The wings stayed on the aircraft in both instances. Interestingly, both accidents were caused by those same sheer pins being damaged in minor and unpredicted ways.

I highly doubt the wing is DESIGNED to cleanly separate. Planes are just very not rigid for something going such a high speed, and so tend to turn into confetti when faced with a harder surface, like a runway or a concrete building. Usually the only parts that survive serious crashes are the landing gear struts.
Same awakening moment happened to me. I was in the edge of a big bed and I was not able to move. And there were (our) wardrops on the other side of the room (later they were moved out). I remember that there was notning much to remember before that and I realized that I was small and new in this world.
Whilst I understand the intention in comparing the average ICE to EV in order to get the larger upfront cost for the EV, I've never known anyone to shop like that. This argument was used against the Prius as well, "it's a 40k car where you could get something comparable for 25k, you'll never make up the cost of gas between the two". But that's not how the high majority of people shop for cars. They figure out their budget, then go around that. If you're in the market and can afford a 40k car, it's unlikely you'd go and get a 25k one, and vice versa, if you're looking for a 25k car, you're not going to go spend 40k because it's an EV.

So while it's nice to known that a more expensive EV will recoup its costs compared to a lower priced IC, for most, they're looking at a 40kIC vs a 40k EV, (post savings, rebates, etc) that hit the monthly payment they're looking for, and in that instance, the EV is going to win 99% of the time.
This is a hyperbolic comment. You are either simplifying to the core, are misinformed or ignorant. There is a nuance.

You can have leaks in every language including garbage collected ones. Allocate a shared OS resource like a semaphore and don't give it back, there you go you have a leak that survives until the next reboot.

Safety as Rust means requires below:

- The program cannot call an operation that accesses invalid memory i.e. uninitialized memory and invalid memory areas.

- The program cannot substitute a memory location that defined as a particular type as another type.

- The program cannot make calls to an operation that causes the runtime environment (OS, CPU interrupts, running modes, system registers etc) that causes the two issues above.

If you have already allocated memory that just stays as it is, this is safe. The action of allocating it can be unsafe if the program makes a call to libc allocator since libc calls are outside of the Rust compilers' control. Similarly directly calling the page allocator of the OS will also be unsafe since Rust compiler doesn't have complete control of the OS and internal structure of the CPU. Similarly freeing memory may also change the page tables.

Moreover Rust makes it easier to create data structures that clean after themselves. This is not a direct safety issue. It is a language feature. The standard library makes extensive use of these. So the common programming patterns usually mitigate the risks of leaking resources but not eliminate.
17 years of working at USPS DeJoy has been the best I've had the experience of working for
Implementing async APIs for microcontroller peripherals in Rust
Yeah to be fair testing a fetch request is not the best example right off the bat. That's an outlier IMO.

That said it's very very easy to write similar looking code using react testing library as long as you're good about separating business logic into a hook. Where it gets dicy & hard to test is when components have complex state/effects co-mingling with render logic.

Business logic is very easily testable as a hook, something like:

```
it('toggles switch state', () => {
const {current} = renderHook(() => useSwitchState);

expect(current.checked).toBe(false);
current.toggle();
expect(current.state).toBe(nextState);

}
```

Render logic is a bit different because React Testing Library's philosophy is to test as a user would interact with the UI, so that looks more like:

```
it('switches state on button click', () => {
render(<Switch onToggle={mockOnToggle} checked={false} />);

getByRole('switch').click();
expect(mockOnToggle).toHaveBeenCalled();

});
```
/Ack
Only when they are sold, or if you receive dividends. If he doesn't sell them he doesn't pay tax on them.

He can then leverage those stocks BTW to receive loans, which he won't pay taxes on as they are a debt. Then he can make use of the stock without selling it, and then use that extra income to invest in other things that will generate him additional income/capital or whatever.

There are even more tricks you can do at that point, where on paper you are technically making a loss and never pay a cent in tax.
And this: https://cloudhiker.net/

(also no affiliation)
I have found Web Components are a really good way to create small 'apps' (like calculators) that can be shared and embedded across multiple different websites.

Being native JS and self encapsulating is very powerful in that kind of use case.

Hard to see web components really competing with Vue/React for large apps still, but love to see development in this space.
Yup. He’s also my GitHub avatar.

The idea behind the name is a reference to the language providing the user the maximal set of tools
I assembled a large collection of tools over the years. And I‘m always happy when a project has a surprise moment like described in the article and I have just the right tool for that. In the other case I tend to make sure it won’t happen again.

And on that note. I tend to buy professional grade tools. Not just because there mainly better, have more features or are more accurate it’s also that they come with a higher Garantie and being able to buy spare parts if needed is an added bonus.
I'd put solid money on Warner earning a few cents every time an AI girlfriend somewhere sings happy birthday within 10 years
That was also an obviously terrible idea, iirc to the point even python leadership aims to never do it again
They've turned React into Angular 19 with signals. Heh.
Sometimes people take such jobs to get out of a bad financial situation.

That can be a legitimate use, but one should remember that it's but a temporary thing to solve a particular problem, there should be an end date, and a way out. In particular, you should not start depending on the thicker stream of money such a job pays.

It's rare that such a job leaves the physical damage described in the story. More often it can damage you mentally: burned out, depressed, crushed by internally felt shame and guilt. This should not be discounted too easily; it can cost you a lot of plain money to get treated, to say nothing of the suffering, both yours and that of those who care about you.
The Value of Remote Work
Wow I hadn't seen rerun before, this thing is amazing!
The dot com bubble wiped out many billions of dollars in valuation.

The dot com bubble also gave us the most valuable companies in history, like Google, Apple, Amazon, Facebook, etc.
(I feel bad about linking so often to my own comments but that information mostly doesn't exist anywhere else)
I think copywriting is trying to kill me
I'm not sure if I'm interested in ffmpegkit or not (because it wasn't described), but I am interested in the dynamics of open source communities, so stopping reading the article would miss the point for me.

Plus I guess as a writer you want people to read your stuff. Obviously if you don't, then don't follow all the usual rules of good journalism like the inverted pyramid, which is what I'm describing here.
> It does, however, invalidate the original argument, which was that tariffs are being promoted by the rich because it's better for them than the existing income tax

If I were to steelman that argument, I'd say getting rid of income tax takes the wind out of the sails of the "wealth tax" / "tax the billionaires" / "fix the loopholes" argument which seem to be gathering steam.

That it kills or underfunds government social-safety programs is a secondary bonus, and using it as an excuse for decapitating safety/oversight/enforcement agencies who get in the way of higher profits via "overregulation" is a tertiary bonus for those that believe in starving the beast that is central government.
You won’t get an answer. They’ve been arrested for indecent exposure
This is the sort of thing I like trying to make llms do, thanks for the idea. I have a discord bot set up already that sends notifications and accepts notes; I will try adding some endpoints and burning some credits I have to see how hard it is to make AI talk to alarm endpoints in a smart way, etc
Isn't most of this water reused and recycled through the cooling systems, therefore making the actual water usage much lower?
Show HN: Reverse-engineered Google Photos mobile API client in Python
Main purpose of the project is to enable media uploads to GP as Pixel XL (unlimited original quality) without relying on a physical device/emulator.
Can be used as a cli uploader or Python library.