skysight-inc/HackerNews huggingface dataset:
vLLM supports MLA for Deepseek models as of 3 weeks ago. 3x higher generation throughput and 10x token memory capacity.

https://github.com/vllm-project/vllm/releases/tag/v0.7.1

MHA is still faster in low QPS regime apparently.

https://neuralmagic.com/blog/enhancing-deepseek-models-with-...

Also published this month was theoretical proof showing that for the same KV Cache overhead, MLA consistently offers greater expressive power than GQA. Furthermore, widely used GQA-based pre-trained models (e.g. LLaMA, Qwen, Mixtral) can be converted into MLA-based models.

https://arxiv.org/pdf/2502.07864
If free citizens in the USofA have {X} and China has sanctioned Germany from having {X} should the free citizens of the USofA honor that agreement they made with China to not sell to Germany when they acquired {X} from China?

How about if they got {X} from Mexico ( who got it from Agnes .. ) ?
We don't need startups, we need Digital-Mittelstand
Interesting business model. I was just speaking about app mascotification the other day with someone. It's a potential branch of the future. I wonder what the appetite is for curated avatars like this right now.

Regarding the tech... I really need to start offloading all of the tech I've built out in the last few years. I keep seeing business being erected on a fraction of the features I've developed in recent memory. Realtime lipsync, 3D avatars with generalized animation systems and basic autorigging, cost-effective/local TTS, STT, speaker diarization and embedding, memory models, agentic frameworks, there's just so much sitting on my drive in a handful of monorepos that needs proper treatment as either a standalone open source project or startup. I could take all this tech, grab a few artists I know and clone Mascotbot's business model in a week...

Not to detract from the great work they did here on coming up with and executing an idea. Subscription-based model work on its own is a really interesting market segment and I am very much rooting for Mascotbot's success.
My ADD brain keeps jumping around between various projects. Some highlights:

- Last month I demonstrated the ability to build Nintendo 64 ROMs with Zig¹, making some headway on Zig-native APIs for interfacing with the N64's memory-mapped hardware. Taking a break for a moment; will probably resume when Zig 0.14 drops (within a couple months IIRC). Next planned milestone will be to implement interrupt handlers.

- Gradually migrating my code repos from Git to Fossil (with plans to continue to mirror to Git). Experimenting with bidirectional syncs in order to preserve the ability to handle merge/pull requests from the various Git repo hosts on which I syndicate my repos. The above Zig64 project will probably be the first real guinea pig.

- Migrating my personal website away from Jekyll has been an ongoing project (going on almost a year now) with multiple parallel efforts: using Fossil's wiki features², using Scroll, and (most recently) using Typst's newly-announced HTML export feature. All three approaches have their pros and cons.

- I've been tinkering with my PowerBook G4; recently swapped in an SSD (using an mSATA→PATA enclosure) and installed the latest OpenBSD (with all partitions except for '/' encrypted; working on documenting that process and the associated kinks - and possibly turning said documentation into installer and initscript patches so that hardware platforms like macppc that lack support for encrypting '/' can still enjoy not-quite-full-disk encryption). Next on the list is rebuilding the battery.

- That PowerBook is also the only working machine I have that has an optical drive, so as soon as it was consistently booting right, I took the opportunity to back up the stack of burned CDs/DVDs I'd accumulated throughout my lifetime.

- I have a bunch of my dad's old photos and schoolwork and such that I've been meaning to digitize and organize.

----

¹ https://fsl.yellowapple.us/zig64

² https://fsl.yellowapple.us/website
Does this have lock in like Authy, where it’s not possible to export the codes? Does it not work on desktop since the page says iOS and Android? And isn’t it a bad idea to use both the password manager and Authenticator from the same company?
Excellent!!! I have been wanting this for a long time
But you wrote it in English. Perhaps if you were taught in a grammar school, you would write it by hand something akin to: οἱ πολλοί

For some UK examples of usage listen to: https://youglish.com/pronounce/Hoi_polloi/english/uk

Showing off your education is oftentimes used to signal high status. That often fails. You can of course argue with the OED:

Hoi is the Greek word for the, and the phrase hoi polloi means ‘the many.’ This has led some traditionalists to insist that hoi polloi should not be used in English with the, since that would be to state the word the twice. But, once established in English, expressions such as hoi polloi are typically treated as fixed units and are subject to the rules and conventions of English.

Disclaimer: I'm one of the οἱ ὀλίγοι from the colonies, so the only thing I was learnt is baaaaaaa.
Cache – Web API
TIL about the Cache API and how you can store an almost unlimited amount of data in it for caching purposes. It eliminates the need for IndexedDB in most cases. The Cache API can be accessed without service workers.
Here's another article about it: https://web.dev/articles/cache-api-quick-guide
Dual BIOS doesn't mean the manufacturer was smart enough to implement two separate storage spaces for efivars.
> .. it hardly matters for normal people that the weights are free. We needed more efficiency breakthroughs.

That atleast allows other companies/research labs to develop competing cutting edge LLM technology and come up with efficiency breakthroughs. The alternative is for the tech to be hidden inside OpenAI and FANGs or released as old versions.
The next few years are gonna be interesting.
https://en.wikipedia.org/wiki/Finno-Ugric_languages
This!!!

...is an accurate description of "prior restraint".

The government (in the US at least) isn't allowed to discriminate based on the content of your speech even if it goes against "controlling the narrative in such a way that the people are happy". IIRC, the burden is on the government to prove the censorship is the result of a compelling public interest and there are no lesser solutions which can be employed.
Building two things ATM - first is an interactive fiction engine (almost done) and game with it (halfway there). Just wrapped pre-production on music and art, going into the studio to record final tracks later in the year. Launching end of the year hopefully.

I'm also building an application and training materials to help people with annual strategy. I've spent 20 years in marketing and ops putting up with people doing it badly so this is an attempt to help people running businesses actually come up with a strategy likely to result in something valuable.
In terms of pedagogy, it is a problem.

I started tutoring other kids in grade school and eventually got paid for it as a side gig later in life. If I ended up covering electronics and/or general electricity, I saw the same thing I saw as an undergrad taking EE courses: confusion. A lot of people found the situation counter-intuitive. It required extra mental labor for them. Hence, multiplied against millions of people, there's overall lost time.

And this isn't just in young people, either. Knew a guy who swore up and down that the "electron holes" really represent positrons.

Bad notation, weird syntax, poor choices in variable names, and so on, all of these are a collective drag which could be streamlined away.
Is that legal in your country? In mine (Netherlands) there are way too many people with doorbell camera aimed right at the street even though it's illegal to record a public space like that. Most folks are ignorant about it though, or think that surely the internet-connected gadget sold by some anonymous corporation won't be abused....
Cool assets! Feedback: the “about” text explaining the site doesn’t show up for me on mobile. This may get shared around more if that gets supported.
working on cursor for desktop. why rely on AI agent that’s self-contained when it’s limited, can’t access the browser, can’t open apps or click around.

i simply want mine to be able to fill in forms in preview with a passport image as context. also to be able to do recurring tasks as if i was the desktop user. e.g., i’m going to bed keep working on this spreadsheet.

it’s working and built but very slow and buggy atm. uses multimodal LLMS and OCR but lots more optimizations needed. need to make it a lot faster. can demo it and need help if anyone is interested.
I found an point-of-sale minipc with a very nice integrated touchscreen (Pipo X10). As I kept getting unrecognized usb device on a usb-serial adapter I entered bios and played with a few usb-related bios settings. Save & Exit and I discovered I just disabled ALL my usb ports with no way to reset the bios or any other available port to plug an input device into.

So yeah, the CMOS battery not clearing the bios + my own stupidity cost me ~150$.
I have been working in my spare time on Japanese vocabulary learning app and just yesterday finally convinced myself to publish the sources: https://github.com/d3nzil/gaku

Be warned it's in early stages, difficult to use and code is big ball of mud. But the basic functionality works, so maybe it will be already useful for someone. And I have been using it and working on it consistently, so hopefully it'll only get better.
Are we using the same website? I mostly see fervent anti-piracy and pro-pay-for-everything sentiment.

UPD: 17 day old account. I was had.
It wasn't React. Everyone knows modern applications must be written in React.
What exactly is the use case here? I have yet to see a website replace their text chat with an avatar
The Myanmar junta is already a failed state and a client state of China, they're highly dependent on them. If the people running things in Beijing weren't OK with that junta, it wouldn't be in power right now.
Why should you even care? You're not responsible for those cards.
Simple typo. "(That is, an expression (λx.M) combining with an expression N returns (M) where all instances of x inside of M are replaced by x.)" Are replaced by N.
Working with clients I realized that many companies lack basic monitoring and observability. E-commerce shops go down and no one notices. DBs do thousands of useless queries per minute. Emails stop sending silently.

I’m building a tool to make monitoring setup a no-brainer. I’m talking about basic website monitoring setup in 5-seconds — literally.

The problem is not a lack of tools. The existing tools are not even that complicated, but they still require too much thinking to set up.
Still working on RunGen.AI – a platform to deploy any LLM or Image model from HuggingFace by just pasting a link.

Still a lot of work to do, but solves a real pain I had while building my previous side project
I did see this happening with AMD too. AMD drivers had a bug around 2020 that newer AMD Thinkpads couldn't drive 4K displays. It was one of the reasons I stopped using Linux after buying a new Thinkpad T14 Gen 1. Half of the hardware outright didn't work. It took a good 2 years for them to fix it.
There is something wrong or that I don't understand.
I put "the example", the Italian translatione is "nell'esempio" which is wrong, but in google translate the translation is correct "l'esempio"
Would you give up every single thing you have? If that wasn't enough, would you really let them go free?

If that's your absolutist moral position, then I think that is consistent with what you said.

I don't think most people would agree. I think that tolerable costs are finite.

The cost to ensure a reasonable amount of safety may in fact be tolerable, but that is a separate position from the absolutist one.

I'm pretty skeptical that someone would sacrifice their entire wealth to de-risk prisons, and I'm naturally skeptical that they would sacrifice the lives of their children before they put a prisoner in a risky position. This is what your rhetorical claims boil down to.
Unfortunately, data centers also need access to considerable amounts of water.
I recently made a little tool for people interested in running local LLMs to figure out if their hardware is able to run an LLM in GPU memory.

https://canirunthisllm.com/
I was gonna reply something similar too. The only "counters" people have when talking about Clojure (that I see, as a non-Clojurian) are pretty weak, and are usually: "it uses JVM, and JVM bad mmmkay" and the typical lazy dismissal of Lisps as "omg it's parantheses everywhere".
> Why not?

If your house had a carbon monoxide leak but your neighbor’s house did not, would you consider your carbon monoxide leak to be “offset” by that fact?
Also easier to avoid such accidents in the first place, since the plant is sitting on top of a planet-wide heatsink.
They are the people who think only one move in chess. I hope this answers your question.
APL programmers enter the room
Greed is why people are going to spend CapEx installing solar to reduce OpEx buying coal.

Greed pushes people out of the status quo.

Greed is why fusion reactors will be reduced in size, cost, and complexity.
I've been looking at this a lot, for ourselves (multitenant saas app running on gcp) and for our customers, who are starting to be curious about something between fully self-managed (too costly) and centralized/multi-tenant/american cloud.

One thing that strikes me is the relationship with architecture. A monolithic, vertically scaled app can run ANYWHERE where I can rent a VM, whether in Norway with Upcloud or on a VPS in Kenya. It's only when you start stitching together managed DBs with autoscaled instance pools etc that vendor lock in begins.

All of these nice toys make our service highly available. But while the overall risk is lower, it is far more correlated between customers. If our service would go down because of a political event, it would go down for all our customers at once.

What about a control plane that manages a fleet of per-customer VMs across an array of cloud providers? Has anyone ever tried this?
Comprehensive Overview of Apisix AI Gateway Features
Not sure where you are, but 30kmh sounds Dutch. Filming the public road from your private residence is illegal.

In practice, no one cares. Cops will even ask you nicely for footage if something went down in your street.

Anyway, best of luck with your project.
I'm just here to praise the "Login as guest". Thank you !!
I implemented the AAN 8-point DCT algorithm some years ago: https://www.nayuki.io/page/fast-discrete-cosine-transform-al...
I think thats the right mindset to have in cases where power increases.

I’m really exhausted with this sovereign citizen crap, but when the government is trying to accrue more powers its worthwhile asking what else can be done with it.

For a prescient example: my mother welcomed policies that made protesting more-or-less illegal. “Just Stop Oil” had been doing a lot of nuisance things and she felt it justified. As did the right wing.

Now, when the far-right started marching[0] she was horrified to learn the extent of the new powers and said it was orwellian.

I use her as an example because I think HN leans left, but it will be the right wing folks who dislike government most. Obviously as a left winger myself- when the right wing government was installing anti-protest measures I was horrified, and was much more keen to point out they it could be used against people like my mum.

The government aren’t your friends, they are either changable- meaning all rules have to be solid enough to be used fairly even if the ruling party changes a lot, or: you’re living in something other than democracy, which is largely considered bad.

[0]: https://en.wikipedia.org/wiki/2024_United_Kingdom_riots
I've been inspired to build my own browser mmo game after seeing hordes.io, which is made by a single person. Launched a prototype with, for now, only basic movement over at http://everwilds.io. Instead of working in a silo I've decided to develop in public and launched as soon as possible to slowly gather an audience. So far the Everwilds.io Discord server already gained 1 member ;) I'll share the link incase others want to follow the development: https://discord.gg/HWZSpkvz
I've been dabbling with local ML projects, and trying to get them to run with ROCm on my Radeon 7900 XTX card. All the solutions to run for example Llama.cpp or Automatic1111 are a bit hacky, so I made a repo where I document how to run them in containers.

https://github.com/Krisseck/ROCm-Docker-Scripts

Needs more documentation and more projects, but all contributions are welcome!
The obvious next step here is to see how well this generalises to arbitrary inputs :)
Yes, as I acknowledged I did not spend time digging in who wrote which exact patch or sift through some loudmouths on /r/cpp whining about things. The burden to substantiate your argument at this point is chiefly on you. I have spent enough time on this already. You can narrow things down to some area that you care about specifically, but I am fairly certain Google and Apple each spend tens of millions of dollars a year, if not 100+, on the LLVM project at large. Are you suggesting this $$$ figure is wrong?

To contextualize, I have been one of those PhD student in the exact same space who used clang/libtooling in a past life, as well as a maintainer of a sufficiently popular corporate open source projects, and I do have my own hunches on how much exactly random "volunteer contribution" is often worth (hint: it is mostly extra pain for the maintainers to review).

The irony is if Apple closed it up for themselves as proprietary software in the first place, they would not have received that criticism. If you start open sourcing, you will be treated with a much different, IMHO unfair, benchmark.

Before LLVM, much of the PL research prototype would be done on Java with some research JVM crap because it was hard to do it in the real world with native code, so I could the academics beneficiaries not among the abused.
Very nice! Way more complete than the other tools I've seen to estimate running LLMs on GPUs :)
Is there any PS web reader that can run it?

(WASM or otherwise)
"being a grand dad"

is his answer. and he colored it. it's not that deep so as to upset you. darklake just practicing his creative writing.
I didn’t find this article credible. It is arguing for small and medium businesses instead of startups, and offers steps to see the vision it paints. But startups are where some of the biggest game changing ideas come from. Large enterprises can sometimes do that too. I feel like the mid sized companies are often stagnant. The product areas it suggests for businesses are very hard to survive in.

These other lines sort of felt like an idealistic version of Germany:

> However, if you’ve ever used a product marked “Made in Germany,” you’ll understand what German culture truly values: mastery of a craft and uncompromising quality.

> They’re not the kind to release half-baked products and patch issues later

Anyone who has owned a German car knows the idea of German quality is a myth.
Yes! This architecture allows you to host your git repos on your own server, while allowing contributions from others with a unified identity (unlike say, Gitea or GitLab, where you’d have to make yet another account).
Thanks! Yes, was also thinking of adding a menu bar item to macOS to have it always visible.
Honest question:

Do you feel GenAI coding is substantially different from the lineage of 4GL to 'low code' approaches?

Reason I'm asking is because despite all promises al suffered from what Spolsky coined the 'leaky abstraction' problem.

Once something goes wrong, the user is left without recourse in a sea of additional complexity created by the tooling that was meant to not have to deal with it in the first place.

My own opinion is that GenAI is different because of (a) its recursive reflexive potential (you can use the tool itself to help you past the failure) and (b) it shifts the input out of the necessity for algorithmic/systemic thinking (which may come as a surprise to the audience here but my experience has taught me is alien to dare I say the majority of people).

Now don't get me wrong. We have not reached the point where (a)+(b) make it to where you don't need application layer devs, but we are definitely seeing some progress.

As for going deeper into the stack to "escape" AI, I would venture that is probably a non starter as the deeper you go the more constrained the domain is, so your escape strategy relies on AI reasoning making little progress, where AI reasoning has always been more successful in smaller well defined spaces.
That video is great!

Plus the bonus of an example of causing spin.

Obviously the ball response can be modeled as an impulse. However as you point out the difficultly is that the physics engine needs to calculate a correct result for the ball bouncing (i.e. it isn't simple to calculate the impulse).
Anything like this for Linux ?
America First Investment Policy
That's over simplifying things ... no, complex gems cannot simply be transformed to Elixir with ChatGPT. You'd have to have an expert in both languages fixing all the bugs.
Reading literature (academic and otherwise) on parsers, writing blog posts about what I learn, trying to implement the things I learnt. I've written about basic finite automata (for regular expressions), LL, LR (including the difference between SLR, LALR, and LR(1)), detoured into some optimisations for LR from the 80's, then generalised LR (RNGLR in particular). I'm now implementing these things, RNGLR is not easy to implement despite having understood it well enough conceptually to write a blog about it (https://blog.jeffsmits.net/generalised-lr-parsing/). I've read far more than I've written about, trying to keep that straight in my head as well / planning the next... probably year of writing ^^'
Newbie comment: I am finding PyTorch over CUDA to be so bloated. The cumulative sizes of the of the binaries + drivers is often adding to more than a baseline LLM model that carries so much knowledge. And now, each new AI app is packaging its dependencies (e.g., StemRoller, Jan.ai, etc.) and thereby occupying GBs of disk space each. I am yet to look into LLM.c and Llama.cpp stuff.
Russia would have to pull forces from other places to retake it and probably see pushing on in Ukraine as more important to them
My experience precisely mirrors that described in various posts here: https://ludic.mataroa.blog/blog/get-me-out-of-data-hell/

I live in Melbourne like the author and I certainly don't speak for the entire industry. But here's it's mostly government and banks and other enterprise where data is just a cost-centre so middle-management could say they were big on data science, which has since transformed into being big on AI.

There's no end-use for most of the work, there's no stakeholders, often the product being delivered will be a 'platform' of some sort and everyone outside the data area is afraid of sounding stupid by asking what that means (it doesn't mean anything). The result is entire services can go down for months at a time and no-one notices (and then when someone does realise management covers up the fact no-one noticed because it's embarrassing).
Whenever i see a Dungeon Keeper pic i am immediately inclined to go play again. If you havn't seen, there's a wonderful fan expansion fixing basically everything: https://keeperfx.net
I'm still working on development of a native Windows application for data analysis of SQLite databases. It's geared towards non-technical (or only slightly technical) users and allows queries to be easily made without knowing SQL. Additionally, it easily lets the user quickly create charts from the queried data (bar, column, histogram, line, pie, scatter). Development is nearly complete and hoping to put in the hands of testers within the next couple of weeks. Also trying to decide on name for the product so that I can start development of website for it.