Nicki Gataro

@Ke09876 if the user doesn't have enough storage space, this will fail, moreover, when mobile users run out of memory, Chromium browsers automatically start cleaning things up, removing saved content such as indexedDB. There is something called persistent storage, but it's is a joke, only in Firefox it asks the user for permission, Chrome just on its own decides to grant or reject it, who thought it was a good idea...

As a frontend dev, LLMs were not meant for the browsers. You have to download the weights every time you reload the page. It's impressive that they do run well in the browser, but I don't see any practical use cases.