skysight-inc/HackerNews huggingface dataset:
Show HN: Transformer Lab – Download, interact, and train models locally
Transformer Lab is an open source tool that lets you interact, train, and evaluate LLMs on your own machine or in the cloud (currently Mac or Linux, Windows soon) through a simple GUI.

Try it out here:

https://github.com/transformerlab/transformerlab-app

One of our goals is to make it as easy as possible to get started experimenting with LLMs regardless of what platform you have (even if you don’t have a GPU). You can do everything through the UI but it is built on an API that can be extended using plugins. When you start the app it will try to figure out what kind of system you have and install the right set of initial plugins to get you going optimally.

Some things you can do locally:

- Download and interact with LLMs
- Fine tune and evaluate your own models
- Export models to formats that will allow you to run in smaller memory or without a GPU (e.g. export to GGUF or MLX)

It comes with a library of models and datasets to get going easily, but you can also download any model shared on Hugging Face and build your own training data.

Why we built this: we have been really interested in research and experimentation with LLMs but what we found was that the tooling for going deeper is lacking — Transformer Lab was built to address that problem.

We are a small, unfunded team and we’re excited to build a lot more on top of this platform. So any feedback on how to simplify getting started or how to make this more valuable for experimenting locally would be really appreciated.
> I would say if you know that you are going to use Vercel, use Next.js but otherwise I would always argue for Remix.

Exactly. It makes absolute no sense to deal with all of Next's artificially imposed limitations if you're running it on your own servers.
That all sounds like a good way to live :) And a very good idea for nature and the planet to have any chance of surviving humankind's consumption. You can make this work with a family, I feel. At least, we've managed this a bit so far. Although, its quite funny. Charity shops sell lots of excellent nearly new kids clothes. Our kids are fine with those, especially as they see it goes to a good cause and is a form of recycling. Last year my wife found a nice top for our daughter which turned out to be a posh brand. On a non-uniform day a schoolmate said "wow you've got that, you're so lucky" to which our daughter cheerfully replied it was like £1 in a charity shop. Which flummoxed her friend. It's like, that's somehow "not the thing to do" to buy this barely used item at a charity shop. I guess that's all about status? Somehow its low status to buy something at a charity shop even though its pragmatic? But then, increasingly in some countries, second-hand clothes are actually now becoming the fashionable thing to do. I offer this as an illustration of how utterly fickle it is as well. What's high status one month is low another, and vice versa. People are moving the goalposts all the time. Rationally, makes sense to avoid this game altogether.
Exactly! If I could, then car improvements would cease to exist.
I general I don't really disagree with you, but there's one place we do differ. I find that in reality we often don't have the choice between a good idea and a bad idea, but rather between a bad idea and a terrible one. And so trying something new simply because what we currently have is bad is not compelling, to me. It's really interesting how much wisdom is tucked away in all of those old hokey folk sayings that we seem to be largely discarding in modern cultureless culture: 'Out of the frying pan, into the fire.' So, no - I don't find it to be just navel gazing.

As to the issues with "our" current system, I think one could argue a lot of it started in 1971. [1] It's referencing the end of Bretton Woods. Under Bretton Woods the USD was convertible to gold at a fixed rate, and other countries were obligated to peg their currency to the USD. The idea being that the fixed conversion rate would prevent the US from printing too much money, or other countries would just convert their excess USD to gold and make a huge profit. Except we did print too much money and other countries decided to cash in their gold. So we simply defaulted on our obligations and withdrew from the agreement.

It's at exactly that point in 1971 that the handcuffs on governments' money printing were completely removed. And we're now seeing the consequences of this. Rather than being some deep issue with capitalism, I think we're just looking at a relatively short-lived monetary experiment that's ultimately turning out to be a catastrophic failure, masked only by the fact that we kicked off said experiment at the exact time computing and related technology was entering into a hyper-expansion phase. But now as that fantasy/bubble of infinite growth to sustain infinite monetary expansion starts to pop, we're seeing the natural outcomes happen at an accelerated rate.

[1] - https://wtfhappenedin1971.com/
Do you know what the recurrence rate is for U.S. prisons? It's around 44%. 44% of people released from prison, within a year, go on to commit another crime severe enough to end them up back in prison
Really looking forward to the day someone puts out an open model which outperforms Flan-T5 on BoolQ.
> In what fantasy universe?

By definition - https://data.oecd.org/gdp/gross-domestic-product-gdp.htm#:~:....

> I never said anything about software

Software, Banking, Foreign shell companies holding all global profits, etc all fall under SERVICES.
Aligning Velox and Apache Arrow: Towards composable data management
Is there any truth behind this claim that folks who worked on Gemma have left Google?

https://x.com/yar_vol/status/1760314018575634842
My 2c:

- 8% or higher for a non-cofounder is very unusual. It’s typically 1-3%. Your CEO is flying in the face of conventional wisdom - but that’s not always a bad thing.

- re: the sales guy making more - I think you just need to make peace with it. People often make more doing less, or doing less technical work. Companies certainly often have initial employees that are as crucial as co-founders but are compensated with 10x less equity.
Are these any good? I have been trying the non pro version of Gemini, and that seems awful at code generation. I am more keen on getting access to the best model and I would pay for it if I wasn't already paying for ChatGPT 4.
Who cares if it's a PR stunt to improve developer good will? It's still a good thing, and it's now the most open model out there.
He is saying it's highly likely to correlate with how you think you should score before you take the test.

Did you have a counter argument to offer or?
Agree. This feels like judging youth because they don't feel compelled to conform to some "subculture" in order to have a happy, fulfilling youth.

As the parent of a teen, I see a massive difference from what I saw as a teen in the late 1980's. At my school, there were very clear and visual identifiers for whatever group kids were in. Crossing these lines was effectively leaving one's comfort zone, and was awkward and difficult.

For my own kid and those that I see at his school, it's much more about common interests, and that feels like more of a matrix than the coveted & siloed subculture worshipped by the author. Kids seem to be more united by what they do than what group they identify with. There are still peer pressures, elements of shared culture (especially in clothing), but it doesn't feel as rigid as in the days of my youth. The old cliquey tropes seem very, very diminished.
I think it depends on the type of work (and also legislation). For example I had architects calculating which kind/size of iron girder/joist (IDK the exact English word for it) put to replace a supporting wall. If they calculate that badly, the roof comes down at some point, and I die.
Think there is not a clear ‘idea of jails’.

To me, the length of sentences in the US suggest that a primary purpose is deterrence, not merely keeping dangerous people off the street.
What if we built procrastination into LLMs?
Banger! This is it!
That is the best set up imo. Vim keybindings and composability are great, but Emacs being built on Lisp is a super power.
Does it still count as "full beam power" if it's in a lead box? That means the full beam power did not reach the GoPro.
That is a good point on the application changes.
What is appealing from Readyset is that it does not require you to change your application code. You can just change your database connection string to point to it and it will start to proxy your queries to your database. From there you can choose what you want to cache, and everything else (writes, non supported queries, non cached read queries) will be automatically proxied to your database.
We tend towards finding smaller and smaller details that we didn't understand as a field matures unless it gets upended by large new discoveries. Classical mechanics for example, we can safely say we've got that pretty much locked down and know what it's good for and where we need to apply other methodologies. Also we have to zoom out from the individual view when thinking about collective knowledge in an entire field. Each individual person has a vast amount they can continue to learn of course but fields as a whole can tend towards more complete knowledge of a particular topic.
Freeware Tools for Windows and Linux
Except the black mirror maybe. That only shows us what we want to see.
At least in the US the role and responsibilities of the police is to protect the government. They may protect the citizens, but they can never be held liable for a failure to protect the citizens.

You'll have to ask a Canadian about the specifics of the various provinces.
Because whenever it's even vaguely cold outside, my neighbor likes to be able to start and idle her giant truck in her driveway without leaving her house (for 40 minutes before she drives a mile to work).
I don't anticipate this changing either - because, let's face it, losing all of your Photos and Messages is, to most people, a bigger deal than perfect security.

I'm experienced with Apple products - but there was one time that I actually got stuck in an E2EE loop and was forced to reset all E2EE data on iCloud. I don't know what I did wrong - but if someone in tech, like myself, can get stuck in an E2EE lockout, I can't imagine other people.*

*This was not Advanced Data Protection. This was stuff that was E2EE for all accounts - like passwords and health information. As such there's no recovery contact.
you can always ask it to include a '!' after every word and then sed it away. Poof, there goes your watermark
They forgot.

Also phi-2.
It's very strange because I read the "Wrongful Death of a Minor" statute and it says nothing about born vs. unborn children, unless it was recently amended. If I'm reading you correctly, you're saying that the Court previously interpreted that "black letter statute" wording to include unborn children (even if the actual wording of the statute does not) and in this case they're merely taking the "relatively uncontroversial" step of expanding their novel interpretation of the statute so that it also includes IVF embryos. Even though the statute discusses neither.

The dissenting justice seems to confirm my impression: "Justice Greg Cook, who filed the only full dissent to the majority opinion, said the 1872 law did not define "minor child" and was being stretched from the original intent to cover frozen embryos."

So the court has now made two rulings that vastly expand the scope of the "minor child" that is mentioned in the "black letter statute". This is obviously fraught with ethical implications and implications for future cases. But since the court asserted that this is simply applying "statute" and there are "no major ethical implications", I guess we just have to accept their assertion? That seems foolish.
As I understand it, CANBUS is a message network among relatively low-power devices. There are two ways of doing this:

+ Some credential exchange between devices to establish a web of trust
+ Devices are locked similar to Apple parts
It's always uncomfortable with a new therapist because they lack the context to know what you're going through, for how long, and the factors that are affecting it. I've seen mine for over a decade at this point, and when I talk to people about their potential growing pains when they're seeking out help, a lot of it is a reminder that you have to create that context/history with them over time.

It seems like yours is more comfortable making suppositions without the historical context, which sucks to hear and is pretty exhausting.
I am proposing a workaround for restoring PWA support in third-party web browsers on iOS - to append some well-known query param or hash to the PWA URL by convention (like ?__pwa__ or #__pwa__ or similar) and detect PWA using it, then hide the UI: https://twitter.com/niu_tech/status/1758877533481717951 or https://fosstodon.org/@niutech/111947656399263607.

But a better response is to show Apple the finger by boycotting its products. For instance, I've replaced iOS for Sailfish OS and Ubuntu Touch, which respect my privacy and are much more open.
Medication is not necessarily the answer: In this we agree, formalising it helps because only when we understand do we have the language and tools to properly address the issue.
In my case I was burning myself out because I was guilt-tripping on my “lazy” behaviours.

ADHD is definitely overmedicated in my opinion, however what you often find is that ADHD people (especially those good at masking) are self medicating with caffeine.

Cognitive Behavioural Therapy is the most likely outcome of a formal diagnosis. Theres no quick wins with that but its the more sustainable way for the majority of people.
What they model is meaning. I'd call them "semantic models".
Truer words never spoken.
> It's 2024 - can we please accept as a society that people can be different without being superior or inferior

The existence of difference necessarily means the possibility of superiority or inferiority in certain contexts. The task of social philosophy is accepting that men and women can be morally equal while being different and, on average, better at some things and worse at other things. For example, our moral philosophy will probably have to come to terms with the overrepresentation of men among both geniuses and criminals.

The corollary to that is why modern “diversity” ideology is a step backward. Positing that the races are different, but those differences are all positive ones, is an explosively dangerous idea. Because if the former is true—and I’m not saying it is, and I sincerely hope it’s not—the latter is just wishful thinking. Because if meaningful differences exist, those differences are probably going to be pro-adaptive in some cases and maladaptive in others.
It makes sense - publications write about the things they added, changed or evaluated, not about all the (many!) things they do exactly as everyone else; so tokenization would be mentioned only if the publication is explicitly about a different tokenization.

And while it's a core feature, it's a fairly robust one, while you can get some targeted improvements, the default option(s) are good enough and you won't improve much over them.
Maintenance is a big key management problem though: if only the owner has it, there will be problems when people inevitably lose it. If there are shared keys for service departments or databases, thieves will get access to them.

Things like time-limited on-demand keys can limit those problems but now you can’t get your car serviced when Toyota’s servers go down and they need to commit to not breaking API compatibility for multiple decades.
It's the preferred occupation even for Gen Z and younger. Get paid to go on vacations, get products for free and have thousands (millions) of people desperately want your life as you talk about it endlessly. The perfect job in the teenage mind.
Kia and Hyundai saved like $20/car by skimping on a part that all the other major manufacturers include by default, leading to cars that were insecure by design. That's negligent.

Punishing people for taking advantage of that vulnerability is certainly warranted, but it's also closing the barn door after the horse has already bolted.
But that is my point. All security measures are defective. I can always tie a chain to your vehicle and leave with it. Security measures deter criminals, they can never stop them. Only the government can do that. The government is not obliged to do that in the US. Thus, no one can stop criminals

To metaphorically put it: no matter how good your 2FA is, I can always get around it if I can torture you or threaten your loved ones.
I love that project! And also that they did so well.
> Who said the obscenity/indecency laws are constitutional?

Courts

> These sorts of laws spit in the face of the First Amendment

FWIW, the same people who created and passed the First Amendment also created and passed obscenity laws.
Paywall free: https://archive.is/SGpyY
As an adult, teen subcultures are fundamentally obscure. It's hard as adults to say whether they're truly "fading" or whether they're simply inaccessible, which is what they're meant to be. Or both.

I tend to think it's both, and that these kinds of articles miss a critical piece of the puzzle: you cannot have a youth culture if the surrounding culture is hostile towards public spaces, third spaces, &c. One consequence of American suburbanization and car dependence has been the development of a fundamental apathy towards those kinds of third spaces.
Charles Berthoud: I got cancelled
Subcultures directly prior to the iPhone felt entirely mediated by movies, tv and advertisement. The boundaries they provided didn't match reality, they were flavors that people found themselves fit into, willing or not. But they were more consistently defined.

It only makes sense that internet influencers - who are even less aware of their role in media than Hollywood writers and massively outnumber them - have lead to faster shifting and looser definitions of subcultures.
I follow this artist for some time and this caught my eye. Maybe posting here someone else has any other idea what went wrong, but this is maybe the case of Facebook just giving it's last breaths.
Remix is really cool and agree with most of your link, but:

> Next.js is on version 13. React Router (built by the same team as Remix) has been around for much longer

this is not a selling point for me. React Router has been such a pain to deal with and upgrade, Next was much nicer to use in apps in comparison.
I apologize. I unintentionally misspoke. You are correct that BSL is a Source Available license as opposed to an Open Source license.

I don't believe the website or the Github page makes that claim.
People Buying Houses with Their Friends
I believe you just need to remove the quarantine bit. I’ve definitely been distributing unsigned utility CLI tools to people on macOS 14. They’re built via CMake and so there’s no implicit signing.

xattr -d com.apple.quarantine Foo

The author of the post even mentions this BUT they’re operating in a very weird space where they want to make a command line tool but don’t want people to use a terminal to access it.

To me it’s a nonsensical issue. I suspect the author got flustered with a set of ideals and didn’t take the necessary step back to reevaluate their situation
Together serves models optimized for inference speed.

They're not Groq but Together (and Perplexity Labs) have the lowest latencies and fastest tokens per second of any commercial services available right now. Also the lowest prices afaik.
Having fought with YAML just recently I suggest the media type application/garbage. The format is filled with strange footguns.
Obligatory "FORTH has had this for ages". :-)
Comparing Timeplus Proton and ksqlDB for stream processing
A deep dive from CTO of Timeplus.

ksqlDB is great for
* SQL Interface
* Real-Time Streaming Processing
* Integration with Kafka
* Stateful Processing
* Scalability
* Security

However, there are also limitations with ksqlDB:
* Deep Coupling with Kafka
* Heavy Resource Consumption
* Not Designed for Analytics
* Not True Open-Source

There are lots of similarities between Proton and ksqlDB. Both support:
* Stateful streaming processing
* Data persistence
* Stream/table concept
* Dual query mode, long running, unbounded push based query and bounded, pull base query
* Query Kafka data and write analytic results back to Kafka

Most features of ksqlDB can be found in Proton, while Proton offers additional benefits:
* Proton demonstrates stronger performance
* Proton is more flexible when consuming Kafka data
* Proton is purpose designed for analytic workloads
* Support complex computing by JavaScript UDF (User Defined Function)
* Proton is more developer friendly

To explore Proton yourself, visit the [Proton GitHub repo](https://github.com/timeplus-io/proton) or create your own workspace on [Timeplus Cloud](https://timeplus.com).
I logged in just to upvote this! Got a good chuckle out of me :)
Ask HN: Best AI toolset and workflows I should be using as developer
GPT4 openaAI API based or local llamas.
Web services.
What's the application of all this?

I'm definitely burned out, but my boss doesn't care, there's no way I can get a better job in this market (even if I had the energy to practice leetcode problems to prepare for interviews), and I'm not rich enough to just stop working. Therapy, exercise, and medication are only enough to allow me to keep going in this bad situation.
Training on 4096 v5es how did you handle crazy batch size :o
This was a real test. They have done this 192 times. It failed two times. The last two times. So it's not that this is inherently impossible, it's just that they can't do it anymore. I think, given the stakes, it's probably best not to just give them a pass.

Source for the number of tests: https://news.sky.com/story/trident-missile-misfired-and-cras...
Show HN: Open-Source Sora Web Client and Fake Sora API for OpenAI's Sora Model
Hello HN community,

I'm thrilled to introduce two groundbreaking open-source projects – SoraWebui and FakeSoraAPI – that are pioneering the development of the Sora ecosystem, even before its official API release.

SoraWebui: This is an innovative web client for Sora AI video generation, mirroring the functionalities of GPT clients but tailored for video content. It's designed to enable users to input prompts and generate videos. Although the actual Sora API is not yet available, SoraWebui serves as a robust framework for developers and enthusiasts to experiment and prepare for the official release.

GitHub Repo: https://github.com/SoraWebui/SoraWebui
Demo Website: https://sorawebui.com/

Experience firsthand how SoraWebui facilitates the generation of video content from textual prompts.

FakeSoraAPI: As a complementary tool to SoraWebui, FakeSoraAPI is a mock-up of what the Sora API could look like. Developed by speculating the possible request methods, parameters, and data formats based on DALL-E's interface, it stands as a provisional solution for video generation. While it can't create videos from scratch, it adeptly selects suitable videos based on given prompts, enabling a full end-to-end experience for SoraWebui users.

GitHub Repo: https://github.com/SoraWebui/FakeSoraAPI
Demo Website: https://fake-sora-api.sorawebui.com/

Explore how FakeSoraAPI seamlessly integrates with SoraWebui to deliver a near-real Sora experience.
These projects aim to provide a platform for developers and enthusiasts to engage with Sora-related technology and content, fostering a community and ecosystem around Sora before its official advent. We believe these tools will be instrumental in shaping the future of video content generation and AI integration.

We're excited to hear your thoughts and feedback and look forward to seeing how the community embraces and evolves these projects.

Best regards,
qiayue.