skysight-inc/HackerNews huggingface dataset:
Show HN: Empirical – test framework for JavaScript developers building with LLMs
Hi HN!

This is Arjun and Saikat, and like other product engineers, we've been excited to build with LLMs. Getting powerful models available as off-the-shelf HTTP endpoints is a huge leap forward to integrate and ship ML to end-users.

While building on top of LLMs, we've also experienced the pain of non-deterministic behavior – especially for applications that require smaller models. Iterating through model configuration while ensuring no regressions across hundreds of scenarios is a tricky balance.

To make this easier, we built Empirical. Here’s a demo video: https://www.youtube.com/watch?v=p8gSGphcOSU

We've focused on:

- Fast iteration cycles and interactivity when you need to change the prompt or add a new sample. We wanted to build something that feels like “hot reload” for LLM development

- A capable UI that combines objective and subjective evaluation, since eye-balling outputs makes it easier to build intuition around model behavior

- Ability to customize which model to test, or how to score it
— with JavaScript (or Python, if you really must)

- Embedded analytics for evaluation results, powered by DuckDB under the hood (more coming up on this!)

You can try Empirical today – with a one line CLI command – locally or on CI/CD. And oh, Empirical is 100% open source – so file an issue and we’d be happy to make it work for your use-case

$ npx empiricalrun

GitHub: https://github.com/empirical-run/empirical

Docs: https://docs.empirical.run/
I appreciate "autumn" for it's lack of ambiguity, but "fall" is easier to say.
> "...Russia has publicly claimed that their satellite is for scientific purposes,” she said.

> “However, the orbit is in a region not used by any other spacecraft — that in itself was somewhat unusual. And the orbit is in a region of higher radiation than normal lower Earth orbits, but not high enough of a radiation environment to allow accelerated testing of electronics as Russia has described the purpose to be,” Stewart elaborated.

Polluting orbits could immediately nullify commercial, safety, and military defense intelligence capabilities of all space operating world powers. Bad stuff.
>there's nothing you can do to take it back

Given the fact that many, many people make their software MIT licensed (or rather, do whatever, I don't care license), I think most of us will be ok with that :)
Some here may find Pete Walker and his work around "C-PTSD" useful.

https://pete-walker.com/fourFs_TraumaTypologyComplexPTSD.htm
true, but as long as we're talking about a democratic society. it would be improbable that kind of people decide on a counterproductive system.
What I want to know is, what is the maximum size of a PHP file that can be loaded?

I guess I can TIAS but is it documented anywhere ??
Show HN: LLMArena – Create and Share Beautiful LLM Comparisons
I don’t think comet brightness is an indicator for dangerousness.
You don't seem to realize the Amazon and Rio Grande do Sul are on opposite sides of the country.
A lot of my right of center friends have seemed to justify drug use just fine these days.
> They keep customers to donate money and then donate the money in the businesses name and get a tax write off

False if you Google search the claim. https://apnews.com/article/fact-checking-000329849244 “ Stores can’t write off a customer’s point-of-sale donations, because they don’t count as company income, according to tax policy experts. Customers can write off their own donations if they choose.”
I don’t deny that, I’m just clarifying the OP that relates the issue we’re seeing “now” to the invention of fentanyl. It’s more complicated than the presence of the drug, like you said it relates to the changes in usage, irrespective of when the drug was invented.
you can use Kotlin in a Maven project as well (configuration here: https://void2unit.onrender.com/post/multimodule-maven-java-k...) or maybe your request is what triggered Jetbrains to develop Amper (https://blog.jetbrains.com/amper/)
My hope is that people move away from email as they get tired by it, and towards more convenient instant messaging platforms which pretty much get the feature set right (attachments, encryption, blocking/spam provisions, provenance, "stories" and special group chat modes for broadcasting) and for which open protocols arise ((are being forced by the eu)): https://www.theverge.com/2024/2/6/24063705/whatsapp-interope...

In the future, I hope that email will be like fax, or at least treated like http in comparison to instant messaging (https).
Free List of 2k VC Contacts Investing into SaaS Startups
How to choose your sources and inputs
Oh, right. Their word for "fall" is "spring" ;)
> At what point does NASA need to pull the plug on Starliner...

At this point, I assume they're not doing so as a punishment. It doesn't cost NASA much to keep Boeing's feet to the fire here.
Meanwhile use phind
An ancient Indigenous lagoon system brings water back to a dry town in Ecuador
- the message being pushed is "India is le bad. sic 'em!"

- it is being pushed by the usual suspects. https://en.wikipedia.org/wiki/CIA_influence_on_public_opinio...

- the reason for the push is India's neutral stance on the oh so important outbreak of tribal warfare happening half a world away in Eastern Europe.

there was a whole barrage of negative hit pieces about India at some point in the past two years, right after their public refusal to stop buying Russian oil or something. I assume something similar happened recently.
I initially mis interpreted the title as "... outpaces daily drinking OF WATER" and was stunned.
I'd believe it as an American, but would like to read a similar article for US threats outside the country. Travel ban / watch list is the main one I'm aware of. Haven't heard about intimidation of family members yet.

I did pull this one up from a Google search:
https://fair.org/home/us-censorship-is-increasingly-official...
More censorship, than intimidation.
Hello. Author of this 17-year-old blog post here. I was a little shocked to find this throwaway post from my ancient history making HackerNews today and I just want to make a couple of notes:

1. If I were to write the post today, I would draw a comparison to Bryan with Oil Companies disputing the science of Global Warming. Global Warming is real, but Oil Companies attack the science when really they disagree with the policy conclusions being drawn from the science. I also see this with modern nutrition, where companies producing unhealthy food are flooding the world wide web with attacks on the science to convince people to keep consuming their products. Bryan was doing the same thing. He abhorred eugenics, but rather than attack the policies, he attacked evolution as a science in the courtroom. That is what he is remembered for and there's a history lesson there that's going to repeat with these modern examples of anti-science.

2. I apologize for the formatting. I upgraded Wordpress and PHP three months ago and lost all formatting on all my posts and the images are messed up. So it's hard to see that much of this is a direct blockquote from the science textbook being referenced. I believe science is real, but I keep a copy of that textbook on my shelf to remind me of how science can be used to justify horrific public policies.
Would maybe Whisper speech recognition be a simpler setup?

Or here's a giant keyboard: https://www.whiteclouds.com/blog/giant-computer-keyboard-pro...

DIY version: https://hackaday.com/2022/08/27/giant-keyboard-is-just-our-t...

For a software keyboard, I think the usual term is "onscreen keyboard" and most operating systems have one built-in somewhere. You can probably configure Autohotkey to function similarly.

The Xbox Adaptive Controller might be a source of inspiration: https://www.xbox.com/en-US/accessories/controllers/xbox-adap...

If you can't map everything to a button directly, maybe using different modes/chords in combination with an on-screen keyboard could work? It would likely be a lot slower than regular typing though.

Have you already tried different ergonomic keyboards, such as softer switches, split layouts, curved or vertical layouts, etc.?
Some thoughts on how to make better choices when it comes to information consumption.
The choice is between:

* be completely autonomous from day 1, and progressively increase the number of situations you can drive through;

* or drive through every legal situation from day 1, and increase the % of them handled autonomously.

I believe the 2nd approach, Tesla's, has one key advantage: it collects data about freak situations much faster and more exhaustively. Given how data has become the key resource in AI, that's probably a very strategic asset they've accumulated here.

Also, Waymo's joker (remote operation by humans when the software bails out) is totally replicable by Tesla robotaxis.
> Wake me when it's brighter than the sun.

I doubt we'll need to.
Honestly at this point we could have just had standardized infrastructure for self-driving vehicles to guide them along the road.

We had government programs doing exactly this until republicans gutted them.

Would have been more stable, cost-efficient, safer, and it'd actually exist today.

The reality is that there are fundamental, unsolvable problems with the current "self-driving" stack. From the cameras to signal processing.

Everyone involved in this space has been repeating the same thing since basically the early 2010's.

Just stop pouring needless amounts of money into these projects that have offered very little fruit. Build the standardized, simpler infra with the money and fund trains while we're at it.

Stop this non-sense.
Call it "typebash" - easily understood by everyone
Probably to be expected, after years of suppression usage spikes, then comes back down to 'normal' levels once people decide the like or hate it.
It all depends on how much ice is in the comet.
Is there a library for creating SVG animations with Python?
Not really. You just need good data or approximations of the data. Then just compute.
> AGI or the AI sota.

Soma? Soda? Sofa...?
China sanctions Boeing, two U.S. defense contractors for Taiwan arms sales
Sadly not in Vancouver :( All my memories of it bring good were from when I lived in Ontario though, it could be a regional thing too.
I don't think that is what they were implying. Conservatism tends to be about not changing or considering new things. It tends to be more "I was raised that X was wrong, so X is wrong". (It is how I was raised for sure.) So, if a historically conservative person tries weed and it doesn't turn out to be the all encompassing evil they were lead to believe, it may open them up to forming new personally verified opinions on other issues too.
How're they running a sleeker operation by paying for renovations that do nothing to increase business?
I think another problem with the artificial noise is that one hears it only when the vehicle has started moving. Before that it is completely silent and gives no advance warning to the nearby pedestrian like an ICE car does.
Suspected it was the 990 char limit per line but this is another one. I assume this is an old system? Despite many claims about “best practices”, there were definitely past platforms where these didn’t exist and a minimal implementation was safer just because you knew the scope of error.

Of course if it was modern, different question.
I wonder how much of that smell comes from night-shift workers, for whom it's their "evening downtime" period.
Strongest Solar Storm in 20 Years Did Little Damage, Worse Space Weather Coming
Yep sounds awful.

Every listened to the political opinions of a stoner? Theyre typically exceedingly dumb.
The US will rather fight a nuclear war than introducing useful units. But Russia and China might be up for that challenge.
I haven't seen a mention of the Oil Shell (https://oilshell.org) project's OSH/YSH yet and I'm quite surprised.

Oils goal is that OSH is just a new Bash implementation (although not bug-for-bug) but with an upgrade-path to the more modern YSH for real programming with type safety etc, but still as a shell language. One of their exciting ideas is using code as data in a somewhat lisp-like manner to allow function introspection in YSH etc.

Based on other comments it seems like Oil Shell is much more principled in working to actually understand Bash as it exists and presenting an alternative language. I would be interested in what differentiates Amber and whether they have a response to Oils?
Mm. But fascists, authoritarians and populists get things done, because of alignment, obedience and because they have less regard for legitimate objections or the law.

I think if you could separate out what Modi has done for India's national pride and infrastructure from what he's doing to the rule of law, and have the former without the latter, everyone would be happy.

(You can make this point about almost any very populist leader)
Incredibly well researched and annotated. A tidbit that struck me was that not only did Kodak produce the first digital camera in 1975¹, they had a product in the form of a digital spy satellite in 1976.

1: https://petapixel.com/2010/08/05/the-worlds-first-digital-ca...
Different strokes. Something about smoking a specific hybrid strain helps me focus and keep my energy level way up so in the morning when I know ill have a busy day, I have coffee and a joint.
it's not the stone that shines, but cloud around it

and we can't even precisely predict cloud formation more than week or two in advance right in our face - on Earth

so no wonder comets are unpredictable
> TF-IDF

"Term Frequency - Inverse Document Frequency" apparently: https://www.learndatasci.com/glossary/tf-idf-term-frequency-...
Yes, Yoto! It’s not just for (kids) audiobooks, they have music cards too. And you can upload your own MP3s to their blank cards, or use it as a Bluetooth speaker.
Look up “Ferguson effect”. Regardless of police budgets, policing in the USA has taken a step back in the last decade and reduced enforcement.

The result can be seen everywhere - more car crashes and deaths, speeding, homicides, car theft, and also in smaller ways like subway turnstile jumping and loitering.
> The sun does not rise.

Wow, pedants going to pedant, even so early in the morning. From the perspective of an observer on terra firma, the sun absolutely rises in position relative to the horizon. The actual causes of that doesn't mean that the sun is physically moving but is only the result of the earth's rotation has diddly squat to refute that to that observer, the sun is in a higher location as time passes until it eventually, wait for it...sets. Oh no, the horror to a pedant that we've now said it not only rises but sets too! Run away! Run away!!!
> [1] - Templating systems themselves are thus a mistake belonging to this class

This is not universally true.

JavaScript has an amazing feature called tagged template literals which let you tag a string with interpolations with a function that handles the literal and interpolation parts separately. This lets the tag function handle the literals as trusted developer written HTML or SQL, and the interpolations as untrusted user-provided values.

Lit's HTML template system[1] uses this to basically eliminate XSS (there are some HTML features like "javascript: " attributes that require special handling).

ex:

html`<h1>Hello, ${name}</h1>`

If `name` is a user-provided string, it can never insert a <script> or <img> tag, etc., because it's escaped.

There are similar tags for SQL, GraphQL, etc. Java added a similar String Templates feature in 21.

[1]: https://lit.dev/docs/templates/overview/
And why is it using [ instead of bash native [[
A full circle, re: Opium Wars https://en.wikipedia.org/wiki/Opium_Wars
That's the needle moving.
The best local investment one can make is in the land. I'm in a rural area in the Pacific Northwest, surrounded by "baby" trees and the skeletons of the old forest that used to be here. The list of foods that indigenous peoples used to eat around here is long, and I would be happy to thrive on that alone. Now, though? There are a few huckleberry spots within walking distance, some mushrooms now and then, elk of course (I get why people pen cattle, but elk and other game require much less maintenance, along with some effort and consideration when hunting), some greens (I've been eating nettles for the past month, on top of good grown elsewhere thanks to petrochemical fertilizers), some invasive greens (dandelion and oxeye daisy), and probably some things I'm not yet aware of. I'm not fishing the river, as there's not much fish there anymore.

The best investments we can make for life is towards community and the land we're on. I don't need an easy life, I need a meaningful one.
What's worse: what drinking does to your liver or what smoking does to yours lungs?
I'd expect a commodity like charging to be a very tough sell in the stock market. Turns out charging is actually not easy, and having boots on the ground in lots of places where people actually want to charge makes a formidable moat (booths on the ground, if we stretch the term just a tiny bit). But I don't buy into any claims that this was a planned outcome from the start. It's not failure when you do something well and stumble into something better while doing the thing you set out for. Not everything is Bezos launching "anything that has a GTIN and fits in a box" with the subset where the number happens to be ISBN.
Launching the First-Class Windows Project for OCaml
People seem to think you're joking, but I think you're spot on.

Putting it in the best possible light, Tesla represented a bet on developing both a new carmaker and the dominant car of the future: electric and fully automated. That was a big gamble, and it required gobs of money. Existing carmakers could try to-self fund that, Tesla couldn't. So Musk, marketer extraordinaire, built up a Jobsian reality distortion field around Tesla. He made his cost of capital incredibly low by hyping the stock to the moon.

If the bet pays off, Musk will historically be seen as a genius. But if it doesn't, he'll be seen as a fraud who milked credulous investors for a project that was never going to work out. And I think that's true even if he ends up with a modestly successful niche carmaker. Many others would see that as a huge accomplishment, but it'll be so far short of what investors thought they were paying for that even visions of an automated future won't make up for their large losses.
Maybe it's targeting that ancient GPLv2 bash (that MacOS still ships for ideological reasons).
Very few people live in the southern hemisphere compared to the north.
Reading through that... seems incredibly vague and provides ample opportunity to selectively enforce at a whim. Seems like a bad omen for the AI industry (at least in CA). Imagine what they'll do when some nut job asks an open source model how to make a fertilizer bomb.
Because progress in AI depends on a great dataset. A dataset that does not exist in the public domain. And the progress in AI is worth too much to stop because laws are not enacted yet. My quality of work has improved significantly since having access to chatGPT4. And this has improved by leaps again since chatGPT4o.
If you do drugs, you think politically left?

Those who think politically left do drugs?
It wasn't called Symbian yet, so I was surprised to find a reference to .sis installation packages in settings.
I have no idea what the visualization means.
Slack Built Distributed Cron
Are apps better than web apps for digital customer targeting (2023)
How to kill the 'zombie' cells that make you age
Yes, I agree with this poster. Just buy your child an MP3 player, they are still made today and lack internet connectivity. You can buy songs on BandCamp, download the files, and then throw songs on the SD card.
The article is not implying he was ever truly honest. It just saying we have more evidence of his “inconsistent candor” mentioned in his firing letter.
I'd just note that there are readily available non-smoking forms of marijuana.
That using marijuana would make someone more left is a logical non-sequitor and, I feel certain, not empirically demonstrated, at least not rigorously. And the fact that you'd want to live in a world where consuming different substances was what dictated people's beliefs is baffling to me. Think of the consequences.
Hard to know if you're being sarcastic or not. I'm not a fan of how they handle FSD marketing, but they are very good at automating car manufactory. I believe they are more or less the only company that can mass-produce EVs at that scale _for a profit_.

The traditional car brands are losing money on EV's and/or can't scale the production up enough. BYD is probably the only other manufacturer that can compete with Tesla on scale and cost.
Thank you! To me, this is a great example of how to read papers. I think I skimmed that section a couple of times after writing the comment and it didn’t register.

Thank you for making the connection.
Yeah, that's not enough though. You should be able to toggle in settings what apps (or even documents/websites) it is allowed to look at. Otherwise, most people are never going to use it for their personal lives. Even as a business, I wouldn't trust it without those controls.
I don't actually have this, but the simplest thing (in my head) isn't possible natively in any tool I've used: I just want to report on "we did what we said we would do". That is:
- What did our team agree to do in the sprint (added to sprint at planning)?
- What got deprioritized (moved to backlog)?
- What got introduced during the sprint (added to sprint mid-sprint)?
- What got completed?
- What rolled over into the next sprint?

Obviously, I can audit every single story that was modified during the sprint, and/or make spreadsheets or custom BI reports, and stuff... but I don't wanna!
Ah got it. I'm currently training for PPL so have been studying this among other things.

Entropy causing gasses to mix evenly is true... on a large enough timescale.

In reality any gas or fluid will form boundary layers between masses of the substance having different temperatures, moving at different speeds, or having other properties (eg salinity for a liquid).

When flying you can end up passing through these discontinuities - regions where the air is very turbulent on both sides of the boundary. You can also develop different amounts of lift in one air mass vs another due to density. The entire air mass itself may be moving in a different direction and/or at a different velocity on one side of the boundary vs the other.

In a small airplane the effect is more pronounced. On a bright sunny day near the ground I get negative G when passing over a small bit of water followed by positive G when passing over a hot parking lot. It is very obvious where there is a region of hotter less dense air rising vs cooler more humid air.
In America, Autumn is reserved for the name of daughters of hippies after they've already used Sunshine and Moonbeam. Also, the punchlines aren't as funny, "did you have a nice autumn?" when someone trips.
The stylish Node.js middleware engine for AWS Lambda