skysight-inc/HackerNews huggingface dataset:
Show HN: Open-source tool for data cleaning with LLM
Data cleaning is often the first yet tedious step for DS/ML/BI. It involves tasks such as deduplication, data type casting, handling missing values, correcting typos, and more.

I'm working on an open-source project that guides you through the data cleaning process. It currently supports tables in Pandas/Snowflake/DuckDB, and outputs DBT SQL/YAML for cleaning.

We take an agent approach, which is very different from Copilot. For Copilot, humans need to specify the steps, which is burdensome. For LLM agents, they handle the heavy lifting of exploring data, figuring out what needs cleaning, and guiding humans through steps.

Here is a 1-minute demo: https://youtu.be/D7jw43ccOkg

Please let me know your thoughts and feedback!
While I agree with that in principal, in talking to people who have actually written proved programs I get the impression they don't think it is practical to prove programs that are more than medium sized. I'd love to prove my code correct, but I deal with 10s of million lines of code and nobody has a clue how you would approach a problem that large (we use C++, but you can select a different language if you want - the problem is the size and you can't get around that with a different language
At 1/2000th both a running cheetah and a running squirrel are completely frozen. I haven’t yet found anything that isn’t frozen with that setting. I suspect at that point you’re in the domain of bullets, very outstretched springs and the like.

Edit: yeah, a speeding bullet caught at 1/5000th: <https://flickr.com/photos/hoohaaphotos/5587502201/>
Yeah, that is always an option. However once boiling hot, if you introduce something into the flask it's more likely to create an explosion front.
A bit like when someone supercools a bottle of water and then taps it to make it freeze; except with exploding sticky gel, and it's as hot as lava*

*Not actually as hot as lava, but wow does it feel like it
Private mission to refurbish Hubble telescope raise concerns, NASA emails show
If they are serious, then they are making the equivocation fallacy - arguing by using a word in two different ways and hoping nobody notices the mistake.

But it's likely they are doing this as a pun, where readers are supposed to notice the equivocation, and find it funny or annoying. For example we can imagine a lazy husband saying "they're called leaves, so that is why I'm going to leave them for tomorrow!" This is not a serious attempt to equivocate the two meanings of "leave" - it communicates non willingness while also causing laughter or annoyance.

An obvious equivocation is not usually an effective argument. But making it a pun can win points with a good humored audience, because they find it funny. Funny arguments can influence opinions even though we know they are nonsense.

TLDR; when people mix word meanings secretly to confuse people and win points, it's equivocation, and that's a morally bad argument and is usually unacceptable. But when people mix meanings blatantly to win points by being funny, it's a pun, and that may be acceptable in non-serious conversations.
I guess I'm glad we don't use your ear as a way to measure sound levels then because we would all be way off.

Gas-powered leaf blowers typically operate around 90-100 decibels (dB), while electric leaf blowers usually range from 60-70 dB.
Show HN: Launch your SaaS faster with human-made Django/ReactJS templates
Hi HN,

As developers, we have our go-to templates that we re-use to test out new SaaS ideas quickly without spending too much time on website design.

So I created djangoroad.com, a collection of templates such as login/signup/waiting list/home page/etc.

The templates are writen in ReactJS on the frontend and Django REST on the backend.
Oh wow, reality comes knocking just when I stopped laughing about China and their silly distorted reference system! https://news.ycombinator.com/item?id=40220072

From my armchair I recommend an automated edit at unprecedented scale: Apply tectonic shift to all nodes every year. This would allow keeping WGS84 while keeping the map closer to the present.
Having ten years of therapy and then spending three and a half years to get approval for euthanasia…I can only empathize without knowing the depth of her suffering. Based on the description of her experience, some laws related to privacy of the individual choosing euthanasia may be helpful. Not surprised, but it did sound atrocious that many people around the world — who didn’t know her — believed and decided that they know better about what she ought to do.
Ignoring what someone puts on a stage would be uncivil.
Congratulations on launching the project!

Making a programming language is a great way to better understand computation and start to explore different means of expressing concepts in code beyond those available in existing languages.

Programming languages are a difficult concept to get one's head around. Having one that implements a lexer, parser, and execution engine -- and is packaged as a resource for others to use -- is an impressive technical feat.

Writing a guide so others can learn is doubly impressive.

Asking a question like "How exactly do programming languages work behind the scenes?" is a great quality to have in your creative pursuits. Not to mention that such questions are the basis of HN: journeys that satisfy our creative curiosities.

Keep making cool things!

---

One piece of feedback: I find the size of the code instruction boxes on the page a bit small. There are no visual indicators that I need to scroll down to see all of the code. I would love for the boxes to be taller so I can read the code and retain all the context without scrolling.

---

Another idea: You may enjoy writing a post about what you learned making the language. What did you find more difficult than you thought? What challenges did you run into? How did you solve them? Why did you choose the syntax you used?

I love reading about the how behind cool projects :D
Yeah, like I said it’s a trickle at this point.
Plot isn't locked into the Observable ecosystem at all - it's a JavaScript library that you can use independently of everything else there.
Related, here's a neat discussion about how this poisons Big O notation: https://news.ycombinator.com/item?id=38337989
These... weren't necessarily the same people.
Four. As in a European study, price competition requires four significant competitors.[1] This should be a basic rule of antitrust regulation.

[1] https://www.techdirt.com/2024/05/16/report-sprint-t-mobile-m...
Thoughts on Dopamine Culture
you forgot the /s unless you really are a wackjob.
Bingo. They do. Apple bought Intel's modem unit but they still use Qualcomm modems.

https://www.theverge.com/2023/9/21/23883565/apple-5g-modem-f...
What are HN's guidlines on young people mentioning their age in a Show HN like this post here? Should we take it graciously, admit they are young and encourage them for what they did or should we point out not to mention their age?

IMO, if we take the age out, some of show HN's might not look very interesting. Same goes for a Show HN where someone mentions they are not a programmer and yet built a thing.
I actually miss the stretchy shrink wrap, it was pretty useful in daily lab life
I was with you until:

> just as one doesn't read Huxley or Cervantes while on the beach.

Why not? And anyway, which Huxley?

:-)
AI-balloon pops, Pasteur fights H5N1 in cattle
ahh, little Bobby tables...
UHD Blu-ray Denies Your Freedom
> Your algorithm is a reflection of you.

This is objectively false. "The" algorithm is designed to maximize engagement - so you will be shown content you are most likely to watch, click, listen to the most. As it turns out, "Outrage Porn" is highly engaging...

Scroll through enough YouTube Shorts, and just like TikTok, your "algorithm" slowly but surely reduces to outrage porn. All paths lead to outrage porn. All of them...
Bad Arguments Against Funded Desertion
Do you have some data to support the position that foster care is at best inadequate? Do you have data to support the position that mistaken child removal is as widespread as even e.g. child abuse within the foster system? Finally, do you have data that illustrates how often children are relocated to strangers' houses, vs. with family members?

I absolutely agree that every time a child is abused in foster care, that's a damning failure of the system. But I do not share your belief that children who experience sufficient abuse to be removed from the home are permanently broken. Nor do I share your belief that the foster system is at best soul-crushing.
This is a story that's just begging for more detail
OP here. I have no idea. It's really annoying. Now there's at least 3 variations of "Sabrina Ramonov" on X, all banned.
Pricing is going to depend on the product. For my SaaS I ended up going with usage-based pricing and am quite happy with it.

1. It aligns to my costs, so I'm not too worried about abuse.

2. It allows servicing "small" users, there is no need to jump onto a recurring plan. You can just buy one package of "credits" and use it for years (or even just coast quite a while on the free trial).

However I think there are downsides with the usage based pricing as well:

1. It discourages using the service. If each use costs money it is a small hurdle to clear. Even if it is cheaper most users will "feel better" with unlimited or pre-paid packages as they are using what they paid for.

2. Predictable cost to the user.

3. Can often be more profitable, especially for small users.
Oh so its the same as regular search then.
When the doctor asks you to rate your pain and tells you a 10 is "the worst pain you've ever felt", that's effectively meaningless. An objective scale is needed. I've never broken a bone so I don't know if diverticulitis is more painful or less, but I would imagine that being doused in kerosene and set on fire would be a lot worse.
> No machine today can do what they did all that time ago

They definitely can, just no one wants to pay for it. We can build massive buildings, huge bridges, bore through mountains, dam hundreds of millions of liters of water. We can stack some heavy rocks on top of each other.
That is interesting. I wonder if L1 is denser because it has to have more bandwidth. But doesn't that point to a space constraint rather than money? A combination of L1 & L2 will have a bigger capacity so it would be faster than pure L1 cache in the same space (for some/most workloads)?

I always thought cache layers was because of locality but that is my imagination :) The article talks about different access patterns of the cache layers which makes sense in my mind.

It also mentions density briefly:

> Only what misses L1 needs to be passed on to higher cache levels, which don’t need to be nearly as fast, nor have as much bandwidth. They can worry more about power efficiency and density instead.
I wonder how this is going to play out. At a company I previously worked for, we ended up not rolling out personalized on-site search because while the results were better in theory, in practice it was so slow nobody wanted to use it.

Then again, Google is so dominant that many folks won't quickly bounce to an alternative...
I labeled it choke because it just stopped.
Point out that you haven't asked them for any kind of compensation so their paranoia is misplaced, and tell them that if they continue to blow it off you're just going to publish the information including their name.
I'm somewhat amazed at how relatively recent UTF-8 is and how many much more recent software isn't UTF-8 by default.

Aside: I still hate that MySQL's "utf8" encoding isn't.
haha that's neat
> Well, yes, but it's advertised as "replacing million-dollar missiles" which is just false.

it could replace in that specific scenarios: fighting against cheap but slow drones.
The issue is rotation of the sky about the line of sight axis. Whether the exposures are short or long, over time the sky will rotate more than what an in-camera system can compensate for (the amount of rotation depends on location/time/direction). Over these timescales a rotator that can perform larger movements is needed. This can be provided by an equatorial mount or an internal rotator.
Ah, Edge/Bing went through this phase recently. A split personality, where sensible stuff appeared on the left, and Copilot laboriously typing on the right. I disabled it, really did not add anything to the experience.
Prison labor is unethical.
I don't want to hear any of these stories, considering I am a very clumsy person AND considering that I synthesized polycyclic aromatics. Thank god I got out after a couple of years, but sometimes I wonder what is still floating around in my DNA...
I'm not saying it's right or shouldn't change but calling it a loophole like it wasn't directly intended is strange.
I don't have examples, as the OSS code bases I can find either A: Don't have practical examples, or B: Use RTIC or Embassy.

Here's what happens if you leave out the RefCell:

TEST.borrow(cs).replace(Test {});

error[E0596]: cannot borrow data in a `&` reference as mutable

If you use Option on the outside, I'm not sure how to then set or access the variable:

static TEST: Mutex<Option<RefCell<Test>>> = Mutex::new(None);

What would you recommend as an alternative? Use case: Sharing state between interrupt handlers and similar.
I think it was sarcasm...or just the word being misused.
That does not matter one iota. Google's goal since they bought doubleclick has been to serve more ads and make more cash, and everything is subservient to that goal. If serving more ads reduces the user experience, they will not choose to stop serving those ads, they will choose to reduce the user experience.

Companies are not democracies. If every single dev thinks that the user experience matters, but the CEO wants more ads, you will get more ads. It's literally a tyranny.
I didn’t understand why you put a sad face/frowny at the end of your last sentence. IMO, granting the freedom for people to choose to die (with checks and balances) is a good thing. I’m sure there will always be debates on whether the approval for one person was correct or wrong. The discomfort that most people have about other people dying cannot be easily alleviated.
Parafilm? 100% agreed. I’ve thought about buying a roll, which will probably last me for a lifetime. One of these days, maybe.
This isn't even about "happy users", though; it's about money.

Where does Google's ad revenue come from if users give up on waiting for their searches to complete before they're ever shown any revenue-generating sponsored links?

Actually, thinking about this more, I fundamentally don't understand Google's search experience strategy over the last 10 years. Even before AI answers, they were heuristic-ing answers into a little box that pushed sponsored ad placements below the fold. Why push sponsored results below the fold? How does Google make money from a search engine that just answers people's questions directly, rather than doing lead-gen for the rest of the Internet (with much of the Internet willing to pay for that)?
Microsoft's custom Cobalt chips will come to Azure next week
I guess the point is that saying you are a teenager in the title can seem like an unfair way to game your post ranking by garnering awe/sympathy.

Lots of middle aged people build cool things too, but they can't pull the age card to boost their rank on the front page (at least, not until they are at the other extreme - like 80 or 90 years old)
Similar to the article, I haven't found complementary image data to be that useful. If the information is really missing without the image, then the image is useful. But if the basic information is all available textually (including things like the code that produces a diagram) then the image doesn't seem to add much except perhaps some chaos/unpredictability.

But reading this I do have a thought: chain of thought, or guided thinking processes, really do help. I haven't been explicit in doing that for the image itself.

For a problem like this I can imagine instructions like:

"The attached image describes the problem. Begin by extracting any relevant information from the image, such as measurements, the names of angles or sides, etc. Then determine how these relate to each other and the problem statement."

Maybe there's more, or cases where I want it to do more "collection" before it does "determination". In some sense that's what chain-of-thought does: tell the model not to come to a conclusion before it's analyzed information. And perhaps go further: don't analyze until you've collected the information. Not unlike how we'd tell a student to attack a problem.
AI #64: Feel the Mundane Utility
DuckDuckGo?

Useful trick with Google for common searches: add

-"best"

Kills most of the clickbait.

Bing, unfortunately, does not have "-" exclusion.
Tactical Ops. Was that the game with … ?

- Steven Seagull
- Sylvester Stallion
The cafeteria ladies?
Luckily I've been out of that particular game for a few years, but it's good to know that less questionable options are available
What if they’re even older than 11.5ky? Neanderthals had larger brains and have been around for half a million years
Yes. Perhaps this is a performance choice for DataScript since DataScript does not keep a complete transaction history the way Datomic does? I would guess this helps DataScript process transactions faster. There is a github issue about it here: https://github.com/tonsky/datascript/issues/366
Correct me if I'm wrong (I've only dabbled in F* and only briefly read about 1ML) but wouldn't F*'s full dependent types make 1ML redundant?

That is, once you've brought types into the value level, modules themselves become redundant - they're just records, and functors are just functions. The point of 1ML, IIUC, is to accomplish a similar unification without demanding full dependent types and the attendant complexities they bring.
Taxing people who own multiple homes and taxing people who own apartment complexes are two completely different things and shouldn't be conflated.
I'm still obsessing about that one. If you read a byte, there's one or two unlikely branches and then a tail call to one of up to 256 distinct subsequent states (or equivalently a read of a table of size up to 256). If you read two bytes, up to 64k subsequent states.

I suspect that reading multiple bytes is faster when the number of distinct subsequent states is smallish, and reading one byte (or maybe even four bits) is faster if the number of distinct states is near the upper bound.

It's also relatively likely that optimal involves reading N bytes, where some out edges consume N and others consume fewer than N. E.g. check eight bytes in case they all match some literal sequence you're scanning for, but if they don't, branch on the first two bytes from that word.

This has really strong rabbit hole vibes to it. What exactly is the right cost model for the target architecture, how should one trade icache for dcache, can any of the branches realistically be predicted for the distribution of input data and so forth. Also how many cycles should go on perfect-hashing the input byte(s) before the transition.

But even if you stick with re2c style read-a-byte-then-switch, and compile with something that knows how to do tail calls for your architecture, the code is going to establish a pretty solid performance baseline. Quite a lot of mispredicted branches but no syscalls, no stack or heap usage.
I don't know if you read the lawsuit but, if the statements provided are true, Texas CPS exceeded any reasonable definition of appropriate behavior. The child was deemed not abused by multiple doctors as well as Oklahoma CPS. Texas CPS proceeded to take the children away from their parents and placed them in foster homes despite the standard procedure dictating they be placed with relatives. The actual behavior of the Texas CPS agents was also egregious.
The main thing you actually want from zoning is to separate noxious/industrial uses from everything else. Houston is weird if it doesn't even do that. None of that other stuff is a problem. Living in a single-family home next to an office tower isn't any worse than living in a condo tower next to an office tower. People just aren't used to it because it's prohibited nearly anywhere else.
confirmed worked for me first try

EDIT: out of 3 times, got it correct 2/3
Extra-terrestrial life does not mean Alien Vehicles at super-light speed darting in and out of the atmosphere or nerosphere. It means looking for signs of life forms on other planets or planetary systems. We could have alien life on Mars, Io, extra-solar planets, etc. They search for that.
I read this title and instantly related to it from the business owner / SEM / SEO perspective

Google controls 90% of search and that's where most consumers start their journey

The current state of the union with Google for businesses, especially small business / local business, is a disaster

- Bidding on your own keyword, to prevent competitors from showing up as #1 - currently consumes 15 - 25% of total paid budget across a number of businesses we own. It's literally just a 1@%!@% tax.

- Google constantly rolls out tests in the name of "quality" - recently for local businesses "hours of operation" became a search signal. Pragmatic enough right? But instantly the spammers started doing 24/7 hours with fake phone numbers etc registered. The road to hell is paved with good intentions they say, this is a constant theme with Google where they come up with some great idea, and then can't figure out how to defend vs the spammers creating massive headaches, costs, etc.

- Google continually takes away visibility and contrl. EG their new AI budget manager takes further visibility away. Right now it drives a little efficiency. But when everybody has it? It will optimize SMB (and everybody else) to the fracture line.

And NOW we are going to spend our precious life trying to figure out how the !%!@ to engage with an LLM (that Google doesnt' even understand)?

I just want to give up.

Honestly it's no wonder that private equity is gobbling up everything from dental practices, to plumbers, to HOUSING

It's become such a crazy sophisticated game that nobody else can play and survive
Would love if this could be built into a website that could analyze the distortions on any city automatically. probably a lot of issues getting an normalizing the data though.
Is there any way to use the usb-gadget-mode to have a Linux machine become a webcam?
While I agree with the general message, I find it ironic that the author laments about Google wasting his time, yet wastes my time with two popups, one of which is extremely obnoxious, while simultaneously downloading 10s of JavaScript files and a needlessly large yet compressed-to-hell GIF.
It's funny, that for a while I would setup windows and create the first user with my desired username, then rename to my proper name. Mostly because of this kind of issue.

Worse, is that with the "windows account" bs, my email starting with me@mydomain, the username directory is "me"

edit: One minor tip, I'll always make my home directory in windows my first quick access shortcut in the side bar, and my wsl home directory the second.
I continue to wonder about the economics of stuffing AI into everything. Compute isn't free - how are Google and Microsoft going to recoup the costs of running these models for every search?