MurphyA/hacker-news huggingface dataset:
Nvidia open sources the synthetic data framework used to build Nemotron datasets
by alexwatson405 | 2025-12-03 16:02:01+00:00
NVIDIA just open sourced NeMo Data Designer, the synthetic data framework used internally to build both pre-training and post-training datasets for Nemotron.

It lets you define an entire synthetic data pipeline directly in Python: structured outputs, statistical samplers, LLM-generated columns, dependency-aware field relationships, Python/SQL/remote validators, and optional LLM-as-judge scoring. Supports quick preview mode for fast iteration before scaling up.

Install:

``` pip install data-designer ```

A minimal example:

``` from data_designer.essentials import *

data_designer = DataDesigner() config = DataDesignerConfigBuilder()

config.add_column( SamplerColumnConfig( name="product_category", sampler_type=SamplerType.CATEGORY, params=CategorySamplerParams( values=["Electronics", "Clothing", "Home & Kitchen", "Books"] ), ) )

config.add_column( LLMTextColumnConfig( name="review", model_alias="nvidia-text", prompt="Write a short product review for a {{ product_category }} item." ) )

preview = data_designer.preview(config_builder=config) preview.display_sample_record() ```

This release also incorporates the synthetic data tech my team originally built at Gretel (now part of NVIDIA), now generally available for anyone to use or extend.

Repo: https://github.com/NVIDIA-NeMo/DataDesigner
by TheOccasionalWr | 2025-12-03 16:02:04+00:00
I'm not sure what you mean with the "code snippets are straight out of Stackoverflow". That is factually incorrect just by how LLM works. By now there has been so much code ingested from all kinds of sources, including Stackoverflow LLM is able to help generate quite good code in many occasions. My point being it is extremly useful for super popular languages and many languages where resources are more scarce for developer but because they got the code from who knows where, it can definitely give you many useful ideas.

It's not human, which I'm not sure what is supposed to actually mean. Humans make mistakes, humans make good code. AI does also both. What it definitely needs is a good programmer still on top to know what he is getting and how to improve it.

I find AI (LLM) very useful as a very good code completion and light coder where you know exactly what to do because you did it a thousand times but it's wasteful to be typing it again. Especially a lot of boilerplate code or tests.

It's also useful for agentic use cases because some things you just couldn't do before because there was nothing to understand a human voice/text input and translate that to an actual command.

But that is all far from some AGI and it all costs a lot today an average company to say that this actually provided return on the money but it definitely speeds things up.
by Naillik | 2025-12-03 16:03:18+00:00
Part of the issue is that larger vehicles are “safer” for the person driving them, so long as their crash partner is smaller. Larger vehicles are more likely to “win” crashes versus smaller vehicles and pedestrians, at the expense of being more likely to be involved in crashes and more likely to cause fatalities when they do.

It’s not just about how safe it is for the driver or passengers of the vehicle, it’s about the impact of those design choices on the safety of everyone else on the road.
by marcosdumay | 2025-12-03 16:03:44+00:00
Trading on inside information has that causality going on the other direction. It's them picking what stocks to buy depending on what laws are being most argued for/against. Every stock looks the same from their POV, and there's no reliable mechanism for making them prefer one law over another.

The GP is right. It's campaign contributions, career rolling doors, and direct payments that make them pick one law over another. Inside trading only let them directly steal money from the population with no strings attached.
by soiltype | 2025-12-03 16:03:46+00:00
No, the edits are better. The original message made unwarranted assumptions, and used intentionally inaccurate language. That's objectively bad communication.

It's not a binary choice between insults (escalates conflict, destabilizes rational decision making) vs hiding your opinions. That's what the word tact is for. It's simply, quite literally, a skill issue if someone can't find a middle ground between those two failure modes.
by jeroenhd | 2025-12-03 16:03:51+00:00
The actual source (https://store.steampowered.com/news/app/553850/view/49158394...) says:

> Only a few seconds difference?

> Further good news: the change in the file size will result in minimal changes to load times - seconds at most. “Wait a minute,” I hear you ask - “didn’t you just tell us all that you duplicate data because the loading times on HDDs could be 10 times worse?”. I am pleased to say that our worst case projections did not come to pass. These loading time projections were based on industry data - comparing the loading times between SSD and HDD users where data duplication was and was not used. In the worst cases, a 5x difference was reported between instances that used duplication and those that did not. We were being very conservative and doubled that projection again to account for unknown unknowns.

> Now things are different. We have real measurements specific to our game instead of industry data. We now know that the true number of players actively playing HD2 on a mechanical HDD was around 11% during the last week (seems our estimates were not so bad after all). We now know that, contrary to most games, the majority of the loading time in HELLDIVERS 2 is due to level-generation rather than asset loading. This level generation happens in parallel with loading assets from the disk and so is the main determining factor of the loading time. We now know that this is true even for users with mechanical HDDs.

They measured first, accepted the minimal impact, and then changed their game.
by tunaoftheland | 2025-12-03 16:03:54+00:00
Thank you so much John for your encouragement and the awesome tool HN Simulator (https://news.ycombinator.com/item?id=46036908)!

For those who haven't tried it yet, I did couple of test posts on the Simulator to get an idea of what kind of comments I might get. Some of the comments were hilariously close of the real HN ones, and others posed excellent questions and even potential solutions to the UX issues that I had been thinking about.
by jimt1234 | 2025-12-03 16:04:00+00:00
The healthcare system in the US is, indeed, the best...if you're rich. If you're not rich, you're gonna spend a lot of time on the phone, arguing with bureaucrats and getting treated like shit.

A friend of mine is rich. We both have a health insurance plan from UnitedHealthcare. His experience is radically different from mine. He can make a phone call, and actually talk to his doctor within a few minutes. He can see his doctor the same day he asks to. He talks to one person who manages all the BS for him.
by WorldMaker | 2025-12-03 16:04:09+00:00
There's a 4K 4:3 remaster streaming on HBO Max. It wasn't exactly well advertised (certainly not to the extent that it has been hard to miss this Mad Men advertising), but it exists and is a good way to watch the show. Feels a bit less cinematic not being in 16:9, but it looks good other than that because the show was shot to be 4:3 safe (as that was still the most common TV at the time).
by threethirtytwo | 2025-12-03 16:04:28+00:00
Ideally we should remove the incentive all together. Limit it so Politicians can only buy index funds that don’t target any specific industry.

Fundamentally you can classify modern society into two groups: government and commercial citizenry.

The incentives of these two groups are misaligned and that is essentially the origin of all corruption.

The commercial citizen, his goal is to make money, compete and to do so by bending the rules and using any means possible.

The government, his goal is to be fair, to enforce and follow the rules, and to guard citizens.

When you combine these two groups the incentives collide. You get government officials who are supposed to be fair but instead they are incentivized by commercial interests so they make biased laws, take bribes and do all that shit.

To reduce corruption you really need to create societies made up of two different groups with two different sets of incentives.

Dictators are more immune to this effect because all of their commercial incentives are pretty much completely fulfilled as they own the whole country.

In a democracy the closest sort of thing I’ve seen to this is priesthood. Buddhism or becoming a monk is similar but these are not elevated leadership positions like priests.

Basically when you become a government official it should be like becoming a priest. You are removing yourself from commercial society. It changes everything. Your incentives are different and it even filters out all the bad actors.

Such a society can realistically exist. I think the unrealistic part is converting our current society into something like this.
by pacificat0r | 2025-12-03 16:05:40+00:00
Well, it's significantly easier to implement than a octree. Game is actually 3D under the hood, projected at a careful angle to look isometric 2D.

The reason the game is 3D has to do with partially visible things being way easier than with isometric textures layered in the right order.

Also, now that i just grab a pixel back from the GPU, it's no overhead at all (to construct or get the data for it).
by theamk | 2025-12-03 16:06:01+00:00
Neat!

Forward polish notation + multi-line programs is _weird_ though. It means you read tokens _right-to-left_ and then top to bottom. Readme gives good example in [0]:

The long form (same in Taka or Forth) of

4 3 2 +

is equivalent in Taka to

3 4 + 2

(and both leave 5 on top of stack, and 4 underneath it)

[0] https://codeberg.org/marton/taka#basic-syntax-and-execution
by VBprogrammer | 2025-12-03 16:06:13+00:00
I not really talking about general styling, I'm talking about the specific models being available. A lot of this might better be described as the world becoming globalised rather than the US cars becoming more European. But the end result is the same, many of the best selling US cars must meet or exceed European safety standards.

At a rough count a list of the best selling 25 cars in the US, 16 of them are available to buy in the UK that I know of (including cars like the Jeep Wrangler which are obviously American classics).

Most of the different is Trucks and full-size SUVs. And a couple of Chevy's which gave up on the UK market a few years ago. So either pedestrian fatalities are concentrated in those areas or there are other factors at play (road design, driver training, enforcement of rules etc).
by nbardy | 2025-12-03 16:06:13+00:00
You haven’t actually looked at their fundamentals. They’re profitable serving current models including training costs and are only losing money on future RD training, but if you project future revenue growth on future generations of models you get a clear path to profitability.

They charge higher costs than OpenAI and have faster growing API demand. They have great margins compared to the rest of the industry on inference.

Sure the revenue growth could stop but it hasn’t and there is no reason to think it will.
by NoMoreNicksLeft | 2025-12-03 16:06:20+00:00
>it seems rather difficult for me to have .1 child.

Hence, the "on average". For any 10 couples, they should have 21 children. If some have fewer, the rest have to have more.

>it's impossible for me to have any children because I am a single man

Sounds like a "you" problem.
by zimpenfish | 2025-12-03 16:06:25+00:00
> Guaranteeing [that congressional lawmakers] never get good at their job

I don't know if you've been paying much attention to US politics since the year 2000 but the vast majority of them are no good at their job regardless of how long they've been there.

> We need to stop pretending that Congress or any of these elected positions don't require skills.

I don't think anyone does? But currently the only real skills you need for attaining high US office are 1) be rich and/or have enough rich people in your phone book or 2) the ability to make Donald Trump feel like a special boy.

> Democracy isn't about letting any random firebrand run things.

waves in US/UK/Argentina/Brazilian politics over the last decade
by jeroenhd | 2025-12-03 16:07:00+00:00
They used "industry data" to make performance estimations: https://store.steampowered.com/news/app/553850/view/49158394...

> These loading time projections were based on industry data - comparing the loading times between SSD and HDD users where data duplication was and was not used. In the worst cases, a 5x difference was reported between instances that used duplication and those that did not.
by CWuestefeld | 2025-12-03 16:07:47+00:00
I'm not particularly concerned about unfair gains made possible by insider knowledge. The economy is large enough, and the set of lawmakers (not to mention leadership-level lawmakers!) small enough, that that the overall effect on anything is going to be negligible.

My concern would be that the "skill" we're seeing isn't with using insider information, but with using their power to alter outcomes to make whatever investments they'd previously chosen become profitable post hoc. If they're causing our regulatory landscape to be change to pad their wallets, that's going to have a much greater effect on our overall system than just being able to make a trade a day earlier than the rest of us.
by fourgreen | 2025-12-03 16:08:18+00:00
Is it true? We, the people, currently pay for roads, we would pay for them in the alternative system - so the total amount of the money we need to pay would not change, only some prices (or taxes) would go down and others would go up. Either we care about having food and we would pay high prices for them (with money we saved elsewhere) or we don't care and we wouldn't pay.
by kakacik | 2025-12-03 16:08:33+00:00
Go back to local politics? Why the only direction should be always up? At the end, who cares?

Career politicians with most power who reach the top will always be good primarily at one thing - bullshitting their way to the top in various sociopathic manners that no power structure anywhere is immune to. Those who are inside the circus for 30+ years? Expect them to be rotten to the core while wearing very polished masks, seeing and dealing with the worst and staying on top. Not a place for a nice good hearted well intending folks.

Don't expect some common good to come out of them just because it would be nice or proper thing to do, either its by mistake as a byproduct of some other effort or some pre-election campaign.
by antiloper | 2025-12-03 16:08:53+00:00
> It's kind of funny, you can ask Rufus for stuff like "write a hello world in python for me" and then it will do it and also recommend some python books.

Interesting, I tried it with the chatbot widget on my city government's page, and it worked as well.

I wonder if someone has already made an openrouter-esque service that can connect claude code to this network of chat widgets. There are enough of them to spread your messages out over to cover an entire claude pro subscription easily.
by dmoy | 2025-12-03 16:09:00+00:00
I would say instead of just blanket "ETF":

1. Only things that approximately match the contents of TSP funds or broader

2. Have to write down a 10b5-1 for the entire duration of your election plus one year, with a double cooloff period (6mo vs 3mo), and have to extend it within 3mo of each successful election.
by horsawlarway | 2025-12-03 16:09:08+00:00
No - because most users also don't check install size on games, and unlike renting overpriced storage from a cloud provider, users paid a fixed price for storage up front and aren't getting price gouged nearly as badly. So it's a trade that makes sense.

Both entrants in the market are telling you that "install size isn't that important".

If you asked the player base of this game whether they'd prefer a smaller size, or more content - the vast majority would vote content.

If anything, I'd wager this decision was still driven by internal goals for the company, because producing a 154gb artifact and storing it for things like CI/CD are still quite expensive if you have a decent number of builds/engineers. Both in time and money.
by devilbunny | 2025-12-03 16:09:14+00:00
> feels like I only understand 20% of the phone's features

This is a persistent problem with iOS. Features are added but not really mentioned. The online manual is very focused on "how do I..." without giving a clear overview of "here's everything you can do. New gestures are added without giving an obvious way to reverse them if you accidentally trigger one.
by crazygringo | 2025-12-03 16:09:24+00:00
No, you seem to not be reading what I'm saying. Please don't call it "incoherent" or "gibberish" just because you don't agree. That's completely inappropriate.

We're talking about a UX choice and you're talking about people "defending themselves" as opposed to "enduring abuses" coming from "much evil"?

The justification you're proposing is the same one that censors free speech, because people want to defend themselves from certain ideas, or things they just don't "like".

There's no harm here. Nobody's attacking you. You're not being abused. We're talking about a software feature you think is inconvenient that it takes up space on your screen.

I think companies should have the freedom to design products the they want, as long as it's not causing harm. Which in this case, it's not. You just don't like it. But that's not harm. If you don't like it, don't use it. Same as if you don't like a book, don't read it.

Rights and freedoms exist for a good reason. They're not absolute because they can conflict with each other, but in this case there's zero conflict. There's no justification for the government to start dictating Google's UX in this case.
by infecto | 2025-12-03 16:09:32+00:00
Zero clue what your point is so please help me understand.

I was agreeing with your stance and adding my own anecdote that it’s a turnoff with the way those posts were originally formatted. Not people I would want to work with. If you do that’s fine. This is not star wars and simply my own choice as it’s everyone else.

I also cannot think of a time in my adult life I wanted to call out a group of people as losers or monkeys i n public.
by justin66 | 2025-12-03 16:09:34+00:00
I guess if I viewed software engineering merely as a placing of bets, I would not, but that's the center of the disagreement here. I'm not trying to be a dick (okay maybe a little sue me), the grandparent comment mentioned "software engineering."

I can refer you to some github repositories with a low number of stars that are of extraordinarily high quality, and similarly, some shitty software with lots of stars. But I'm sure you get the point.
by alexwatson405 | 2025-12-03 16:09:50+00:00
Hi all- I’m a co-founder from Gretel; our team and tech are now part of NVIDIA.

NeMo Data Designer is our core product from Gretel and now the internal framework we use heavily for both pre- and post-training data in Nemotron for a variety of use cases.

The OSS version is fully general-purpose: Python-first, modular, and designed so you can mix statistical samplers, LLM columns, and seed datasets in a single pipeline.

Happy to answer questions or hear feedback on missing features
by somenameforme | 2025-12-03 16:09:57+00:00
In general when one looks at the longest serving politicians, it seems to reek much more of extremes of corruption than skill. The insider trading this article references being but one aspect of that. It also correlates with people turning into warmongers, but that's probably just another angle to corruption since there's a rich and ridiculously unaccountable flow of money in military related stuff.

For another datum consider presidents' second term. This is often where they are supposed to be able to really act out their vision for the future since they're ostensibly out of politics after this and have at least 4 years of experience at the highest level, yet they almost invariably tend to be extremely underwhelming.

I'm not arguing there is no skill, but I am arguing that just spending a lot of time in office doesn't seem to correlate much with achieving that skill.
by CyberDildonics | 2025-12-03 16:10:17+00:00
Zig is the language that was intentionally made to fail and error out on windows carriage returns instead of parsing them like every language ever made. They made a version for windows and then made it not work with every windows text editor. Their answer was to 'get better text editors' or 'make a preprocessing program to strip out carriage returns' or 'don't use windows' (they had a windows executable).

This is not a group with community or pragmatism from the start.
by pgaddict | 2025-12-03 16:10:36+00:00
That is part of the key idea, yes. It's more elaborate, because it can split the aggregate - it can do part of it before the join, and finalize it after the join. Similarly to what we do for parallel queries.

As for indexes, it can help, but not in this particular example - the "code" tables are tiny, and the planner adds Memoize nodes anyway, so it acts like an ad hoc index.

Indexes are more of a complementary improvement, not an alternative to this optimization (i.e. neither makes the other unnecessary). FWIW in this case the indexes won't help very much - if you use more data in the code tables, it'll use a hash join, not nested loop / merge join.

That doesn't mean we couldn't do better with indexes, there probably are smart execution strategies for certain types of queries. But indexes also come with quite a bit of overhead (even in read-only workloads).
by MarkusWandel | 2025-12-03 16:10:45+00:00
I always say "on a scale from no canoe to a $5K canoe, even the crappiest canoe is 80% of the way there". This camera illustrates that for vision. When you hear about those visual implants that give you, say, 16x16 grayscale you think that's nothing. Yet 30x30 grayscale as seen in this video, especially with live updates and not just a still frame is... vision. Not 80% of the way there, but does punch way above its weight class in terms of usefulness.
by embedding-shape | 2025-12-03 16:10:52+00:00
> On the map it only buzzes when I move the cursor, interestingly enough

Sounds like the game is doing more when the cursor moves around, they're probably checking for where the cursor is, and something is making the CPU/GPU do a bunch of extra work, which finally triggers the coil whine when the PSU is more heavily used.

I've basically had the same issue with Nvidia cards since the 2080ti started doing coil whine as soon as I opened Unreal Engine. Some programs trigger different sounds, depending on how much/well they use the GPU, and I've had the literal same experience with "hovering with my mouse over element X triggers coil whine" multiple times before.
by complianceowl | 2025-12-03 16:11:16+00:00
Great recommendation! I can definitely see the difference (e.g. Daniel Tiger). I agree with your philosophy about not hiding the existence of bad behavior, but teaching them how to deal with it. And I'm sure once my little guy grows, he'll gravitate towards Mr. Beast and all that, but at least I'll set a baseline so that that's not all he watches.
by pixelatedindex | 2025-12-03 16:11:37+00:00
> I'm not particularly concerned about unfair gains made possible by insider knowledge.

I am. I work at a company that trades publicly. My wife works at a firm. I can’t do anything with my stocks outside of three weeks a quarter. I can never buy options. My wife has to clear her positions with whatever department. If I have these obstacles, congress should absolutely have them — maybe more. Ideally they can trade index funds and that’s about it.