skysight-inc/HackerNews huggingface dataset:
I've wanted to convert a massive Pandas codebase to Polars for a long time. Probably 90% of the compute time is Pandas operations, especially creating new columns / resizing dataframes (which I understand to involve less of a speed difference compared to the grouping operations mentioned in the post, but still substantial). Anyone had success doing this and found it to be worth the effort?
ChatGPT or Shakespeare? Readers Couldn't Tell Difference–Preferred AI Verse
I guess I wouldn't be surprised if there were issues with data and/or analysis. Should we assume they are basing their miles driven off of used car listings? That is, they see someone puts a 2019 Subaru Impreza up for sale in 2023, with 50,000 miles, and they add that to their data set on how many miles the average Impreza gets driven per year? But maybe people leasing drive differently than those who own or keep vehicles longer? I'd like to see the data on their average number of miles driven per car model per year.

Would also be interesting to see which were the safest cars according to their analysis.
My favorite description of this sort of setup is "coded by vandals".
There's the "T14s Gen 6 (AMD)", "T14s Gen 6 (Intel)", and "T14s Gen 6 (Snapdragon)".

I'm not naming them either ... just telling you how it works.
I think GP made a pretty neutral comment, and you interpreted it rather poorly.

It's a bit of an overreaction which, ironically enough, is the kind of engagement Twitter thrives on.
To whose calendar?

For each customer meeting only specific staff needs to attend, not all.
The US did rebuild Germany, Japan, S.Korea and Taiwan. Its hard to imagine these countries getting to where they are today without US involvement. They could have just followed British history and made these countries colonies with an American Viceroy in charge. But they didn't. And that goes to values.

The goals and intent driving these processes wasn't all noble, but the end result wasn't too bad either. Its natural once you rebuild and reshape a Germany or Japan(basically a feudal society pre-WW2), to think well maybe it can be pulled off elsewhere.

But replicating those stories elsewhere was just too complicated to pull off. It required huge resource commitments and totally compliant local governments. Lot of luck basically. That wasn't a problem in the immediate aftermath of WW2, but got more and more complex as time passed. And American financial (dollar hegemony) and corporate interests took over. Cause their goals are simple.

Ofcourse Chomsky is right to point out all the hubris and hypocrisy, but pointing out hypocrisy even stand up comedians are capable of doing. Doing something about hypocrisy is a much more complicated story.
Depends on what you mean by left. Some people, including many who would describe themselves as such, think "leftist" means things like pronouns and reparations, and are even happy to engage with capital when it supports their pet causes.
Those are obvious bullshit leftist smear claims, but even if they were true it wouldn’t matter, as Trump is the CEO who has appointed capable people to do the work for him.
I hope that the incoming President is not campaigning at this time, nor at any time in the future.
Try Metro Awakening too. It came out a week ago and I'm really impressed. Gameplay is excellent. It's no Alyx but it's good. And even on my old Quest 2 it doesn't look too horrible on the device itself (without PC)
VR continues to lack a Killer App to sustain the field (I say this as owner of 3 VR devices, including the Index)

Valve tried to make it with Alyx, and while it is amazing, it did not inspire the industry to follow up on.

I do not blame Valve for moving on when nobody followed them.
I wonder if anyone surveyed Europeans to see if they want the things? I get them in the UK and would be happier without them myself.
We probably should call those something different, since they are not related. Peanut Spread would be entirely fine.
Nah, we’ve had two nuclear-electric boats before: Tullibee and Glenard P. Lipscomb. They just weren’t successful (Tullibee was to some extent, but she was also quite small).
Use the side bars to select individual countries instead of "World".
not to dispute but rather to refine.. go to a third order effect. Imagine that Injustice is remedied (somehow involving policy), negotiations with the growing remedy system rely on growth of remedy so cleverly take advantage of the shared desire for remedy and easy public political speech win of emphasizing remedy, such that negotiations then stretch out the timeline, and add a tax, and some supervisory positions with regulatory oversight in yet another group, to be fair.. the remedy system is less remedy and more frameworks.. the Iron Law of Bureaucracy sets in.. other noise or inefficiencies or internal contradictions, grow.

Private companies play their part in implementing this remedy of Injustice and Good Policy, yet private companies exist to profit first and foremost. Management practices of labor have a sordid history, going way back.. A worker in a private company with a lottery work permit must play out the life under management in that company, whatever that may be.. And that management will also change, not always for the better.

Now its 2024.....
They do the task because they know that they will get a good reward from an automatic feeder, with or without an audience. They might perceive them as competition, better get the treat before one of the hairless ones takes it. In private, just randomly mashi f the screen until the feeder is cooperative might be good enough, even if it takes a little longer.
> What does not work: Keyboard, mouse, TB & USB-C ports, thermal/freq mgt.

So, eh, yeah. Basically useless as a laptop.

Is the "Conclusion: Highly recommended" at the end sarcasm?
> He bought Twitter to be able to shape the platform to his image of the world, while claiming it was about freedom or some such thing.

Musk tried to back out of buying Twitter. But this detail is not very relevant.
Fixes

> Reduced chances of birds getting stuck in the world.

I really think I give it a replay. It was such a great game and truly started a new area of gaming.
As a reminder, the Twitter APIpocalypse already happened in 2012, long before Musk... and some of the people now at BlueSky might have been behind it ?

https://news.ycombinator.com/item?id=4550625

At least, that's also why we got Mastodon...
> Tactics being examined include substantially increasing subscription fees for those that leave, charging steep exit fees, and allegedly making its Office 365 products incompatible with rival clouds, they added.

Why are there no details or examples? Is Ars this bad recently?
The black bar means someone died. A real computer scientist.

I hope it’s not a legend like ken or something, but it’s not obvious from the front page and #1 is a video game.

Tell me we’re not handing out black bars for anniversaries of software now?
Relevant information about the links between the AT Protocol and IPFS: https://bsky.app/profile/why.bsky.team/post/3l7vjsvufwc2g .
It's best to think of it as "tree-ing" or "to tree"

A really, really fantastic article:
https://eukaryotewritesblog.com/2021/05/02/theres-no-such-th...
It’s populated by a lot of leftists that, while unhappy with the right, can have a sort of reasonable discussion about it though.

I’m left, but I can listen to people that identify as right on HN and not roll my eyes, because they have good points as well.

If you pick a random person off the street (left/right), your chances aren’t nearly so good.
+2 Porkbun
I think it's pretty obvious that Alyx didn't inspire the industry because it's a giga-budget game addressed to a tiny potential market, that Valve could only afford to make due to Steam being an infinite money printer. It wouldn't surprise me if Alyx never recouped its development costs despite the immense hype around it.

If Valve wanted more Alyx'es to happen they needed to spread their wealth around until the VR market gained more momentum and became self-sustaining.
As others have mentioned, title fraud. My recent closing disclosure has buyer, seller, agent, and title company. It'd be pretty easy to call the buyer claiming to be the title company and request a wire for exactly the right amount to a fraudulent location.
I watched the whole thing. Impressive!
Somewhat surprised that networking is not mentioned in either list. Maybe a USB to ethernet dongle was used?
This is exactly my take as well. The people leaving and putting out the call for others to follow them are the same ones that lost their power when the platform changed hands and the ideologies of the people who run it changed.
Tangential, irrelevant, "flamebait...generic tangents...internet tropes." "reminder" that the guidelines explicitly say to avoid. Nobody mentioned ownership or licensing or anything tangentially related until you did.

https://news.ycombinator.com/newsguidelines.html
> Children with autism or ADHD might struggle in some ways, but be better off in others. It seems clear that there is no objective reason they are worse than a neurotypical person, so if a "cure" to these conditions was developed, you would have some degree of moral quandary.

I normally lurk HN but created an account because I see a lot of comments about this. Maybe I can offer some insight.

I was diagnosed with high functioning aspergers at a young age. After years of OT and work I am able to live a fairly normal life. I don't talk about it, and I could count the number of people who know on my fingers. It's hard for me to gauge this, but if you met me I doubt you'd realize unless you were looking for it.

To the world I look like I have things together, but there's nothing I wouldn't give to be normal. I don't understand the push to accept it over searching for a cure, if such a thing is possible.
Leftists know a thing or two about infighting. If X becomes the right wing space and bluesky the left wing one, they can soon point at each other for "look, the other side doesn't even get along" gotchas.
From a security perspective, and as a programmer, I've never liked ZIP files precisely because there are two mechanisms to identify the contents, the per-file header and the central directory. When you're defining a format, protocol, or w'ever, ideally there should be a single source of truth, a single valid & useable parse, etc; basically, the structure of the data or process should be intrinsically constraining. There shouldn't be a pathway for multiple implementations to produce different functional results, and ZIP archives are in my mind the archetype for getting this wrong. tar files aren't ideal, but in the abstract (ignoring issues with long file names) they don't have this problem. (tar files don't support random access, either, but better to rely on something suboptimal than something that's fundamentally broken.)

A similar security problem, though not as fundamentally baked into the format, is MIME parsing. The header section is supposed to be delimited from the body by an empty line (likewise for nested entities). But what if it's not? For better or worse, Sendmail was tolerant of the absence of an empty line and treated as headers everything up to the first line that didn't parse as a header or header continuation.[1] Later systems, like Postfix, originally copied this behavior. But Microsoft Exchange and Outlook are even more tolerant, yet in a much more horrendous way, by parsing as a header anything that looks like a Content-Type or related header immediately after the first empty line. They have similar hacks for other, similar violations. So today, depending on the receiving software, you can send messages that appear differently, including having different attachments. It's a security nightmare!

I not a Postel's Law hater, but ZIP archives and Microsoft's MIME parsing behaviors are just egregiously wrong and indefensible. And even if you think the Robustness Principle is inherently bad policy, you still have to design your formats, protocols, and systems to be as intrinsically constraining as possible. You can't rely on vendors adhering to a MUST rule in an RFC, unless it's unquestioningly crystal clear what the repercussions will be--everybody else will (because it's the natural and convenient thing to do) reject your output as trash and drop it on the floor immediately so violations never have a chance to get a foothold.

[1] MTAs don't necessarily need to care about MIME parsing, but Sendmail eventually gained features where parsing message contents mattered, setting the de facto norm (for those paying attention) until Microsoft came along.
Looks like the hybrid version of the CR-V was released in 2020:

https://hondanews.com/en-US/honda-automobiles/releases/relea...

...and the study only covered model years up to 2022. It would be interesting to compare the hybrid to the standard version. If there is a significant difference, I'd be suspicious of data quality.
you dont need to even encrypt zip, since encrypted ZIP file can trigger tripwires during transmission.

unencrypted zip, but using .docx or .xlsx format is the way to go (the best way is to hide inside one of the openxml tags or xml comments )
Ooo we're back in the old good days of twitter again! The time where you could build against it and do things.

I wrote a contest winning bot back at one tie:

https://theexceptioncatcher.com/blog/2015/11/how-i-got-my-bo...
That isn't a response to your own crappy post, its a misdirection.
The basic outline of this post isn’t bad, the problem is that’s all there is - a basic outline. If you haven’t dealt with these problems before the checklists are meaningless. If you HAVE dealt with these problems before the checklists are redundant
Valve still knows how to make excellent games. Deadlock is a Valve game in alpha, and I think it's going to be very popular once released.
Great question! That was actually covered in the link I posted.

Compared to PyInstaller, it doesn't dump any temporary files on disk.

Compared to Nuitka, it uses the real CPython, not a different implementation.
While I agree with you, the culture is coming from the sign language. Liver disease doesn't come with a shared language.
The government could apply a fine, and shops selling that butter could put up a sign warning that butter is made from milk.

That achieves the same result without the destruction of perfectly good food.
Sure, but that's why someone allergic to dairy might ask their friend who prepared dinner if anything was made with butter or cheese (or yogurt or sour cream, etc.), just to double-check.

If the person cooking is uneducated enough to not know that butter and cheese come from milk, I highly doubt they're checking the box the butter comes in for an allergen listing.
I Built a Teenage EdTech Empire (and Lost It All)
I've got the perfect soundtrack for it (flashing lights warning) https://www.youtube.com/watch?v=wNtxgxYY7sI&t=66s
Sounds like a perfect environment to make games. No budget or schedule pressure, virtually limitless resources so the staff can strive to make art with love and without the corruption of chasing a bottom line.

The entire media industry on almost every format is chasing nostalgia because they refuse to recreate the environment that made endearing stories and experiences in the first place.
I think an example would be helpful, conditionals:

Within the "program dimension" there is just no way to run code conditionally without an if, no matter how much you move left and right, you are constrained. It is only possible by using the "higher dimension".
The criticism wasn’t only about how limited the DSL was — it was about how some of the design choices are repeating patterns which are very common sources of security defects. HTML and SQL are DSLs themselves and have non-trivial security contexts.
M4 MacBook Pros use a quantum dot (QD) film rather than a red KSF phosphor film
Emmy Noether, paging Emmy Noether, Emmy Noether to the red courtesy phone please!

You can't say that given <conditions>, 1-phenylpropane rearranges to 1,2-diphenylpropane, you cannot pull whole atoms out of thin air for an indefinite amount of time. No human would make such a mistake, but AI does, and what's worse, it is impossible to talk the AI out of its strange reasoning.
Public companies are slaves to the shareholders
My great grandparents had a friend die in this fire.

Then they and their kids had to go through it again 26 years later.
Not necessarily? Non-echo chamber is more interesting, but I’ll take one that echos my beliefs over one that doesn’t.
I dont understand why I would build on bluesky when it seems like it would have the same medium term issues that the twitter api had anyway, but enjoy it while it lasts I guess.
Bluesky has also added 1m new users for each of the past 2 days.
They don't have to be, but if I just want to quickly log an object to inspect it I'd rather not have to chain together a bunch of gets and prints.
Agree, did the same.
Case and font are different
Thomas E. Kurtz of BASIC fame https://news.ycombinator.com/item?id=42141761
It seems obvious to me that this was written by Costco’s PR team, doing damage control
Tis Leive, sis
RIP.

Legend.
I hope Mr. Tetraheder remembers to make any accounts permanent regardless of the wishes of the members - nothing like a permanent asset.
It is often the case that the nifty Python thing you want to pass around uses one or more nifty Python libraries that have no C/C++/Rust/Golang equivalent (or no obvious equivalent), and so rewriting it becomes a herculean task.
Nuclear and renewables are part of overall energy production in China to a far greater proportion and absolute number than in the US.

China has a smaller nuclear fleet capacity than the US and meets a much smaller percentage of its electricity needs with nuclear power:

https://pris.iaea.org/PRIS/CountryStatistics/CountryDetails....

https://pris.iaea.org/PRIS/CountryStatistics/CountryDetails....

As of 2023 US got 18.55% of electricity from nuclear power (775 terawatt hours) while China got 4.86% (433 TWh).

As of 2023 China does get a larger share from renewables:

https://en.wikipedia.org/wiki/Electricity_sector_in_China#Pr...

https://www.eia.gov/tools/faqs/faq.php?id=427&t=3

It's 29.1% renewables in China (2,756 TWh) vs. 21.4% (894 TWh) in the United States.

Grouping nuclear and renewables together as low-emissions sources, the US gets 47.65% of its electricity from low-emissions sources and China gets 33.96% from low-emissions sources.

China is building nuclear and renewable sources faster than the US, so will narrow the gap over the rest of the decade, but it's also growing its total electricity consumption faster.
> * Many companies fail to provide specific, actionable feedback after candidates spend hours on assignments.

AthenaHealth in Watertown MA, this is you, you miserable pricks. Didn't even send me a "No thanks" email.
If that was the case I'd expect the non-hybrid CR-V to be up there too.

I found a discussion of the 2019 report, which was the year before the CR-V hybrid came out, and the CR-V fatality rate was 2.7.
Summit supercomputer gets virtual farewell on Zoom
Wonder if these bugfixes mean new speedruns?
mean reversion to the level of available feedback seems like the principle at play.
Props to Ritchie Vink for designing polars.

But also props to Wes McKinney for giving us a dataframe library during a time when we had none. Java still doesn’t have a decent dataframe library so we mustn’t take these things for granted.

The Pandas API is no longer the way things should be done today nor should it be in new tutorials. Pandas was the jquery of its time —- great but no longer the state of the art. But I have much gratitude for it being around when it was needed.
Remix introduces TeleForm: 2D to 3D in milliseconds
Isn't this more an issue with how the data from the camera is used? Or rather, where it can go? Maybe I'm a bit naive here, but isn't the issue that we don't want camera data going to third parties (or really... any party). So is there not a way that this can be sandboxed? Camera data must stay on device in an enclave. Honestly, this seems what's wanted for a lot of type of data. Is this just not possible to actually implement in the OS? Because I'd imagine not being able to process vision data really limits what you could do.

I think of this kinda like the data collection with many phone apps. I understand that it needs access to the networks to make connection to wifi or bluetooth, but why is this bundled together with an app's ability to record and send that data back to the developer? There has to be a better way to handle all this.
I learned software starting with BASIC and I suspect I’m not alone.

A monumental contribution to practical computer science.

RIP.
I'm still irate Twitter broke all my automaton and then had the gal to try to charge me $100 a month!? Looks like it's up to $200 now.

That's as much as my car loan... No normal individual can justify that.
OpenGarage's device can keep a cloud connection open to Blynk or the maker's own OpenThings.io cloud server.

Let's hook up the garage door to a system that, if it were hacked, would let anyone on the Internet control it. What could go wrong? /s

I just don't get it.
FTL: "FHWA defines a roadway departure (RwD) crash as a crash which occurs after a vehicle crosses an edge line or a center line, or otherwise leaves the traveled way. Another term our partners often use is lane departure, which is synonymous with RwD, since both include head-on collisions when a vehicle enters an opposing lane of traffic."

Road departure fatalities are high because of head-on collisions, not because there is an epidemic of people crashing into trees along the side of the road. If you follow the links on the cited page, they clearly show that head-on crashes result in more fatalities than tree+utility pole crashes.
Bummer, sorry to hear this!
I had a similar experience with spark, especially in the Scala API it felt very expressive and concise once I got used to certain idioms. Also +1 on duckdb which is excellent.

There are some frustrations in spark however, I remember getting stuck on Winsorizing over groups. Hilariously there are identical functions called `percentile_approx` and `approx_percentile` and it wasn't clear from the docs they were the same or at least did the same thing.

Given all that, the ergonomics of Julia for general purpose data handling is really unmatched IMO. I've got a lot of clean and readable data pipeline and shaping code that I revisited a couple years later and could easily understand. And making updates with new more type-generic functions is a breeze. Very enjoyable.
Or pin the thread to top 5 articles while the bar is in effect.
TeleForm converts 2D panoramic video into interactive 3D scenes instantaneously.

It builds on novel view generation models with a new generalizable paradigm. We're super excited to share a preview of these models as we continue to improve them.
I converted to DuckDB and Polars. It’s worth it for the speed improvement.

However there are subtle differences between Pandas and Polars behaviors so regression testing is your friend. It’s not 1:1 mapping.
No, I haven't. That's disappointing. I would have hoped people would have taken BlueSky at their word when they were told they weren't wanted.
TBF, a walk down the street where cctv cameras are present is likely already training data for some AI.
https://www.cyph.com/pricing
I opened a PR for it: https://github.com/NixOS/nixpkgs/pull/356310

In the meantime you can also add packages that aren't yet in nixpkgs using pkgs.callPackage.
I'm not surprised. There have been studies that show caterpillars retain memories through metamorphosis into a butterfly (a process that basically liquefies them).
> Pumped hydro is great where you can build it and it is cost superior to batteries

Given the dramatic price decline of LFP cells in the past year, I'm not sure this is still the case.