skysight-inc/HackerNews huggingface dataset:
I'd prefer for Rust to opt for correctness/bug-freeness over performance, even in release builds. If you are doing number crunching you should have to opt out of these checks.
If their knowledge cutoff is 8 months ago, then how on earth does Grok know things that happened yesterday?

I would really love to know that.
if only there were some way to move beyond ads, to something where items that would genuinely benefit or brighten one's life are surfaced
Saying the vulnerability is in Parquet itself gets more clicks.
> Making America "stand on its own two feet" would give it a lot of freedom in making choices that are at odds with future super powerful China that is no longer benevolent.

The idea that relationships reduce your independence is almost childish, like a 18 year old who things they tie you down and they'll go it alone in life. It's through relationships that people - and nations - have power. The US by itself can't afford to do much. Now the, again, vast network of US allies - including in that theater Japan, South Korea, the Philippines, Australia, to an extent India - share the burden.

> freedom in making choices that are at odds with future super powerful China that is no longer benevolent.

The US has disconnected itself from China for years now. China has little influence politically in the US.

What happened was China became extremely nationalistic, threatened and abused everyone, and the US moved in and allied with all its new enemies.

However, as the US becomes extremely nationalistic, threatening and abusing everyone, China is now moving in and building relationships. It's their own back yard, so it is hard to compete if you act like just another nationalistic dicatatorship.
That's fair, thanks for taking the time to look and giving the feedback.
The "ferrying animals across a river" problem has definitely not been solved, they still don't understand the problem at all, overcomplicating it because they're using an off-the-shelf solution instead of actual reasoning:

o1 screwing up a trivially easy variation: https://xcancel.com/colin_fraser/status/1864787124320387202

Claude 3.7, utterly incoherent: https://xcancel.com/colin_fraser/status/1898158943962271876

DeepSeek: https://xcancel.com/colin_fraser/status/1882510886163943443#...

Overflowing wine glass also isn't meaningfully solved! I understand it is sort of solved for wine glasses (even though it looks terrible and unphysical, always seems to have weird fizz). But asking GPT to "generate an image of a transparent vase with flowers which has been overfilled with water, so that water is spilling over" had the exact same problem as the old wine glasses: the vase was clearly half-full, yet water was mysteriously trickling over the sides. Presumably OpenAI RLHFed wine glasses since it was a well-known failure, but (as always) this is just whack-a-mole, it does not generalize into understanding the physical principle.
Dark Mirror Ideologies
I'd be surprised if they don't support it for at least one more release. With Intel, they discontinued the PowerPC systems much faster (by the end of 2006.) They were still selling Intel hardware 2 years ago, a couple years into the ARM / Apple Silicon transition.
In my mind I'm visualizing the IBM office to be of scale in the Blade runner movie :-)
When I visit that gritql link, the first line of "Usage" already tells me a lot: (1) what problems can it solve, (2) how do I use it and (3) what is entry threshold. This makes it a very cool tool which I am will be using in the future. That's for telling me about it!

(In case you wonder, the answers I saw are: (1) semantics-aware code search/replace with no IDE requirement; or maybe better "grep" with no false positives (2) write queries on command line or in file, and pass them to tool; (3) very low: install the binary, there no need to "import" or "setup project" or any things like those).

Compared to that into, Glamorous Toolkit presets itself much worse. Here were my thoughts when I opened the website: It seems to be some sort of data explorer tool, but it's also kinda weird. For example, the API explorer clearly shows post-processed data, so it's not actually exploring Github API, but rather some sort of binding to it (GhRepo according to the title).. so what's the use of API explorer which requires bindings to be written first? DevOps explorer seems interesting, but I don't care about Jenkins, so what I really want to see is how hard is it to teach it about new system. Maybe it's in the videos, but I am not going to watch long videos unless I am already interested in the tool. Maybe if I click around? Nope, and the blog is not very helpful too... In fact, the comments for the post were much more informative than the website, I love HN!

So, apparently the answers are (1) it can visualize the data, if I am willing to learn smalltalk (2) it's smalltalk, so you create smalltalk classes, and they become stuck in the "image" that you cannot easily share with others nor use with any existing workflows and (3) it's probably a few hours of youtube (the first video alone is 45 minutes) + experimenting before I can get any useful output.

I don't see it ever catching at all, sorry.

Granted, it seems like a general problem with Smalltalk: the collaboration story is bad. It seems every Smalltalk user lives in their own little world, and sharing stuff with other people is an afterthought, at best. Just compare gritql's and GT's homepage: one starts with 3 copy-pasteable commands which would immediately show something cool, another starts with mysterious "Download" button followed by 45 minute video.
Nix Derivations, Without Guessing
> you don't like the aesthetic so

Who says I don't like the aesthetic? I can like the aesthetic of something and also acknowledge the harm it causes. It's kinda weird that your response is to make things up about me here.
Software doesn't fire people, people fire people.

"Coding error" could mean anywhere from "we wrote an actual good-faith attempt to measure some sort of performance, there was a bug, and we blindly followed what it said without double checking" to "the code we wrote to 'select * from employees' when firing people was in 'error' in hindsight because we now wish to have some of those people working for us again".

No matter how you cut it, in the absolute best case scenario, the people doing the firing were so incompetent that no one can tell they weren't being malicious.

The median scenario, they were simply being malicious.
That makes sense, but I do wonder if the idea here is that he thinks Tesla will be less damaged than others.

In either case it’s really dumb but hey it’s not like we all didn’t at some point ruin an economy or two.
The article somewhat buries the facts but a couple of important ones:

- They were able to get them reinstated within 24 hours.

- A presentation seen by Science said the overall NIH RIF (reduction in force) was based on administrative codes and that some “may not have been intentional.”
Am I the only one that has had some hard to pin down problems with rsync? I'm excited about this because I'd love to have an alternative implementation. In particular, "rsync --compress" over SSH seems to have a rare and hard to track down issue. I've used rsync for decades doing hundreds of nightly system backups, and maybe once a month one of them goes out to lunch (IIRC it just hangs). The rarity of it makes it hard to isolate or come up with a reproduction. Removing the "--compress" resolves it. Anyone else ever come across something like that?
> not to speculate too much but they sound like they could be an ideal short-run, low-impact, high capacity transit system if done right

Except they are the exact opposite of all of that. The just flat out suck. But its one of those easy traps to fall into.

The German company Cargolifter lost a nice chunk of money. And they aren't the only ones.

The technology hasn't really changed for a long time. And nobody has yet made it useful.

A few reason, they are INSANELY big for a pretty tiny amount of actual payload. That means infrastructure for them is really damn big. That means they hang in the wind like its nothing, you need massive energy just to stabilize them in one place. They are just generally really hard to control.

They are very expensive to design and build. And once you build it, unlike with a 737, you can't transport 100s of people multiple times a day, nonono these things are slow, and picking up cargo is slow, and picking up people is insanely slow. So you can operate this thing for like a day, and maybe do a few cargo lifts. Not exactly a great business. Ah and btw, you also need to design a quasi unique aircraft with lots of fun failure modes and issues that you get to discover and rediscover. They are the opposite of high capacity. And you better hope the weather is good because your not picking up people if it isn't.

And scaling the operation? Your never gone mass produce these things and each one needs its own massive infrastructure. See what the government paid for in Germany, its now a ski resort: https://de.wikipedia.org/wiki/Cargolifter-Luftschiffhalle

So have fun building a new gigantic building for each new craft.

So lets just do what we know works and has worked for 200 years, trains and ships.
FSD is not able to drive in the same conditions humans are so you're comparing humans driving in challenging conditions to FSD driving in good weather on highways.
It was a document database. The idea being that workflow was document based, and the applications you made for it were using documents in a workflow.
Who's they? The Department of Health and Human Services?
https://www.quiverquant.com/ is another one I've followed. They do other stuff as well, but they cover congressional trades.

An example: https://www.quiverquant.com/congresstrading/politician/Nancy...
As a latch key kid I had nothing but me time. So I hit up BBSs and found out about and downloaded warez. But to play them on our family computer I had to upgrade the DOS to 5.0 (also warez). So I learned how to upgrade the OS/play/downgrade the OS before my parents came home. Computer skills, IT migration skills (under high pressure time constraints), and time management. Weekend time was spent with mom, at her office while she worked and I played on Rogue and Trek on the VAX or skated the mini ramp they had in the parking lot for employees.
Yeah. I know the bitter lesson.

For neutral networks, on one hand, larger size generally indicates higher performance upper limit. On the other hand, you really have to find ways to materialize these advantages over small models, or larger size becomes a burden.

However, I'm talking about local usage of LLMs instead of production usage, which is severely limited by GPUs with low VRAM. You literally cannot run LLMs beyond a specific size.
Designing a Better Soldering Station, Garnering $500k in Pledges
Can we use this to find people stuck in Earthquake rubble?
> They need the dollars

For what?
> As for Trump himself, I think he truly believes the rest of the world is taking advantage of the US and tariffs are a way of setting things right. My guess is that in his view, the country (or at the least the rich people he cares about) will benefit from all this.

I don't think he has any such belief, and would abandon those 'beliefs' in an instant if it suited the only thing he cares about, himself.
> The real question is, how much data do we need to store inefficiently, in a way that uses a lot of power and space?

This is indeed the critical question, and it's far from being trivial.

One issue we all hit is moving the data from the higher tier storage to the cheaper and more efficient one, which requires sync and paying for the transfer most of the time, but also handling two separate access and authorization process, backup and recovery system for data that absolutely needs to be accessible for the few years of legal retention, and can/must completely disappear afterwards.

In most orgs I've seen the cost of going through all that complexity is just not worth it, compared to "just" paying for the higher tier storage for the few years long lifetime of the data.
Project Gutenberg Projects (2020)
Good thing he wasn't on a motorcycle.
that was more fun than I was expecting it to be, but it just ended abruptly at some point. also you really need to filter the word list (or use a better one to start with); it was jarring to see "cumshots" in there!
behold, a brave new future where your tv is also your power strip
From article: "Then, when the screen turns off again (either manually or via timeout), another signal is sent, just 1 ping this time."

Nice.
Either way - that I didn't know. Do they all do this?
I completely agree. In this era, photos aren't an art anymore. Although my friends always argue with me that taking a good photo is not just pressing a button. and You need to choose the right time, the right light, and a good picture. That takes skill, just like painting etc etc.
But i admit in some points Photos help us see the world. They show happy things and sad things. They help us remember and learn. That’s a good thing.
And in my opinion, photos are not bad or wrong. They help us share stories and feelings—but it's not an art anymore.
> all tariffs are bad and abolishing them will lead to global prosperity

I think when you get into the realm of extremes, you are no longer debating another human but a strawperson in your mind.
Nanuq: From bear blog to JSON, Markdown, or a static site
Debian and Ubuntu tend to want to lock the version of a system tools to the version of the OS.

Debian tends to have long release cycles, but is very stable. Everything will work perfectly together on stable (in fact, testing tends to be almost as good at stability vs other OSes).

Ubuntu is basically Debian with "but what if we released more frequently?".

If you want the latest tools, then you'll have to settle for a less stable OS (sort of). Nix and Arch come to mind. Neither are super user friendly.

If you want stable and the latest tools, Gentoo is the way to go. However, it's even more intimidating than Arch.

If you want stability and simplicity, then the other way to go is sacrificing disk space. Docker/podman, flatpak, appcontainers, and snap are all contenders in this field.

Windows and Mac both have the same problem. Windows solved this by basically just shipping old versions of libraries and dynamically linking them in based on what app is running.
Many comments are comparing Glamorous Toolkit to a JuPyteR notebook. It's worth noting that the comparison falls short because Glamorous Toolkit itself, including all of the UI [1], is implemented in the target language.

[1] https://github.com/pharo-graphics/Bloc
The Java subsystem was necessary to keep Domino relevant as an application development platform. IBM couldn't continue to rely on the proprietary LotusScript language forever (it was similar to Visual Basic, but mostly worse).

The additional of web server features was well intentioned but never worked correctly. IBM had this fantasy that developers could build an application once, then deploy it automatically to both Lotus Notes native thick clients and web browsers. Of course, this completely fell apart for anything but the most trivial applications. It also created a lot of market confusion because it competed with IBM's own WebSphere Application Server product.
They respond to DMCA requests and also have anticipatory obedience which is freedom of association

They treat their journalist publications and social media posts differently

So just post torrent links as a social media user if thats what you would like to see
Unless they had a 6 month career they likely have still done very well
Genetic Programming and the wider field of Evolutionary Computation and Genetic Algorithms are really good at some kinds of optimization.

If the problem fits into a tree form, then Genetic Programming programming is your best friend.

If the problem can be encoded onto a set of substrings of 0s and 1s, then Genetic Algorithms are your best friend.

Likewise if your problem can be encoded using floating point numbers, then Evolutionary Strategies is your best friend.

Now... I could ruffle some feathers by saying that Genetic Algorithms and Evolutionary Strategies aren't really all that different. Same algorithms could be used for both. But historicaly they they came roughly at similar times frome different places on earth, Illinois vs Germany.

Back to GP. The cool thing about GP is that when the solution is evolved you have THE solution to the problem. No futzing about with how or what the results mean.

A big problem in the past is that GP doesn't scale well like neural networks. It is not embarrassingly parallel. It has been very limited by the types of hardware/architectures available.

But GP is a great field of exploration!
Settle down, Beavis. Not everyone is running Linux in a 24/7 production environment. I hear some people even fart around with it at home for fun.

I've been in pager rotations for most of the last 20 years so I'm sympathetic to that. If some genius symlinked unzip to 7z with no testing in production and caused an incident I'd be real mad. But uh I don't think that's remotely what OP was suggesting here.
Thing is, the tool needs you to pick the one instance that survives the purge. Which means looking through 10^x of mostly similar photos to pick one.

Removing duplicates isn't that complex already, and these tools exist so anyone can try it. It's just a truely grueling process.
This guy has been ranting and raving here longer than I can remember or thought to make an account so I assume he is HN royalty and that's why it's tolerated. That said it doesn't really bother me if I understand the circumstances.
Naming things is truly hard even for the smartest people.
"Paul Newman alcohol" is just showing you results where those words are all present, it's not really implying how widely known it is.
> One example is enough to disprove the "not capable of" nonsense. There are other examples too.

Gotcha, fair enough. Throw enough chess data in during training, I'm sure they'd be pretty good at chess.

I don't really understand what you're trying to say in your next paragraph. LLMs surely have plenty of training data to be familiar with the rules of chess. They also purportedly have the reasoning skills to use their familiarity to connect the dots and actually play. It's trivially true that this issue can be plastered over by shoving lots of chess game training data into them, but the success of that route is not a positive reflection on their reasoning abilities.
It’s a lot simpler to install nowadays. Just download, install, open the app, and voilà! Tons of self-executing examples are available within the notebook-style windows too.

Hope this helps.
You're completely correct, of course. The issue is that most people are not looking for quality, only efficiency. In particular, business owners don't care about sacrificing some correctness if it means they can fire slews of people. Worse, gullible "engineers" that should be the ones prioritizing correctness are so business-brainwashed themselves that they like wise slop up this nonsense at the expense of sacrificing their own concern for the only principles that even made the software business remotely close to being worthy of the title "engineering".
Linus’s views on GPLv3 would be something to watch https://youtu.be/PaKIZ7gJlRU?si=263GyZd9YaPu4-PC
Probably because they are working towards a future where they don’t have to worry about releasing source code for anything, while being free to make any modifications they want. They just need time to code around all the FOSS they’ve leeched off of the last couple decades or wait for BSD licensed projects like this pop up to do that work for them.
some gains come from stripping metadata,

That's not compression, that's just deleting people's data.

structural compression means optimizing how image data is encoded, like better Huffman tables for JPGs or smarter filtering for PNGs.

I think that's just called compression.

How are you getting better huffman tables for JPGs and how are you doing 'smarter' filtering for PNGs ?

I'm asking for deeper technical explanations because not only would beating current image compression libraries be a technical feat, a lot of people in this thread think that you aren't actually doing anything differently.
True, when it comes to data, there is a strong case to be a compulsive hoarder. It's cheap to store; often free and data is often marginally more useful and interesting than most generic mass-produced old junk which sits in garage gathering dust.
> TWO heavyweight processes

If you're going to emphasize that it's two processes, at least make sure it's actually two processes. `[` is a shell builtin.

> `eval` being heavy

If you want a more lightweight option, `calc` is available and generally better-suited.

> inexplicable flurry of punctuation

It's very explicable. It's actually exceptionally well-documented. Shell scripting isn't syntactically easy, which is an artifact of its time plus standardization. The bourne shell dates back to 1979, and POSIX has made backwards-compatibility a priority between editions.

In this case:

- `[` and `]` delimit a test expression

- `"..."` ensure that the result of an expression is always treated as a single-token string rather than splitting a token into multiple based on spaces, which is the default behaviour (and an artifact of sh and bash's basic type system)

- `$(...)` denotes that the expression between the parens gets run in a subshell

- `-eq` is used for numerical comparison since POSIX shells default to string comparison using the normal `=` equals sign (which is, again, a limitation of the type system and a practical compromise)

> even though the processor has single cycle instructions to add two numbers and test for equality

I don't really understand what this argument is trying to argue for; shell scripting languages are, for practical reasons, usually interpreted, and in the POSIX case, they usually don't have to be fast since they're usually just used to delegate operations off to other code for performance. Their main priority is ease of interop with their domain.

If I wanted to test if one plus one equals two at a multi-terabit-per-second bandwidth I'd write a C program for it that forces AVX512 use via inline assembly, but at that point I think I'd have lost the plot a bit.
90% of everything is crap. I think there's a law about that or something
Who is paying for all the costs involved in making that channel and showing it to everyone?
Location: Los Angeles Remote: Yes
Relocation: Case-by-case

I'm a CTO, expert engineer, and data professional interested in team-building, consulting and architecting data pipelines. At Edmunds.com, I worked on a fairly successful ad-tech product and my team bootstrapped a data pipeline using Spark, Databricks, and microservices built with Java, Python, and Scala.

At ATTN:, I re-built an ETL Kubernetes stack, including data loaders and extractors that handle >10,000 API payload extractions daily. I created SOPs for managing data interoperability with Facebook Marketing, Facebook Graph, Instagram Graph, Google DFP, Salesforce, etc.

More recently, I was the CTO and co-founder of a gaming startup. We raised over $6M and I was in charge of building out a team of over a dozen remote engineers and designers, with a breadth of experience ranging from Citibank, to Goldman Sachs, to Microsoft. I moved on, but retain significant equity and a board seat.

I am also a minority owner of a coffee shop in northern Spain. That I'm a top-tier developer goes without saying. I'm interested in flexing my consulting muscle and can help with best practices, architecture, and hiring.

Would love to connect even if it's just for networking!

Blog: https://dvt.name/

Résumé/CV: https://dvt.name/resume/

GitHub: https://github.com/dvx