skysight-inc/HackerNews huggingface dataset:
Probably worth mentioning that the submitted link is just the presentation by the author of Unpoly, with some history and reasoning, but the better explanation of Unpoly itself is on their website:

https://unpoly.com/

Essays on HTMX website also help a lot:

https://htmx.org/essays/
That's the definition of L4, and the reason Waymo isn't L5. L5 is no human in the loop is ever necessary.
Germany doesn't have Minijobs? They're pretty much what this article is describing.
He mentions a CPA at the end but I didn't catch any mention of an attorney. I wonder why.

The state bureaucracy doesn't care about you. The tax code is enormous and only gets bigger. The bureaucracy's game is to claim you screwed up with minimal transparency. Nobody will volunteer to do a deep dive on your case, nobody has an incentive to help you, and nobody is accountable for their mistakes or lack of effort.

It's very difficult to play with these rules, and an attorney can help change the game.
This is not really new, lots of people are writing papers on different paths to this.

There was a huge interest in synthesizing motor fuels from coal or natural gas up to 1980, it makes for depressing reading because the Fischer-Trospch chemistry for building up hydrocarbons from hydrogen and carbon monoxide has awful economics. For anything else people would be happy that iron works as a catalyst but they scoured the rest of the periodic table looking for something better and didn’t find it. You have to run the reaction at low temperatures otherwise you get nothing but methane, but under those conditions reactions that build up and break down hydrocarbons are closely balanced so you have a huge machine which makes a trickle of fuel so the capital costs are high.

Looking at the history you’d think somebody would tell the airplane engineers that they should just go clean sheet and figure out how to fuel airplanes with hydrogen or methane but they are so used to being coddled (like that time the FCC couldn’t make them upgrade their broken altimeters or how they are just barely starting to remove lead from GA fuel after all these years) that they are sending chemical engineers on what’s been a lost cause for more than a century.
I can assure you that for anyone dealing with large volumes of storage and/or bandwidth of still images (i.e. pretty much any high-traffic website), where costs directly related to storage/bandwidth are measured in millions of dollars, will not consider a 20% saving to be a "pretty minor" thing.

I agree that in video, the savings can be even more substantial. But keep in mind that the median web page still has zero videos, while the median web page has about 1 MB in images. In practice most of the transferred bytes in web browsing are html (which is very small after compression) and images. Javascript, css and fonts also contribute to the page weight but those tend to often be locally cached since they're mostly static compared to the html and images.
JSON lines looks kinda interesting, but the newline-delimited thing seems weird.

It seems to me that you could write a JSON streaming parser that, if the outer element is an Array, reads and outputs/processes one Array element at a time as its JSON value. Yeah, you can't get the array length, and if there's a parse error somewhere down the line then you have to figure out how to deal with that (a non-streaming parser would have rejected the whole input), but that's kind of inherent in using a streaming parser. The upside is that you can work with any valid JSON.

Sure, if you're interoperating with shell tools, and don't have `jq` available, newline-delimited JSON might be helpful. But on the other hand, just install `jq`, dummy!
how is a line more efficient then a circle?
You are trying to do colour management on the web, and also likely in the general consumer PC space.

This is impossible, and will remain so for at least a decade.

No vendor other than Apple has the slightest interest in getting colour even vaguely right, because they're all run either by colorblind lizards, or have corporate drones that are given identical monitors. The cheapest monitors possible that are basically greyscale.

Recently, Windows has taken several steps back from Vista's fairly good colour management. For example, the newer Win UI 3 SDK is 8-bit sRGB SDR only. Similarly, HDR support on Windows 11 is totally broken, and every semi-annual release does random things to it. When bugs are identified by consumers (not Microsoft!), they delay the fixes to the next semiannual release... at which they break other things. There hasn't been a release of Windows ever that can correctly drive a directly attached HDR display, such as the type used in a laptop.

None of these corporate drones understand the problem because they literally cannot see it.
> The situation is even worse now.

Is it really? I have the exact opposite opinion. I mean, I feel like the industry has pretty well standardized on React in Typescript for the front-end on web apps. Sure, there are other technologies that do different things (e.g. Svelte, and someone else mentioned Phoenix LiveView), but for the standard "I'm building a CRUD-focused web app", there are simple choices to make and it's easy to "do the right thing". I contrast this with 2016, when things were still in flux so it was much easier to make what turned out, in hindsight, to be the "wrong" choice (e.g. Angular or Flow). Plus, tooling support is much better now.
Have you tried htmx? Maybe HTML wasn't designed to be dynamic, but IMO htmx does a great job extending it to provide interactivity in a way that feels natural and simple.
> The Playstation was really the first format that opened up the market to a lot more people.

The absolute courage to write this in a thread about Atari, man.
Sorry, I meant when will Rust for Linux be completed? Meaning, when all the C code will be replaced with Rust? I will change the title.
European lawmaker urged to quit over Gulf corruption scandal
And, given a finite present value, I'm pretty sure Yale has the money to buy it back if they want to...
Oh yes. CSVs are deceptively challenging especially if your use-case is from excel files to csv. Excel will happily convert a worksheet to csv, but it's a naive conversation. Headers that start on line 3, multi-line headers, inconsistent column counts, etc. It adds up really quickly!
Nobel Peace Prize: Russian laureate 'told to turn down award'
https://arxiv.org/pdf/2212.03551.pdf
I think it's fine to assume the more likely interpretation that this company simply isn't interested in the format anymore, rather than whatever larger stretch you're describing here. "You don't want to keep dead code around." That's rich :) maybe if this was some one person hobby project or something.
Why Are There 750k Unfilled Cybersecurity Job Openings?
As semiconductor VC funding dips, startups trip, crash, build for the next boom
This sounds like a data lake or delta lake type of situation. If all you need is daily bulk updates but don't care about individual row updates nor concurrent access, I would probably not use a full-fledged database in the first place.

e.g. https://docs.delta.io/latest/delta-standalone.html
Ski resorts are melting. Here's what that means for winter vacations
Python lets you play the system bell sound
I'm aware that the parent article doesn't refer to diabetes. I never said it did. As a general comment regarding this disease I shared what my current state of mind on this was. Is there a link between diabetes and the mechanism explored in the parent, maybe? I don't know. But maybe, just maybe, if enough paths are explored we'll eventually find the right one. Diabetes seems to be an interesting one for me ... but I'm by no means an expert. Just an interested observer that is doing a genuine effort to understand.
I had never heard of sandstorm
Discussed at the time:

The Plan 9 Effect or why you should not fix it if it isn't broken - https://news.ycombinator.com/item?id=11791980 - May 2016 (107 comments)
Reproduce, then narrow down.
I’ve had one on my keychain for at least 5 years now with no issues. It would have been longer but I did switch to a USB-C key two years ago. I kept the old one enrolled as my backup key.

I use a password manager, but my Yubikey has all my 2FA. Including TOTP.
Many years ago I saw a fairly dodgy looking ad asking for someone to write revision material for GCSE IT. I emailed to find out more, found out it was for BBC Bitesize (very popular free internet based revision guide in the UK) and spent the summer writing it. Being able to name drop the BBC helped get further jobs and I've send some cheeky cold-calling emails to see if companies are looking for writers etc. Sometimes they are, often not.

I'm always on the lookout for freelance work. Should anyone need a writer with technical knowledge then my email is in my profile!
but... that is why its great? That's the only relevant factor in my day to day life anyways. that with my USB-C headphones I dont have to think about whether its upside down or not.

...am I not a tech person? Hold on, need to go do some existential musing.
There’s a strong correlation between Alzheimer’s disease and high blood sugar
levels.

https://www.alz.org/media/Documents/alzheimers-dementia-diab...
Yes, in Czechia we have same corrupted politics and business. Since summer 2021 prices goes up around 30% on food, 50% for energy. Most ridiculous is that our power plants make enough energy for entire country and 15% are sold abroad, but... All energy is auctioned on the Leipzig Stock Exchange for 600% higher price than it is actually made (1 kWh cost around 1 CZK to made, it's sold for 6-7 CZK and rising. Now our gonverment need to cap prices from our taxes so state budget has this year recorded deficit since 70’s around 350 bilion CZK.

Trust in gonverment is very low, voter turnout was around 48% in regional elections.

Our politicians blame war in Ukraine, it's ridiculous.
One thing I'd like to add is that you do not have the computing power to generate a large language or vision model. Period. Unless you have hundreds of thousands of dollars for compute time you are just not going to do anything interesting with model building and AI.

Upgrading existing systems with AI is probably where it's at using existing models like stable diffusion, GPT-3 or some of the smaller downloadable language models if the task is very simple and the economics of using GPT-3 don't make sense.
I don't think many people troll in voice, either, so then it doesn't make sense to say that. But this is getting quite meta. Point was that your claimed opinion is so far out there compared to typical life that I don't know if you're serious about not installing any apps for legitimate and useful purposes ever.
I 100% agree. I really like the idea of getting rid of passwords, but I wanted to be able to control my own information. That is why I built Bulwark Passkey (https://bulwark.id), an open-source virtual passkey manager which allows you to export your credentials out of it, or sync them across devices.

Passkeys have a lot of advantages, but the current plans for implementation are rather limited. If you're interested in passkeys that you can actually control, please check Bulwark Passkey out!
Disturbed sleep should IMO also be looked at - eg UARS and sleep apnea. You can sleep 8h every night and still feel crappy waking up. Maybe disturbed sleep is even worse than lack of sleep?
I can feel better after 6h of good sleep than after 9h of disrupted sleep (eg when I know I‘ve been snoring, eg due to throat infection).
Germany doesn't have

> the cycle of "I'll take whichever bad choice is least bad right now because I'm desperate."

Welfare covers the basics and provides for a modest life, no desperation included.
Because the metodologies are proce
This feels like a false dichotomy: while you cannot change your sexual orientation, you can choose to make it more apparent and it has clear benefits for other lgbtq+ people around you (which, for me, gets it out of the selfish connotations of showing off: wherever you live, being openly gay still carries a non-zero physical risk, you don't do it just for the fun of it).
Natural Language Processing Demystified
Level 4 means full autonomy within certain predefined conditions. In Cruise's case, this might be, "Only in certain parts of San Francisco at night." This qualifies for Level 4.
Because in my day to day life wearing clothes is not a prerequisite for interacting with technology. I frequently exercise. This requires many showers and many changes of clothes. I walk around in the morning just wearing my boxers for the first hour of the day or the last hour of the night. This isn't exactly abnormal behavior. I always have my phone around but always having my phone plus always having my YubiKey is a step up in difficulty and not a linear one. Any successful auth solution better be prepared to solve such behavioral issues or they won't ever reach sufficient adoption levels.
Isn‘t that what DeepMind tried to circumvent by using AlphaZero for AlphaTensor, to discover faster matrix multiplication techniques?
I'm not very familiar with it, but Stan Efferding (The Rhino) recommends conjugated linoleic acid (CLA) as part of his Vertical Diet. I've found that beef and rice is pretty much the ideal bodybuilding food, so he's evidently onto something.

Definitely yes on butter. In fact, just throw away most pre-2000 health advice (lite, low-fat, etc). Those recommendations were tainted by Big Ag to get us to forego healthy foods for higher-profit ones. Margarine is cheaper than butter, sugar is cheaper than ripe veggies in stuff like spaghetti sauce, and so on.
If we were willing to significantly overbuild nuclear power production capability yes, but from what I understand with current carbon capture efficiency it's more effective to have that nuclear power directly offset current energy consumption instead.
Power dynamics never really change, do they? The currency in which power is measured, and the eules by which they play are all that changes. And the more things change, the more they stay the same.
Don't put it together. Learn all this stuff, understand it deeply. Then use it when you find it improves whatever you are working on.

If you start putting it all together you will most likely only confuse other developers, especially juniors. Don't do it. The point of gathering all this knowledge should be making the application simpler and easier to maintain. So introduce stuff gradually and only when you find the added complexity pays out.
That's not the stated goal of the Rust-for-Linux project.
The article says, "In the 17th century, people sometimes issued perpetual debt." True, but not just in the 17th century; consols have been issued into the mid 20th century, mainly for war (from the Napoleonic wars up to WWII).

The article also mentions, parenthetically, "The interest rate was reduced to 3.5% and then 2.5% during the 17th century." Does anyone know if this was specific or if some law alterered interest rates?

The bond is older than Yale itself (though FWIW there are plenty of schools still operating that are older than this bond).
Interestingly, the parent was posted two hours ago and I find it near the bottom.

It is either revealing of the visiting patterns of HN members, or.
The problem is that we need to pair generative models with verification systems. We have the models, but no verification yet. Fortunately code and math are easier to verify. Some things require simulation. In other cases you can substitute an ensemble of solutions & picking the most frequent answer as consistency based verification. But for each domain we need to create verifiers and that will take some time.

The good thing is that we'll be able to generate training data with our models by filtering the junk with the verifiers. Then we can retrain the models. It's important because we are getting to the limit of available training data. We need to generate more data, but it's worthless unless we verify it. If we succeed we can train GPT-5. Human data will be just 1%, the race is on to generate the master dataset of the future. I read in a recent paper that such a method was used to improve text captions in the LAION dataset. https://laion.ai/blog/laion-5b/
I meant: should not have been part of Euro. EU membership makes total sense.
I don't think it's scrum that's the problem. I used to be a big proponent of it when it came about. But in those early days of agile there was excitement that we were gaining this control over our own development process. That was never going to really happen. The company I worked for was doing development work for government and started pushing agile as a way to do it, eventually transforming itself into an agile consultancy. It pains me to look at the profile of people I worked with back then, great people, who now just peddle what I consider bullshit. Anyway for myself I no longer do any of that, just dev work, and I've been on good and bad teams. The process doesn't actually make a difference.
Yes, this sort of thing is best thought of as a different sort of battery. You put energy in, and later get energy out. It's not a fuel.

If you could do it with solar power, it's sort of like free energy but no more than charging batteries from solar is. There are still infrastructure costs at minimum.
Please see my reply to sibling comment.
I'm absolutely rooting for you doing an episode together. please listen to some other episodes before dismissing the content because of format - they're fantastic.

> whether server-controlled group membership is as big a disaster as you claim it to be, given you have to verify users to avoid interception anyway, at which point malicious devices are clearly flagged so clients can take evasive action (e.g. big red warnings, or refuse to encrypt messages in that room, etc.).

I really would love to see this addressed: the UE of crypto. In 2022 we should absolutely refrain from leaving the decision to the user w.r.t if it is safe or trustworthy. Users suck. Don't trust users to look at warnings unless you're intention is to cater to only those of us who still have a GPG FPR in their ~/.signature

It. Does. Not. Work.

"Web of Trust" was a great idea but failed to scale (when was the last time you received a gpg encrypted mail from anyone).

Signal served us well until SGX.fail (https://sgx.fail), and it's why something like Matrix deserves to succeed.

Systems get better under pressure (when questioned) so I really hope y'all get a chance to talk.
It often surprises me that Parquet is not widely known outside of data engineering circles. Most software developers are still mucking around with CSV for large tabular data, which is absolutely the wrong format. Better developers use sqlite, which is less wrong but still wrong. Postgres is closer to the right answer, but for very large, typed tabular data, Parquet is the way to go.

Parquet is a columnar format that is compressed, typed, efficient for columnar queries, append-friendly (though not rewritable), and is a natively supported format for Apache Spark. Parquet libraries are now widely available for most languages (didn't used to be the case, but now they are). I query Parquet files with DuckDB in Python and it blazes through GBs of data in seconds.

At work, the canonical format is TSV (tab separated values) which despite being human-readable, is huge, inefficient to query and does not support data types.

When I have to work with large TSV files (10GB or larger), I first convert them into 500MB Parquet files. The latter are faster, smaller and less prone to type errors. Because columnar formats like Parquets are indexed, I can do complex operations like joins, window functions, aggregations on them in a performant way, while any similar operation on TSV files will trigger a table scan each time.

I recently ran a Spark job on a very large TSV file which took over 8 hours and timed out. A Spark job on the same data represented in Parquet completed in 5 minutes.
> I think because Postgres writes the entire row even if a single column has been updated.

This is because of the consistency model postgres uses: Roughly, the old row remains in existence as long as transactions started before the UPDATE are still running, and the new row exists alongside it for that duration. Transactions started before the UPDATE can't see the new row, and transactions started after the update can't see the old row, because the transaction id (txid) is added to the query and is compared to hidden columns on each table/row (xmin and xmax).

This is one of the things VACUUM cleans up, actually deleting those old rows once all the old transactions have ended.
Wow. Thank you for sharing. I had no idea there was a scene for this.
To my mind, they are both a form of sleep deprivation. I would say that sleeping poorly, no matter how long you lay there, still constitutes sleep deprivation.

And as people get older, they tend to both sleep less and also sleep less deeply.
That was my first thought: JSON is highly amenable to compression; due to the repetition this blog is complaining about. It's a good lesson for junior devs: if you find yourself thinking about saving bits and bytes with custom protocols, you need to pull out of the rabbit hole and find the existing solution to your problem.

Sure, for a local data file or something where it's nice to be human-readable-ish, CSV can be a better choice than JSON (assuming you use a library for all the edge cases and string escapes.) If you really want a super-small and fast serialization, that's what protobuf is for.
dang - you are an Internet Treasure.
HN workers probably tend to be highly educated and the idea of slowly sinking into dementia is especially terrifying for them. The whole amyloid hypothesis has been debated for decades as well, so by now a lot of people are more familiar with alzheimers research vs others
You create a contact address from a normalized version of the entered address (after address verification) and an independent account ID. You can also generate an account ID derived from that normalized address.

The positive response of the address verification will tell you the address is deliverable and the user has access to it. Later if someone tries to register a capitalized form of the address it'll get rejected because of that account ID collision. Then the user can be pushed to a password recovery path where they'll need access to the e-mail/MFA to get control of the account.
:)

ChatGPT is so good I'm not sure that forums and comments won't be replaced.
Ajax was created by Microsoft to show Outlook on the browser....
Powershell actually ships one! I think you have a good point. I was going to build my own as C# ships alot of configuration options that can DRASTICALLY improve speed, which arn't on by default. But, we can test Redmonds version and get at least a decent idea of if it's suitable. I'll run some tests on that and get back to you in an hour or so. I'll use the same tests you have on https://github.com/BurntSushi/ripgrep/blob/master/benchsuite...

My testing will be on my Dev VM, in a WSL container on ubuntu 22.04, targeting a built linux kernel. With powershell from the Microsoft blobs they ship for linux. And Ripgrep from just Apt Install Ripgrep. With 5 warmup cycles for each.
If you want a passkey manager that allows you to export credentials, I would like to plug my own solution, Bulwark Passkey (https://bulwark.id). It's open-source and lets you export your passkeys outside of the system, as well as sync them across multiple devices, much like a password manager.
I notice that there is a limit of roughly 600 words max when I ask it to write something, a script, story, etc. Is there a way to increase the maximum amount of words that it can output?