skysight-inc/HackerNews huggingface dataset:
This is kind of beating a dead horse. Of course the web was better when only the intellectual elite were on it. Of course it turned into a cesspool when the other 99% joined, including the 1% who are prolific destructive trolls.
It seems like people that are highly engaged in online conversations do so because they, consciously or not, think their contributions will pull the universe toward some goal. That goal might be "truth", "freedom", "absurdity", etc. (Uncovering those goals sounds like a really fun project.)

I think some of it also comes from status needs. Specifically, dominance.

I don't understand the lurker mindset whatsoever. It has to be how most people interact with the internet though, otherwise there would be 10's of thousands of comments on every post here. Ever since I started using the internet as a little kid I've felt the need to toss my thoughts into the cyber stream. I think all the word games I've played with other people online have truly made me a multitude.

All that is opposed to real life interactions. In real life, people sometimes just sit next to each other and occasionally share thoughts. It's a lot more like chat rooms instead of like social media. In a chat room, the facets of an individual are more prominent, meaning, as the chat continues, you witness how a person reasons through their ideas and feelings. Maybe he's a climate skeptic but oh hey, you love my favorite band, what!

The above multi-facetedness of irl and chat interaction is in contrast to this, what we're engaging in now. This comment I'm writing is an expression of a microscopic slice of time in my life and thoughts in my brain. But it's now reified. People can come back to it 10 years from now and play with it in their heads. I might be dead by then, or I might be a fascist or I might have become a Zen monk. The new eyes sipping my words have no clue, little context, of who I was an hour or a day ago, let alone a decade since.

No wonder we stumble into toxicity on social media. Not only are we probably trying to prove or achieve something, but its asynchronous nature causes weird second-order effects. Millions of people can read a Facebook post written in a fit of rage and fear with a migraine ripping through the body of the author at 3 in the morning, but suddenly, that psychologically, philosophically, sociologically, cosmically absolutely insignificant moment could cause ripples throughout the entire world. We're built by evolution to play joyous semantic games with each other. With social media we're trying to do the same, except our innocent flourishes are all punctuated with grenades and nuclear bombs.

Anyways, those are my thoughts on that. I'm very happy to hear that you found good people to share your esteem and friendship with. That's the dopest shit.
Sortof depends on the software.

If it's specific to some domain, then a description won't make it more useful if you're not in that domain.

If it's more generally useful, there are plenty of wonderful tools people might not have heard of.
So I plan to collect every link I can, and then sort them into "events" that are based on something that actually happened.

This just moves the problem to being "what links to prominently display for an event". I'm not sure on the details, but I'll probably end up with some heuristics for what links are the best with an option to manually override it. I also want to implement a fair bit of user-controlled filtration (think along the lines of https://pcpartpicker.com/products/motherboard/, except for news articles instead of motherboards)

Organizing links is, I think, best done manually in the end. But with automation to make it easier. For example scrapping RSS feeds and using keywords to suggest where I might want to put them. I also want to make it possible for users of the site to add content (or for high profile articles, just suggest it, because spam sucks).

In some sense this is "realtime", but without any plan to race to make it happen as quickly as possible. Pushing updates to email of course less so. Triggering "this is a big enough of a change to send an email" will be a separate manual action. As for when that email will be sent, I'm thinking of setting it up so people can subscribe to a saga with daily (default)/weekly/immediately on change.
The problem is that it's a continuous event.

A lot of places are on the margin where 1c or 2c matters a lot. This margin moves up the more we increase heat.

But more than that, the volatility in the climate system increases at a much greater rate than the mean temperature.

Extreme weather events will continue to get more frequent
Another quote from the press-release of the study:

>“Epidemiological tracking shows a steep trajectory of new infections, indicating Omicron’s rapid spread, but so far with a flatter trajectory of hospital admissions, possibly indicating lower severity,” explains Dr Noach. “This lesser severity could, however, be confounded by the high seroprevalence levels of SARS CoV-2 antibodies in the general South African population, especially following an extensive Delta wave of infections.” [1].

So, to actually make the comparison we'd need to compare new Delta infections with new Omicron infections time-matched, comparing people who were seronegative to start with. This would be really hard to do in South Africa since there is a high proportion of seropositive people.

[1] https://www.discovery.co.za/corporate/news-room
If you don't check every day, it's inevitable you will miss something. I guess the real need is not a webpage but more of a notification service that tells you the major news stories of the day.
A group of people publicly proclaimed that the election was fake. They announced they were going to advance on Congress and Stop The Steal. They showed up in the thousands with weapons and restraining devices, broke into the Capitol building, broke a lot of things, literally wiped their shit on the walls, and were finally repulsed.

Sounds like an "INSURRECTION" to me. What part is missing? Do you only count it as an "INSURRECTION" if it fails? Hmm...

---

Hey, I heard a joke:

Q: How do you know Trump was running the January 6 insurrection?
A: It failed.

:-D
I'm trying to be charitable here, can you expand on that and explain why that's not an invalid comparison? For example, the word immediately after your quote was “S3”. That's not something the CNCF can solve for you since one of those is a service and the other is an application you can run — at the very least you need an _extensive_ ops and security if you're relying on it as much as S3 – and, assuming you're talking about Rook, you're comparing it to one of the largest, highest-scaling services in existence but here's what you're on the hook to do if you do it yourself:

* Kubernetes

* High-level storage services: Ceph, Cassandra, NFS

* Lower-level storage for whatever you pick for the previous point

Each of those, and the combined service you build, needs staffing for operations, monitoring, security, etc. support. If you follow any security standards or are in a regulated industry, you're on the hook for documenting compliance on all of those, too, especially if you need to be able to demonstrate things like immutability.

You certainly can do this but that's a number of full-time jobs requiring expertise. If you have enough storage usage you can potentially justify the savings over the rates you'd be able to negotiate but that's a big up-front cost which you hope but are not guaranteed to recoup.
Elizabeth Holmes vs. Marcus Aurelius
> for example the role that The Guptas, McKinsey and KPMG all played in looting the state.

Who made that possible? The voters, who voted for Zuma and the ANC and gave them a legislative super majority, who then in turn gave the Guptas all the power that they managed to get and either looked the other way or more likely were complicit in the Gupta's corrupt dealings with KPMG and McKinsey.

Without South African politicians selling out the South Africans who voted for them, the Guptas, KPMG and McKinsey would be entirely irrelevant. But I'm sure these facts won't prevent South Africans from lynching some more foreigners.
PyTorch vs. TensorFlow in 2022
On the median day, major western news sources have zero articles I care about. Here are the current headlines from https://text.npr.org:

- The parents of the accused Michigan school shooter head to court again

- Experts crack the secret to last letter of Mary, Queen of Scots before her execution

- The Air Force discharges 27 service members for refusing to get a COVID vaccine

- Their lives were changed by gun violence, and now they're running for office

- The best and worst places to live if you care only about money

- To save lives, the overdose antidote naxalone should be sold over-the-counter, advocates argue

- Vaccine protection vs. omicron infection may drop to 30% but does cut severe disease

- The federal agency that measures racial diversity is led mostly by white people

- Rep. Liz Cheney read the text messages she says Mark Meadows got during the Jan. 6 siege

- Kentucky crews search painstakingly for 109 people missing after deadly tornadoes

- 'Return of the Jedi,' 'Selena' and 'Sounder' added to National Film Registry

- Pfizer data shows that its COVID-19 pill is effective against severe disease

- Saule Omarova gets candid: Banks sank her nomination to become a key regulator

- The Supreme Court again leaves a state vaccine mandate in place for health care workers

- Survivors of Nassar's abuse reach a $380 million deal with USA Gymnastics and the Olympic committee

- This year's Golden Globes nominations avoid obvious pitfalls, but won't restore the awards' luster

- More Black families are homeschooling their children, citing the pandemic and racism

- No U.S. troops behind a drone strike that killed Afghan civilians will be punished

- What dish is never missing from your holiday table? Tell us why you love it

- Elon Musk is Time's 2021 Person of the Year

I'd love an RSS feed that lets me know about Russian troops on the Ukranian border but not about any of those "stories." Actually reading the news is a frustrating experience because the signal-to-noise ratio is so poor.
At FAANG and similar companies yes. Note that it's total comp which includes RSUs. At senior levels RSU refresher is quite high and it all adds up.
There have been no clarity on the status of “being able to stay on iOS 14”. Previously, you could stay on iOS 14.8.1 and the system saw it as “fully updated” but with the option to upgrade to iOS 15. Now, any devices with Automatic Updates turned on gets updated to iOS 15 automatically. I figure they allowed users to stay on iOS 14 in order to avoid the CSAM (legitimate concern) but now they are steamrolling everyone to iOS 15. Does that mean they will be removing CSAM in the future?
I will wait for a couple of days to see if 14.8.2 or 14.9 appears. If it does not, I think we can consider iOS to be EOL (and that Apple changed their mind about iOS 14).
Incredibly cool! This should invite a whole new type of blogger to the internet - well done!

Curious - I'm looking at your other projects as well and the design is quite good. Are you using a firm for design, or do you have any front end frameworks to recommend? For some reason design consistency the way you have it is extremely hard for me.
Vitalik originally proposed it here: https://ethereum-magicians.org/t/a-rollup-centric-ethereum-r...

ETH2 is where Ethereum goes from Proof of Work to Proof of Stake and as a result uses 99% less electricity.

The second phase of ETH2 is sharding where instead of Ethereum being one big chain it has one execution chain and 64 additional data shards. This makes it scale incredibly well when it's a settlement layer for rollups (up to 14 million TPS with 1024 shards - See https://polynya.medium.com/conjecture-how-far-can-rollups-da...)
All infrastructure at all times in history is crumbling. The second Japan builds a new rail line it starts “crumbling”.

China might look like it’s light years ahead on infrastructure, but infrastructure starts to be a pain in 50 years when suddenly you gotta spend on replacement and maintenance.
We could also use an inflatable module with a centrifuge inside it. The smaller diameter would make coriolis forces worse and walking would be tricky, but, at least, your body would spend some time under some gravity.

Putting it inside a large inflatable makes it easier to pack and solves a problem with rotating seals and the need to stop rotation when a spaceship is docked (because an internal part is rotating, but the rest of the craft is static). One issue that it doesn't solve is that it'll doubtlessly pass some vibrations and some oscillations to the rest of the craft, so any microgravity experiments will need to account for that.
The ending seems to imply that drugs with similar effects to the ones we ingest every day can be arbitrarily prohibited, solely based on their "traditional" use before or after the start of our modern era. The mention of the scandals in UK Parliament is used to illustrate the hypocrisy of these prohibitive laws. Qat and coffee have more in common than not, but one is Class A and one is sold by McDonald's.
What makes you think Solana is Centralized? It runs over 2000 nodes. The number is currently is less than that of Ethereum node count, as the demand is less.

It also would be a fair comparison to compare what is existing today. So, please don't say that Ethereum 2.0 will be far more efficient. By that time Solana would have made great strides too. So, let's compare what is existing today. Ethereum 2.0 is being touted for several years and still not ready. We can compare Ethereum 2.0, when it's ready and there, but not now.
The question, as always, is who watches the watchmen? We saw what happened with broadcast and telecom regulation for phone and radio/tv in the USA. ABC, CBS, and NBC held a virtual monopoly until cable news 60 years later. AT&T/Ma Bell did likewise. It was horrible and arguably retarded innovation and diversity of viewpoints for many years.
Companies that are hiring Software Engineers
I have worked on reliability for some private OpenStack deployments, on-prep K8S deployments. Views are my own and don’t reflect on any open source community or company.

To operate a production cloud you need expertise at all parts of the stack. This includes network, kernel, maybe firmware, orchestration, etc. You also need adequate planning where your on-prem data center teams continuously upgrade your hardware/firmware and add capacity. From an organizational perspective this is an entire VP or SVP level organization depending on where you are.

Operating large infrastructure is hard. If it’s not your core competency there is really no point in dealing with it. Either way, it takes enormous effort to hire and keep a team skilled to operate infrastructure. You will lose your team to big-tech eventually.

You don’t need external consultants to manage your cloud infrastructure. Your existing engineers can skill up to use it. Public cloud will commoditize what typically takes a lot of time to plan for capacity, DNS, networking, scaling, etc.

In short - its prioritizing speed of execution over everything else. The opaque billing is just cost of doing business. But unless tech is your core competency, opaque billing is much easier to deal with than all the other situations that come up with managing and maintaining your own infrastructure.
With zkrollups, there's a cryptographic guarantee that the off-chain computation is valid.

With optimistic rollups, there's a withdrawal delay so people have an opportunity to submit proof of fraud.
Agree with the idea that the physical and digital worlds are bifurcating.

The main way I see it is in discourse, and particularly the way in which people seem to believe "their way" is the only way, when actually they're just in a bubble.

Comments here allude to it. Many people have been diving into the virtual world since lockdowns became mainstream. But many others have gone the complete other way - many of the groups I'm in have been rejecting technology more and more because they now value human experience far more.

This is only one example, but as far as I can tell, these two groups are almost completely at loggerheads now, the other side just seems baffling to them.
I thoroughly enjoyed this. I kind of agree.

Of course it's not quite as binary as 1990s = good / 2020s = bad, but this article does resonate fully with my most cynical side.

I'm surprised there was no mention of cookie banners (unless I missed it).

> Although Zuckerberg and his merry band of wankers have a lot to answer for, the death of web 1.0 and the humble personal blog is not their fault alone. Search plays a huge part in this shit show too.

I like this guy.
Yeah for us it means you have a team tech leadership role.

It’s hard to imagine a team where everyone is “leading”. Some people have to be doing.

TBH I doubt the actual work people are doing has changed. It’s more about status and salary.
Average revenue per passenger improved by 5.2 per cent from €69.0 in F20 to €72.5 in F21. Average ticket
revenue per passenger decline from €37.7 in F20 to €32.0 in F21 (by 15.2 per cent), while average ancillary
revenue per passenger increased to €40.6 from €31.3 (by 29.6 per cent)

Wizz air annual report.

Lots of people spending a little adds up. Poundland for example, small amounts of revenue for each individual product, but millions of transactions add up.
The green line is mean temperatures on the same days of each year from 58 to 02. The red one is 2002 onward.
Years and years ago (around Gore v Bush) we hit a few "point of no returns" and I started to look up what can we actually do if we are past a point of no return. I found some relief in the idea that we could pump chemicals into our atmosphere to balance out the "bad" chemicals.

I have a pretty naïve understanding of this and I was aware at the time that this was a bit of a nuclear option because its unsure if this would work and once we do it there isnt really any going back. But this is an option right? At some point some country that has been impacted by climate change enough will start to dump something into the air to counteract climate change.

I havnt thought about this in years but someone asked me recently and I brought this up and they questioned it a bit and I realized I didnt actually know how it would potentially work.
I like this framing. My previous framing came from `Loonshots`, where Bahcall frames this as "Artists" (Revolutionaries) and "Soldiers" (Evolutionary). I felt that, in the context of engineering, Artist/Soldier felt dismissive against the soldier. Revolutionary/Evolutionary avoids that for the better.

https://www.goodreads.com/book/show/39863447-loonshots
It tries to do pretty much everything. Just my opinion.
Nothing in Ada made it impossible to use it on PC or similar devices. And performance of its compiled code was similar to that of C code if not better. And some of its features like ability to return from a function a dynamically-sized stack-allocated array is still not available in C/C++ or Rust for that matter.

I guess what really made it a niche language was the cost of compilers. DoD vendors in eighties already learned how to milk their customer.
Well, I'm not an American, and yet I think they're entirely right.

Also, we note you don't provide any actual rebuttal. :-)
Oh so I guess that's why I'm seeing "ghosts" of finder windows under the dock sometimes, especially right after taking a screenshot? And they disappear if I switch to finder. I kept thinking "how could they've possibly broken that". Updated to 12.1 today, will see whether that improves anything.

But it would be more interesting to see the parts that deal with untrusted data (file format parsers, protocol handlers) rewritten in Swift.
Thanks for asking! Busy like a sailor with two dicks in a whore house, but hey, at least I still have a good job.
Anyone else feel let down by all the existing container formats out there, and feel this itch to like, write their own? I know, I know, that's like the worst possible idea, xkcd #927 "now there are 15 standards", but like, what if?

What I'm looking for is basically something that ticks all the boxes of LOC's 7 Sustainability Factors. Is able to store arbitrary binary data, along with metadata, in a single file. Easy to pack/unpack, particularly in Python. I'm pretty well covered for image/audio/video formats, but none of those lend themselves to n-dim arrays.

Ogg, matroska, and HDF5 are all container formats which can ostensibly do this, possibly even well. Ogg and matroska are supposed to be able to support arbitrary data steams and metadata, but actually finding tooling to do the operations I want to do has yet to bear fruit. HDF5 is insanely complex, and I have some concerns about performance and data corruption risk.

Tar is tempting but it does some really goofy things, like ending an archive with 1kB of zeros.

What actually looks most promising as an existing "format" is the RIFF family of chunked encoding. Dead simple, python stdlib even has a reader. Only real downside is 2*32 ~= 4 gigabyte size limit, though this can be overcome by using a "stream of chunks" model.

Alternatively, a stream based on Msgpack, with some slight constraints, is very appealing.

Sqlite3, also very tempting.

If I did write such a "format", it would definitely be built on the primitives of either RIFF, Msgpack, or Sqlite-as-application-file, so it'd be less of a "file format" and more of "existing format with some opinions about schema".

Protip for anyone also thinking about making their own file format: make sure the API/format supports some sort of arbitrary metadata model! Apache Feather and Parquet are pretty recent, but don't really support writing metadata, you kind of have to hack around it. IMHO, this is a huge oversight, especially considering the internal metadata is literally just JSON-encoded fields.

Edit: actually just reread the follow-up to "moving away from hdf5" and it mentions ASDF format. This looks really promising. YAML metadata header with binary blocks. Normally it's not a good idea to start with UTF8 and later go binary, but if you know when to stop reading text, it's not the worst. Also, it's a name collision with the asdf version manager (and also anything else named after rolling the left hand home keys)

https://cyrille.rossant.net/should-you-use-hdf5/

https://towardsdatascience.com/saving-metadata-with-datafram...

https://en.m.wikipedia.org/wiki/Resource_Interchange_File_Fo...

https://msgpack.org/index.html

https://www.sqlite.org/appfileformat.html

https://asdf-standard.readthedocs.io/en/latest/
Markdown and Git should be very accessible to a non-technical audience and I've had good success with both.

Here's my favorite SAAS offering in the space - https://www.gitbook.com/
I very much enjoy Bentonville for mountain biking. I was just there Friday because there was a nice 72 degree day.

Oven and Tap _was_ one my favorite restaurants. The food _was_ amazing and it is a nice classy atmosphere, but until they apologize for taking legal action against a waitress for telling the truth, I'll be voting with my dollar.

The restaurant is so in the wrong here. They want it both ways: to short change their waiters by deducting 7% of their wage from their paychecks, and to seize tips. Unfortunately this is common practice, but it needs to be eliminated completely.
I just went to set up a hard limit on several accounts. There is email notification. The only actions stop individual services on individual Amazon server locations.

There is no global "DROP DEAD" action freezing my account and my liability to Amazon.

My ideas for fake notification addresses and their purported actions are likely against HN rules. I'm just going to leave Amazon AWS.