skysight-inc/HackerNews huggingface dataset:
I really liked the book. I wrote my own review trying to dissect their secret sauce and I believe it to be their data pipeline. The focused on it from the very beginning and wasn't sexy at all. From the book:

> Piecing together a custom-built database, Straus purchased historic commodity-price data on magnetic tape from an Indiana-based firm called Dunn & Hargitt, then merged it with the historic information others in the firm already had amassed. ... Using an Apple II computer, Straus and others wrote a program to collect and store their growing data trove.

> Over time, Straus and his colleagues created and discovered additional historical pricing data, helping Ax develop new predictive
models relying on Carmona’s suggestions. Some of the weekly stocktrading data they’d later find went back as far as the 1800s, reliable
information almost no one else had access to. At the time, the team couldn’t do much with the data, but the ability to search history to
see how markets reacted to unusual events would later help Simons’s team build models to profit from market collapses and other
unexpected events, helping the firm trounce markets during those periods.

They also took market prices as nearly devoid of real life meaning. I was originally very skeptical of this approach as it requires immense discipline and rigor to avoid data mining. You see economists do that where they create a signal for something like the 23 month lag of GDP. Why 23 month lag? Because 1-22 were insignificant. But they seem to get away with it due to their strong academic background.

> Here’s what was really unique: The paper didn’t try to identify or predict these states using economic theory or other conventional methods, nor did the researchers seek to address why the market entered certain states. Simons and his colleagues used mathematics to determine the set of states best fitting the observed pricing data; their model then made its bets accordingly. The whys didn’t matter, Simons and his colleagues seemed to suggest, just the strategies to take advantage of the inferred states.

https://mleverything.substack.com/p/how-renaissance-technolo...
> "collapse in X-X+10 years" is overwhelming to many ears

"collapse in X-X+10 years" is not usually as overwhelming compared to what follows it. And usually, was follows is either we have to drastically raise taxes or abolish capitalism altogether and implement authoritarian governments, because as we know, only the capitalist societies damage ecosystems.
CTOs of like half the companies on the planet (and 90% of the Fortune 500) which use AWS seem to trust it just fine.
I don’t think enough people use pihole for smart TV manufacturers to care, and encrypted DNS breaks that anyway so setting up a 5G base station in your house would be overkill
There's something to be said about layers of security providing redundancy to catch errors--that's part of what goes into highly reliable operations used in aerospace and health care. If you get the postgres wrong and that's all you're relying on, then that's all you've got. If you've got the same postgres wrapped in a more rigid validation then arguably there are more bugs that need to align for a mishap. Of course the flip side is that's even more complex and more difficult to implement. The reality is people probably tend to skimp on the postgres layer's security if they're burying it deep under other things. Whether you're focusing on the postgres layer or some higher later (python or whatever), that's still just one layer of protection.
Some (all?) browsers will still play autoplay videos as long as there's no audio track (or if it's muted by default)
It's a drop in the bucket vs container ships and cars.

The containership situation can only have gotten worse since this article was published
https://www.theguardian.com/environment/2009/apr/09/shipping...
"inflation" is what you call the tax on "hoarding money and keeping old and useless things" that the author claims is lacking. (page 8/9)
These are excellent, super inspiring project! Forwarded it to all my software students : )
Almost zilch. These things should be phased out for health reasons. But climate change? A drop in the ocean.
Node.js – v17.2.0
https://www.theverge.com/2021/2/17/22287191/amazon-alabama-w...
It is true that the French Revolution and subsequent counter-revolution were not as successful as the American Revolution was, and that the non-democratic features of the American system are a major reason for that.
Your thinking is wrong and you should probably log off. Because we live under patriarchy sexism against men just sounds like cuckolded incels complaining. It doesn't exist.

Edit: this incel man child flagged me to the mods in under 15 seconds lmfao
Do dictionaries make you angry?
What do you use to encode the MP4s?
Interesting choices of examples there.

The still of the motorcycle rider has obvious motion blur, which immediately raises the question of how that can work with a depth channel. Can you access the depth data in some other way than just a Zdepth channel? If not, there are some serious limitations to what you can do with it.

In the video example, the depth channel flickers a lot. This seems to indicate the depth is some kind of calculated estimate, and not very reliable.
New Aerogel Could Produce 70 Times More Hydrogen Than Rival Methods
How do the independent cores mediate access to shared I/O on buses? (that includes RAM too)
Smart TVs scan what's on the screen to get data on what people are watching and sell that data to anyone who wants it

The idea is to make sure they can keep that data flowing even if someone intentionally disconnects the TV from the internet
I wouldn't encourage anyone to learn about complex topics from John Oliver in the same way I wouldn't encourage them to learn about them from Tucker Carlson. They're both entertainers first and foremost and have little to no obligation to report on the basis of fact and instead exist largely to tell their viewers what they already believe.
Spacebar: replaced by GIFs.

Arrow keys? Believe it or not, also replaced by GIFs.
Anthony Fauci: I Am the Science
Why do peole care about helium so much?
Israel might be a safe country to go to. The Orthodox there would make it very difficult for that country to enact a vaccine mandate.
I don't know. I prefer it when companies actually give the technical details.

> While we are still optimizing these instances, it is clear that the Graviton3 is going to deliver amazing performance. In comparison to the Graviton2, the Graviton3 will deliver up to 25% more compute performance and up to twice as much floating point & cryptographic performance. On the machine learning side, Graviton3 includes support for bfloat16 data and will be able to deliver up to 3x better performance.

This means nothing to me. Why is there more floating point and cryptographic performance? Did Amazon change the Neoverse core? Is this N1 cores still? Did they tweak the L1 caches?

I don't think Amazon has the ability to change the core design unfortunately. This suggests to me that maybe Amazon is using N2 cores now?

But it'd be better if Amazon actually said what the core design changes are. Even just saying "updated to Neoverse N2" would go a long way to our collective understanding.
It's been a long time since I've worked in that world but in the micro-controller world it is common.
It's a Notion-published site, so arrows select "blocks" (pieces of content) on the page.
Starlink could be that backhaul. Future terminals will have 1Gbps.
> Ad-support allows for a much greater userbase which is a key ingredient to having a good search engine or a good social network.

This logic is backwards. Having a large userbase allows them to sell ads in the first place to the user base that won't pay for the service in the first place.

Pretty much every large tech website has a building phase where they make no money and sell no ads while building a user base large enough to start selling ads. None of the large web companies today have charged to use their product and at this point it's unlikely they could.

>But the argument here is that Twitter’s users won’t defect anywhere. Its social graph is too valuable for them and a coordinated move somewhere else is borderline impossible.

Which is a terrible argument written by someone who doesn't understand the market. It's like saying no one will move away from AIM in 1999. Yes, people will. There are lots of historical examples, including the Digg to Reddit exodus. Even Facebook itself has had the problem of users migrating away from Facebook. Facebook has literally bought companies where users have migrated to (Instagram/WhatsApp).

> EDIT: as a baseline, consider how many users are willing to pay for purchase/subscription to different Twitter apps.

Virtually none. No one was paying for TweetDeck and now it's part of Twitter. Consumers aren't using HootSuite or Sprout Social, they target businesses. Going down the Android list most Twitter apps are free, the few that cost anything have small install bases (Fenix 2 <100k purchases, Talon for Twitter is ~ 100k purchases). Twitter has an daily active users of over 300 million users. So maybe 0.1% are willing to pay a one time fee for a client? I don't think Twitter can do much with that.

Virtually no one,on a consumer level, is willing to pay for a messaging service. WhatsApp (one-to-one) is free, Facebook is free (broadcast), Instagram is free, Snapchat is free, YouTube is free, TikTok is free, Skype is free, Zoom is free (to individuals), Google Chat is free, SMS/MMS/RCS usage is free (depending on how you look at the service cost).

On a business level you can extract payments (think Slack), but on a consumer level, messaging has no value people are will to pay (so it's ad supported instead).
The US labor situation is changing on a cultural level big time and rapidly. The working force is taking back the control. Companies are going to have a tougher time exploiting people for cheap labor with no/shitty benefits.

I love it. Unions are going to be a major driving force again and it's gonna be good for the work force. As a country we have to make it tougher for companies to exploit labor unfairly. The government has failed. The people know it and are finally taking action.

A true democracy would have strict regulations on companies which guarantee good living conditions for the people that live in it. The game of capitalism must be regulated, because it's a sociopathic construct. It's only goal is to make more money... as soon as possible. Left unregulated it exploits people.
Some business person probably read this post and thought "Hmm, Debian ...".
I’m pretty sure Facebook is more worried about competition from Snapchat than Giphy. Which is to say, not at all.
My father has been saying this for years. I find Google to be useful by using search operators. I know for a fact that the YouTube recommendations algorithm is “worse” than before. It’s infuriating
I get it, I almost included eternal september in my own post, but this feels like a reductive way to overlook an actual problem.
There are many problems in the world that only a handful of companies have. You could make money joining those companies and helping them solve the problem as an employee. You could potentially make much more money by creating a company that solves that problem and then selling it to one of those bigger companies.
Probably worth noting that the regular cell providers can also provide SIMS that dump the end device into your existing, normal private network rather than the internet.

I don't know how this service differs in pricing, so it's hard to quantify when this AWS service would be a better idea outside of coverage issues.
That limits the userbase to only people that are savvy enough to be a server admin, though. I've actually been discouraged from running my own server by people in the Matrix Chat world. Apparently there are risks if you're not knowledgable enough.
Bigger concern is probably local pollution. That said, I thought it was in the news recently that California is banning them?
Is this a competitor to Twilio's managed SIM card service? That's been my go-to in recent years whenever we need to provide cell data connectivity to a small number of devices.
> As for security, Postgres supports Row Level Security. You can literally protect every single row of your data with a solid security policy using a security mechanism older and tested longer than the average age of your typical HN reader.

Maybe you're referring to the underlying concept rather than the implementation, but wasn't row-level security added to Postgres in 2016?

https://www.postgresql.org/docs/9.5/release-9-5.html

> This is one advantage few people know about PostgREST, once the database produces even a single row of data, it starts to stream JSON to the frontend. Users don't have to wait for the response to fully buffer in memory in some Python or Go process before being relayed on.

This is one big reason why I like this kind of architecture, though I'd generalize it a bit. More than streaming, you don't have to reimplement access control mechanisms (as noted), subscription mechanisms (AWAIT/NOTIFY), or batching/transactions in your API layer. So much of what you do in an API server is just proxying for functionality that already exists in the DB, and that alone is a reason to seriously consider this approach.
Does the gubmint see it that way? the parts of the US defense complex that need launch capability have their own and are very happy with the whole structure that provides them, it seems.
My uncle owns a small business. He says it's great because he can pick the people he wants to work with and fire ones he doesn't like.

I pointed out I have the same choice by walking off a bad team and finding a good one.
I feel like this much content needs it's own section. Having the onhover on my cursor that resizes and moves around so much as a move the mouse or page up/down is pretty horrible UX. I'd do something like how MS Excel has Task Panes on the right of the window. Then each thing can have an image/video and a paragraph explaining and showing what it is. The main issue here though is he's trying to explain/list all these tiny little features instead of just simplifying the page which is probably causing analysis paralysis and hurting conversions, so adding more information is probably just salt in the wound. He really just needs to get people to sign up and see the features and they'll be self explanatory, up sale from there.
Canadian internet is a dumpster fire due to the Bell/Rogers monopolies. Anti competitive behavior is ignored - Bell configure their 'VDSL2' lines into a non-compliant signal to lock out non Bell modems (anything that implements real VDSL2 standard cannot synchronize to showtime so does not work), 3rd parties like Teksavvy are forced to pay for system access and then on top have to pay a compensation ['inconvenience'] fee for each line which ends up passed on as a cost to their customers who get screwed with some of the most expensive and poorly performing internet in the world. ISPs who install their own infrastructure get screwed on insane backhaul fees which get passed to consumers as high internet service fees and the ISP has to bandwidth shape and restrict line speed to avoid backhaul saturation or 'excess usage' fees. The Liberal government actively encourages the abuse and blocks attempts to get anything fixed either through the courts or parliament (which, like any dysfunctional democracy, rarely sits now - but that's a different story).
Bookmarked for review later. Can’t wait to get all steamed up about something some guy said.
Honestly, they’re not innovating so much as forcing a product market fit that everyone knew existed, but didn’t have the business case to develop without a hyperscalar anchor customer (like AWS!)

If anything, this is just another data point that shows how truly commoditized tech is. I just worry what happens when Amazon decides to “differentiate” after they lock you in.
I mean yea - another way to look at is if you're making $700 per month doing nothing you'd need make at least $701 to even consider from a pure economic perspective - realistically more like $1000+ to be motivated enough to go to work.

So many will write that off but then you have the a ha moment of what if I do work under the table so that's what you do - best of both worlds free money and extra cash. Problem obviously is a lot of ppl choose illegal options especially considering how profitable they are.
Do you allow serverless deployments? Or does it have to be running on a docker / machine?
AMA with Ines Montani, Co-Founder and CEO at Explosion
> We have emotions, and sometimes an emotion tells us an idea is bad, and that is more economical than analyzing carefully why an idea cannot work to ultimately arrive at the same conclusion that our gut already made.

I think this is exactly right. It also fits with what OP was saying that it is liberating to be in an environment where you can express your feelings like that.

Ylu shouldn't always just blurt out your gomut reactions, but if you have an environment of mutual trust, it's understandably a nice thing to be able to do.
I think they are linked but I would define the cultural shift as something separate, canceling of people is a symptom / result of this cultural shift so they are linked.

However there are other aspects of this shift that fall outside of cancel culture. For example the fact that a platform like twitter can have a CEO that publicly supports the rejection of the 1st amendment is also a symptom of this cultural shift, a few decades ago that would not have been possible, in fact it likely would have resulted in high level board meetings and a PR disaster in the 80's and 90's if a CEO of a large public company would have stated opposition to free speech.

We has a nation (the US) have lost desire to uphold the cultural principle of free expression, the law has become a needed check on this cultural shift but sadly the law only survives as a check for 2 maybe 3 generations, if we do not do something to shift us back to being a culture that respects free expression the law will fall to the new culture of non-expression or controlled expression and a new dark ages will emerge
Redox is Plan9-inspired except it goes a little further with some of the core concepts.

Instead of everything being a file, everything is a scheme (basically a URL).
Thermonuclear war would certainly kill life in a lot of places and render large areas inhospitable, but I’m not convinced Nuclear Winter wasn’t exaggerated propaganda. Remember the USA/Soviet Union exploded hundreds of nuclear bombs in the atmosphere between the 1940s and 1960s, including some terrifyingly large hydrogen bombs that were much more powerful than what we deliver on ICBMs. Chances are most of the northern hemisphere would have a bad time with fallout for a year or two but large parts of the Southern Hemisphere would continue on as if nothing happened.
Observations About Today's Crypto Bull Market
Warehouse employees in Bessemer are not making $40k. More like $20k with minimal benefits if they're lucky. Keep in mind that's before a couple grand in income and sales taxes.
I would assume that'd be so nickle and dimed by CISPs (probably trying to milk the enterprise cow) that nobody either knows or cares about that.
Blender Studio: Denoising Sprite Fright
Google already does that though...
They love 5G because their mesh neighborhood spyveillance BS works even better without the need for WiFi permissions.
OAuth flow to obtain JWT without user consent
in the age of diversity hires I can't imagine calling someone's ideal stupid and still having a job
Yes. It seems it has somehow stopped returning search results.

It tries to answer my question, it shows summaries of Wikipedia articles, it has a host of sponsored links, it can point to things on the map.

But I'm using a Web search engine and I was trying to find Web pages containing my search terms. That idea seems to have been lost somewhat.

(yes, I guess if you scroll down far enough. But it's probably a matter of months before they're all gone)
> It sold 4.5 million units

That number is very strange. It'd make it outsell the C64c over its lifetime even though both computers coexisted and Commodore killed the 128 in favor of the still more profitable 64c.

> The MSX line sold 5 million

About 9 million, according to Wikipedia, but I would bet in higher numbers because they were manufactured by a lot of different companies, marketed under lots of different brands in a lot of different countries. We know they sold 7 million in Japan alone (probably counting MSX, MSX2, 2+ and Turbo R).
Libtree: why was that library loaded?
Will we completely eradicate SARS-CoV-2 and its various mutations... no.

Will we reach a point where SARS-CoV-2, and its various mutations, are no longer a significant public health concern and we can return to "life as usual"... yes.
When Cantrill and his team works on something, HN listens, and for good reason. Startups like Oxide show that there's room for a lot of innovation still on a smaller scale, even within fields like HW.
I know that Knuth has some introduction in the beginning, but he goes over it pretty quickly, which is why I was saying that some primer material is helpful just to get a headstart and not feel confused (plus Knuth himself says that you should just skim over the beginning material if you want to get to the "exciting" stuff).

> Spend days or weeks per section, or even on a single page if you get stuck.

This is asking a lot for people who don't have much time to spare. That being said, it's also why many people struggle to start Knuth's books. Most people have forgotten high school math at this point, and it's hard to learn and re-learn when you get older. I think some introductory coursework like the book posted by OP might be more fast-paced for people looking to start learning about algorithms.
Android STILL does this? Wow.
Personal anecdote from yesterday.

I was running into an issue with a docker container that I was trying to install on my NAS. I searched using just the actual error, one word, and the name of the container/service, again one word. So two words in total: “FakeUserAgentError caliber-web”

DDG gives great results, where the first result is GitHub issues related to what I’m seeing and so on.

!g gives me first two links as some crap websites that have scraped the above GitHub issues, then the GitHub issue mentioned above and some JP/CN websites which are supposedly about the error but I can’t make sense. Utterly useless results.

This is the first time I’ve seen this, never before. DDG results were miles better than Google results. Note: I generally use DDG so not sure if this is recent development or not.
I am aware of it being an adversarial environment, but right now they are on top and they can afford the “maintenance” fees on keeping the machine going, probably with a lot of the top AÍ talent that’s available to recruit (considering their earnings). Mercer himself can just live off the earnings.
AWS re:Invent is this week. This was announced as part of the CEO's keynote. I am sure we will get more details throughout the week in some of the more technical sessions.
Former 3rd party recruiter here, I loved meeting with candidates and hearing about what matters most to them before "pitching" them any opportunities. A good recruiter should learn more about who you are and your career goals before making any suggestions. I would say that is a good benchmark of a recruiter who cares and is not going to try and put a square peg in a round hole, so to speak...

*While I have met some downright bad recruiters in my time, I have also met some really great ones, so if anyone wants a connection to one LMK!
Refinement: Formalizing the Simplicity Underneath Complex Programs
Many institutions the US was known for has suffered the same fate in the last fifty-something years. "Make America Great Again" refers to how beloved our institutions were. They see Civil Rights as our nation's weakness, holding us back from greatness.
The spooks will take over that one, too.