skysight-inc/HackerNews huggingface dataset:
> what and how should things be cached?

If something is read much more frequently than it changes, store it client-side, or store it temporarily in an in-memory-only, not-persisted-to-disk "persistence" layer like Redis.

For example, if you're running an online store, your product list doesn't change all that often, but it's queried constantly. The single source of truth lives in a relational database, but when your app needs to fetch the list of products, it should first check the caching layer to see if it's available there. If not, fetch it from the database, but then write it into the cache so that it's available more quickly the next time you need it.

> When and how to denormalize, why is it needed?

When you need to join several tables together in order to retrieve a result set, and especially when you need to do grouping to get the result set, and the retrieval & grouping is presenting a performance problem, then pre-bake that data on a regular basis, flattening it out into a table optimized for read performance.

Again with the online store example, let's say you want to show the 10 most popular products, with the average review score for each product. As your store grows and you have millions of reviews, you don't really want to calculate that data every time the web page renders. You would build a simpler table that just has the top 10 products, names, IDs, average rating, etc. Rendering the page becomes much more simple because you can just fetch that list from the table. If the average review counts are slightly out of date by a day or two, it doesn't really matter.

> Why append-only and how?

If you have a lot of users fighting over the same row, trying to update it, you can run into blocking problems. Consider just storing new versions of rows.

But now we're starting to get into the much more challenging things that require big application code changes - that's why the grandparent post listed 'em in this order. If you do the first two things I cover above there, you can go a long, long, long way.
Really appreciate this great, detailed answer! 100% agree with getting to an MVP with PMF as quickly as possible should be the top priority for a startup.
I didn't go to college, and I'm one of the techs you're referring to. But techs also think on-job experience and self-motivated projects are equivalent to or better than college, and both of those are necessary.

There are tons of high paying jobs available to people who learn trades, either in trade schools or on the job. Much of tech is like a trade - as a software engineer, I certainly have more in common with a car mechanic working on custom builds than I do with an accountant, lawyer, doctor or CEO. A lot of Americans were sold the false idea that college would help them know what they wanted to do, and make money. But it's not a magic beansprout you just ride up to the heights of society... definitely not when everyone else is doing it and everyone else is in debt. You have to actually be motivated. And if you're motivated... well it's kike George Carlin said about self help books: You went to the bookstore to go find a self help book, you're motivated, what do you need the book for?
Even without genetics this problem still exists. What about the people with parents who push their kids harder? What about the people born in areas with better education?

You could push these questions all the way to debating if you ever had any free will to begin with or if your whole life was the result of your environment. And ultimately does it even matter what the answers to these questions are? If rewarding people for being smarter drives the population to move towards the goal, then why not keep things like that?
Good luck getting anyone on hn to consider that just maybe colleges being often openly hoatile towards men might drive them elsewhere
It's really really difficult to estimate the probability of something like that if it never happened before. Compare this to: in the next 200 years there will be a 9.0 earthquake in San Francisco with a probability of 99%. Or a pandemic...
> Men have no opt-out to 18 years of child support even if the child

God will someone please think of the men
Pv – An Electron app for viewing PDF with Vim keybindings
Ah shucks I thought we had mostly avoided that stuff in the US.

I'm guessing though they're using some old spam ip/block though, there's a lot more obvious piracy sites then a Manga site. For instance, I can access all the major torrent sites.
I agree with you. I mostly work in enterprise and understand that it has different needs and ROI requirements. However, my personal mindset is that computers and networks are really really fast now and it's a tragedy that most of these gains are nullified due to unoptimized layers of abstraction or over-architecting. So it's a welcome sight to read about well-designed infrastructure like this.
From a sample of 3 countries (two with very traditional gender roles), I’m not convinced. In Eastern Europe software engineering was a female dominated field.
There is - https://github.com/paullouisageneau/libdatachannel
> Those who manage to jump through all of the hoops don't realize that there is a secondary scam waiting for them: working for a wage without significant stock options while someone makes millions sitting around doing nothing off of their effort.

I know this is the thing in US and shouldn't surprise me but I'm based in central Europe and honestly the thought of this still feels so abstract to me. I'd love to have an option of choosing jobs that offer stock options.
As a sibling comment mentioned, read DDIA: https://dataintensive.net/
It was definitly the reason, by 1992 it was impossible to buy a C compiler that also did not had a C++ one in the box.

Also why Apple moved from Object Pascal to C++ on MPW.
Most of the code is under the LGPL license, not in the public domain. The build files are under BSD and/or public domain and BDL and/or public domain for documentation. FWIW being in the public domain with sources available is considered free according to the FSF (not the OSI apparently).
I had this same question when I first learned about social security and saw a non-trivial amount of my paycheck funding the program. So I wrote this comparison (it is about 10 years old but still accurate): https://www.diffen.com/difference/Ponzi_Scheme_vs_Social_Sec...
On a site like this where anyone can comment and only a few do, this is the far greater problem compared to p-hacking: https://web.ma.utexas.edu/users/mks/statmistakes/filedrawer.....

There are probably 512 people in this thread right now that have had that same experience you did but didn't reject the null hypothesis so they're not commenting.
I have the same feeling regarding both Github and Gitlab merge requests. After using Gerrit for almost 4 years at work with enforced fast-forward, having a linear git log is relaxing.

The merge commits enforced by these "mainstream" platforms are noise for me. I think that now one can choose to fast-forward on pull requests, but per PR and not by default.
Clearly, if a human did this it would a problem, so why should it be acceptable for an automated system to do the same thing?

One worries that the corporate overlords are preparing the legal system for completely impune manufacturers of self-driving cars. "Sorry your child is dead; the car did it so there's no one to sue or convict."
Hard to tell. For example, if COVID came from the Wuhan lab, then I suppose we would say they've been brilliant at PR since they haven't really been seriously hounded over that.
They will not try to steal it because they have it. Check what analytics has the page where you make payments. Check your browser settings (passwords, credit card data).
> Transatlantic slave trade (was done mostly by non-government actors)

The laws upholding slavery were government action, without which there would have been no slave trade because without government support to hunt them down the slaves would all just run away.

> the Dutch East Indian Company colonization of Indonesia

The Dutch East Indian Company was essentially a government. You can't "colonize" anything and not be a government.

> drugs traffic in the 20th century

The result of government prohibition creating a black market.

> the cumulative effects of poisoning from tetraethyl lead

> the ongoing plague of opioids addiction sparked by Purdue pharma

These things are certainly bad, but Stalin killed more than 20 million people. If you were to nuke five cities the size of Los Angeles it wouldn't be that many people. These things aren't even the same order of magnitude.
K isn't the abbreviation for kilo, so if you're going to rag on the fellow for the 'b', then you should at least be asking what a Kelvin*bit is.
I’ve settled two GDPR cases so far over here in Sweden. Litigated both myself.

I write using Google Docs and agree with you. It’s suboptimal. I’d rather write in markdown, but some Docs features are too nice to give up, mostly sharing the document via a link letting others comment on my draft. If anyone knows of a MD-based solution that has some kind of collab feature I would be very interested.

My experience so far has been good. Two companies that were completely unwilling to take me seriously suddenly became very willing to discuss a settlement after I’d filed my claim with the court. I believe I ought to have won both cases had I gone to verdict. However I also have a gut feeling that the courts view me with some suspicion. In Sweden we don’t really have a tradition of litigation as a way of enforcing rights (we’re getting there) and seeking compensation for immaterial damages is sometimes looked upon as frivolous since these damages would not be compensated in Swedish legal tradition. So these kinds of damages are a new thing. But this is only a gut feeling since I haven’t gone to verdict.

One last thought. In class actions based upon the GDPR the claimants will be legion while the claims will be small. For example you might have 100,000 claimants each entitled to 300 EUR. As a lawyer, how do you manage all these clients. Since the claims are so low you can spend only very little time per client before the cost for your services become much larger than the claim itself. These cases would be difficult to take on “commission” for that reason. Is there some software for managing class actions?
You're making a lot of leaps of logic here, which might be why your colleagues are disagreeing with you. You go from "not everyone can learn algebra or calculus" and "mental disabilities exist" to "therefore intelligence is a scale and controlled by genetics and unalterable," which doesn't really track.

Your previous education, your upbringing, your cultural values, these things all also have huge effects on your aptitudes, and you've just dismissed them out of hand, apparently in favour of pre-determined genetic intelligence. I mean, all I know of you is this comment, so I could easily be missing a lot more context about this argument you've had, but it sounds like you have an axe to grind, not a carefully-considered conclusion.
How does this fare compared to uWebSockets? https://github.com/uNetworking/uWebSockets
This is another form of Calvinism or predestination with a university label on it
2k sockets on a test bed vs 2k real user request in production is very different. I doubt you ran a top 1000 Alexa site on your laptop. Today we need to deal with SSL which eats from the performance budget.
The only Electron apps I use, are doing work time as I have no say in what either employer or customer require me to use.

My private computers they are mostly Electron free as far as I can tell, and yes I even pay for Sublime Text.
That's exactly why many scam emails start off with some religious salutation. If that doesn't put you off you're worth investing some time in because you have self-identified as gullible mark.
That's the Answer.
Thankfully there is no C++ on Electron.
No. I think you have a healthy perspective and we should all be questioning if current trends are beneficial/sustainable.

I haven’t read the article, but the headline alone to me seems alarming, $1,500 a month is a lot of money for only 2k rps.
> the classical UNIX desktop

CDE? That hasn't existed for decades.
Your grandparents sound like awesome people. Do you know what their beliefs were about post-death / after-life?
One problem I can think of with binary logging would be catastrophe. I have had to pull HDs, go through the logs, line by line and piece together what happened in those final moments.

Text logs are easy to get at, I don’t need a special program to read, I just need something to display a raw byte on the screen.

Also, I wonder what the actual performance benefits are. I remember back when most protocols were text and/or binary. Usually binary was slower when messing about with stringy stuff. For example, using memcached to cache strings. Why encode/decode strings in a binary protocol when you can just use strings all the way down? I don’t know if that premise is still true, but for us older people, it makes sense to keep inherently stringy stuff stringy to avoid overhead.
MIT isn’t selling their name, the association of alumni of MIT (basically just some other private entity) is selling the name. Obviously in reality the institute benefits from the association (it helps MIT get donations) and vice versa. A symbiotic relationship.

I am a paying member of the alumni association (well, the Northern California chapter) so I suppose I am marginally complicit in this fraud. Sorry!
> I’ve taught mathematics at community colleges for over 20 years and I’m absolutely convinced that not all people can learn algebra or calculus. To me it is obvious this is so since the mentally disabled can’t. There’s a level of “intelligence” that’s necessary to learn a given topic. Not everyone can learn all topics.

I think most people agree that there are extremes. There probably exists a small number of people who literally cannot (just like how 1 in a million could probably teach themselves calculus at age 10, also exists). However it's a big jump to conclude that even a small percentage of the people at your college cannot in the literal sense - i.e. if their life depended on it, they had all the resources they could want, they had no other distractions.
This tool created by a friend of mine out of the frustration of not having a proper Vim-like keybinding in PDF viewers.

The main point of this app is a simple modification to PDF.js that support (kind of) smooth scrolling for j/k keys.

Today, if compare this to Firefox's built-in PDF viewer, hitting j/k in this app will scroll vertically but keep the horizontal scroll position, while Firefox's PDF viewer will jump the page horizontally as well to show fully each page, I think this is a good point.
Memory safety issues are exaggerated. It's definitely harder to keep big, complex software memory sanitised, but it's not something completely insurmountable.

You use C judiciously on the most performance demanding tasks, while trying to bring the overall task itself closer to some simple algorithm, on which you can later throw heavy verification, like formal verification, valgrind it to death, fuzzing etc.

The current wave of "new age" computer languages like Koltin, Go, Rust have a very noisy activist userbase which tend to extol some very simple, obvious things as ultimate virtues.
Book Review: Permanent Record by Edward Snowden
Could you expand on this more? I don't know a lot about GUI programming, but I'd be interested in learning what the current failings are within the desktop space.
I guess it's the American way, but seems strange to outsource this to Apple, here in Ukraine there is a government developed app with similar features, it can hold your driving license, car registration, id card etc
New diagnose system rapidly and sensitively measures antibody against SARS-CoV-2
What's better is that EU based companies are using American hiring software (lever, successfactors, workday, etc). Americans have no cultural sensitivity whatsoever, and the general professional and educational landscape varies widely on both continents. Yet the companies are hiring someone, whom? No idea, those hired are desperate to keep their jobs and will deal with any bullshit, bringing in more desperate cheap people from far Eastern Europe and Southern Asia. After 3-5 years of consolidations and "AI", we'll have perfect candidate profiling with fingerprinting and global blacklists. I'm so happy I don't have to search for a job, I'm one leg out of the industry. Just keep in mind that software created in such environments will destroy your health, life, infrastructure, and money. I'm back to printing stuff, filling forms, and sending letters when possible.
Maybe its a lot of money just for the web servers, but for the entire infrastructure stack its pretty reasonable IMHO.
When a book is titled "Algebra", it's always a bit ambiguous whether that means "high school algebra" or "abstract algebra". I clicked on this link thinking it was about group/field/ring/etc theory and wondering what an 'intermediate' treatment of those topics would look like.
Sure, then you just fall back to whatever best effort approach you were using before.
SEO Best Practices to Optimize XML Sitemaps
I use Newsy to test things out initially. Newsy (https://www.newsy.co) is a tool that converts a domain name into a content-aggregator (i.e. Reddit clone). Here's what I've been doing.

1. I have an idea for an app. I buy a domain name.

2. Usually, I don't have much time to develop the domain. And while I'm doing all the market research, I plug my domain to Newsy. Newsy asks me to fill in some niche keywords which are related to my idea or startup I'm thinking of. So I type in "workout", "weight training", "workout training exercises".

3. Newsy will automatically find contents and create it (here's an example - security related - https://www.getinfosec.news)

4. It comes with sitemap, newsletter, Twitter integration to regularly post tweets. I also let a few of my colleagues know. Over the next few weeks, it builds traffic. It even gets some people sign up as a newsletter subscriber or member on my Newsy site. Sometimes, I post links on Reddit just to kickstart some traffic driving to my site. It works from time to time.

5. I let it run for about 2-3 months. By this time, I have ~30-50 users signed up with real email address. Now I can actually start emailing these users to find out more about the problem space that I want to solve.

Above process has been super interesting - if anything other than to make sure my newly bought domain is being used, not just sitting there idle. Hope that helps someone.
I wonder if it could be because masculinity is being challenged on campus in the current era. Why would a male who has issues with women want to go to a place where he will be challenged to change his views in sensitivty and toxic masculinity courses? Conversely, why would a male who does not have issues with women go to a place where he will be labeled as having toxic masculinity? It's not like these issues haven't been all over the press for years.

#MeToo Is Making Colleges Teach Toxic Masculinity 101

https://www.thedailybeast.com/metoo-is-making-colleges-teach...

Toxic Masculinity and Higher Education

https://www.higheredjobs.com/Articles/articleDisplay.cfm?ID=...

And so on. A quick search turns up 1000's of such links
At some point, the number of people on that tail will be smaller than the number of people with an incorrectly setup $TERM, for a net gain in effective portability.
I wouldn’t say to take experts opinions without further research, but causal dismissal of both the Fed and multi decade successful hedge fund of Bridgewater is foolish.
Excellent post, good technical content, amazing feat.

That said, I echo that the amazing feat is that they can fit modern inefficient tool choices with poor mechanical sympathy into that budget. The last decade of web-dev tooling has been pushing the TCO of systems through the roof and this post is all about how to struggle against that whilst using those tools.

If they went old-school they'd get another order of magnitude savings. Many veterans know of systems doing 10x that in 10x less cost.
Remember C10K was in 1999.
Yes but I don't have to use a defi on ETH or even use ETH at all. I can ignore ETH.

You can't ignore the IRS - you will have to pay taxes. Those taxes must be paid in US dollars.
Simplicity is a good baseline. In Unix systems, off the cuff scripting works really well for live human interaction.

Complexity, particularly NOT-self-documenting complexity, becomes a nightmare.

Imagine instead that each program controls a special area under /proc/(pid)/ which behave like tmpfs to that program: named interfaces are subdirectories, messages are files.

Reflection of supported interfaces becomes easy. It integrates with existing software, and it's self documenting for both software and users.

Complexity can be opt-in rather than the only way to operate.
Because as fashion driven industry that is the only way many will get experience on language X down on their CV or favourite source code repository for head hunters.
Ask HN: Was Theranos' product impossible or just a failure?
For any HNers in biochem, how ridiculous was the idea of what they were selling? Blood tests with small amounts of blood doesn't strike me as impossible, but I don't know anything about the subject.

Is this closer to AMD Bulldozer or to me raising $BILLIONS for my "quantum-computer-in-this-box-you-cant-open"?
> Censorship isn’t what make social media and blogging so toxic to our culture.

Correct so far. Censorship doesn't encourage toxicity except by discouraging good actors disproportionately. I'll expand on this.

> It’s the lack of reputational cost to bad actors and the undeterred gathering of information.

Adding reputational cost has been tried, see "full name policies", Facebook comments on online newspapers etc.

It discourages the careful and does nothing to stop:

- those who think they are right and feel backed

- those who are too engaged anf don't care about their reputation

- those who doesn't understand that it is dumb to write dumb things under your full name

- trolls with fake but real-looking accounts

The result is an explosive mix: full name policies affect good, reasonable, level-headed actors far more than it affects trolls and zealots.

Don't you wonder why HN is such a nice place despite no full name policy? It is in part because everyone is exposed again and again to different perspectives from people wildly different from themselves who can dare to speqk up here.

This, together with good moderation result in compound interest (and then there is attrition so nothing grows into the sky).
They may be capable of other work, but for some reason they're doing OnlyFans.

Perhaps they know more about their options than you or I do.

Regardless, banning OnlyFans won't create new opportunities for them.

If banning OnlyFans is a social good, should they be compensated for the lost opportunity, the price that they're paying?
People like you pointed to benchmarks in the past and said the exact opposite. It is sad that any kind of reasoning stops at some benchmarks
The six free natural healers
> I feel as if I'm asking something fundamental that hasn't been considered by insiders.

You're not. You're asking a stupid question and complaining that other people don't share your views on what makes a game fun.
Also that 2000 request per second has to happen 24/7 not only quick demo session.
This is an amazing book that improved my effectiveness as an engineer by an undefinable amount. Instead of just randomly picking components for a cloud application, I learned that I could pick the right tools for the job. This book does a really good job communicating the trade-offs between different designs and tools.