skysight-inc/HackerNews huggingface dataset:
Ask HN: Sources to learn how to scale systems
Hi HN,

I've been out of the industry for a few years and have missed out on learning how to scale systems & databases (specifically cloud based) to large workloads/numbers of users etc.

I have picked up a lot of fragmented knowledge from reading - sharding, load balancing, distributed systems, using NoSQL DBs where possible, eventual consistency, .. but my answers in interview loops don't seem to be sufficient. I think i'm lacking a clear high-level understanding of where different techniques apply, and why to prefer one over another

Can anyone point me to good resources to get a high level understanding of different strategies and where they might be useful? How do I piece together some understanding of scaling while not having a job that exposes me to those problems?
>at least public companies more or less motivated towards increasing shareholder value.

Is that supposed to be reassuring?? Increasing shareholder value for a lot of companies means destroying manipulating human lives
"have a consulting side hustle" sounds to me like they're doing their own thing, not working for "some consultancy company".
Question for the crowd: how to manage up a politically savvy skip manager that routinely trivializes engineering effort? They couch it in sarcasm, something like "oh you can build that in like 2 minutes, it's just an SQL query and 3 lines of python, right?"
I use it for lots of projects, spanning years of work, including commercial projects with ~20 devs. Those projects aren’t public, and I’m sure lots of other people do use it that way. It’s still not going to rival the install base of git.
The Resound OPL3 is widely available today and Adlib compatible. The original hardware is not of mucb interest today, other than to collectors.
As a pianist, the suggestion that Chopin or his études are not held in high esteem for both technical and musical merits is simply ludicrous.

His technique paved the way for Liszt and Debussy études, and Godowsky expanded their utility. Most technique after him is influenced by him in some way.
China is well known to do a great job on banning malicious apps for years. Few governments in the world are so advanced in controlling malicious, toxic, cheating apps and maintaining them faraway from good people.

Some of the malicious and criminal apps have billions of dollars , like Facebook, Instagram and Whats'app. but the chinese minister is winning this war against the neonazist internet companies.
Time for Happiness
The _job_ is why those people are miserable! This is insane! It's like running a gym and requiring people to already be fit to join!
> Any job that has included in the listing for job responsibilities: "A passion for what you do", I have not applied to.

As a developer and former recruiter, I will say that most job ads are not written well. Many people cut & paste the text from other jobs ads and tweak it for their own purposes. The people with whom you'd work may not even be aware of what's in the job ad. Crafting a good job ad is hard.
> "I know what I'm doing," Lambert said, as he put his files — and his pen — into a bag. Then he stood up, bumped into a chair and walked off, saying "Ciao" and waving his hand, before returning because he had neglected to pay the bill.

> As he paced around the restaurant waiting for the check, Lambert refused to answer questions about who he worked for or why no trace of his firm could be found.

My god. This would be perfect comedy if wasn't so concerning that it happened at all.
India will overtake the US economy by 2030
I think the author is the one projecting. They don’t like work, they don’t want to feel anyone else does either because that would mean they’re missing out on something, and they’re so convinced that they think everyone who does must be lying.
Can entry level applicants do this?
Fecal Transplantation for Recurrent Clostridium difficile Infection in Older Adults: A Review - https://onlinelibrary.wiley.com/doi/abs/10.1111/jgs.12378

Fecal Microbiota Transplantation for Clostridium difficile Infection: A Systematic Review - https://annals.org/aim/article-abstract/2288521/fecal-microb...

I just cribbed these from the Wikipedia article at https://en.wikipedia.org/wiki/Clostridioides_difficile_infec... so I don't know if there's better or more recent studies.
You could put the pass directory on an encrypted filesystem.
Way to create a bootable USB drive
Speaking as a European, I would trust the US government over the German government at least.
"the reason git won was speed"

It wasn't just speed, it was also that the Linux kernel was developed under git, that Linus created git, and the existence of github, which a lot of people liked.

After a while, it also just developed a critical mass where the attitude of people/companies that weren't using it almost inevitably became one of "everybody else is using git, so we should too".
It’s not an article. It’s a “roll up” of a thread by Sarah Jamie Lewis as you can see here

https://twitter.com/sarahjamielewis/status/10889141928479170...
Right, but it's not like money has an expiration date on it.

If it's going to be irresponsible then, it's probably just as irresponsible now, perhaps not as obviously. ("Better hurry up and make that mistake...")
Rust is no more a garbage collected language than C is. Just as one can implement reference counting in C, one can do the same in Rust, but it is not forced on you just like it is not forced on you in C.
Here is a comparison of capsule-based FMT versus colonoscopy-based FMT, in which either approach had a (very) high success rate.

https://www.ncbi.nlm.nih.gov/pubmed?term=29183074
Ask HN: What has been your worst onboarding experience as a customer?
I'm having a pretty lousy experience at the moment trying to become a customer of British Gas (a utility company in the UK).

It's such a painful experience that I'm going to pay extra to join a different company.

And it made me wonder: what bad experiences have you had when trying to join a company? What made them bad experiences? What should the company have done?
I see you can use a name (rather than a number) for the port like "ftp" or "http".
Too late, I installed the "Distraction Free Youtube" extension. No more sidebar: No more clickbait.

Youtube got so much more pleasant.
You are right, it would have been correct for my comment to refer to mid level people. But regardless, creating minimum wage would not help you unless you are the type of person who would earn below "union minimum wage" without the union. Otherwise, you would be diverting part of your paycheck to low level employees and to union fees.
Read the George Soros Speech at Center of Sheryl Sandberg Facebook Controversy
This is the real test. If money was taken care of, I'd probably be doing something else with my time. In my case, I've found the most fulfillment volunteering in very remote areas. My job is good, but I'm under no illusion that I love it or that it loves me.
The numbers I've seen are higher than that.

The Mayo Clinic has posted numbers for a couple of different clinic locations that have seen a a 90% success rate.

https://www.mayoclinic.org/medical-professionals/digestive-d...
>It's not relevant for understanding Facebook's current challenges whatsoever

Yeah, it is.

Looking at the original goals and intentions that FB was founded around is indeed quite relevant to understanding their current actions.
It is more enjoyable to work with people who love what they do. I also don’t believe you can be actually very good at something if you not I live with it.
That’s it.
it's auto-generated - it says so at the top. i don't see the point of this at all since you could reproduce by simply searching "survey" or "introduction". at minimum a cite count would've been helpful to distinguish well written ones from poorly written ones
The code uses CFB mode, so fixing the IV results in a constant first block, which gets XOR'd with the first plaintext blocks to make the first ciphertext blocks. So knowing one plaintext gives you access to all first plaintext blocks.

One problem with your proposal is that for CPA security cuts the security level of the scheme in half. For an n-bit hash about 2^(n/2) operations are required to find a collision, and given a collision you break CPA security.
If you care enough about the position to cut and paste, will you care enough about the employee?
Before I went into research I used to have a previous career that was hard, dirty, dangerous, and poorly paid, and I took as much joy in Monday mornings then as well.
All of them, except maybe Pinterest, have clear functioning business models, and even Pinterest seems like a safer prospect than Snapchat given that it has already successfully accomplished a decent amount of monetization.
Nearly 1 in 5 Americans is keeping a big financial secret
Plastic SCM claims that 5TB works and that 50GB is the average size in their cloud offering. It seems that the Free Software world does not care about such use cases.

https://medium.com/@psluaces/plasticscm-vs-git-c17934fad7ed
>It could be something, it could be nothing.

Multiple people collaborating in a campaign to collect information or compromising material on Citizen Lab seems like something (regardless of whether they are sophisticated or well funded)
Yep. On a unixy system, check out /etc/services.
The Murky Ethics of the Ugly-Produce Business
TL;DR
I know what I should be doing, do mostly the right things, but still am obese.

—

Speaking as an obese person that knows the dangers and generally does the right thing re: diet and excercise- it’s crazy hard.

I entered freshman year of HS 6’2” 275lb, graduated Senior year 6’3” 290lb. I’m 36 now and my weight has pretty much been in that same window my entire life.

I played very high level high school athletics (4 sport varsity, all star teams, etc.), still play competitive “A” league rec sports all year every year, and still do cardio and weight lifting 3-5 days a week. I hike at least 6 miles a week rain or shine with my bow and hunting pack in the woods outside my house for practice. I’m very strong and shockingly flexible- but I still have the physique of a beer league bowler (of which I also am).

I don’t drink soda or eat fast food for the most part, and my diet throughout the week is mostly veggies and proteins. My diet is definitely not perfect and I must be consistently eating more than I output, but...

The weight will melt away until I get to 275 and then my body turns into an always hungry eating machine. Or If I have pizza (or something carby) for lunch I’ll be craving carb food the rest of the day.

My will power is strong, but there is no such thing as just one bite. It’s zero bites or all the bites and it’s a crazy pull. It’s also infuriating because this is the one part in my life where I’ve never been able to just will it so. Sports, work, kids, outdoor adventuring: I have never faced a situation that I couldn’t just grit my teeth and make it through.

Not the weight though. There are too many little unconscious failures that stack up through a day or week that will hinder progress. The conscious ones take a toll even more because now you get to think about “I shouldn’t have...” the rest of the day.

It’s a weird deal, luckily it doesn’t take an emotional toll on me like I’ve heard it takes others. It’s a thing, it’s my thing I try and work on (that and being generally nicer), I just keep plugging and monitor the hell out of my health. BP, glucose, A1C, cholesterols, etc. all paint a picture of a man healthier than I look on a BMI chart.
States and large companies routinely try to understand who is behind journalistic endeavors, to influence them, and to counter other state's influence over them. This stuff is never going away, and it is very likely to get worse and more complex.

Influence and counter-influence operations: https://www.rand.org/topics/information-operations.html
I like being around people who have a passion for software development. That does not mean that they are working themselves to death but the curiosity will end up making them better developers.

As a .NET developer you usually get a MSDN licence from your company and that will give you a generous amount of "free money" on Azure. My passionate colleagues have read up on what you can do and tried some cool things while most of my other colleagues have never even logged in to it.

My passionate colleagues might read an article from Hackernews about web architecture at lunch because they think it is interesting while my less passionate colleagues browse Facebook.
>If the industry or the public wish to avoid that fate, they would have to come up with something in the middle: self-restraint (ha), or possibly a private certification scheme like MPAA.

Sounds to me like you've accepted government tyranny as being the default. You also make it sound as though government intervention fixes all the problems - it doesn't. You STILL have to check whether the pilot is drunk before the flight and sometimes they still are drunk during the flight even with all of the regulations in the industry.
It is curious how Free Basics is largely overlooked in discussions about Facebook's role as a publisher or platform with respect to speech and access.

When it's the only way to access the internet in an affordable manner, Facebook becomes the de facto authority in control of what readers have access to.

Dangerous.
I imagine making something like that would be fairly easy as an Keepass plugin.
Gatwick airport trial for valet-parking robots
I bought off-marketplace health insurance one year. There's no provision for online subscription. You have to call in, and they have to read and acknowledge all the disclosures, so it takes like 45 minutes of droning over a phone.

Considering the plan was basically equivalent to a marketplace plan, I don't understand why they couldn't just list it on there where enrollment takes like 10 minutes all-online.
Perhaps we're both right, in a way?
I consider the standard libraries part of the language. C stdlib does not include ref counting, nor is there any refcounting construct available without building it yourself. Rust obviously has Rc<> and Arc<>.
Reverse Substract and Skip if Borrow (RSSB) uses only one parameter and is supposed to be turing complete. I havent understood how it works, to be honest.
> When was the last time you visited git-scm.org?

Like most people, I go to Google which then redirects me to the correct Stack Overflow question/answer the most often. I think git-scm.org is mostly a guide to get started and the reference documentation.
Yep. What happens when you hire a bunch of people for their "passion" and then it turns out they need to spend their days setting up A/B tests and marketing emails while maintaining a crappy house of cards that they aren't allowed to put time into improving because that's not what has customer-visible ROI? Well, you get an office full of miserable cynical people whose passion has been stamped out.

I just watched the Netflix documentary about the Fyre festival last night, and it seems analogous: it's actually worse to get people excited about a dream that doesn't exist than for people to be open-eyed about what something actually is.
I don't think one has any correlation with the other.
Ask HN: How am i gonna start?
How am i gonna even start?
Okay, am 24, woman. A mother of two 1 and half year old and 3 months old. Separated from mh kids father and never been married. Im currently living with my parents and currently no job cause am hands on to my kids. I always ask my self of how am i gonna achieve my goals in life. Im still at the verge of moving on from my break up. And its kinda hard for me. It was my first relationship and i have given my all. I am a med student but i stop schooling when i get pregnant. I want to be a psychiatrist but rn i do not know how to get there. I dont have work to provide for my kids but my parents they'll help me to raise them. As i finish college but am financially paralyzed. My sister will go to college too and my parents will support her. We do not have lots of money. Im still in my 2nd year in my preparatory, med tech and i have no xlue on how to run on my life. How to start. Im confused with of these mess. Please do give me a reasonable advice. I know i fuck things up. But definitely rhis time i want it so bad. I want to be there and reach my goals.
Ages ago, I was hiring for a senior systems engineering position. I wanted to use a one-line requirements section: "Knows how a computer actually works"

Was blocked by HR/recruiting... :(
Why is this a link to another Reddit/HN looking site than the article itself?
This has improved in recent promo rounds, there seems to be more recognition of this. However the L4 to L5 process has been in the past framed as "L5 owns/leads a project/component." In some smaller projects, or in my 'remote' site, this can often mean having to stick your elbows in, in order to own something, rather than just contributing to something someone else owns.
>Education is the greatest weapon against obesity that we have.

Yet the most educated societies have the worst problems with obesity. A fair statistical case could be made that Education causes obesity, albeit it too would miss most of the problem.

>reason of high calorie intake is not gut bacteria [majority of cases]

Most research I've read, especially around epigenetics, the thrifty metabolism and the Dutch hunger winter studies, all show a strikingly different biome of gut bacteria in [an overwhelming majority] of obese individuals compared to average bmi non-thrifty metabolic people.
Signal on the other hand has made eliminated their access to much of the metadata, including contact information [1] (using SGX sandboxes which is no perfect solution but better what Facebook has) and information about who has sent a specific message [2].

[1]: https://signal.org/blog/private-contact-discovery/

[2]: https://signal.org/blog/sealed-sender/
As someone who studied some formal logic and some psychology, I have to say that providing the "Not very accurately" option is both bad logic and bad research methodology.
The same for broadcast television. Products for old people, brand awareness campaigns, banks.
It will also make it easier for them to take your FB profile and run targeted ads on whatsapp using it.
Would it not be significantly more frustrating if you use git blame and you see:

> Revert: Some WIP didn't work out.

Git blame again from prior to that commit.

> Added missing semicolon.

and again:

> Fixed spelling.

and again:

> Stupid typo, wrong method call.

and again:

> WIP, going to see if X can work.

Before running git blame once more, finally getting to the commit message that actually pertains to the current line of code you're seeing. Including the explanation (commit message) for why it is the way it is, and very importantly when this line of code actually made it into the software?
I’ll pull what I consider an important quote into this thread:

> ”SQLite uses cathedral-style development. 95% of the code in SQLite comes from just three programmers, 64% from just the lead developer. And all SQLite developers know each other well and interact daily. Fossil is designed for this development model.”

FWIW, I consider this an extraordinarily productive development model.

Agile may be about People and Interactions over Processes and Tools, but (and it’s too often forgotten) all dev must first be about effective output in the problem space. So, how do you optimize ratio of Outcomes to People/Interactions/Processes/Tools? This model.

FWIW, I also consider Linus’ and Guido’s “BDFL” approach a way the bazaar is channeled back into a cathedral.
While keepassx is a great tool, Bitwarden is a much more capable product which solves many more use cases than the single device/single user one.

Yes, the dependency on mssql is a bummer, but it is freely available and is a robust db system. And, as other have pointed out, there are alternate backends you can run if you want to forego support from the vendor.
And even if it was solely for criminal activity it would still not be good. After all a lot of victimless "crimes" were, are, and will be illegal in a lot of countries.
I think you're spiting yourself by opting out of every single job that lists that line. Whether or not a company encourages burn out probably has nothing to do with whether or not they put this or that boilerplate on their job ads.

It's not as if they have a consistent set of criteria they're searching for when they write that. Someone in HR or recruiting put it in there because it's what they've always done and they haven't seen a downside to it. In that sense it's just fluff. Fluff is bad for recruiting, but you shouldn't try to infer what a corporate culture is like merely from the flavor of fluff on job ads.
> However, in the HR system, the resignation cancelled the promo.

Can I ask you about occurrences of fence post errors?

There was a very important eng who was basically a sole contributor on a difficult component in a system. He announced his retirement date well in advance, but after the bonus payout period. HR terminated him early, denying him the bonus and leaving the team to scramble and organize a mini-summit to do knowledge transfer. The team itself had no control over the date. I believe it was a similar company.
But if you are ignoring them anyway, won't the add value remain at 0?
And here, a vaguely related hacker news discussion on "Why Does “=” Mean Assignment?"

https://news.ycombinator.com/item?id=16803874

(Ctrl+F Plankalkül)
No, when someone scams or lies to another person, the scammer or liar is at fault.

The lesson here is that Oracle isn't to be trusted, because they will lie to and scam their hires.

There are plenty of companies and people that have scruples and will honor verbal agreements.
I'm older than you and still trying to find the purpose you have. For now I fill my emptiness/time with a "love" of software engineering.
Rust doesn't do runtime garbage collection. It "garbage collects" at compile time, in a highly optimized way, the same way a human would by manually writing "free". My understanding is that Rust does this well enough that there isn't really a performance cost compared to C.

Edit: I see your other comment about the use of Arc and Rc in the stdlib, that is a good point. However, how much does that actually matter? I'm genuinely curious, my guess is that it is not significant, but I'm not well informed. For example, would that affect embedded use cases?
The real link would be this one: https://www.wsj.com/articles/they-own-the-system-amazon-rewr...

Here is the outline'd version: https://outline.com/Km9vL4
>That's nonsense. Indians aren't one race. Indians are multiracial themselves.

Race doesn't exist, there is only skin color, ethnicity, haplogroups, nationality, language, subculture, etc.
I like to work with people who love doing what they do. That’s what I understand under passion.

It doesn’t necessarily mean that they have to work until 8pm every day.
Interview with Jesper Louis Andersen about OCaml, Go, and Protocol Design
This is one of the things which really rubs me the wrong way. I've rejected a couple of offers over the years simply because the interviewers came off as weird robots with poles up their asses (that unfortunately includes Google, where the people I met couldn't take a joke but had no problem laughing about others). You CAN crack a joke without being unprofessional, especially if it's about the profession. I don't understand why people choose not to do that. Humor is one hell of a stress coping mechanism and inside jokes are a side effect of having a cohesive team.
What does TC stand for?
That's awesome; but where are you going to plug this in? And if you can find that hardware, you can probably scavenge an original SB 1.0 too.

You know, just the other day last week, I was thinking about how good it would be to have real hardware FM synthesis for those vintage sounds.
Would love to hear more about the reverse engineering journey.
Other than the staging area, hg has all of these.