skysight-inc/HackerNews huggingface dataset:
I don't work at twitter, but one thing you can know for sure is that the tweet needs to be distributed to multiple machines to meet this performance requirement. A single machine probably could probably send three million trivial messages in three seconds, but if you mix in any business logic it's not gonna happen.

What I'd do is have a shared highfanout queue. Once you have more than say 10k followers your tweets go to the high fanout cluster. You'd have hundreds or low thousands of machines, each of which serves a slice of consumers. When the tweet is sent, you write it to this queue. Each consumer is pulling from one of the shards. If you have a thousand workers that means each worker only needs to send a thousand messages in three seconds, which is very doable.

Only about 180k twitter users have more than 20k followers. If each users tweets every 200 seconds, which seems like a high estimate, then that implies a load of about 1kwps for this system, which seems doable, especially if you have a small intermediate layer of distributors which consolidates the write load.

That's just my sketch.
I am shocked this first version of an online encyclopedia has lasted so long.

Typically first versions of software reproduce real world limitations, which don't apply to the software. Second and third iterations tend to drop them.

Wikipedia has lots of those real world limitations. Notoriety and style of writing were determined by the limitations of shelf space and paper.

The selected editor team is something wikipedia specifically wanted to get rid of but has bumbled back into over time.

I keep expecting someone else to crate wikipedia 2.0, but so far nothing. Here's my suggestion for a better virtual encyclopedia.

- Articles are cryptographically signed by authors.

- Articles are not editable after publication. Edits result in new articles.

- Articles have a unique and unchanging url.

- Registered users can vote on articles.

- Registered users can create collections of existing articles. And those collections can be tread as an article.

- Articles can be filtered on popularity, and on popularity among select groups of authors, and on popularity among select groups of up-voters.

I think based on the above you end up with human repository of knowledge. Where articles and links to articles are reliably unchanged, and you never have to worry about them changing "under your feet" so to speak.

The same group of people running wikipedia now, can reproduce their own view of the world in the above setup, and their fans can use it.

Any other group can also create their view of things. There is going to be one most popular view of things. But there could also be a one armed economists' view of modern dance filter of the knowledge pool.

How to deal with spammer or trolls? In addition to voting and filtering, top notch text compression and time based moving of the least often visited articles to slower and cheaper storage.

The slowest and cheapest storage we have, combined with how well we can compress text, in my opinion, results in almost unlimited capacity to store text. And thus notoriety should not be a concern. Leave that to paper encyclopedias.
It's not really any different to how we have different categories for racing. We have categories for people in cars, and categories for people running under their own power, etc.

Does the fastest lap record for some track take away from any sprinting record?

Even if there was a running race and car race on the same track I don't think anyone would have any issue differentiating between the various records that would exist.
There is no need to jump through hoops like that to try to justify making copies to execute. The same section of US copyright law that says making archival copies is not an infringement also says that making copies to run is not an infringement [1]. See section (a)(1) at that link.

[1] https://www.law.cornell.edu/uscode/text/17/117
Same for Belgium. Voting is always on Sunday.
Several in fact!

But to take your implication head on, I once worked for a company whose owner decided to do this stuff himself.

It resulted in several instances of people going unpaid for a few days and the owner sending out an email basically saying "if you don't get your paycheck on this friday and need money, come talk to me, I'll fix it".

The result?

The owner finally started paying someone who was competent enough to ensure everyone got paid on payday!

These laws exist for a reason, and those reasons generally involve people being affected by it.

---

My learnin's from watching all of that happen is not to take it lightly.
Dictozo – Stop Forgetting English Words
Dictozo helps you memorising English words by highlighting them along with their definitions or translations in webpages.
It is tough to remember or retain the meaning of a English word you searched some time ago. You have to search the same word again when you see it again and the cycle goes on. Now we have a solution to your problem.

DICTOZO lets you save definitions and translations of English words, and displays them on every next occurrence on web-pages. It saves your time that you put, while looking for the same word again and again; also enhances your vocabulary.

New Features added:

- Custom Word Replace
- Voting the definitions
- Fast Scanning webpage
- Export list to CSV from dashboard
Is it cause you want to own a home one day? Or at least stop paying more rent each month than a mortgage in other states?
Well, there is a constant flow of small boats crossing from Africa to Spain and Italy carrying illegal immigrants, and they sometimes capsize, or some are thrown overboard either dead[1] or alive[2] by their fellow travelers.

[1] https://elpais.com/espana/2020-08-07/se-les-acabo-el-agua-ti...
[2] https://www.bbc.com/news/world-europe-32337725

That would give them plenty of opportunity to learn the connection between boats and food.

However, the article notes that they do not attack the people, but the boats:
“In these and all other known cases, the mammals ignored the humans who took to life rafts; it was the boats that attracted their ire.”
Advice I give to anyone (with career options) that is considering this field is that serious work in this field requires significant professional level learning and intellectual abilities, yet the profession as a whole is effectively treated as "skilled labor". If you are serious about SE as a career, then within in 10 years, do one of the following:

1 - Start your own sofware development company. Do the startup thing.

2 - Start your own software consultancy business.

3 - Make an informed choice of a niche and become an expert.

Outside of the above, at most you can look forward to (in general) is either transitioning to management, or a continuation of what your are describing: a glorified blue-collar career. (White collar professionals with experience seeking employment do -not- suffer the same indignities that is the common experience of skilled workers in this field.)

Management is fine if that turns you on, but you will definitely not scratch your geek itches as a manager, so the question is: is wasting your intellectual abilities as a young person worth a "payoff" of ending up in a management role? I mean, if you're going to end up in middle management, wouldn't it be smarter to just cut the chase, get that MBA, and start your management career properly. Or is it perhaps worth a fun first 10 years of "free soda", less structured work environment, and the adolescent culture of software development? Your 30+ year old self will likely tell your younger self "this was a mistake". Seriously consider the fact that this is a field where inexperienced workers routinely dismiss experienced practitioners. The technical domain ignorance pervasive in the field is rather significant and one of the more surprising aspects of this industry. Knowledge and experience can actually be a liability in this industry and high level fakers abound.

There are many other possibilities, of course, but these type of opportunities (such as making a pivot to writing books on software development, etc.) are more about the individual concerned -- their drive, ambition, work ethics, social skill, etc. - than about software engineering in particular. But so are the 3 options listed above.

TLDR:

For certain individuals, career choice is incidental. They possess the necessary skills, ambition, drive, discipline to succeed regardless of the industry. For the overwhelming others, a career choice is a strategic choice. Software development as a career is a poor choice for the latter. If you are intellectually capable, but not a go-getter, pick another career that requires brain power.
Democratic Squabbling Doomed Sorely Needed Housing Legislation in Sacramento
How does that follow? I can't imagine that there are any book recommendations -- be they your friends, the Book Review section of your favorite newspaper, or whatever -- that gets things right for almost every single review. That's absurd.

When I see a book recommendation, I read the associated review (if it has one), read other people's reviews, look at the author and the blurb, and, yes, even the cover.

That tells me much more than a YouTube thumbnail, with only a little more time (but of course I'm going to put more time into choosing a book that might take me two weeks to finish). Indeed, my initial filter is probably much the same as a YouTube thumbnail: I skim past many recommendations based on the genre and author alone.

I think if the Times Book Review always wrote reviews in which 1 out of 15 of them made me thing "I need to get that book," I'd be amazed at how much they "get" me. I wouldn't bother with anything else. Every 15 recommendations lands me another "must-read?" Sign me up!

The problem listed in the article is that Goodreads is no where near 1 out of 15.
https://news.ycombinator.com/item?id=24438027
> but I want to pay by check

Totally your right ofc, but I'm curious about why? What makes paying by check better for you compared to an automatic or manual transfer?
It's not nonsense. Market forces are made up of locally sane choices (but in a usually orthogonal aspect).

Sure, it's good intentioned, but still, it pushes the needle a tiny bit, and all those add up.

Just the fact that the developer thought, okay, sure we'll just require Chrome, no biggie, instead of providing something as a browser extension or a desktop thing means that either a) for some people the functionality that this thing offers is king, so they would install even Baidu Browser too if they could just to get this functionality, or b) Chrome's market share is so dominant, that ignoring other browsers is a non-issue.

And of course Google has vast resources to win the feature war. This alone means a lot of niche products will be Chrome only. And then others can play catch-up if they want, but the first mover advantage is very big when setting web quasi-standards.
I was in high school when the first iPhone came out. Before any of us got a smartphone I had a friend who knew T9 so well that she could type out an entire SMS to someone while in class without looking at the screen. So she would reach down in her pocket and pick up her phone and she’d be holding the phone by her side and she’d be typing out a message but she’d be looking at the blackboard, the teacher, and her desk while typing so you couldn’t even tell that she was typing from where the teacher was standing. I found that pretty impressive. I asked her about it and she said it was no biggie, she’d just been typing a lot and therefore she had learned how to do this without really trying to learn it.
Since Wikipedia is getting a lot of unfounded criticism here, it may be good to raise some real issues: Wikipedia (even just the English Wikipedia) should not be considered as a unit. The fact is, a lot of articles are very good, better than in any other encyclopedia, but that can sadly lull people into dropping their guard/critical thinking when it comes to other articles/topics.

The thing is, Wikipedia is very vulnerable not just to unconscious biases, but also to malicious involvement. Just a single malicious editor with a lot of time on their hands can be unexpectedly harmful, especially if they are targeting a topic where the malice will not be obvious to the majority of editors, or if there are not many editors there to contest the malicious edits for some other reason.

Once that single editor gets support of like minded people, the situation is grim. The other ones don't even have to be naturally competent, a single "puppet master" can coordinate many "meat puppets" (people that follow orders or a common goal) or even plain-old "sock puppets" (abusing alternative accounts). Most good-faithed editors just avoid conflict with the malicious group, because

* it is unpleasant
* it requires much time
* it may require knowledge (even though malice requires less knowledge, especially with off-wiki coordination)
* it (and other conflict) may look bad for them on Wikipedia in the future
* the admins and the arbitration committee tend to punish all sides of a conflict

The "political" topics (including the parts of history that are "relevant" to nationalism) tend to be the worst. I suppose one reason for that is that politics is a viable common goal that can unify some meat puppets and competent malicious actors together. Another is that politics tends to scare a lot of editors that operate in good faith.

Another issue is that the people in power on Wikipedia in case of conflict between other editors, admins and ARBCOM, very rarely (or never) want to invest enough time to really get to the bottom of the issue at hand (which can, admittedly, be very difficult, especially since the people in power often lack the specific knowledge regarding the possibly obscure topics at hand). In the end often both the pro-Wikipedia and the malicious side gets punished, because the admins or ARBCOM just want to "resolve" the conflict or content dispute and get it over and done with.

Yet another issue is that in recent years the Wikimedia Foundation (owner of Wikipedia and other projects) has started to act against the volunteers (the case with Fram[0] is most notorious).

[0]: https://en.wikipedia.org/wiki/WP:FRAM
Orcas are smart, and one of the things some pods have learned to do recently is to wash seals off ice floes by swimming together to create a wave. They are in dire straits, with fishing boats taking all the fish, and maybe they are trying desperate measures to find food.

The increasing migration across the Mediterranean, often in overcrowded, unseaworthy boats, raises the possibility that maybe a pod of orcas has come across a boat that is sinking, putting seal-sized, slow-moving creatures into the water...
Mandating resolves gerrymandering, voting on workdays and a host of other problems.
If you ignore the press and go to the science, you'll see that the RCTs done in other countries failed to show any effect.

Plus, your theory doesn't have any legs because it makes no sense for other countries to ruin their economies and lockdown themselves just to make Trump look bad. If it was a magic cure then countries like India wouldn't give a flying fuck about Trump or whatever your pet theory is.
Does it count as a loss if you get reminded about it by a comment on HN?
If so I lost too :/
> I don't care to look much deeper unless I'm actually working at Twitter, and it seems that's my problem.

If you want to get a job, you probably just need to suck it up and spend some time doing things you don't want to do.
Science is the process of producing new knowledge and new questions from old questions, under consumption of coffee.
That's not a copyright infringement. See 17 USC (a)(1):

"(a) Making of Additional Copy or Adaptation by Owner of Copy.—Notwithstanding the provisions of section 106, it is not an infringement for the owner of a copy of a computer program to make or authorize the making of another copy or adaptation of that computer program provided:

" (1) that such a new copy or adaptation is created as an essential step in the utilization of the computer program in conjunction with a machine and that it is used in no other manner, or [...]"

It is interesting to compare that to 17 USC 109, the codification of the "first sale" doctrine:

"(a) Notwithstanding the provisions of section 106(3), the owner of a particular copy or phonorecord lawfully made under this title, or any person authorized by such owner, is entitled, without the authority of the copyright owner, to sell or otherwise dispose of the possession of that copy or phonorecord [...]"

Note that 109 specifically limits itself to copies that were "lawfully made". If I receive a CD-ROM containing a pirated copy of a program and I give that CD-ROM away (the actual CD-ROM I received, not a copy of it) I am potentially guilty of copyright infringement. I've infringed the copyright owner's exclusive distribution right, and the first sale doctrine does not save me because that particular copy was not lawfully made.

If I receive a CD-ROM containing a pirated copy of a program and I run that program from the CD-ROM (or, arguably, copy it to my hard disk for the sole purpose of running it from the hard disk), it would appear that I have not infringed any of the copyright owner's exclusive rights. Section 117 does not contain a restriction to lawfully made copies, and so seems to save me.

I never noticed that difference before. Anyone happen to know why 109 is limited to lawfully made copies and 117 is not?
I have seen similar achievements with some really shitty enterprise software. Where I would normally pull data out of the system and use modern tools to perform analytics, other people who have used the software for years will write 500 line long SQL statements to get the same answer
"They're inedible but if you flip them over, you will be rewarded with a rare delicacy"
I once bought a Fairphone 2 while living in Europe, moved to NZ.

That was the end of the phone for me as the microphone broke and the parts were very expensive to get shipped.

Disclaimer, make sure if you buy one, you live in a place where it’s economical to get fixed.
>regular work visas are for employment with an entity based in the country

Usually true. Although some countries (like China) do have a business visa that you're supposed to get if you're e.g. attending a business event.

With a US passport traveling to countries for example, there's nothing keeping you from visiting for a month or two and working from a short-term rental. I don't know all the theoretical rules that may exist but I know traveling partly/fully on business, people obviously do work for their US company all the time without filing any special paperwork.
Are database engineers still in demand? What do they work on?
I would like to get into database engineering.

Is the field still in demand? Does demand outstrip supply? How do organisations view potential hires in this area? How can I get into the field (Is a phd necessary?)? Are there any opportunities? What are people working on? What advice can you give me?
You missed at least the verifiability part.
Google Trends may predict Covid-19 cases in US hotspots
Increased Internet Search Interest for GI Symptoms May Predict COVID-19 Cases in US Hotspots
Honestly, it’s not you.

These days I contract so it never comes up - but I used to resist requests to help out with hiring other than putting in a good word if I know someone personally. I hated interviewing applicants as much as sitting interviews myself.

There’s not a great way to find out in fifteen to thirty minutes if someone is competent or a good fit so we resort to asking these nonsense questions because it’s the done thing. It’s a bit like Agile. There’s no good reason to do it, so we just do it until someone comes up with something else to do.

I do pretty well at interviews these days if only because I’m relaxed (contracts are usually short-to-mid term so I have a very “it’s just one gig” attitude and tend to crack jokes and ask about the team rather than the project - I’m pretty sure I can do the work, I’m not sure we’ll get along 8 hours a day so that’s more important for me to find out).

To your question, if you’re thinking about throwing in the towel - I wouldn’t if it’s just because of a problem of interviewing.

You have experience and are therefore clearly capable - but life’s short and as you’ve said it’s not your passion you might be happier doing something else.

So the best answer I could give you brings you back to where you started I’m afraid:

Only if you want to.
When you can imagine a slave owner making the same argument ('it invalidates my business model!'), said argument kind of becomes a positive.

I mean that seriously. If your business model can't exist without the exploitation of humans. maaaaaaybe it shouldn't exist, morally.
The lack of cultural unity is the reason people don't want a powerful federal government.

With the turn the democratically elected Hungarian and Polish governments have taken the past few years, I sure hope there won't be a powerful federal EU government any time soon.
Alternative: Publish a blog about the spite license, and then anyone who reads the blog knows the contents, but has not read the license itself!
Truth is tricky. If I state "The sky is blue", I can look out of the window, the sky is blue, my statement corresponds to the state of the world, my statement is true, right? But in mathematics there is no window, everything is internal, abstract, so what does "truth" mean when there is no state of the world with which to compare? More importantly, would the mathematics be any different if the axioms are declared to be true? No, it wouldn't make any difference at all. So let's leave "truth" to the physicists and philosophers.
> not forcing women to wear a veil

How the fuck does THAT fit with the other examples you gave? The word "force" in there should make it pretty clear that it's not ok or just a matter of opinion.
Nope, spanning voting over several days makes it easy to hack the electoral process. In Belarus, they voted for 5 days and people are out in the streets for 5 weeks to reclaim their votes. Today is the last of three voting days in Rissia, and it looks like the results will be totally made up.
No. They have architectural licenses but they use ARM designs.
Yes, but also in less strict terms: rust, Java, python, anything that lets you not worry about using valgrind.
I'm probably going to get a lot of flack for this comment, but it's my honest opinion. People want you in the office so they can babysit you. They don't care about performance; they care about politics. I know, I know, your company is different. You all are equal and it's about saving the world, man. But here's the honest to god truth; Karin the office manager wants to save her job and has zero leg to stand on sending out emails about the kitchen fridge being dirty if you all are from home. Accountants and paper pushers can't push more paper when they have no artificial hierarchy when you all are at home. The engineer team manager is having a hard time managing you all in your home offices. It's all about politics. I think I remember reading in Yuval's book "Sapians" that humans can only organize around 100 people until they have to have some kind of shared myth. That shared myth can be religion, etc. etc. OR it can be in the form of being a "Googleon" or "IBM'er."
The State of SwiftUI
I would add several Palahniuk books and How I Became Stupid by Martin Page.
Apple lays out vision for how xCloud and Stadia will work App Store
That should be fixable in the same way speaker groups in Google Home work.

Try using module-loopback to add some latency to the sinks and get them in sync.
How to Play Mozilla Firefox’s Hidden Unicorn Pong Game