skysight-inc/HackerNews huggingface dataset:
Not familiar with the project but it is great to see a counterpart to over-provisioned enterprise infrastructure. $10 in 2021 can do what $100 in 2011 did, what $1000 in 2001 did, and that is not solely due to hardware. Well-designed deployments of K8s, KVM/LXC, Ceph, LBs like this project can handle so much more traffic than poorly configured Wordpress storefronts.

They're using battle-tested tech from Redis and RabbitMQ to Ansible and Grafana. Nothing super fancy, nothing used just for the sake of being modern. Not sure how long it took them to end up with this architecture but it doesn't look like a new dev would have a hard time getting familiar with how everything works.

Would definitely like to hear more about their dev environment, how it is different from prod, and how they handle the differences.
Correct me if I'm wrong but I don't believe Cree manufactures any chips in the US?
Does Appalachia have enough available flat land for something like this? Urbanization has been challenging for that reason, while the article talks more about solving water resource problems.

Something more like Hong Kong or Chongqing.
Docker Desktop provides an easy way to run `docker` commands from a non-Linux host, taking care of the VM management under the covers. It simplifies a lot of concerns so Docker "just works" on a non-Linux host.
It's all about controlling the distribution of the media. The media content doesn't matter if it doesn't reach the audience at all.
This is intensely offensive. US tech companies are banned, robbed, and defrauded by China. We have no chance to compete with them in China, yet they can come here and freely. Tiktok should be banned.
Use temp-mail.org
What’s the reason behind where they host and having issues with providers? I haven’t heard this before

Regarding DMCA’s, as an entity doing business where they’re legal, what should they do as a middle man?
Humble Book Bundle for Makers
I'm curious why this is needed. I feel like "phubbing" is just snubbing, unless there is some phoney aspect that is relevant to the context. Otherwise how is it different from book snubbing (boubbing)?
I come to HN for intelligent discussion, not xenophobic conspiracy theories so far-fetched no intelligent person could believe in them.
> Regarding DMCA’s, as an entity doing business where they’re legal, what should they do as a middle man?

Don't use them and instead have your middleman be in a country that ignores intellectual property rights and copyright?

I'm not saying CF is wrong to pass them through. I'm just saying CF is not the right choice for a warez site for longevity.
"An extremely simple CLI that composes well with UNIX pipes"

Just for fun, I occasionally experiment with proposed "post-quantum" encryption solutions and one in particular called Classic McEliece, from the same author (more or less) as the encryption used in age. Its small and compiles quickly. The interface is elegant and seems impossible to screw up. I have rarely seen anyone outside of the author and his followers use file descriptors in compiled programs in this way. I like it.

Three programs, each only does one thing

usage: cmkeypair 5>publickey 9>secretkey

usage: cmencrypt <message 4<publickey >ciphertext

usage: cmdecrypt <ciphertext 8<secretkey >message

To be fair, I should probably add that McEliece arguably fails the "small, copy-pasteable keys" criteria. :)
Is somebody claiming to have signed a contract on a blog post significant evidence that they actually signed it? Can you say “one of these 1000 signatures is probably his pseudonym but I don’t know which one” and have it stand up in court?

Of course it falls apart if the author is compelled to answer in court whether they signed. Then it comes down to whether they are willing to debase themselves by lying.
> ones which glue the display onto the baseboard

yea funny story about that. I have a google pixel 3 xl. Was in great condition. No cracks or issues. So I'm in the medellin airport waiting for my flight to Lima when I'm talking to a friend and notice that a crack is forming alongside my phone. To my horror, the battery decided to swell open so far that it cracked open the cell case. Here I am with a phone that as far as I know, is about to shit the bed and I'm in the middle of a foreign country on my way to ANOTHER foreign country with no way of activating a new phone. (google fi requires the phone be in america during activation.)

Luckily in Lima, I was able to track down someone that could doa. replacement. This phone was clearly not designed to be repaired as I saw him slowly melt layers of glues and pull apart different pieces to do the actual battery replacement.

He managed to get it working but now the finger print reader isnt' working. So here I am currently in latin america with a phone that has a cracked case and a broken fingerprint reader. I'm waiting till I can stomach coming back stateside to replace this phone because repairability was never a concern.
Every data centre is all about efficiency. Power usage is the #1 expense.
From a quick glance it seems to host obviously copyrighted content for free. In some jurisdictions (like Spain) the companies would have a hard time at court against the website creators, since it's a not-for-profit* website sharing culture.

Now show an ad, or premium accounts, and it becomes a for-profit endeavour which is straight jail time. I'm unsure about donations.

(Based on previous rulings I followed ~10 years ago, laws might have changed IANAL yada yada)

*not for profit != non-profit
I've done things at scale (5-10K req/s) on a budget ($1000 USD) and I've done things at much smaller scales that required a much larger budget.

_How_ you hit scale on a budget is one part of the equation. The other part is: what you're doing.

Off the top of my head, the "how" will often involve the following (just to list a few):

1 - Baremetal

2 - Cache

3 - Denormalize

4 - Append-only

5 - Shard

6 - Performance focused clients/api

7 - Async / background everything

These strategies work _really_ well for catalog-type systems: amazon.com, wiki, shopify, spotify, stackoverflow. The list is virtually endless.

But it doesn't take much more complexity for it to become more difficult/expensive.

Twitter's a good example. Forget twitter-scale, just imagine you've outgrown what 1 single DB server can do, how do you scale? You can't shard on the `author_id` because the hot path isn't "get all my tweets", the hot path is "get all the tweets of the people I follow". If you shard on `author_id`, you now need to visit N shards. To optimize the hot path, you need to duplicate tweets into each "recipient" shard so that you can do: "select tweet from tweets where recipient_id = $1 order by created desc limit 50". But this duplication is never going to be cheap (to compute or store).

(At twitter's scale, even though it's a simple graph, you have the case of people with millions of followers which probably need special handling. I assume this involves a server-side merge of "tweets from normal people" & RAM["tweets from the popular people"].)
Properly tuned NGINX on a physical server can handle incomparably large load for static content than some of the "cloud" storages around.

The "trick" has really been known for a decade, or more. Have as many things static as possible, and only use backend logic for the barest minimum.
They're probably more limited by bandwidth than requests per second, but anyway you look the number of requests are still impressive considered the budget.

BTW, the site is not just fast: they serve images on high quality (same as the original [1], that can be multiple MBs per page [2]) at an pretty impressive speed too.

[1]: before someone asks why they don't optimize the images, this is by design since they want to serve high quality images. There is an optional toggle to reduce the image size, but this is disabled by default.

[2]: for those not familiar, the average number of pages on a manga is something like ~20, and this can be read in ~5 minutes depending on the density of the text. So you can easily consume 50MB+ per chapter.
Ah, the efficiency of software. Ain't it grand?
> South Asia and SE Asia, maybe. But East Asia (NE China, Korea, Japan) has actually one of the most ethnically "pure" populations in the world.

Northeast China–usually defined as the provinces of Liaoning, Jilin, and Heilongjiang–does not belong on your list. According to the 2000 Chinese census, about 10% of the population of Northeast China comes from ethnic minorities – the majority of whom are Manchus, but also including significant numbers of Mongols and Koreans. That is far from being 'one of the most ethnically "pure" populations in the world'-especially when compared to Japan or Korea.

Indeed, even though Northeast China was (in 2000) approximately 90% Han, prior to the 19th century Han were a minority in the region, and Manchus were the numerically (and politically) dominant ethnic group.

According to the 2000 Census, the most ethnically homogenous part of China is not the North or Northeast, but rather Eastern China, which is over 99% Han (and, as well as being over 99% Han overall, 4 of its 7 provinces are over 99% Han too.) By contrast, North China is about 94% Han and Northeast China is only around 90% Han.

(There have been two Chinese censuses since, in 2010 and 2020, but I can't find ethnicity figures for them.)
Monterey CA (USA) bans all rentals of less than a month except for legal hotels.
Try to convert as much content as you can into static content, and serve it via CDN. Then, use your servers only for dynamic stuff.

Also, put the browser to work for you, caching via Cache-Control, ETag, etc. Only then, optimize your server...
Or even a patreon style 'you get nothing but a supporter badge' with that kind of traffic levels.
Yes, there is a very blurry line between operating systems, programming languages, and we can include databases as well. Some operating systems as you point out are PLs. Some PLs are implemented as databases. They’re all just really complex accounting systems by nature. Look at the implementation of a lot of OSes, PLs and DBs they are really just made up of tables keeping track of relationships all the way down.
> It is a rust dev cultural problem that will go away with time and general adoption. Right now almost all people writing in rust are the bleeding edge types that use the latest backwards incompatible features without caring. Combined with these new features being added every couple of months it is almost required to use insecure rustc installation from outside your repos no matter the distro.

And yet at the same time the people working this way are pushing their changes out in a way that affects the rest of the world looking for stable repeatable systems.

There was a brief few weeks at the beginning of this year where pyca/cryptography had a hard dependency on a rust compiler being on the local system. pyca/cryptography is a dependency of a large number of important applications, notably Ansible.

You're fucking up my automation if you're expecting me to `curl <website> | sh` in my build pipelines. pyca/cryptography's maintainers were completely not understanding of the situation and derided anyone who criticized them for it along with statements like "I refuse to work in C++." Zero concern from them about breaking the world for lots of people.
Yes, you run it on its own thread and output messages to a threadsafe queue for other threads to consume as is the usual practice. Or did you ask for something else?
ChaCha20-Poly1305, great. Thank you, I was looking for the algorithm.

Just found a similar tool called hpenc[1], written in C++11 with libsodium yesterday. It uses AES-GCM or ChaCha20 to encrypt files and streams. But this is even better as it's more ergonomic, drop in, I don't have to worry about dependencies and it does much more, like encrypt using ssh or gpg keys.

https://github.com/vstakhov/hpenc
Nvidia Shows How to Build AI Models at Scale with PyTorch Lightning
Note that this strategy is a bit regressive. The law usually only applies to multi unit housing, and exempts single family housing. But those who live in single family housing are usually are richer than those in multi unit housing, so this essentially makes housing more expensive and difficult to build for the lower income people.
Their disagreement is presumably with the assumption that "high traffic roads where it's not safe" are a net good that should have been created.
Growth = Stress + Rest [1]

To maximize performance it is necessary to take breaks to give your brain time to process information. By stepping on the gas 24/7 you are guaranteed to burn out.

Schedule breaks and take them. You're not doing yourself any favours by pushing yourself beyond your limits.

Like others here have said, don't neglect your health. Take time to eat healthy, workout, and sleep. Sleep is the ultimate nootropic.

--

[1] Peak Performance by Brad Stulberg and Steve Magness
She said her writing sample was a snippet pasted from one of her novels, so the information to de-anonymize her is there.
It’s often so easy not to submit these kinds of changes. But 10 years later you still don’t have them.

Seems like a long wait now but is worth it later.
I had nothing but respect for the whole team. Dedicating their time to build everything from scratch, not to mention that they maintain everything for free.. It's a cool project, not sure if there's a way for anyone to contribute.

I"ll join the discord afterwork to see if they need any extra hand.

Gee, how do these people find other people online to work on all of the cool projects. I would love to join rather than playing games after WFH on the same pc over and over again lol
> There is literally nothing China can do to me as long as I stay firmly in the West.

There are numerous Uyghurs in the West who would disagree with your assessment given the harassments they have had to endure. This will only become worse as China continues to become more powerful.
(Only read the abstract). I’m learning Emacs and it’s making me think that we missed on the correct abstraction level of the operating system. There are programs that are OS-like (Emacs, browsers, Electron, anything that takes plug-ins). Maybe operating systems could have been lower level, and we could have developed more/better options on the pseudoOS level on top. This seems somewhat inline with the Smalltalk vision.
Real estate developers who can't find enough investors typically come up with some scam like TIF in order to extract funds from local governments with corrupt politicians. This project targets some area were the local government wouldn't have any capital to extract, so this wouldn't be an option. Maybe this billionaire can arrange for some federal-level corruption, like "opportunity zones".
The author doesn't point this out well, but Minikube allows you to pretty easily expose a remote Docker host to be used for `docker build` and other Docker API commands. The command is `minikube docker-env`, which defines env vars that point the `docker` CLI client at Minikube's Docker API.
What is blocking this industry in the US? If it's staff, surely some kind of special visa program combined with tax breaks could be a pretty generous offer to TSMC to setup shop onshore.
That seems like an awful lot of effort to go to for what really ought to be a settings toggle.
Articles like this always make me chuckle, from a philosophical point of view it seems to ridiculous, yet it is easy to imagine the man who has everything clinging onto it for dear life.

Careful what you wish for I guess?
> but it didn’t do that. It only tagged black people

Do you have a source for that? I couldn't find this in the article but maybe I missed it.
Someone who wanted to hang around fitness people, instead of datacenter people. Depressingly often strategy is based on personal preferences of upper management
It wasn't missed, from what I saw in the issue and pull request. It was offered, and ignored.

Part of me thinks that's a shame, because it seems like it's just that a for-profit entity behind the project was the only reason for doing so, but at the same time, the outcome isn't bad I think. Having multiple high-quality choices with different driving causes (and organizations) behind them is more beneficial in the long run than just one. Competition is good, even in open source, most the time.
What definition of "investment properties" are you using?

Does someone who rents two houses count as "investment properties"? How about someone who owns a complex with 50 units? How about a corporation that owns a complex with 500 units?
It is important if the algorithm gets broken or weakened somehow. Also, I was looking for something like this just yesterday. If the algotirhm was clearely displayed in the readme I would have found it with a web search.

You made a great choice. Thank you. This tool looks awesome. Can't wait to build it.
Government distorting the labor market by keeping businesses open which should have closed with PPP loans (grants) isn't a free market.

Do you not remember the signs saying 'support your local restaurants'? As if they are somehow entitled to money, but the people fired from those places do not.
What's the benefit of a cdn if nothing is cacheable? Slightly lower latency on the tcp/tls handshake? That seems pretty insignificant.
No, but 5k in Kazakhstan tells a completely different story than 5k in the US.
It is trivial to disable systemd-resolved on any distribution, as well as making systemd-journald disable its logging to forward everything to syslog. I wonder what the GP post's difficulty was?
I really doubt.

Of my short encounter with "modern" webdev, I found that running out of RAM was far faster than running out of CPU, even with every trick possible thrown to increase GC aggressiveness.

RAM is by far more discriminately priced on all these new "cloud" hostings, and has the most unpredictable performance change with size. Even on real hardware, going for high RAM servers is quite expensive.

While CPU, or I/O saturation naturally throttles itself, RAM exhaustion is rarely pretty, and hard to proof your software against. Most disconcerting about this is that your RUST, GO, or the TRUE ENTERPRISE JAVA®, don't really use that RAM at all. Most of "modern languages" RAM content is just zeroes, and empty buffers.
I was under the impression that 2 is manifestly false (unless I'm a very weak sense) given currencies in use that retained some value after the issuing state fell.
Probably they would. If we had a more thorough source we would know for sure.
The CDN part is kind of pointless because they can't really have nodes in large parts of the western world since.. it's a warez site. The CDN providers will get takedowns, requests to reveal the backing origin, etc. You can't use a commodity CDN provider for this.
Is the quest for immortality a solipsistic misunderstanding of evolution? -Yes. However it's substantially less stupid for bezos etc to fund science than it was to build the pyramids. If we simply made the bastard pay as much taxes as his employees I would be happy to allow him to spend his wealth as he sees fit no matter how philosophically bankrupt it may be. It's easy to envy him, but it takes 1000 data scientists and engineers to optimize people into opting out of individuality. Bezos is not an axis of evil. Evil is banal. Hes just an aging narcissist with very common and somewhat regrettable urges. If we love liberty we must even love his liberty.
Smartphone prices could rise as TSMC raises chip fees
They do have a crowdsourced CDN called Mangadex@Home. I participated in it from last year until the site was hacked. The aggregate egress speed was around 10 Gbps.

The NSFW counterpart of MD also has a CDN appropriately named Hentai@Home run by volunteers.

These 2 sites are the only ones rolling their own CDN for free that I know.
Why aren’t lightweight hypervisors used more outside the public cloud? It seems that would go a long way in protecting the rest of the device from poorly written c code parsing user input.
And while that is probably true for most of us and gorilla faces, even those midwesterners would easily distinguish an Asian person from a Gorilla.

It's true that we're good at recognizing faces (even where there are none), and distinguishing on a basic level (type of animal) but specific faces are mostly cultural.
I would not be surprised if there were federal laws against the use of Poker bots online.
My cheap $20/month VPS serves tens of thousands a user per day without breaking much of a sweat. Using a good old LAMP stack (Linux, Apache, MariaDB, PHP).

I don't know how many requests per second it can handle.

Trying a guess via curl:

time curl --insecure --header 'Host: www.mysite.com' https://127.0.0.1 > test

This gives me 0.03s

So it could handle about 30 requests per second? Or 30x the number of CPUs? What do you guys think?
I'm guessing content owners may have realized the value in letting people use tiny sections of their songs. Meme songs on tiktok likely generate huge profits when streams of that song jump.
I must have missed those people. People here are in general not poor, but most are neither completely out of touch.
Fascinating that players in VR would not attempt to turn the handle of a latched door, and instead would simply assume the door was locked. And the solution was incredible: simply play the hand-rotation animation when the player grabs the handle - and the player will think they had rotated their hand!
> Kiln was also a great product and allowed for using both Git and Mercurial. It was way better than anything else at the time, but lost out to Github.

I used both FogBugz and Kiln at a previous employer, and I really liked FogBugz, but we had nothing but problems with Kiln. We had a fairly large team (maybe 75-100 people) and a good sized project (maybe 300k lines), and it was painfully slow to do anything in Kiln and it was down/broken at least once a month. It wasn't so bad early on when we were small, but it didn't scale with us very well.
Not so much race conditions but the distances doors synchronize across the network has to be really carefully synchronized with the weapon ranges, character rendering ranges and building mesh level-of-detail.

If doors synchronize closer than a player's sniper rifle range then a player can either stand just behind a door (that is open for them) and shoot people at range (who see the door as closed). Or the door defaults to open and a closed door that seems like cover allows you to get sniped.

While the ideal is to synchronize everything at the same distance, if you have 100+ players on a single map and a sniper rifle with 500m range you can be synchronizing the stage of hundreds of doors per player and eating bandwidth that would (usually) be better used synchronizing player position state. In practice you end up doing some amount of 'automatic' synchronization and some based on context... and a server that has the definitive world state that can 'undo' shots through closed doors etc.

Building rendering distances can also be an issue with doors, generally you switch to simpler building models as they get further from the player's camera. But you can't include doors in the lower level of detail models until you are at a distance that enemy players are also not visible. So while a building can be a 200 triangle shell at 400m it still has to have doorways and network synchronized doors, even if the doorway is 4 on-screen pixels it should still be possible to see a player move behind that open doorway (or not see them if the door is closed).
You forgot to mention that TikTok enables the use of high quality copywrited music in their videos.
It's under psychedelics, for now I'm only searching the description and title. her you go for DMT link https://jrelist.com/?q=psychedelics+fungi+psychedelic
Does it serve 20-40 hi resolution images and uploads per user?
Puppy-killing scientist smuggles rainforest babies in body cavity (2015)