skysight-inc/HackerNews huggingface dataset:
It's taking one source - look at how these people solved it! - and trying to apply it to others.

SO is relatively simple; it's basically customized forum software which is a solved problem that has been around for decades. A junior dev can build an alternative, and it can be built using tried and true solutions like MySQL + PHP, which are horizontally scalable with database sharding, read replicas, and maybe stuff like memcached to accumulate votes before updating the database or a CDN for caching static files.

Google has different problems and different workloads, and they have hundreds of times more applications with thousands of times more load. Apples and oranges.
I am not trypophobic but I find these images unsettling nonetheless.
Hi, I'm a performance tuning expert, and this thread piqued my interest.

The first thing that I noticed is that even with caching enabled, you're loading "too much data". After loading the main page and then clicking one of the tiles, there are several JSON API calls.

Here's an example, 195 kB transferred (528 kB size): https://api.mangadex.org/manga/bbaa17c4-0f36-4bbb-9861-34fc8...

Oof. Half a megabyte of JSON! Ignore the network traffic for a moment, because GZIP does wonders. The real problem is that generating that much JSON is very "heavy" on servers. Lots and lots of small object allocations, which gives the garbage collector a ton of work to do. It's also expensive to decode on the browser for similar reasons.

On my computer, this took a whopping 455ms to transfer, nearly half a second. That results in a noticeable latency hit to the site.

In my consulting gig I always give developers the same advice: "Displaying 1 kilobyte of data should take roughly 1 kilobyte of traffic".

In other words, there's isn't 500 KB of text anywhere on that page! A quick cut & paste shows about 8 KB of user-visible text in the final HTML rendering. That's a 1:60 ratio of content-to-data, which is very poor. I bet that behind the scenes, this took a heck of a lot more back-end network traffic and in-memory processing to generate. Probably tens to hundreds of megabytes of internal traffic, all up.

This is one of the core reasons most sites have difficulty scaling, because for every kilobyte of content output to the screen, they're powering through megabytes or even gigabytes of data behind the scenes.

Can this API query be cut down to match what's displayed on the screen? Can it be cached for all users? Can it be cached precompressed?

Etc...
Again, if you get a kernel exploit, you don't need access to the messaging app or to escalate privileges.

you're already root.

you can access any component without much restriction.

How the data is stored has nothing to do with this
Pardon the biological analogy, but diversity has 2 main benefits : resistance to epidemics (malware) and faster evolution (innovation).

I don't want to converge towards a single OS, but welcome standards and bridges between them.
> The term “toxic masculinity” does not and is not intended to imply that masculinity itself is toxic.

That's funny, really. I always only ever encounter it used by people who smear any and all masculinity as "toxic".

Do you have a link to a place "toxic masculinity" is used to describe a minority subset of the male population?
Sure, there isn't a gene that makes you run faster, but no matter how hard you train, you'll have a hard time beating Michal Phelps unless you're also naturally built like Michael Phelps: https://www.biography.com/news/michael-phelp-perfect-body-sw...

The point isn't that there is a "best" set of genes. The point is that there can be genetic advantages or disadvantages. Physical reality has an impact on experiential reality.

Where it gets dangerous is when people start using this as an argument for eugenics or an "ought" rather than "is" (i.e. constructing hierarchies out of physical attributes).
>On account of them being tiny, they aren't a threat to freedoms outside of their own country.

SA has been directly involved in funding terrorism(1), they're fighting a war in Yemen for their own national interest(2), they are pressuring countries in very concrete ways (e.g. Lebanese prime minister Saad Hariri's resignation in 2017 was basically forced by SA)(3), they've been trying to isolate Qatar since 2017(4), they have no qualms about murdering a critic in an embassy overseas(5), they're increasing their influence in places like Bosnia(6).

________________

(1) https://en.wikipedia.org/wiki/State-sponsored_terrorism#Saud...

(2) https://en.wikipedia.org/wiki/Saudi_Arabian-led_intervention...

(3) https://en.wikipedia.org/wiki/2017_Lebanon%E2%80%93Saudi_Ara...

(4) https://en.wikipedia.org/wiki/Qatar_diplomatic_crisis

(5) https://en.wikipedia.org/wiki/Assassination_of_Jamal_Khashog...

(6) https://www.france24.com/en/20181113-focus-bosnia-herzegovin...
My grandmother worked as a mechanic for the phone company in the nine-teens. Her sister did whatever she wanted, she started and ran her own business.
Is it a "narrative" that college isn't it worth it anymore or is that largely based in fact in the US? Especially when it comes to specific degrees that don't have a demand in the workplace. The cost of higher education in the US has financially crippled millions. And trade jobs pay well for far less education costs. Doing a cost / benefit analysis would seem the wisest choice.

The bigger problem to me is that with such a high cost for university education, our future electricians won't have one. Whereas in Europe they very possibly might. I know which society I prefer to live in and it's not the one where people are less educated.

What narrative about uniform privilege? Can you give some sources?

I've also never heard privilege explained as making life "just easy". I've heard just for example that life can still be hard but your skin color is not one of the things making your life hard.

I'd be interested in reading these narratives that are so different from the narratives I've read about privilege.
> Why spend $5,000 a semester to watch a Zoom lecture from an average professor when you can open YouTube in a new tab and see a world-class professor share the same information for free?

Because most employers will not even consider your application without a degree.
I’m sorry, in 2021, companies and universities are bending over backwards to hire black candidates.

This falls in the “earth is not flat” category in 2021, I will not bother posting evidence, as a litmus test of the HN crowd.
Without the mutual benefit of trade, what will prevent war?
RDP is pretty easy to explain: if you need a GUI, RDP is infinitely smoother than VNC or anything else the Linux ecosystem has to offer. I even use it on Linux for things like livestreaming (OBS running in a minimal GUI like openbox). The are many similar workloads that are less "servers" and more "cloud workstations" that use GUI apps.

As for Windows in general, 90% of the Windows servers I see fall into one of the 2 categories: 1) they run some Windows-only software or 2) the sysadmins at the company know Windows, so that's what they use. If your company relies on something from 1), you're very likely also going to fall into 2).

Specific example: a company wanted to allow any employee to log in from any computer and be ablr to get work done. A VM terminal server was too heavy for their network and server budget and they already had decently powerful PCs, so they went with AD and that roaming accouts thing. They had to hire a Windows server sysadmin to manage it.

When they decided they also needed a good NAS, web server and backup system, they already had a Windows sysadmin on staff and the licences+over-spec required to run in on Win were still cheaper than hiring another sysadmin.
You mean morally indefensible politics and misinformation propaganda? Oh no. Anyway.

I mean these politics are pushed by rich Americans and foreign interests, surely they have the means to start their own hosting platform. It's the same that advocate in favor of businesses rejecting customers because of free market.
"You can upload your research and publish it on the open web. Members of the community will be able to vote on your research to raise its visibility."

Oh dear.
Can Capitalism Save the Planet?
Would you mind outlining your approach?

Really interested to see how you think about this sort of thing =)...
It's pretty easy in Python too, eg.:

>>> soup = BeautifulSoup(requests.get("https://www.rust-lang.org").text)
>>> [x["href"] for x in soup.find_all("a")]

['/', '/tools/install', '/learn', 'https://play.rust-lang.org/', '/tools', '/governance', '/community', 'https://blog.rust-lang.org/',...
This is correct. My point is that you would want to access messages data after doing that.
On device? The vast majority of people don't give a flying fuck about privacy, for them the decrease in battery life would not be worth it
Mind you, those companies probably shouldn't have as many features as they have.
What? You somehow think that if there is a named thing then it's not genetics. It's genetics both if it's a named thing, and if it's yet unnamed thing too.
The entire piece is based on a single source who could have an ulterior motive, i.e. selling his book. In my other comment, I note what they could verify, namely his claim to have received a call. They could look at his phone company’s receipts. They could attempt to contact the father. They could at least make a note that the author’s claims are unverified.
Yeah, I get it, that sucks :/ I do know that PrinceXML has CMYK support so maybe check it out. Else you'd always have FrameMaker and the Server edition if you wanna go that much enterprise-y.
Heres the issue with Proton's marketing that no one is mentioning. The CEO keeps making claims about "Swiss law" as if it is something to be desired. However he never adds any citations to the relevant laws or their interpretation. This seems strange because #1 How many Proton customers know anything about Swiss law (how many can even read German or French^1) and #2 The CEO is not a lawyer, he is a physicist.

It seems prudent that Proton customers would want to have a look at those "Swiss laws" (a) to see what sort of protection they offer and (b) to make sure they dont violate one. In the case of (b) the customer will potentially lose all privacy protections, as emphasized in this announcement.

1 It appears that Swiss law is conveniently published in English however the English translation is not what Swiss courts use.
I'd like to add my support here too, but with a note.

When scraping and parsing (or writing integration test DSL), I always start out with CSS selectors. But always hit cases where they lack or require hoop-jumping and then fall back on Xpath. I then have a codebase with both CSS-Sel and Xpath, which is arguably worse then having only one method.

I suspect here, one uses this tool untill CSS selector limitations are getting in the way, after which one switches to another tool(chain)
Yes and no.

The Unreal approach makes it easy to create levels with a waterproof outer hull which allows you to use certain optimizations (such as portals in the BSP tree) to reduce what you need to draw.

But even without that, CSG usually produces only geometry that has a thickness, and that's what helps with the sliding through floors in the first place.

But since the Unreal approach makes it very easy to query if a point is inside the valid space of the level, or not, that's also used as a shortcut for determining if things did fall through somewhere.

So yes, the "blank filled with mass" approach further reduces the problem but no, it's not strictly necessary.
The story i've heard is that the olden days, operating a computer was seen as clerical work, just like being a secretary, so ideally suited to women.

Then we got 8-bit microcomputers in every home, and operating a computer became a technical hobby, so ideally suited to boys.

The generation of boys growing up playing with computers, and girls not playing with computers, swamped any existing biases in the industry.

I wonder if the communist countries had the former phase, but because not so many homes had computers, not the latter.
Not a library [1], but trivial to integrate in your architecture. Just redirect stdout to gwsocket

[1] https://gwsocket.io/
That's how it's used and understood though.

I agree it was never intended to, but the reality is different. It should be dumped and a new term used.
"an operating system is a collection of things that don’t fit inside a language; there shouldn’t be one"

I've wondered the same thing about databases. Just like an OS, a database has to manage data on disk and figure out when to cache it. The files & folders metaphor is arguably a relic of pre-computer times--instead of searching through folders, it is easier to search and sort based on particular attributes, something that databases are well-suited to. I think it'd be interesting to start with a database and try to build an OS around it, see how far you could go.
Palm Oil: The Most Destructive or Versatile Vegetable Oil?
Thanks, this looks more powerfull. Support CSS, XPath and XQuery. Maybe I could learn a bit of XQuery when I have a use case for it :)
For the one I purchased, I researched them on Consumer Reports, which independently assessed their efficacy. How do you tell they work less well before you make that assertion?
Yup. It's trivial to google "starting salaries for XXX" before committing to a major and the loan.
Ken Birman's (https://www.cs.cornell.edu/ken/)' book

"Guide to Reliable Distributed Systems: Building High-Assurance Applications and Cloud-Hosted Services"

He even give a course about topics in cloud computing :
https://www.cs.cornell.edu/courses/cs5412/2021sp/

Another interesting course about distributed system is from MIT
https://pdos.csail.mit.edu/6.824/schedule.html
I get an error on several articles to the effect of:

invalid ipfs path: invalid path "/ipfs/undefined/2107.00648.pdf": invalid CID: expected 1 as the cid version number, got: 31965309853
I did not mean to imply that it must not be tried :-/

We frequently don't catch murderers; this does not mean we should not investigate new methods of catching them.
Looking at their diagrams it seems that the k8s cluster exists solely to handle their monitoring and logging needs which would be extreme overkill, especially since 18k metrics/samples and 7k logs per second are nothing. Plus you now suddenly need a S3-compatible storage backend for all your logs and metrics. Good thing Ceph comes 'free' with Proxmox, I guess.

Deploying an instance of Prometheus with *every host is also unusual, to say the least and I don't quite understand their comment to that. If you don't like a pull-based architecture (which is a valid point) why use one at all!?
There are many more push-based setups out there that are simpler to set up and less complex.
3D Table Model
Among 3d models of furniture, tables are in special demand. The table is a unique thing in the interior. Even despite the fact that tables of various types are now produced, and their functions are strictly defined, any table can perform many tasks in the interior. If there are many completely different chairs in the living room, then it will look a little strange. But different tables in one space will not raise questions. This only increases the responsibility of the designer for the selection of the most suitable table for the room. It doesn’t matter if it is a kitchen, living room, dining room or study.
Finding a good 3d table model can be tricky. Unfortunately, there are no universal options: matte looks different than lacquered, wooden — not like plastic, round is very different from a rectangular table. When placing a 3d model of a table in three-dimensional space, the following details should be taken into account:

· construction (shape of legs, countertops, additional parts, for example, boxes);

· size and height;

· table material and color;

· decor (for example, carving, stucco molding).
Saito Community Town Hall #3 – Official Recap
> a lot more knowledge in some countries about which jobs lead to high paying careers

The knowledge is there and completely trivial to obtain. Google "starting salaries for XXXX major".
> A narrative that college isn’t worth it anymore

Is it entirely false though? What benefit does a college degree in sociology does to a person (and even broader society) when the person will likely be in over 100k+ debt?
Some people can certainly reach an intuitive understanding of mathematics that will never come naturally to "normals".

It's worth noting however that we often consider these people "disabled" (or euphemistically "differently abled"). The point is that there's no genetic dial you can turn from "worse" to "better", it's more like a massive board of switches that feed into each other.
You are confused in exactly the same way as everyone at the CDC who insisted, and continues insisting, that airborne transmission of COVID-19 does not happen.
The last time I tried something like this, I quickly quit and used LaTeX. For all of its warts, it’s an excellent tool and it runs very quickly compared to a browser.
Ολλανδια – Τουρκια προγνωστικα προκριματικων World Cup
You might be missing a change in index: `obj[0].prop` vs `obj[1].prop`. Or, your JSON might have the same property defined multiple times: `{a:1, a:2}` (though I'm not sure how gron handles that situation).
Οι Ολλανδοί θα προσπαθήσουν να περάσουν πάνω από την Τουρκία στην κορυφή του ομίλου όταν οι δύο ομάδες συνεχίσουν τις προκριματικές τους συμμετοχές για το Παγκόσμιο Κύπελλο 2022 στο Άμστερνταμ το βράδυ της Τρίτης. Η Τουρκία είναι αυτή τη στιγμή στην κορυφή του ομίλου με 11 βαθμούς από τους πέντε πρώτους αγώνες της, ενώ η Ολλανδία κατέχει τη δεύτερη θέση στον όμιλο, έναν βαθμό πίσω από τους αντιπάλους της. Μην καθυστερούμε άλλο, ας δούμε τα σημερινά Ολλανδια – Τουρκια προγνωστικα προκριματικων World Cup
https://xkcd.com/303/

You missed my praises for Apple and Google platforms.
So Linus is not favouring any type of git strategy or any of that stuff that people like to go on wars about.

The only thing he's saying here is that github pull requests create a merge commit with a non descriptive commit message (only says that two branches where merged, not what was merged) and that the merge commit will be authored by a github.com user.

On gitlab, you can define the commit message of the merge commit and the author will be set to the account that merged the pull request, the only problem with gitlab is that (obviously) the merge commit won't be signed.
I disagree - we have excellent tooling avaliable to cram and compile code into smallest CPUs, but our teaching methods are still the same as they were in 1800's
But humans generally like to organise things hierarchically and I would think database are not well suited for this purpose.

That is, unless there exists some kind of tree structured database that I don't know about ...

Many years ago Microsoft tried to implement some kind of database oriented file system (it was a big dream of Bill Gates IIRC and probably meant for Longhorn), but this project never became part of an official Windows release AFAIK. It'd be interesting to know why Microsoft abandoned this initiative.
I wouldn't want this at all. Just off the top of my head I can think of a ton of use cases this makes hard:

* I ask a seller on FB marketplace to send me some pictures of an item

* I need to send pictures of some documents to my solicitor

* A new friend I've just met in a bar tries to send me her contact card

* My mechanic tries to send me a PDF of the invoice for his work

Sure, there are ways around all of these, but it makes iMessage (or any messaging service) a lot less useful.
Show HN: Weka Checker – The smarter way to check references
I wish they had made the C65 sooner. Or, at least, made versions of the VIC-II that could work with faster memory and CPUs, or at least 80 columns.

The 6502 had a very high IPC rate compared to 8088 and Z80's and was competitive even at a lower clock rate. Fixing the hardware issues that prevented faster disk access would have enabled business apps on the platform.
I’ll be interested to see how many people are actually using Codex in 12 months time.

I honestly don’t know if it’s a shiny new toy that people will get bored with, or a genuinely useful tool that will become part of your average developers toolkit.
I don't think it is ever a moral issue at all.

It would be a real moral problem to have others judge the value that someone is able to contribute by strange factors like this -- some faceless "expert" decides the NBA player has to forfeit their income because they are over 7'2".

The real moral issue is popularizing the idea that it is unfair or the gains ill-gotten if people are successful, that their earnings are like loot that should have been "divvied up". It comes from and breeds jealously, resentment, division, hate, and crab mentality.

If people do well because they are intellectually gifted, physically gifted, because they work hard or because their parents raised them well or because a coach just happened to see them playing basketball while sitting in traffic driving through a poor neighborhood. Then great. Someone else doing well does not make my life worse.

I also think there should be various safety nets so the poorest and least skilled people can have at least basic access to necessities and training if they would be otherwise unable to support themselves.
"Nowadays, everybody insists on putting stuff on K8s regardless of how large or small it is."

But if you already have the tooling, experience and support for k8s, why wouldn't you use it?

I can fire up a k8s cluster on any major cloud provider in minutes (or bare metal in slightly longer), and deploy almost any web app using a standard interface that has extremely wide adoption.

K8s supports a ton of things, but you don't have to use them. It can be complicated, but usually it's not.

It feels a bit like saying why use Linux for your simple app when it could run just fine on DOS or QNX. How many years of my life have I wasted debugging networking issues on Linux or Windows that turned out to be caused by a feature I wasn't even (intentionally) using...
Good old nukes, that worked rather well between US and the far more expansionist USSR for decades without a significant trade environment.
I hate it when people act like every other project has different constraints. For most web projects that is simply not the case. Maybe in some cases there are small differences which won't be noticed by any run of the mill setup. If your constraints are different but you have 100 members and never more (like most startups) your constraints generally don't matter even if they are radically different. Most people here are overarchitecting for the "chance of becoming Facebook"; personally I rather make a lot more profit (from day 1) by using cheap stuff and simple setups and when we accidentally make it to Facebook size, we will revisit. We can move it to Amazon to keep running and in the meanwhile rearchitect. But chances are against us, and all of you here, that we will ever reach anything close to this. Even with investor money (just did 2 raises) we have better stuff to do.
Yet, the possible resistance is also on the consuming side. It requires a lot of willpower not to flow with the river, but tools like Fraidycat (https://fraidyc.at/) help a bit in following people not trends.
Very interesting and cool. Exciting things happening in this space.