skysight-inc/HackerNews huggingface dataset:
Scrapping seems to be a fairly solved problem, there are open source scrapers that are competitive with google, and just download an entire site into an archive, ssl headers could be included to prove the authenticity of the archive in a distributed environment.

Indexing I have no idea how this could be done in a distributed way, as far as I know it basically cant. Distributed p2p apps use a central server or will send the search query to everyone on the entire network until some one gives them a result. Which isn't efficient enough to work on googles scale and the privacy issues.

My best guess is to break a query into tokens and then have a dht of indexes for each token and then have the peer request all the needed indexes compile them together or something? Anyway even if there is a way to distribute an index efficiently, I cant think of a way to generate the indexes in a secure way, at least without some sort of human oversight, which might be acceptable.

Distributed ranking runs into all the problems sdrinf pointed out. A better solution is to have lost of ranking factors enough that its easier to just make a good website than figure out the system and how to game it. Then let the end user weight the ranking factors to suite them, this should give better results than google and make SEO harder to fake.
yup. cbs should be handing the team a wad of cash and saying, "run with it!!!"
I have an office with a few of those and they are not great and do overheat. I am quite surprised you having been exposed to a great number of them never had an issue.
If you read into it, the new Code of Conduct actually may actually do more to ostracize people.

Notable contributors have already been harassed on Twitter and other platforms because apparently their actions outside of the Linux Kernel and LKML deem them breaking it, and people love to attack people for breaking rules.

There was also no-one really asking for a new Code of Conduct, and things weren't really broken. People are mostly just worried that its going to cause more issues and tension than when we had the lack of a proper CoC, or cause them to get targeted.

The Code of Conduct also has a few questionable statements, such as not judging people based on their technical abilities, which is a super important thing when you're actually developing one of the world's largest operating systems and people like to contribute garbage.

It was also, as the Author themselves has stated it was only made as a political statement, and the entire idea of it is to push an agenda.
(^ See their twitter for where they said this)

Sometimes hostility and arguments really drive some people to do better at times also; and it makes people think about their code quality and double check it before they actually submit their patches -- you don't want to be slated by Linus if you submit rubbish do you?
Is that your opinion, or are you citing a developmental theory? Personality invariants are a thing. e.g [0]

If you can elaborate on your point of view I'd be happy to further explain what I mean here.

[0] https://www.jstor.org/stable/87360?seq=1#page_scan_tab_conte...
I think this comes across as incredibly nuanced and thoughtful.

Often we only see the outer surface of what people are actually like, and make judgments on their character based on that.
It certainly has to help someone in a re-education camp somewhere in China.
Spoken like someone who wouldn't shoot down a drone, the kind of people who would do not think along these lines.
Motivation Might Not Be What You Think It Is
Do Not Run Dockerized Applications as Root
Like all human systems, you get what you optimize for.

Universities want paid grants for money and prestige, so the that's what the researchers go find. I've said this before on here but the solution to this problem is the universities like Harvard and foundations like RWJ which have near infinite money and don't need to operate like this. They need to push forward real research that is reproducible (maybe several times) and shows whatever the data really shows. The researchers who create reproducible studies get bonuses. Again, you get what you optimize for.
Tbf, that's not restricted to HN.
I highly recommend watching the TED Talk that Torvalds presented. You get a much clearer idea what he means by "not a people person".

https://www.ted.com/talks/linus_torvalds_the_mind_behind_lin...

This talk is also back in 2016, and even then, he talks about not being proud of the way that he reacts to people sometimes. So, while his recent announcement may come as a surprise to some, it's something he appears to have been giving a good deal of thought for a while now.
I currently use NameSilo. Don't forget they also offer free whois privacy for life.

My only complaint with them is their DNS records are only updated once every 15 minutes.

This makes doing automated API based DNS based LE challenges annoying because you need to sleep your script for 15 minutes to ensure the update got pushed.

Also, I'm surprised Cloudflare omit talking about whois privacy in the blog post. Makes me wonder if they plan to sell that for some amount of money.
His feelings about two of the "sides" of this argument are so recognisable. I'm generally in favour of going out of my way e.g. to make minorities feel more welcome to compensate for the natural tendency to make them feel less welcome. However, the nastiness of some of the people in "my camp" pushes me away from it and makes me reluctant to openly support that cause.

In effect, they're really counterproductive, and the only reason Linus is now openly on "their side" (for lack of a term that better describes what I mean), is because the "other side" also was really nasty, pushing him away from them.

It took a while for me to realise what privileges I have had that some others have not. The first step to realising that was being open to that even being possible, and shouting contests do not encourage that.

I'd love it if Linus' approach here would lead to less-heated discussions and actual insights on the subject, but the hate and vitriol I've seen spewed in his direction after his announcement doesn't make me hopeful...
Just came back from Europe. Everyone knows about this and all media reported on it. Surprisingly so little is said in American media. Its not new that Americans do not like other nations succeed in space! If these were US-based rovers, each network will give it 10 minutes cover. Same sad story about Chinese Moon landing. Most American friends laughed at me when I told them China landed rover on moon. Some even question Wiki article as conspiracy theory.
I agree, I've actually made a point to not read older entries before I write anything new in mine and wait until afterwards or an entirely different time specifically for reading it and not writing because I've noticed this effect in myself.
so i'm on board with your central concern here. my issue with functional css is that your markup has no semantics. you can't just look at it and know what things are by their names. ie,

<div class="m-5 p-5 text-gray-light bg-gray-darker border border-gray-light">

what the hell is that thing described by all those styles?

versus:

<div class="profile-card">

and i know immediately what it is, and can instantly map the markup to what i see on the page.

you just lose too much by not having that imo.

i really like composing styles out of small little semantic utility classes as in the first example above, but you can do that and still have semantically named classes easily enough with a preprocessor.

i'd be curious to hear your thoughts on that. when i've discussed this concern with functional CSS purists they usually just shrug and say something like "you get used to it" or "you just don't need those semantic class names" but i find that response unsatisfactory.

clean, readable markup is so much more pleasant to work with.
Expectations of politeness generally involve letting people have their happy delusions if they aren't harming anyone. For instance for someone whose son went MIA in Vietnam and holds hopes that he will return one day telling them "He probably either died and his corpse was forgotten or in the off chance he is alive went AWOL with some peasant girl after getting fed up with the war and lives in fear that he will be found out.". Even if statistically it is 100% true that would be staggeringly rude to say to them.
I mean that the potential impact that a blokchain-based system could have on the way we generate and exchange value - could be revolutionary. It could be one way that wealth distribution could be facilitated if you buy the idea that data is the new currency. Blockchain brings power to the people because it puts data in the hands of the person with the keys to that data. Ideally, we are careful enough to maintain those keys and not abdicate control of them to yet another centralized authority.
I can't see what was wrong with your post; whatever we might say of any of the books in question, it seems to me like you're answering a question and helping us understand where Pinker's claims come from. If someone is going to carp that the sources of "pop-sci," let them cite what they feel is a higher-quality source.
have you tried dokku? https://github.com/dokku/dokku
If an improved CoC means that more people feel able and encouraged to contribute, does that then count in favor of the 'technical contribution' axis for the people who wrote it? If not, your plot isn't all that useful.
Retrieving the full path of a process on MacOS (and exploring procfs)
One thing I think CSS frameworks got wrong is mixing layout with style. At the time, maybe it was justified due to lack of layout options. But today, especially with grid, but even flexbox, layout can entirely be done by the framework's consumer, and should probably not be done by the framework itself, which should focus probably mostly on style. Unless of course it's a layout framework, but grid is so flexible and easy to work with that you probably don't need a layout framework. I'll just leave this here https://learncssgrid.com/
A pop-sci book seems like it's at least as good as personal anecdote, which is used on HN to claim all sorts of bizarre things.
Big pharma would lobby hard against that kind of law change.
The number of discussions I have had with the staff in mathematics and computer science about the
need for such journals would last years. Everyone pretty much wants them because they know the need
of saying "hey I already did this and we got nowhere - try something else" is so crucial for science and mathematics.
“Why should they go the extra mile, for free, for every member of the public who demands answers and transparency? Sorry, but it’s too. much. work.“

I understand your exhaustion at the idea, truly, but in an era of publicly funded research, the public does have a right to demand transparency for the same through Congress (in America).

That said, a more reasonable level of transparency, post-facto, ought to be sufficient for for most - emails, data, etc. get requested of members of the Congress, for example. Or for a more representative example, take a look at the explanatory efforts of the Federal Reserve and when they go beyond the plain economic research to also provide detailed public transparency.
These standards of care do exist for a lot of things. (see NCCN treatment guidelines for ones related to oncology). Oftentimes a doctor will not be reimbursed by insurance if they give treatments that are outside of approved standards. There is leeway given, though, because its just damn hard in many cases. Patients can present with 4/7 key symptoms and may report other unrelated issues. Or ailments can act differently in different people. Or maybe you have never been able to sleep well and don't even notice that, and it's a key issue related for a diagnosis.

1 really interesting point about it, though: They vary WILDLY by nation. You wouldn't think it would make a difference, but because of the varied regulatory bodies, and even culture, it does. (This was an issue that Watson for Oncology ran into after being trained by US doctors. In Japan, even on the occasion is gave a reasonable answer - it was watson after all - it often was not how the Japanese doctors would act in that circumstance).
cbs seems to be a machine of human automatons not actually thinking or doing anything.. just following an algorithm, copying the shapes and colors from gene roddenberrys works and sticking on a price tag every business cycle
Capitalism is not a choice.

Given the nature of the human mind and the material state of the world, the equilibrium state of human economies is capitalism.

To see what I mean, consider any complex system. There will be certain patterns and processes that naturally unfold in that system, while other patterns and processes do not manifest without external energy. The reason is because the former states are closer to the equilibrium state of the system while the latter are comparatively farther away.

Capitalism is like an equilibrium state, and all attempts to control capitalism require external energy. What is a concrete example of this?

Regulation has a tendency to be repealed if the public or government loses sight of why the regulation was passed in the first place. On the other hand, companies usually want regulations repealed by default. This tension between opposing forces must resolve itself, and it does in favor of companies because not only are they constantly applying pressure against regulations, but the public is often allured by the fact that many regulations lower potential levels of economic growth. Therefore it's more likely than not that regulations be repealed in the long run.
> That would simply not fly at my company.

Sure, but that's a terrible example because a lot of what goes on in companies is more about appearance than substance.
Sure. But in reality as a leader you sometimes have to be willing to piss off some people. You can't always be nice. Sometimes you have to draw a clear boundary.
"I think therefore it is"?
> I'm choosing to stay away from bullies.

Who are the bullies in your opinion? Don't be shy, name and shame!
When this project hit HN a month ago I said

> It does look cool. And it also looks like a huge labor of love. Luckily CBS and Paramount Pictures already have guidelines in place for allowing noncommercial fan-made productions. One hopes that they will continue to recognize how important hardcore fandom like this is to the success of the franchise.

And now I'm saddened.
mjg's quote was concerning ethics and abuse, and does not mention politics.

The concern is that the CoC itself may be used to abuse individuals.

Asides from the Tso example, there was someone else harassed because, outside of a project, they expressed a sexual preference for male dominant/female submissive roles.
It's also something that people should have expected. I don't understand how people have not noticed that all of the major sites that generate revenue through user profiling and advertising have been pushing hard for users to either be obligated to register using their phone, or to setup a two factor authentication using their phone when it's not necessary for registration.

The reason I say it's something people should have expected is because if people were more critical of the things asked of them, then things like this would never get off the ground. Instead, because people do not seem inclined to naturally believe that corporations might have ulterior motives, such practice has become common place and on some sites even mandatory.
Are there more Europeans here in HN? Because this hard push for empathy and stuff it just feels... weird to me. Empathy as the ability to see through your own biases and understand others POV is good in every setting. Empathy as a way to not communicate directly is just a waste of time.

Most malicious people I've encountered in my career are the types that comes with smiles, corporate language and all that stuff.
In “real life,” no, but on the internet, yes.
> However, the nastiness of some of the people in "my camp" pushes me away from it and makes me reluctant to openly support that cause.

Doesn't sound like you actually supported the cause if you can be pushed away from it like that.
Like I say, I agree with you in the broader sense but I was making a finer point here. i.e. not whether the premise is true, but just what the scope (or even how valid) was of the research that demonstrated the premise.

GP provides sources in a sibling thread where the discussion is further elaborated.
> Yikes.

Agreed. Wholeheartedly.

> I agree that this might help you move quickly when starting a project

I don't even see this... at least I can't imagine a case where I'd want to replace "background: #333;" with "bg-gray-darker". The CSS has at least been well established for years/decades, and it'll be much easier to find documentation/support/etc.

> But you pay a huge cost: maintainability. There is no encapsulation at all,

He's advocating that the encapsulation happen at the level of templated markup (or JSX, whatever), rather than at the level of CSS classes.
I would at least say it needn't be. Can we not set out rules for an open source community to follow without enumerating the pet peeves and favourite protected classes in descending order of importance to the document's author?
The CoC is a form of identity politics that is enforced upon already-inclusive communities, to make them thread on thin ice.

Being against the CoC, means that, in today's climate of polarization, you are against inclusiveness. So I am going to be unreasonable about it:

The only reason "body size" is mentioned, is because the author is fat. The only reason why "gender identity and expression" is mentioned, is because the author is trans. For most of these cases, a simple "don't discriminate on disability" would suffice.

Then there is the extremely wide scope: A document that is supposed to make sure that pull requests and issues are dealt with without too much assholes, also polices appearances of its authors on social media and conferences.

Meanwhile there is no place in the manifesto for neurodiversity: Autistic people with low emotional intelligence.

These CoC's are pushed in through the back, by activists. Just like those that went out of their way to pressure maintainers of computer vision software to remove "lena.jpg" (A modeling woman now working with disabled people to do data entry) and change her with a picture of Grace Hopper (A soldier who happened to be woman, making sure that space remains US-only).

Everybody is welcome to contribute to my all-inclusive software! Nazi's, Antifa's, racists, conservatives, democrats, soldiers, peace keepers, freedom fighters, they's, fat people, skinny people, fat-hating people. If you act professional: I would never know: It is not like I would go to the Twitter of the one that made a PR to check out their identity politics (or lack thereof). There is another group doing that though...

If the CoC would be appended to the open source software licenses on my projects, than it would not be open source anymore, I would not be free to do with the software whatever I want.
True. Have someone do a quick check before sending. "Do you really want to say it that way?"
Hitler was also a good communicator.
>Doc slipped his finger up my bum

Is this a standard way to diagnose appendicitis?
Drafts and pre-standards are often free. http://www.open-std.org/jtc1/sc22/wg14/www/docs/n1548.pdf for example.
This technically it's possible to implement standard compliant implementation without paying.
thanks for this! developer here; im going to recreate this app for the sole pleasure of telling cbs to 'suck it' when they send the inevitable cease and desist. and when it goes to court, ill be back pleading for help! :)
Many people do. Many poor people make bad life decisions which lead them, unfortunately, into their poverty.
Where in the definition of FOSS does it say anything about breaking down barriers? Neither the definition of free software nor the definition of open software said anything about that. Unless that guy somehow would provide something that indicates that there's a consensus about his definition of FOSS being the correct one, it's just another person trying to push his own values as the values of an entire group.
I feel like the "version" of me interacting with my wife has a lot less redaction of thought/stage management going on than the one of me at the office.
This is huge for session musicians; all the people who lead normal lives but play guitar or drums for Florida Georgia Line, Bon Jovi, Alice Cooper, keyboards for Eminem and pretty much any pop or country-pop recording today that contains real instruments.

Even the normal people behind the studio console recording desk (Think Alan Parson producing Pink Floyd's Dark Side of the Moon, before he got "big" on his own).

I'd bet members of The Wrecking Crew[1], though modest, would have really benefited from a system like this. Though they were so busy recording all the hits from the 60's and 70's the rates they made may have seemed fair at the time.

[1] https://en.wikipedia.org/wiki/The_Wrecking_Crew_(music)
>Try telling people who have only Comcast to not get off the Internet, or people with only one nearby grocery store to boycott it.

Regardless of the personal cost to not doing business with them, they won't send an armed force after you that will kidnap you. But with the government, if you want to grow a plant on your own property that they don't agree with, they will. That makes a massive difference.
It's driving me crazy that I can't find this video. There was a defcon talk where they put a phone on airplane mode and stuck it in a faraday cage. They set up a box to see what it would transmit after they drove around for a while and connected to wifi and it transmitted location data based on the acceleratometer.
Lets stop caring about the Nobel institutions.

They have proved they can and will be corrupt as needed. Politics should not validate science, but people treat it so when we care about the Nobel prizes.
Exactly. We got rid of our "re-education" employment centers long ago.
> The only reason "body size" is mentioned, is because the author is fat. The only reason why "gender identity and expression" is mentioned, is because the author is trans. For most of these cases, a simple "don't discriminate on disability" would suffice.

Is being fat or trans a disability? :/
> One thing I think CSS frameworks got wrong is mixing layout with style.

I think some of this is due to the fact it was originally more about document layout than screen layout. At least the cases where I find CSS (horribly) awkward are cases where I'm trying to do something that falls more into the category of UI layout. For document formatting, it feels like a much better fit.
Memex... neat. I remember reading about Vannevar Bush many many years ago.
Have you considered stepping back and wondering if you really need orchestration at this scale? Couldn't a simple unit file suffice?

If you have many such projects, perhaps something like Saltstack or Ansible, both of which have support for Docker container management built in.
That isn't sufficient, unfortunately. A third-party's treatment of an individual depends a lot on the appearance of the individual. (i.e., beautiful people are treated differently than ugly people.) That is, one's appearance can have a causal effect on one's 'environment.'

Thus, even if raised separately, the 'environment' to which each identical twin is exposed will be more similar than the 'environments' of two non-identical people.

Simple example....

Adam and Bob are raised separately.
Yet, both develop to be confident and strong leaders.
Is this leadership quality 'genetic'? Or, is it because Adam and Bob are each 6'5" and handsome?

It would be very difficult indeed to statistically tease out these things.
they're sort of mail-blasted out to anything even remotely infringing; you put the onus on the recipient to prove otherwise. for fans and small shops without the resources to make their case (which may well be legitimate), its bullying :(
Mods, can we make this a toplevel comment?