skysight-inc/HackerNews huggingface dataset:
> I don’t have any good solutions here.

There shouldn't be any. There is no good or moral way to perfectly control a human population. Anything of the sort inherently degrades the human condition because it requires complete submission to authority. Since humans are corruptible, authorities are also corruptible. Therefore, it is vital that crime and insurrection never become impossible even if only to preserve the threat against authority.
I really miss my DN3500 (68030 box with EISA bus and ESDI disks, from memory) - Domain/OS (and Aegis before it) was a surprisingly fun OS, switching between Aegis, BSD & SysV userlands, and it came with enough compiler tools for me to write an AutoCAD driver for a Summagraphics tablet I picked up around the same time. The windowing UI was surprisingly pretty too, and Apollo Token Ring with its whacko RAM-over-Network architecture worked surprisingly well. It's a real shame HP swallowed them, but perhaps the moral of the story is not to try to ship 3 different OSes at the same time on the same hardware (and not to write a huge evolutionary fork like Aegis was).

Edit 1: The DN3500 also came with a hardcopy of this PDF :)

Edit 2: From memory, it also came with a surprisingly good super-early guide to TCP/IP and the Internet, complete with a hardcopy of the HOSTS file in case you couldn't get it via FTP from Internic ;)
There has been a lot of recent reporting about falling rental prices, in some historically overpriced areas.

These stories ignore the sky-rocketing rents facing most of the nation - foster an unrealistic picture of the rental market.
The language in the rebase article [1] has been softened
somewhat.

[1]: https://fossil-scm.org/home/doc/trunk/www/rebaseharm.md
The amount of money spent on this weapon of war could have been used to build a $700k house for every one of the 550,000 homeless people in the USA.

If you taxed Jeff Bezos at 100% of his wealth and simply confiscated all of his US$183 billion of assets and liquidated them, you would have to find another 1.3 of him to do the same to to cover the cost of this program, which is 2.3x his net worth. Even if you tacked on Elon Musk's US$164B, you wouldn't have enough to pay for this.
Yeah, stuff like leveling and role changes become issues mainly at companies with large engineering teams. I.e FAANG, MSFT, etc.

In my opinion the main reasons to work at a startup are A) it’s growing ridiculously fast and you expect your equity to be worth something. B) your learning. I.e you like the technology or the space or your new to tech. C) you like the people.

Hence retention and recruiting for startups is a totally different ball game.

Other small non venture backed tech companies have a different set of challenges in this regard.
https://trends.google.com/trends/ is probably the best resource for the "top" queries, though it doesn't dive too far down the list.

Particularly their "Year in Search" entries, like: https://trends.google.com/trends/yis/2020/US/
I read this book a while ago based on the fact that a lot of HN users recommended it, but I didn't think it was that great. It could have been 5 pages to get the point across, but that doesn't sell a book. It's been a while but if I recall correctly you could summarize it to: "If it's important to not miss any steps, use a checklist. Don't have too many or people will skip it. Only include relevant steps. Checklists are useless if they're not followed." I'm probably butchering it a little though to be fair, if it interests you give it a chance.
Yeah ... maybe...

There might also be anxiety around playing a game you don’t know well, which wouldn’t manifest in a language you were familiar with.

Honestly, this article is pretty superficial.
I mean it's not that weird that a company would authorize major search engines scraping them but no one else.

I don't really see this as Google playing by different rules so much as economic incentives being aligned in Google's favor.
Thank you for those insights, it's a topic I'm interested in. Agree with what you're saying about naive bots hitting websites/hosts/subnets too hard, in the context of site owners being hit by multiple bots for multiple reasons and them questioning the return they'll get.

I'd be interested to know more info wrt DNS lookups. Did you apply a blanket rate limit on the number of DNS requests you'd make to any particular server?

From past experience I know the .uk Nominet servers would temp-ban if you were doing more than a few hundred lookups per second. At the next host level down, was there a blanket limit or was it dependent on the number of domains that nameserver was responsible for?
Well I suppose if you are a redditor you will probably see the white supremacist boogeyman everywhere.
Black tea with milk is a saviour for hangovers. Mind you, I guess this could be conditioning based on my environment (I'm Irish).
The US has deforested far more land than is present in all of England. Look at the satellite map of the US and see huge swaths of uninterrupted farmland larger than entire European countries Most of the old growth forests in the US are long gone. A lot of what remains is new growth of >100 yrs old lacking the original biodiversity.
I'm trying out Cloudflare Pages, it's pretty good so far.
And linking past threads on the same subject is helpful.
Liz knows she has a long future in public life, without ever having to win an election again. There will always be a place for a previously-elected legacy reptile in the bureaucracy, as she gradually takes over her father's client book. She'll never have a problem getting Senate confirmation, no matter where they decide to stick her.
The USAF/USSF seems to have already made the switch to unmanned spaceflight (the x37b).
> So on `get` if we're in the process of resizing

Not just get, but set also, right? Otherwise I would think a large group of set operations that overflowed more than once might be problematic to deal with. Or maybe I'm missing something that makes that a non issue?
Multiple manufacturers do artificially limit the performance of their engines as market segmentation; they do have physically identical ones with different software and thus different performance. The customer is not being cheated, they get exactly what they paid for.

The manufacturer will never offer re-flashing the ECU to get more performance; that would be problematic from the paperwork side, so I suppose that the offer was an aftermarket one. If someone is willing to go this way, he might just heed your advice as well.
Maybe it would be nice if some sort of simple central index of "URLs + their last updated timestamp/version/eTag/whatever" would exist, updated by the site owners themselves? ("push"-notification)

Meaning that whenever a page of a website would be created or updated, that website itself would actively update that central index, basically saying "I just created/deleted page X" or "I just updated the contents of page X".

The consequence would be that...

1) ...crawlers would not have anymore to actively (re)scan the whole Internet to find out if anything has changed, but they would only have to query that central index against their own list URLs & timestamps to find out what needs to be (re)scanned.

2) ...websites would not have to just wait&hope that some bot would decide to come by to have a look at their sites, nor they would have to answer over and over again requests that are just meant to check if some content has changed.
Interesting, while i haven't built a sphere yet I have factories going on multiple planets and haven't noticed any performance issues. I'm on a a 2700k with a 970GTX. Not suggesting you don't have issues, but perhaps there is a fix?
Spoofing user-agents hasn't worked in a long time for anything but small operations because search engines publish specific IP ranges their scrapers use.
If it's performed as an abortion would that still be considered genocide? Isn't that implying that the fetus is a living person with all the rights accorded to them? That would seem to be going against the contemporary wisdom of abortion wrt women's rights.
Awesome tip, thanks!
> The developer machine was compromised in a deeper level (rootkit?)

Unlikely that would not have taken 3 month.

> The developer installs a particular application in each Linux box

Possible, but also unlikely, as long as the vm wasn't used for other things this also wouldn't have taken 3 month.

> The developer installs a particular application in each Linux box

There probably is, but it probably has nothing to do with this exploit. For the same reasons as mentioned above.

My guess is that it was a targeted attack against that developer and there is a good chance the first attack and the second attack used different attack vectors hence the 3 month gap.
I’ve always been curious, is there a stated reason why HN doesn’t have the feature natively? Is it meant to avoid too fast back and forth comments or something?
You could host it P2P in Peergos - https://peergos.org/posts/p2p-web-hosting

Disclaimer: I'm a co-founder
Thank you. The docker part isn’t the barrier for us, but rather all the other moving parts that glue stuff together, eg load balancing, custom nginx directives we have, static file serving/caching, deployments, datadog integration etc ... not to mention just the paralisys of choosing something amongst the sea of options out there :)
People who do not listen to their friends are already dead.
Yes but if they're negatively correlated and everything is tanking then they won't impact your returns as much than if they're positively correlatd.
Yes, I completely agree that weakening encryption is an incredibly slippery slope. I don't know what the right answer is. I just know that a lot of people would not be happy with a government that did not do everything in their power to prevent horrible acts from happening. There are bad people in this world that would not think twice about murdering thousands of innocent men, women, and children. To have the government immediately report any vulnerabilities that they find instead of using those findings to do good for their citizens will be a hard pill for most of the population to swallow. It will absolutely have negative consequences when they don't report those vulnerabilities immediately though. For a government to do perfectly well for its population, it would need to stay on the cutting edge of technology and ensure its population has the best security while at the same time staying able to exploit the security of their adversaries. But that would be incredibly hard to do.

On the completely secure systems end of the spectrum, bad people will take advantage of that complete security. You wouldn't have to worry about having your identity stolen, but I don't know how we would prevent bad actors like organized criminals or terrorists from taking advantage of those completely anonymous and secure tools. I'm also not too sure what living in an authoritarian regime with complete security would look like. Maybe dissidents would still have tools to fight the regime or maybe the regime would be better at controlling the population and squashing dissent.
If you have an MSDN subscription (e.g. through work), using your free Azure credits to host a site is a pretty good option.
The "developing a product and then offering the more or less completed product to the military" is how we got the Predator drone though.
> Or is this just how it is on FreeBSD?

It's not. We do a lot of code review, and it's done publicly. It's easy to look at the commit logs. I find it telling that the article doesn't spend even one word trying to delve into our code review practices. This case was an aberration.
Also you can deploy your `public` folder to Netlify simply by drag-and-drop. I love this.
On a related note, Cloudflare just introduced "Super Bot Fight Mode" (https://blog.cloudflare.com/super-bot-fight-mode/) which is basically a whitelisting approach that will block any automated website crawling that doesn't originate from "good bots" (they cite Google & Paypal as examples of such bots). So basically everyone else is out of luck and will be tarpitted (i.e. connections will get slower and slower until pages won't load at all), presented with CAPTCHAs or outright blocked. In my opinion this will turn the part of the web that Cloudflare controls into a walled garden not unlike Twitter or Facebook: In theory the content is "public", but if you want to interact with it you have to do it on Cloudflare's terms. Quite sad really to see this happen to the web.
Because they won’t take the job otherwise.

If you want them to work there, then you need to match their requirements.

You could also give everyone else a pay rise every time you struggle to fill a position I suppose.
The public is unaware of the capabilities that makes the F35 stand out. It is not a traditional fighter. Sensor fusion is just one of the major components.
"You're just biased" is the first retort of every troll. Actually my bias is closer to your view than to the opposite. That's not the issue here.

The issue is that you're coming in with guns blazing, lashing out and firing condemnations at the side you have a problem with. Not only is this not helpful, it does violence to the thread. You're coming in to a room (let's call it) of human beings who have dealt with, and are still dealing with, every side of this profound and painful issue. That calls for compassion, regardless of where you are on the opinion spectrum.

When you show up with intense judgments and condemnations ("genocide", "dystopian", etc.), you're destroying our chance at human understanding. It changes the nature of the thread as much as hitting someone in the face would change a dinner.

It's also the cheapest of internet moves, the easiest thing to produce online, because it feels so good and justified while you're doing it. We've all been there, of course. When it feels like people aren't listening to you, the only thing left to do is shoot rhetoric in the most concentrated form you can come up with. That'll show them.

In reality, what you're doing is poisoning the connections between people. That's not as bad as poisoning people literally, but it's a second-order version of the same thing.
Whenever there’s a pot of money that people of a special group inexplicably fail to pick up, it’s worth wondering if teaching them to pick it up is the solution. I am no expert in gender discrimination, for instance, but even I have come across research that suggests that (1) people are less impressed with a resume if the name attached to it isn’t the right kind (by gender or other characteristics) and (2) people interpret identical behavior differently when coming from people of different characteristics (e.g. a male negotiator is viewed as “tough”, where a female negotiator might be viewed as “overly demanding”).

The approach in the parent article may not be ideal, but from where I stand, it’s as valid as waiting for someone (who?) to teach groups of interest to negotiate, and having the problem fix itself.
The census data is available for bulk download, mostly as CSV (for example [1]). Scraping census.gov is worse for both the Census Bureau (which might have to do an expensive database query for each page) and for the scraper (who has to parse the page).

Blocking scrapers in robots.txt is more of a way of saying, "hey, you're doing it wrong."

It's also worth noting that the original article is out of date. The current robots.txt at census.gov is basically wide-open [2].

[1] https://www.census.gov/programs-surveys/acs/data/data-via-ft...

[2] https://www.census.gov/robots.txt
Britain's Covid-19 care home cull
For those without chrome you can achieve similar functionality with RSS feeds:

https://hnrss.github.io/
Dude, I didn't even mention the Bible.
> What I learned in the two years to follow was that I was trying to control something I had no control over, and I suffered as a result. In my third year, I began to journal. I discovered that my thoughts and my actions were the only two things I could control. It was a pivotal moment in my life. I went from being a victim of my circumstances to being a master of my destiny.

Almost every book and teaching mostly comes down to this. Whether is Viktor Frankl or good old CBT. I actually read a very good passage about this in a book called Hapiness Trap

- Choose anything you are aware of: a sight, sound, smell, taste, sensation, thought, feeling, movement, body part, material object—literally anything.

- Focus on that thing and observe it as if you were a curious scientist.

- As you’re observing it, notice who’s doing the observing.

- That’s all there is to it.

- In that moment, when you observe the observing, you are the observing self.

- So the moment you realise what is happening—that you’re fusing with stories or believing that you are the documentary—you can instantly step back and observe.

- Then all you need to do is notice that you’re observing and in that moment, there is the real you.
"You don’t really believe the peeing in bottles thing, do you? If that were true, nobody would work for us. The truth is that we have over a million incredible employees around the world who are proud of what they do, and have great wages and health care from day one."

The first two sentences above in Amazon's PR Tweet are so...childish? Condescending? Patronizing? I don't even know the word for the feeling I get after reading it. Who OKs a Tweet like this?!
This is a kind way of saying that the defense industry and their sole customer are vertically integrated and serve as a way of transferring HUGE amounts of tax money into private hands without any accountability or real market forces at work of any kind.

The whole thing is a criminal enterprise designed to rob public funds and enrich a small group. It's been widely known for decades and everyone who thinks this is a bad thing is powerless to stop it.

It teaches one a lot about the true nature of the USA.
Heh, I missed that - just skimming the code on mobile. Maybe there should be a slight edit in the text and/or the custom binary search could be dropped (as it's not the main focus of the article).
How much money do you need to save for the incentive to exceed the effort and discomfort? If you make $50 an hour how much effort will you spend every day to save $50 a month?

I am sure the variable rates helped to incentivize people to conserve electricity in Texas recently but that is an extreme case.

Electricity infrastructure is capital intensive and long term stable rates are required to finance it.
In this case no CI was involved so that wouldn't have helped.

(The CI was not compromised but a dev laptop which was used to manually build+deploy the kernel, without any CI involved).

Through generally I agree with you.
Side note, if HR really wants to have a serious conversation with you about how reading Container Ship / Canal slash is inappropriate at work... maybe start putting in applications at more reasonable places.
The "cheap F-5 clone" called the F-20 Tigershark would have been one of the most capable and cost-effective fighters ever, but it offered insufficient opportunity for graft and corruption, so it was killed by Congress. It was also no doubt the last time any manufacturer will ever attempt to develop a significant military aircraft at their own expense.
Senior Full Stack Software Engineer (Berlin or Remote) – First Engineering Hire
We're looking for a talented Senior Full Stack Software Engineer to join us on our mission to solve one of our biggest health crises of our generation and lead the development of algorithms and our mobile app. This will be the first engineering role and therefore you will be a foundational pillar of the overall venture. You will have the change to shape the direction of the company without inheriting any sup-optimal processes or legacy code. Working closely with the founders across medical, neuroscience and product, you will develop and launch the first version of our mobile product with the goal of making a direct impact on our early users’ lives and metabolic health. This requires you to enjoy both thinking about the big picture and taking decisions on our technology as well as hands-on building our first product.

We are backed by Atlantic and just getting started, so you’ll get lots of room for your ideas, freedom to experiment and an incredible journey together.
About 30% in Europe, but in the "western" part, like Norway, above 60%
This is the kind of content I come to HN for! I don't get to do a lot of low level stuff these days, and my forensics skills are almost non-existent, so it's really nice to see the process laid out. Heck, just learning of binwalk and scapy (which I'd heard of, but never looked into) was nice.
I meant, cloning all of Twitter today is useless because you won't ever need the infrastructure to handle 100M+ users.

But a basic microblogging platform? It's not impossible to do in a week.
It's performative virtue signaling and I wish Cook et al would stop. I wish all of corporate virtue signaling would stop actually.

Corps are amoral and we should stop pretending otherwise and if the US wants corps to behave different, then we need to regulate them.
Counterpoint: Appending U+1F609, U+1F61C, or U+1F643 to the end of your comment would have added immense value in communicating your point because it would have lightened the otherwise harsh tone of your words :)
bottomed out -> beached

that blocks -> blocking
I've been wondering about a taxonomy of food preservation techniques.

* Sealing (this technique seems to be a type of sealing)

* Fermentation

* Cooling

* Dehydration

* Removing specific elements like sugar etc

I guess it all boils down to preventing germs from thriving (although I suppose there are other things that can happen too--food going dry or stale)
My metaphor for my current team is a basketball team. Each player knows their role, how to pass the ball to the right person at the right time, and the team collectively adapts to challenges in real time. The manager's role is to look at the big picture, get the team the resources they need to succeed, and make strategic decisions to allow the team to succeed.
> I'm pretty sure the mechanism is: backing down from your position of power, apologising, being quiet in the community, and finally reintegrating once you've shown that you've learned from your past mistakes.

This requires that you actually accept that your punishment is deserved; which implies giving into the Woke Mob. Not all of us are interested in doing that. Not all of us care so much about "disadvantaged" people, especially in the area of open source which has been as close to a true meritocracy as the species has ever created.

> This person has done some crummy things

RMS is clearly autistic, so whatever "crummy things" he's done need to be taken with a grain of salt. Maybe a boulder of it. I don't care what RMS thinks of women, honestly; I care what he thinks about code and computers and freedom. Why would you look to him for an example of how to treat or think about women? It would be like looking to him for how to think about the NFL or about the coronavirus or something: totally outside of his wheelhouse and ultimately not that important to what he contributes to and works on.

> Being able to do anything with no social consequences would allow people to serially commit to doing horrible things, without ever losing their ability to continue doing them.

The problem is that the Woke Mob has co-opted the control of the definition of what is horrible, and expands it continually over time into areas that were not always considered horrible; and what's more, they apply it retroactively. Giving those assholes access to controlling what happens in computing is not exactly a win for the species.