skysight-inc/HackerNews huggingface dataset:
I match the user agent string on containing "Google". It seems that Google Chrome only includes "Chrome", so I don't block users this way. Here is an overview of all Google crawlers' user agent strings: https://support.google.com/webmasters/answer/1061943 As you can see, they all include Google (capitalized).

I don't use robots.txt because they say that doesn't stop them from including the site in search results: https://support.google.com/webmasters/answer/6062608 I don't know if returning a HTTP 403 error will, but it seems like it's worth a try.

I also looked into banning IP ranges (that would have been my preferred option), but if I remember correctly they were subject to change and it seems overkill to write a scraper for that page that would then have to generate a config file and reload a service.
>> that still doesn't explain why posting these files is so cool that the post shot to the top of HN.

This article shot to the top because of at least three things:

1. It was well written.

2. It had to do with cool tech in a complicated problem space.

I only know those two.
now that with the first column also fixed. i failed
Yes basically.
My default search engine for more than a year.
Mobile and desktop, rarely I use !g bang.

Also, dns are 1.1.1.1 / 1.1.0.0
Browsers are ff and safari.
Email is ProtonMail.
Even if they added a Patreon button (or whatever the "ethical" provider is this month), 99.99% of their revenue would still come from ads. Seems like some weird mental gymnastics to pretend their business model wouldn't be what it is.

Like it or not, it's fantasy to pretend that donationware scales beyond individual devs. It's rarely even enough to support individual dev stuff.
Have you tried Searx[0]?

It returns results from the major search engines (and can be customized for more) while attempting to maintain privacy as much as possible. I'm not sure how effective it actually is from a privacy standpoint, but being able to see aggregate results in a single, clean UI has been a big productivity boost for me. I've been running a self-hosted instance for a few months now and haven't had major complaints.

[0]: https://github.com/asciimoo/searx
I don’t consider vi to be a system admin tool only.

While I don’t think vi is a showstopper, it would certainly be curious how a mid to senior engineer wouldn’t know how to use insert and quit in vi. This would make me think that a Windows only background never even meant connecting to a shell and having to view a file.

I’ve experienced lots of app developers who only use an IDE and don’t know how code is deployed or runs so they’ve never debugged a deployment, ever. They are in a big enough environment where that’s someone else’s job and they never have to talk with them.

That’s perfectly cool and folks will make a living and retiring in that world. But I don’t typically hire too many of those because I work in cross functional teams where the windows devs have to at least be able to understand and communicate with the Linux devs, and vice versa. That means having basic user level skills like two commands in vi, because it is almost always available on Unix systems. And frequently the only one allowed.

I think folks confuse this as meaning that people who don’t know vi are dumb, they aren’t. They could be geniuses who just don’t need to know vi. But for many types of interviews, it’s a super easy screening question that makes me follow up with more questions if they answer “I have to google.” It would be similar if a developer didn’t know cd or had never seen notepad or something.
No need, you can block them by user agent, they are consistent - or just disallow them in robots.txt.

If you need to make sure it's actually a google bot when a client shows up with the user agent, you can use reverse dns: https://support.google.com/webmasters/answer/80553
You'd be very surprised just how many people are doing this (sort of thing). A ton. Netlify itself is a revelation.
This sounds like you're suffering from interview burn out to me. If you have a condescending voice towards interviewees outside interviews then it is usually a manifestation of how you perceive them in the interviews.

Do yourself and the candidates a favor and step back from it to allow yourself to lose such prejudices.
The Web We Have to Save (2015)
Exactly how are you not involving Gmail when you set your transaction receipt email address to be your @gmail.com?

While I do understand the point that /purchases looks creepy, your comparison is dishonest.
My take? The majority of HNers strongly support the second group and have an inflated view of the capability of even current automated systems.
If the system is deterministic I have no idea what the free in Free Will refer to. If we don't assume that the current situation is the product of the person's free will, his determined reaction to it isn't freely decided either.

Me having or lacking means to predict behavior entails nothing about the freedom of will, is is only outcome of my limited knowledge and technical ability. If the system is deterministic it is possible in principal to perfectly predict person's behavior and if that is the case, he has no freedom but to act in the way he does.

> Making different choices would not be free will but absence of will/random choice.

Perhaps I'm not understanding what you mean by free will.
I think vi is the de-facto install of an editor on any non-Windows machine. You can't assume any other as vi in its simplest form is extremely lightweight and prevalent.
I switched to DDG about half a year ago.
What I really like is that for me I can switch location bias on and off.
Sometimes I want region specific results, but most of the time not, so I actually get better results on DDG.
> Autonomous app-based air taxis are coming together with automated urban air traffic control (Uber and others). Market estimated to be worth €1.5 trillion by Morgan Stanley analysis.

Those are a bad idea, independent of automation. At least until 100% of our energy is carbon-free.
It's said that "the past is a foreign country". It's also an incredibly violent one.

There's been this undercurrent in archaeology and historiography since the 1960s that interprets the past as a successful of peaceful cultural, technological, and linguistic diffusions and that downplays evidence of conquest, force, and violence. For example, an archaeological belonging to this school that chanced across a layer of an ancient fortress festooned with skulls, arrowheads, and soot would present that layer as evidence of some kind of funerary ceremony instead of applying Occam's razor and suspecting a conquest and sack. It's infuriating.

Reading recent papers on ancient Rome (a personal interest of mine), I find myself stopping, sighing, and saying almost out loud, "Those Germans just moved into the empire as good neighbors? The name 'Vandal' got its connotation for no reason at all? The contemporary historians were just lying propagandists and we can dismiss everything they wrote? Really, dude?". Or, "Indo-European languages replaced almost all indigenous European languages because... cultural diffusion? Before writing? Okay dude." I could go on and on on. These "[migration of] pots not people" people apply the same lens to _everything_, and it's super annoying: what they claim runs counter to what everyone knows deep down is true about human nature.

Fortunately, this "[migration of] pots not people" is no longer tenable. Ancient DNA has opened up a world of new evidence --- see [1] and [2]. As it turns out, As it turns out, intuitions of the early anthropologists like Gordon Childe --- whom these 1960s-era "pots not people" have not rested from attempting it discredit --- were right after all. Conan the Barbarian is a pretty fair depiction. What you see in the genetic record is wave after wave after wave of conquest and slaughter. Some Y chromosome lineages disappear entirely, while the X chromosome ones survive --- indicating that conquerors (as everyone suspected) basically killed off all the men and took all the women. This pattern is attested in historical times in Asian steppe cultures [3], and there's no reason to suspect that pre-historic cultures operated any differently. Turns out, they didn't.

The reason Europe speaks Indo-European languages isn't that the ancient inhabitants thought that Proto-Indo-European was neat and adopted it --- it's that the PIE-speaking Yamnaya swept in from the caucuses and slaughtered mostly everyone (especially men) except the Basques. It's not pretty, but that's the way it was.

Moreover, it's important to realize that we all have the latent potential for barbarism inside us. We've been at peace for so long --- almost 75 years --- that we've forgotten that man's natural state is "war of all against all" and that peace is incredibly fragile. Downplaying ancient violence encourages present complacency and endangers our present peace.

[1] https://www.nature.com/articles/d41586-018-03773-6
[2] https://www.bbc.com/news/science-environment-43701630
[3] https://www.amazon.com/Genghis-Khan-Making-Modern-World-eboo...
If this were a real concern as you're hypothesizing, then we'd already have the data of olive oil making tons of people sick. Even relatively tiny outbreaks of food borne illness from spinach make the news, so where are all the people getting salmonella from olive oil? When the observed data doesn't fit your theory, then you need to reevaluate your theory no matter how much common sense it seems to make.

If the figures of the article are accurate, there is something in the neighborhood of one dead bird per ton of olive oil from Portugal. That's enough that if it were poisoning the oil, people would be dropping dead in droves. Consuming olive oil would be like playing Russian roulette.. but it's not.
It was a political move to help the then state governor Scott Walker with his election last fall.

https://www.google.com/search?ei=eBbgXMeXFeOW_Qba2pWYAg&q=sc...

https://www.jsonline.com/story/news/politics/2018/07/31/scot...
It is, because without the "Collateral Damage" video, most people in the US wouldn't have been exposed to the horrors of what their tax dollars were doing at that time.
I once rejected a company because they had a big framed picture with 4 naked girls full frontal in the interviewing room. And because the manager pointed to it saying how "open minded" the company is.
is there source code for this?

it's a really cool project, but in the end if there's no source code, then the post is just so much of an advert for teamworkCRM.
Not hosting my data in Libya!
Ironically one of the most mentally cleansing things you can do is to bust your ass physically then sleep like the dead.

Might not even be a bad idea for larger companies that have the logistical range to get their staff swap collars a week a quarter.
It works great for conversation like this. It lets a person summarise 1 wiki page worth of assumptions and definitions into a single line and quickly establishes an order-of-magnitude scale to frame the discussion.

Fiction, science fiction and storytelling generally are ideal for that sort of usage. They let people pre-consider a lot of the arguments and assumptions of the people they are talking to.
The fact that Google tends to ignore half the query does make that choice easier.
I didn't find this confusing. If scheme isn't the language used in the job them who cares? If I am hiring a C++ programmer then I don't really want to drill into your Algol'60 background to trip you up!
I 'did' find this confusing.
From what I recall, Bing also displays AMP pages. Wouldn't you want to block crawls from Bing too?
I can't explain why this comment is not downvote, other than Antisemitism. USA is responsible for far more death and destruction of the whole countries like Lybia and Iraq yet, whenever Israel comes up people are so hostile.
when you concentrate that much power, the effects may be worse than the original problem. Indeed it may not even address or care about the original problem once it reaches critical mass. The type of people who are interested in social/economic/political power, seem mostly interested in social/economic/political power, and the moral crisis de-jour is just a tool.
So if you’re not a developer and familiar with git you suggest for people to use the ridiculously complex, react-based gatsy, and still use git too?
Translation and Types
I have a similar experience. Food Service -> Framer / Roofer -> Army Paratrooper -> Casino Dealer (You be surprised how hard that job actually is [0]) -> concurrently going to school for software -> Jr Dev -> Sr. Dev

I used to laugh when people would complain about almost anything. Due to my Army experience it makes most people's complaints non-issues to me. But I am starting to realize you have to meet people where they are and have some empathy for them. They only can see it from their perspective. Telling people to suck it up, hasn't been exactly effective for me in this industry. Different environment so different tools are effective.

[0] Not so much physically, but dealing with people for 10 hours a day and most of them are very unhappy (losing money) takes a toll. I'd rather frame houses imo.

Edit: Formatting
I'm a nerd with pretty mild porn usage and no terrorist habits.

I have 0 reason to not use google. I really don't care if they find out my obsession with electronics and that I have the hots for tall girls.

Out of every company, I'd give Google the nod as most helpful company of my lifetime.

Can someone tell me why I'm wrong?
Show HN: Feather Bubble – interactive children’s stories
- "python remove from list": Google has the Python docs on the first page. DDG does not.

- "site:news.ycombinator.com rms_returns duckduckgo": At first the DDG results looked better but multiple results had no mention of "rms_returns" at all.

- "archlinux dmesg audit": Both nice.

- "lange nacht der museen berlin": Wow, unexpectedly relevant results on DDG, did they improve their local results?

I think I should indeed try again. Previous times it was full of spam for local results.
The documented way is the noindex tag (in html or http headers): https://support.google.com/webmasters/answer/93710?hl=en
> DDG also skews heavily to US results which is a pain.

DDG also skews heavily to US results which is one reason I find DDG useful.

I have been largely using DDG for years. What finally drove me away from Google completely is that you cannot get search results that are untainted by localization anymore. Whenever I search for programming related topics or the subjects typically discussed on HN I always get a some confusing local results no matter what language and region settings I use. https://google.com/ncr which did a good job for years doesn't seem to work anymore.

Really the only reason to refer to Google nowadays is if I deliberately search local places, organizations and businesses - this is where Google is unbeaten in my opinion. Even local news and events isn't usually worth the g! switch. These two might be good in the US but here in Germany all search engines are equally bad at it.
There are some queries that governments would be very interested in knowing who did it. As an example could be the query how to make bomb. Does DuckDuckGo hand over this information to government agencies? Information such as ip address, user if etc?
I've been working on a search engine as well. It's screen shot based. That's how frustrated I am using Goog!

Very buggy and can't take much load, but check it out: https://glorp.co/Search/Hacker%20News
Some devices use MEMS oscillators instead of crystals, which has the bizarre side effect of making them allergic to helium: https://ifixit.org/blog/11986/iphones-are-allergic-to-helium...
I’ve found grid-template-areas to be a powerful way to layout my page with one fell swoop.
T1 is a language for constrained environments, embedded systems with little RAM
Poll: Which search engine do you use most regularly?
Which search engine do you use most regularly?
So do I, but my livelihood does not depend on it, so I can safely do this and encourage people to use another search engine. Any other search engine. Even if you fall back to Google if you can't find something, at least use another search engine by default. I don't think that's too harsh to ask of a tech audience (which is the audience of my websites).

Of course, if your websites generate income based on people that came from google, I would not expect you to follow suit. As I mentioned in the post, the idea is that there are lots of resources on the web that are not there to turn a profit, but that are still valuable to people. Google is not listening when we use words, so I took action.
You don’t see it because you don’t live it. It’s death by a thousand cuts. Again, I never blamed men (or any group) for the situation — it’s just backwards American cultural values rearing their ugly head yet again.
I've had the exact opposite reaction, grid is a godsend. Grid fills a very specific role that flexbox cant: two-dimensional layout. Continue to use flexbox when you only need to control things in a single dimension, but once you need to control both dimensions grid makes things so much easier.
Please avoid "why would you do X?" when discussing some tool or workflow. It's needlessly confrontational (and through that, restrictive of diversity, as different groups can have different needs and preferences), devoid of information (it doesn't explain the converse, why you shouldn't do X), and lacking in imagination (establishes tradition as a hard principle, and not just a guideline that can be broken depending on the context).

It's good to want to know why some people want to do X, but try to ask it in a way that doesn't make a negative assumption about the people taking a certain approach.
If it offered results that even began to resemble relevance, I would, but Google's the only one covering my country's market with good results.
1 to 1 comparison.

Do you want your leadership figure at 30 to be someone who spent the last 11 years learning tech/design? Or someone who is new to the tech, but lived a 'tough' life for the last 14 years?

I don't see any advantages to the later, except they are lower cost.
I've hosted several small apps with Netlify, and I recently setup my first blog/brochure type site using Netlify CMS. It's awkward, but it's amazing to me what you can accomplish with a (free) build server, a couple small 3p services, and a CDN with so little effort.

Great dev experience, great user experience.
Katie Sylor-Miller: Visual Git: Filling in the Gaps (SmashingConf 2019)
This looks like the best laptop you can get for Linux. If only it came with AMD graphics.
Do you not have a tap?
For WordPress, I’ve to be always worried that it might go down unless hosted with a good dedicated provider. Unless it is complex and I want to do lots of things besides just writing/blogging, I try to choose something static than WordPress.

For the many many static sites that I throw out with either Jekyll or just plain HTML/CSS/JS, I know that once I drop them to something like S3 + CloudFront fronted by Cloudflare, it will very very unlikely go down.

They all have their time, places and circumstances.
I remember hearing years ago IE usage was crazy high in South Korea because they had laws in place requiring all online banking customers to install an ActiveX control. If that's true... Then they've come pretty far.
> ... as Microsoft’s free technical support for Windows 7 expires in January 2020.

they are still on Windows 7? ouch!!!
That’s an odd complaint when I first read it

Maybe it relates to hand pain and stuff

You could use right shift, also, though that’d be tricky for my brain
Citation needed.

They use Bing Ads, but I’m not sure if their actual search results are just proxied Bing results.
This seems overly reactionary. Writing is hard, and specific, and the devil is always in the details as it relates to a person, so it's almost nonsensical to give generally applicable writing advice. But, I don't think that makes it impossible to give advice as it pertains to a particular style.

I've found that if you want to be a good writer, you need interesting material to draw from. That can come from your imagination, your lived experiences, other material you've read, or most likely all of the above, but you're engaging in world building first and foremost. I particularly like this Faulkner quote:

“I would say to get the character in your mind. Once he is in your mind, and he is right, and he’s true, then he does the work himself. All you need to do then is to trot along behind him and put down what he does and what he says. It’s the ingestion and then the gestation. You’ve got to know the character. You’ve got to believe in him. You’ve got to feel that he is alive, and then, of course, you will have to do a certain amount of picking and choosing among the possibilities of his action, so that his actions fit the character which you believe in. After that, the business of putting him down on paper is mechanical. Most of the the writing has got to take place up here before you ever put the pencil to the paper. But the character’s got to be true by your conception and by your experience, and that would include, as we’ve just said, what you’ve read, what you’ve imagined, what you’ve heard, all that going to giving you the gauge to measure this imaginary character by, and once he comes alive and true to you, and he’s important and moving, then it’s not too much trouble to put him down.”
But how does that help Foxconn if they're not even going to be doing business in the state?
>And fuck that, what percentage have already experienced worse than what a male manager might realistically experience from a complaint about his behavior in a 1-1? And don't bother pulling out the "but what if absolutely nothing happened but the woman accused him unfairly and he lost his job and wife and kids and had to live under a bridge until he killed himself??!" unless you have some solid evidence that this happens more often than women get raped by acquaintances.

If the percentage of women that experienced problems were actually really low, and if rape basically didn't happen in the work place, how would that change the way we should have this discussion?

It sounds like you're saying women raped by acquaintances and women having problems in the work place are related. I've always interpreted it as they are acquaintances through friend groups, not necessarily through work. I guess it'd be interesting to see a study of what percentage the acquaintances are known through work explicitly, then maybe that could shed some light on where the tensions come from.
Not all resources are HTML so I couldn't use the meta tag, but the header looks interesting! Reading up on it, it seems to achieve pretty much the same thing as my current solution. Would you say this is better for some reason? Nobody should encounter my server's 403 response except those with a Google user agent anyway.

The page doesn't say whether this works the same as the robots.txt disallow, where you may still appear in results because other pages link to you. The 403 might be more effective, but I can't really tell either way.
You can surely think of a better choice

,⟨prefix⟩ for example
I did almost exactly the same yesterday.

https://blog.omerh.me/post/2019/05/17/first_post/
The problems you experienced were not with DOS, but with Windows 3.11 / 95. DOS itself was one of the most stable platforms I've ever worked with. I personally worked on a NetWare Server running on DOS that had an uptime of over 20 years. DOS's stability was not an outlier. Many of the UNIX machines I worked that predated DOS had uptimes that all measured in months and years.

The only reason why Windows was so buggy for you is that you were using the home editions. At the same time that you were experiencing blue screens in Win 9x. My NT workstation was rock solid without any of the issues you described.
Yeah, but you don't actually get the tax breaks if you don't even end up doing anything in the state. What is the actual reason for doing this?