skysight-inc/HackerNews huggingface dataset:
The last time I wrote a generalized web scraper (as opposed to something specific that we had permission for) I put a lot of effort into distributing the load across many websites so that no single site would feel any pain more than if you were just browsing as a normal human being.

We were--at the time, scraping for lead information to add to our marketing database, and this isn't the thing I'm exactly the most proud of in my career. But we all make mistakes. I wouldn't do that again.

At the same time, we rotated things so that we weren't killing the websites in the niche market that we were trying to scrape for leads.

The algorithm was that we would seed Google, Yahoo, and Bing with certain keyword searches that were relevant. Then we'd take the search results from the APIs and stuff them into an array. Then we would sort them proportionally. If we (like we did) most often get the most hits from google, followed by yahoo, and then by Bing, we'd stuff the results into an array and intersperse them.

So if we had 3x google results and 2x yahoo, and 1x bing, we wouldn't hit the google results first. We'd hit a google result 3x then a yahoo 2x, then a bing 1x and cycle.

It was a decent way of doing things.

We never broke anyone's stuff. Even if it should have been.
Thanks for doing this! There are so many people putting so much effort in writing detailed Quora answers on such a wide range of topics. All of that content disappearing whenever Quora inevitably shuts down/gets acquired would be akin to a library burning down.
You can run a local copy on a server of something like Github. For example BitBucket Server (which used to be called Stash). I worked somewhere that was on GitHub but cried when it was down, then went to BitBucket and cried when it was down. It's a big point of failure.
I assume you are asking a serious question, but yes, you need to at least grow to match the rate of inflation/cost of living. Aside from that, it's up to you to decide how much you want to grow.
Sublime Text also is depending a lot on github.com these days with Package Manager...
Shit, betabrand lost their cobra
Passing around an IP address in a single register. Today's CPUs are powerful enough to not need hardware forwarding chips to route up to 1Gbps of traffic easily, without much custom software optimisation. However that only holds true for IPv4 traffic. Throw in IPv6 traffic and suddenly each compare takes twice as much time in the CPU. Functions cannot pass addresses and masks in the registers, requiring stack juggling or worse, memory access.
>but software companies are not willing to hire people my age for good reason

I doubt it. I've hired two 18 year olds to work remotely for me, one of whom does excellent quantitative analysis I've yet to see out of anyone I've employed with an advanced degree.

Companies are by and large very stupid. Don't devalue yourself or your skills.

Craigslist is decent.

One of the best things you can do is invest in a Github or open source portfolio where you demonstrate proficiency with various technologies, methods, and algorithms. It'll be easy for me (or other hiring managers) to look at it, ring you up, ask you questions to make sure you didn't fully steal all the work, and task you with some basic contract work to see if it's a good fit. Then we go from there.

I got a lot of recruiting requests after I contributed a pretty solid amount of documentation and debugging work towards Facebook's HipHop (now hhvm, sort of anyway) repository and project.

You won't get paid upfront, obviously, but consider it a good investment. Hiring managers are more increasingly wanting to see proof that you can do work, especially independently.

Good luck. And if you're handy with R-stats, quant work, machine learning, and maybe even some Python/shell programming (have an application that could use some freelance work), hit me up. Info in my bio.
One aspect I find interesting about this argument is that children are actually much more cruel than adults seem to remember or realize. Kids will often expose their classmates to real violence (whether physical or psychological) at an early age and without the input of fictional violence to guide them. Of course, it depends on the specific school and I was lucky enough to grow up in a sheltered environment where this wasn't frequent.

The danger of movies and games inspiring violence seems comparatively meager. The risk of wasting time through addiction to these things is the more immediate danger.
If you don't fall in practice now and then, you won't find where the limits are.
There's a pretty wide spectrum between "do whatever you want" and "let's implement thought-crime." I don't understand how me saying that something is a bad idea for anyone to do somehow becomes "policing" what other people are thinking. Could you please explain that to me?
You either have to strip the potential for character to influence resumes or accept that bias and nepotism will exist.
My question is about this line:

> When you close your account, we will immediately destroy all your personal information and won't keep any backup.

I'd love to hear how you're purging users from your backups, and how long you keep backups.
Somewhat related: http://semi-rad.com/2017/05/but-did-you-really-climb-it/
Put a day aside (seriously, a FULL day) and visit the WWII museum next time you're in New Orleans. I believe it's built on the location of the Higgins Boat factory.
"Zerg swarms" of smaller, less expensive, easily replaceable ships have trounced our carrier battle groups in at least one high-profile war game we conducted a few years ago. At the time, I think we assumed these were little more than manned, modestly weaponized, high-speed cigarette boats.

It's reasonable to speculate that drone swarms will become a real thing, probably very soon. Will they replace aircraft carriers? Not for decades, unless we stumble into a war and get humiliated by an enemy swarm. (For what it's worth, I think we've become so arrogant that another military humiliation in our lifetimes is almost a certainty. But now I'm editorializing.)

But again, this seems so reasonable as to almost seem inevitable. When you no longer have to worry about feeding, accommodating, and protecting human sailors, it's pretty amazing how much smaller, faster, cheaper, and more performant your ships can get.
First off, most of those languages/frameworks aren't even modern, let alone "more modern" than PHP. Next most of them are not significantly faster than PHP, if they're not definitely slower than PHP. If you're not using modern PHP, you can upgrade to PHP7.x faster than a full rewrite. I would avoid rewriting anything non-trivial, because you have no guarantee that your new codebase will be completed in a predictable amount of time, let alone be faster. If a specific sub-module needs to be in a faster language, rewrite that small part in something like golang or elixir. You need to be really careful with full rewrites, you're more likely to end up with a whole year of lost productivity than a success story. I'd recommend learning how to profile and optimize performance _after_ migrating to PHP7+.
In this article, he argues both for and against populism.

" What happened is that large parts of the population—which had been passive, apathetic, obedient—tried to enter the political arena in one or another way to press their interests and concerns"

vs.

" There was a lot of elite discussion across the spectrum about the danger of too much democracy and the need to have what was called more “moderation” in democracy, for people to become more passive and apathetic and not to disturb things too much"

Basically, we want more people who believe in what we say to be involved.

https://reason.com/archives/2017/05/31/noam-chomskys-venezue...

Chomsky is pretty virulently anti market and anti capitalism. His linguistic genius does not give him authority when commenting on policy.

Basically, he praised Venezuela (and Chavez, and socialism) until it went to crap, and then blamed the capitalists and the fact that they did not implement "true" socialism (whatever what means) as a reason for why he was never wrong.

"Speak up unless you disagree with me."
Remove these 9 things from your Facebook right now – DIGITALAMPLE.COM
I think the main thing you need to realize is that is climbing with ropes there is a lot of overhead involved to do it safely. I'd say about 1/8th of the time is climbing the other 7/8 is spent with the logistics of the rope management, partner management and placing protection in the rock. With free soloing you can focus entirely on the climbing and not on the logistics. I honestly think its more about this focus and flow and less about the cheating death.
When I was a student, my rDNS was the student housing building number + apartment number. Makes it easy for people to direct abuse requests at least.
just a shorter version of everything he said in the blog post.
Yep, the post author calls it his favorite book and links to it in the article, specifically discussing the topic of Chapter 2 on Bus protocols.
If your printer is on a network, it can 'phone home' in most cases. They now know which IP address the printer lives behind. Get compromising document > look up serial number from dots > look up IP address from serial number > get address for IP from ISP (through means fair or foul). Payment option is irrelevant.
There's a mental aspect (chalk = business time) but it's not a placebo. Have someone deadlift with a particular grip with and without chalk, and they'll lift more with the chalk, no question. It helps grip.
Most modern hitters seem to be really bad at bunting. A lot of times you'll see someone literally push the bat forward into the ball, which is literally the opposite of how to execute a good bunt. I think of bunting like free throws in basketball; they're both things that really seem like they should be so easy, and yet some of the best players really seem to struggle with it.
The end of the 4k war between YouTube and Safari?
LTE or DSL? I'm on LTE in Vancouver and it fails (and has consistently in the last 6 months).

Are you in Calgary? Telus always rolls out experiments in Calgary first. For example, until recently their only deployed GPON networks have been in Calgary subdivisions.
Incorrect. You need build-time dependencies to change an application, and runtime dependencies to run it.

Deploying/scaling is somewhere in the middle.
Why did you lose interest? Both SOPA and Docket 17-108 fundamentally address freedom of speech on the Internet.

The outcome of the SOPA fight was the 2015 Open Internet Order (which ostensibly treats the Internet as a public utility and protects against both government and corporate attempts at censorship). Docket 17-108 (what this is about) reverses the 2015 outcome and gives ISPs discretion to regulate the web and slow down or block companies with competing services, which is what they did in 2011 and a reason why the Open Internet Order was crafted[1].

[1] http://www.businessinsider.com/verizon-blocking-google-walle...
Between Flash video and geographic restrictions, the BBC does an excellent job of making sure I'm unable to see Adam Curtis' video output.
Step 1: solve someone's problem

Step 2: collect money

The small business world is filled with unsolved problems. Get out there and find 'em.
Net Neutrality is related to ISP networks and the idea of of "common carriage." The word Net in the phrase does not apply to any and all networks.

Cloud providers are not carriers. Traffic engineering and Net Neutrality are orthogonal concepts.
Use Docker.

When you build a docker image, you copy all your runtime dependencies (`node_modules/`) and build artifacts into the image. When you push a deployment you are deploying that static image with the dependencies baked in, instead of trying to install the dependencies at startup.
This is really helpful. I was being pushed to upgrade by the programmers i am trying to hire who say old website code is kind of spaghetti..and a new clean rewrite in node/ruby will go a long way in hiring good bayarea programmers.
Which assumes that there isn't a strong female employee to start with.

Someone has to be the first employee.
This is my own experience with the very miniscule free-solo experience I have and even with trad leading over sport, over top rope.

If it's within my abilities/condition, I get into a much more zen/like zone doing trad leads vs coming up second. Or even leads in a gym. I really don't like falling, so that focuses me up and the world just fades away. It's all managing foot position, burn, effort level, pace, etc.

On the other hand, if it's outside my ability/condition and I'm shaky with failing energy... It's the worst experience in the world(overcoming it feels nice though lol).
Well, it's hard to get good advertisers when the ROI isn't there.

It's not something you'll hear unless you're in the know, but there is a pretty high level of animosity towards Pinterest in most retail marketing departments. I love Pinterest, so it was surprising to learn when we started this work, but it boils down to: 1) traffic from Pinterest ads show very poor quality / engagement. 2) Pinterest has not been a good partner - they've actively "snubbed" a number of big labels. There are even a few major retailers who "deleted their Pinterest". 3) Organic Pinterest basically doesn't work, so they won't even put an intern part time onto managing their Pinterest account. Even one of their top retailers, Nordstrom, appears to use a bot to post to their account.

When your ad dollars don't show ROI, people spend elsewhere. And if your main customers aren't engaging your platform, that's definitely trouble too.
Those languages won't be faster, they're pretty much the same speed. The labor cost of the rewrite would completely dwarf any possible micro-gains from switching between 2 languages that are already nearly the same speed.
That's really cool! Honestly, it seemed really weird to me at first, but I guess if you don't have a tradional leadoff type guy, putting someone who gets on a base a lot is the next best thing, and Bautista certainly walks a lot.
Hey British Airways, Here’s Five Whys It Was Not the IT Person’s Fault
Snark is so easy but thoughtful analysis is hard. Marketplace businesses necessitate having adequate supply and demand to keep both sides happy. Rarely can you scale them in lock step.
Well, you're also missing things like the onerous process that some of the processors would have you go through to sign up. While I haven't been the person to actually setup a Stripe account, my impression is that it's pretty light-weight. From what I remember the business people having to go through to sign up for a merchant account with a processor (for a 100% online business) back in ~2010, it was practically like signing up for a mortgage. There was also back-and-forth between different "levels" of employees on the other side of things. At one point, IIRC the process even stalled because their end stopped responding to enquiries from our company. On top of that we were forced to use their Java middleware crap even though we weren't a Java shop. They made you feel like they couldn't care less about your business.
If it takes them 5 years to make a reliable, enterprise-ready version of the Surface then thats ok with me
Yup, you're 100% correct there.

For example, I've personally done quite a bit of what's actually free soloing in cave exploration, but that style of climbing is done in confined spaces with rock on every side. You're much less dependent on individual holds as you'll usually be supporting yourself by pushing against the rock with your whole body, so it's a lot safer than most free soloing - even if you do fall you have a good chance of self arresting by, and if you can't you can at least slow your fall significantly and just slide to the bottom.
Yes, compare this response to Craigslist. The latter is downright successful, dominating and print money for everyone involved.
typedef struct { uint8_t[16] d; } ipv6addr;?
It sounds like you're being surprised that anybody doesn't know about it, even if they're in a risky position themselves, which seems disingenuous.

Before today, what was the most likely path to this knowledge? As in one month ago...and how many 26 year olds have occasion to learn themselves the details of printers? Nobody uses printers.

Yes, working in that position it would be more likely, but she still could merely be a corner case when it comes to laser printer dot awareness, even within the IC.
I guess you can use a 3d printer as a 2d plotter...?
Yeah, sandstone and water don't mix.

I was highlighting the sudden surprises that tend to catch a climber off-guard. If someone is climbing on wet sandstone, they should already be cognisant that it may crumble. (They should also avoid climbing it when wet so that they don't break holds, but that's another topic on stewardship.)
I just did this (left Uber, actually, a month and change ago). Found something since. "Why'd you leave" questions weren't any harder than "why are you leaving" questions.
Isn't the type of resting already distinguished from non-supported resting in competitive or high-level climbing? I know that the term "free climbing" means that you use ropes and supports for safety, but not to aid you in any way.
I remember earlier last year when the Red Sox were batting Betts, Pedroia, Bogaerts, and Ortiz as their first four and Betts was hitting a ton of home runs, my father and I thought that they go Pedroia, Bogaerts, Betts, Ortiz since Bogaerts had little power and Pedroia kept hitting into a lot of double plays. A few weeks later, they started doing Pedroia, Bogaerts, Ortiz, Betts, which was actually even better since then opposing pitchers couldn't safely walk Ortiz.
> "Probably a better idea to work on a solid recruiting process that can shake out practitioners of bad behavior from the candidate pool."

I agree in principle - but how do you suggest this be done?

It's not as if harassers are going to cop to it in an interview.

I: "Have you sexually harassed your colleagues at previous jobs?"

C: "Oh yeah, sure, yep, I'll show myself out now."

Nor are companies permitted to answer whether or not someone was terminated for cause, or whether they received harassment-related reprimands.

I think everyone agrees that detecting and filtering out bad actors from your candidate pool is great - but is there actually a practical way to do so?

The "state of the art" around this is back-channeling - calling around to see if you can locate people who have worked with the candidate, and getting the unofficial word on whether or not they're bad actors. This has pretty glaring and obvious issues, and isn't always possible, but we don't really have a better way.

I think profiling people for leaving Uber is highly problematic - but what's the alternative? Ask them if they got canned for harassment, and when they inevitably deny it, just take them at their word?
"social kindness is rooted in just giving enough of a damn to have a discipline for it" -binarypaean

Well said! Thanks for sharing!
/32 is like you can build your own entire internet!
I disagree. I'd say older people have more networks, more experience and more resources, hence will find less comparative benefit in giving away precious equity to YC (etc) than young people who need all the above.

It could be said that YC and other startup incubators have done a stellar marketing job in taking ~6% equity off organisations by turning the tables on funding and making companies "apply" to give their equity away. From YC's perspective they have nothing to lose and everything to gain from this arrangement, versus the founders who are in pretty much the opposite position.
USPTO Director Michelle Lee Resigns
> a meaningless game (that was stupidly given meaning)

"This time it counts!"
Where can I apply? The site says it's already started: https://www.startupschool.org/

> The course will begin on April 5th, 2017

But the title implies they're going to add 10,000 new applicants.
I think there's such a pushback on the term "cheating death" because it sounds like "I should have died, but I didn't", when in reality that's not what the thought process is. The thought process is "of course I'm not going to die because of x y and z".

For me, the best way to describe it is that I strive to feel in control in progressively more difficult environments. That's the mental state I'm looking for. The progression of the mental state goals are easy to follow:

Top Rope (rope already set up above you): "I feel in control despite me being 40' off the ground"

Lead climbing (bring the rope up and clip into the wall as you go): "I feel in control despite me having to take a big fall if I fail"

Outdoor climbing: "I feel control despite me climbing real cliffs outside"

And you can follow this all the way to free soloing, where you can feel in control despite having no safety net at all. I'm not going to pretend that I understand Honnold, and I don't free solo, but this line of thinking makes sense to me.

The other off topic reasons I climb are:

1. Getting better at a sport, just like any other sport/hobby.

2. I like the outdoors and adventure, climbing is a great way to see things from a perspective most can't.

3. Fitness
I fail to see how.

99.99999999% uptime is 3 milliseconds of downtime a year. That's not even a TCP retransmission.
How hackers abused satellites to stay under the radar (2015)
My ISP supports IPv6... if you configure a second, PPPoEv6 connection on your router. Which as far as I can tell none of the top routers on the market here support. Heck even OS X doesn't seem to support it.
Apple’s Business Chat Plans to Take on WhatsApp, Skype, and Facebook Messenger
I'm typing this on my way from work to university.

I'm 19 with no formal qualifications except high school. Not a 'genius'.

There are jobs out there for young developers!
I love Islay Scotch & Bourbon...will have to find this beer.
I don't see why it has to be about cheating death. What about just the fact that you're accomplishing the climb yourself, with as little external help as possible? A free solo climb doesn't even use any tools, other than climbing shoes and presumably light clothing. Having a massive drone flying next to you or a safety elevator makes it much less about just you and nature.

Imagine you completely reproduced a famous climb indoors with a 3D printer. Surely you can understand the difference between climbing that and climbing the real thing, even if the physical difficulty is identical.
Is the link between risky behaviour and a toxoplasmosis infection that well established ?
That's one of the oldest rhetorical devices in the book. It's a common technique of good storytelling. Clickbait is annoying because of its context, but the reason it works is because those techniques stimulate human curiosity, and increase their enjoyment of the story.
Which is a byte array. When you pass this to a function, it does not fit in a single register. The equality operator doesn't work, nor do other logical operators. Everything has to be defined. 64 bit would have been so easy. And it would still have been enough.

Edit: somebody replied and deleted their comment. Since I had written a response I am editing this comment.

> Then your real complaint... is that you don't have 128-bit machine registers

Agreed, although my real complaint is more towards IPv6, for not thinking about this real-life limitation.

> what the urgent need to pass IPv6 addresses in machine registers

It's much slower than IPv4 to deal with! 64 bit addresses wouldn't have had this problem and still would have enough space for everyone on earth.

> And how is it "irritating af"?

Apart from the speed concerns:
> The equality operator doesn't work, nor do other logical operators. Everything has to be defined.
Not losing users?
The Reality of Repressed Memories
Uber is big and the culture in any given pocket varies quite a bit. It's entirely possible not to have known what was going on 200 employees over.