skysight-inc/HackerNews huggingface dataset:
In a couple places it sounds like you're interested in scraping HN -- if that's the case there is an official API: https://github.com/HackerNews/API

My own take on it in general is that for personal/research use I'm not morally opposed to scraping, even when it's in violation of the ToS, with two conditions: that it doesn't place an unreasonable burden on the server, and that it doesn't invade people's privacy. The legal significance of the ToS is murky at best (disclaimer: I'm not a lawyer) but if the site asks you specifically to stop scraping them or puts up a technical barrier you should stop (morally and, in the US at least, legally: see craigslist v 3taps)
We use our local library for watching DVDs, they have a great collection of both new and old releases and it is free.
The media owners have died.

Yes, there are new owners, but those new owners are not putting forth the effort required to enforce a viewpoint. It takes real effort to keep the line workers from setting the tone.

Walmart used to be all about stuff made in the USA. Sam Walton died. I'm sure he spins in his grave.

The same goes for media companies. An original founder with a vision dies, and then things go off track.
I've been learning Laravel for some time now and use it for a few personal and work projects, I'm also new to the open source world and yet to contribute much - are you looking for contributors, or are you just on GitHub for the transparency?
Because I often forget how much I have on my card, and tapping my card is easier than logging into the web portal.
If it's the teenager working at McDonalds, they deserve a reasonable wage just the same as if it were the mother working there. Denying people the right to earn a fair wage just because you imagine they are teenagers doesn't leave them better off. Most of these people are over 25 years of age. It is not 1970 anymore.
BLACK BIRD CLEANER PRO 1.0.2.3 DOWNLOAD FREE WITH SERIAL KEY 2017
Anyone know what the false positive and false negative rates are with current tech?

Edit: Assuming real world conditions where people don't pose for you.
Addictive new app is the Ice Bucket Challenge of 2017
Or UploadVR!

I read several reports of their "kink room", but I never did read any reports that they actually got rid of the "kink room".
See here: https://medium.com/@s8mb/im-a-neoliberal-maybe-you-are-too-b...

https://www.bloomberg.com/view/articles/2017-05-23/centrism-...
..or a return to dot matrix printers? Good thing I never threw those away.
Meanwhile, back in the real world, I spent an hour waiting to speak to someone in the police the other day only for the guy on the desk to say he needed another 30-45 minutes with the lady at the desk and there were no other staff. So, if you really do want to report a crime or some criminal behaviour that has got to the stage where a little bit of community work by the police would help, good luck to you. Maybe take an afternoon off work so you will have time for the bureaucracy.

We are a long way from 'you have twenty seconds to comply' policing.
Yeah, but his point still stands. :-)
Algorithmic seems more amendable to monetization than user-submitted. If nobody knows the algorithm (and supposing they can get one working well), then nobody knows how if {new movie X} pops up organically or because its production company spent advertising budget to make that happen.
However the mound height has changed as recently as the late 60s
404 comments. I'm doomed.
The term usually says a lot more about the person who uses it than it does the person to whom it is applied. Much like "neoconservatism" it's often shorthand for people who I disagree with, and used sloppily without reference to the history of the few who self-identified under either term.

That said, with liberalism & non-populist centrism in general on the ropes in advanced democracies, I could see the term being embraced and rehabilitated. See the already mentioned /r/neoliberalism for an example that I couldn't have imagined a few years ago. Does meme magic work on centrist compromises?
A thousand times this. I had a discussion on the plane with a person trying to make their city more like the Bay Area. And they had looked at universities, and air ports, and demographics, and infrastructure. I asked them whether or not their state allowed the enforcement of non-compete agreements? Yes. Do they allow employers to take ownership of all work product even when it is done on the employee's non-work time on non-work equipment? Yes. So I said, first thing you have to do is make both of those 'no', then you can start on the other bits. But allowing people to compete with the people who hired them is essential.
You should check with your broker. They should be giving you some kind of notification. Maybe it's a message in a digital inbox that you have to sign in to see?
I've worked places where the dual monitor denial was based on jealousy from other job titles like manager, producer, sales, etc. Who didn't recognize it as a task enabling tool, but perceived it as a status item that they should receive before the lowly developers.

Same goes for a quiet workspace even though their job relies heavily on talking and face to face communication.

My personal favorite is,"sure you can go to that conference/event that is related to our department." Followed by,"oh, we don't have anybody to fill in for you." And then all the aforementioned jealous employees go to something they could care less about just to get that sweet writeoff.

The lie of training seminars and conferences is always a carrot. Yet we are treated like shit at most companies for trying to get it. Obviously this doesn't apply to tech staples or cutting edge industry startups, but then again their influence on a metric is within a margin of error compared to the rest of the country.
If I understood the point of the article correctly the author addressed this pretty well. Just like candy store employees were too sick of candy to bother stealing candy, the kids who are raised in an electronic environment are also desensitized to the addictive strategies.

People used to fear that the TV was going to be so addictive, but instead the generation that grew up with TV and was supposed to be so addicted to it never got addicted. Instead it's their parents and grandparents that have the TV playing at all times in the house.

Maybe you don't get addicted to tech that you grow up with because its just normal and routine. But its the previous generation that gets hooked and projects their fear.
> Someone putting up a bunch of words doesn't bind you to a contract

Scraping is copying, which is an exclusive privilege of the copyright owner under copyright. In the absence of a license or a copyright exception, you have no legal right to exercise that privilege. Someone putting words on a page might give you a license for the use you intend.

You don't need to be bound to a contract, because this isn't about restricting a right you have in the absence of license.
There's fundamental physiological difference.

It's not clear there is. Consider this part of the article:

Yet Honnold ended up scared, really scared, on Corrugation Corner. He clung to the big, friendly holds. “I overgripped the shit out of it,” he says. Obviously, though, he didn’t give up after that first experience. Instead, Honnold donned what he called “mental armor” and crossed the threshold of fear again and again. “For every hard pitch I’ve soloed I’ve probably soloed a hundred easy pitches,” he says.

One by one, acts that had seemed outrageous to him began to seem not so crazy: soloing moves in which he hangs only by his fingers, for example, with his feet swinging in the open air, or, as he did in June on a notorious route called The Complete Scream, climbing ropeless up a pitch that he had never ascended before. In 12 years of free solos, Honnold has broken holds, had his feet slip, gotten off-route into unknown terrain, been surprised by animals like birds and ants, or just suffered “that fraying at the edges, you know, where you’ve just been up in the void too long.” But because he managed to deal with these problems, he gradually dampened his anxieties about them.

So was he born this way, or through repeated exposure did he train himself to be this way?

Or, more likely, is it a bit of both?

The article certainly seems to suggest that we can all improve on our ability to manage fear... perhaps not to the degree Alex has, but enough so to allow us to tackle challenges that might otherwise seem insurmountable.
Ohhhh. You just described law enforcement sting operations...

Damn, damn, damn...
The difference between these cases is that even considering everything that is wrong with US administration, it is just not comparable to the Russian. People (and institutions) have a track record, and there's no principle in logic that prevents me from using that record to evaluate their trustworthiness: What you call an ad hominem, I call bayesian reasoning.

For example: It was, until this administration, extremely rare for the US government (the executive, to be precise) to lie to US-based press. They'd deny to comment, or say something that was meaningless when examined closely, or tell you to ask X (who will deny to comment). But, contrary to common believe, it's extremely hard to find examples for them straight-up saying A when knowing that it's really B.
Right, I've come across that page, but I include my name and contact in the header, and don't make more than a request every 15 seconds so it won't hurt their servers at all.

And I did have affiliation links initially where I included the non-affiliate links next to them if people didn't want the affiliation. But then I got rid of those cause people didn't like it. I don't care about making money on it, just think it's interesting.
Unfortunately it's read only so that stuff won't be coming to iOS.
Use a parachute https://www.youtube.com/watch?v=iqEkFBNiP3c&t=2m02s
Of course this goes without saying that the law depends on the jurisdiction where the scraping takes place.
Looking at the pictures El Capitan seems really tall and flat/sheer. Are there other cliffs in the world that are even taller or more sheer? I'm just wondering since I've seen comments from people saying something to the affect that they can't imagine what could top this. There are thousands of mountains around the world. Surely El Capitan isn't the Mt Everest of climbing.
Had you updated your contact information with a copy of a scanned ID? Was it legitimate?

This is probably more due to regulatory pressures
and any possible Coinbase alternative in the USA is going to have the same problem.
Nice hack. There are many stories from that period, one of my favourite ones is about Witold Pilecki [1] among several things like founding secret army he was basically responsible for intel on concentration camps - people didn't know what was happening there/they didn't believe they were mass killing people; so he arranged himself to be taken to Auschwitz, organised resistance there, built communication device with mates to send info out; after sitting there for more than two years waiting for allies to take it over he decided to speak to them personally, so he escaped and did manage but west said they can't do it without soviets and soviets didn't want to do it; then he started organising resistance just in case soviets are going to take over govt - he was right, they did... his story goes on and on [1].

[1] http://www.poloniainstitute.net/witold-pilecki-bravery-beyon...
Ask HN: Guidelines to perform scientifically rigorous benchmarks
I don't agree with that. In fact, I wear a helmet whenever I am near a wall because I have seen way too many formerly solid looking rocks fall, even on granite.

Heck, a few years ago, a 2000 ton slab of rock fell off of Half Dome, which is a famous granite dome in Yosemite. I can't find the article now (of course), but I read a great article about how rock expands and contracts with the heat of the sun, water gets into cracks and plates will break off.

This article is okay, though it isn't the one that I'm thinking of. If I can the correct article, I'll edit this answer.

http://www.livescience.com/51490-yosemite-half-dome-rock-fal...
I suspect they are more interested in their copyrighted content than load on their servers. Hence the licensing program.

If you aren't trying to monetize, you will be lower on their radar, but not immune.
I think that might make you easier to track. Even driving slowly round the neighbourhood listening carefully would ferret you out.
I absolutely love that line... Yes, you just won a WS, but it took you 6 games!... LOL
Doesn't work on my Chrome for Mac.
I think all of the reasons listed by the article carry some weight. When I was a teenager in the 90s my parents did not want me to get a job, and instead focus on studying. When I finally landed that awesome job making chicken at $4.75 (training wage) my colleagues were older, in their thirties and up, white and African American. Returning to that same restaurant in 2015 I found the majority of the employees appeared to be of Hispanic origin. So maybe it's just a combination.
Most modern cameras have, for the last couple years, used NFC to quickly and easily transmit photos from the camera to the phone. From what I understand, on Android this works pretty effectively.

On iOS, however, weak NFC implementation means that one must use a kind of janky WiFi transfer system. It works, but it's kind of difficult to use and not very elegant.
> Reddit addresses this specifically in their TOS and prohibits it.

Where? I don't see anything that prohibits scraping. There are provisions against rehosting content, but that isn't scraping. You can scrape content without rehosting if you are locally scraping in an app, for example.
As a person from northeastern Europe living in Tokyo, I really hate the Japanese doing something similar -- in the summer they set their ACs to 20-22, when it's 35 outside, while in the winter everywhere inside is at 25+, quite often even as high as 28. Plus, their ACs are the 'blow freezing wind in the face' type, so it's extremely terrible for the health. I have taken to wearing a quilt+buff for the neck during the summer just to avoid getting sick all the time.

At least I sit next to a window, so I can let some warmer/cooler and fresher air to compensate, but it is such a waste of electricity, it drives me nuts.. It's also imposible to concentrate when the air gets too dry from the AC.

ends rant
I'd almost completely forgotten Apple tried to push their iBeacon standard, arguably in competition to NFC in many ways. If I'm honest, my expectations for NFC lighting the world on fire with iOS support have been severely tempered by the huge number of articles/businesses/startups that proclaimed iBeacons where the next big thing. I've still never encountered them in the wild outside of Apple stores or friends who bought iBeacon hardware for hacking personal projects.

https://en.m.wikipedia.org/wiki/IBeacon
The difference is that a Senator (who is vice chair of the Senate Intelligence Committee) is privy to more information than you are.

And lying can have very real consequences for politicians, even when it happens without breaking a law.
LOL I'm still not throwing them out. Nostalgia. They'll sit on a shelf next to my Nintendo and typewriters.
You’ll never guess where Russian spies are hiding their control servers
I'm a swimmer. I'd like someone to teach me how to have huge hands and feet like Michael Phelps so I can swim like him.
That is what OP is saying he will do....rehost the content.

"I actually created a site...that scrapes...from Reddit...and shows that information."
Not O(log(searchable))?
Some core group obviously cared enough Apple decided it was in their interest. I'd be interested in knowing who it was.

Option 2: they plan to start using it themselves in future products for pairing instead/with BTLE or maybe for some sort of in-store display.
Empirical Findings of 'The Nature of Order' [pdf]
Oh I totally get that, which is why I make sure any of the scraping I do isn't to make money, just to write about interesting analysis. But I'm just also curious about people here's opinions on legality and whether they care about following the specific site's rules.
I had good luck with
Hadoop World - https://conferences.oreilly.com/strata/strata-ca and
Hadoop Summit (now branded as Dataworks Summit) - https://dataworkssummit.com/san-jose-2017/sponsors/

They're both pretty big and not as technically deep as smaller ones could be, but they make up for it with multiple tracks (ops, security, dev, business) and a breadth of technologies represented.
Nah, their complaints about Strickland happened last year as well, even into the NLDS, when he had only given up 4 home runs all year. He does well in most situations. If anything when he was still a rookie he needed to improve because he only had one pitch, but now he has a few.
maybe this is why some color printers will refuse to print black and white if they're out of the color ink.
Would you mind sharing your spider technology stack. How do you find new urls efficiently? What spider and what storage do you use? Do you append everything in one WARC file and split it if it gets too big?
Most OSes already support some form of using temporary random IPv6 addresses within your provisioned range, including so far as for each individual outgoing communication. Windows has supported it since Vista, IIRC, and defaulted to it since 7, I believe.

It's definitely still a problem if your ISP assigns you too small of an IPv6 range, and doesn't stop people from tracking you as your range, but it does as well, if not better, than NAT at stopping people tracking your individual devices.
This is the Betanet. We will not use sha256 as in our Mainnet. We are already working on a WebAssembly implementation of a memory hard ASIC resistant POW.
Pretty sure you're trying to ask "how do you quit a freesolo?" In which case the answer is usually "downclimb".

It's relatively easier to quit a vanilla free climb.
If anyone's wondering, the API is significantly more limited than the Android NFC API (which having used it extensively over the last 2 years I can say is very pleasant).

Still, it's better than nothing and it represents a huge opportunity for NFC tag providers (where I work). We've been waiting for this for about 4 years.
there are actually a lot of people who can climb harder (on a rope) than alex honnold; he has done one 8c+; atm 350 people have done 9a or harder and a lot of people have done multiple 8c+ routes:

http://escalade9.wifeo.com/par-nationalite.php

i think what's so special about him are his mental abilities, not his physical.
Where are the Ads
I do not have any Ad blockers but noticing that now a days both Google & Bing do not have much Ads especially for things like restaurants, hotels, doctors, cinemas...
I laugh at people who try to exercise ownership of bits. It's foolish to place data out there in the open with the expectation that people are going to treat it nicely.

Data yearns to be free, stop fighting it!
There's some National Geographic video footage of the climb here: https://www.youtube.com/watch?v=9HoUDDetAg0
Sure, I'm just curious about people's opinions on whether or not it's necessary to follow site's rules on data scraping, whether it's always ok if you're not trying to make money on it, or if something like giving credit to where the data comes from makes a difference. Just things in general like that if that makes sense.
Who's copyright?
I thought that terminal velocity for a human on Earth was about 120 miles/h. Seems like Wolfram doesn't take that into account.

Just makes the horrifying fall even longer!
Not you. Though I wonder what you were specifically wanting to find out with your question.

I'm speaking from observations made sometimes on Hacker News and frequently on Reddit.
I wonder if there is any technical reason for requiring iPhone 7. I thought iPhone 6 and iPhone 6s also had some kind of NFC hardware present to support Apple Pay.
The legal system does not "decides" on legality unless its forced too. Consider the case of Google Books project. Eventually the courts did rule that it constituted fair use. Or consider the situation involving Flickr and Pinterest. [1] or the one involving RapGenius and lyrics licensing. [2]

So to answer your questions:

> Are comments on sites like this public data or private?

> Does the purpose of your scraping make a difference, if one use is just a project but another would be selling the data?

There is no correct answer, at least unless you are willing to wait a decade and spend millions while the cases make their way through the byzantine legal system of districts, circuits, appeals and supremes. Unlike Science & Technology where there is a "correct" answer, you should approach legal system with different perspective using instincts and acceptable risk tolerance.

The history is littered with people who took a bet, and ended up succeeding or failing upwards.

Finally ignorance is actually preferable to knowledge. By writing this question or say having this conversation over an email you are simply creating a paper trail that can only harm you if you get sued tomorrow. [3]

[1] https://photo.stackexchange.com/questions/53304/what-is-the-...

[2] https://www.nytimes.com/2014/05/07/business/media/rap-genius...

[3] https://www.fastcompany.com/1588353/steal-it-and-other-inter...
Unoptimised code says a lot, it's an indication of what we can expect of real world apps that will be mostly or entirely unoptimised. It's like theoretical vs real world java performance, in limited and optimised benchmarks it might produce fast code, but in real projects it doesn't.

And that's the best case, there are already people in this thread talking about compiling python to web assembly, any performance improvements over the current state of the web are going to be pissed away immediately.
If a site provides a sitemapindex in the robots.txt, would you assume they're allowing their site to be crawled on the pages they've set out within?
When Franklin Computers dropped their Franklin Ace line they had a huge parking lot sale. Snagged a mess of motherboards and parts to make 5 2e compat machines.
When my residential ISP started allocating IPv6 blocks, they published our postal codes in the whois database. In Canada, in a city, that postcode is basically a dozen buildings (one side of a street block), at least where I live. For a stalker, it's practically a full address.

We pressured the ISP to remove this information. They resisted, said it was policy, we read the RFCs and argued back. A few weeks later it was removed.

Similarly, most Linux distributions now enable IPv6 privacy extensions. Once people settle in their habits, it becomes more difficult to change this type of behaviour.

IPv6 is a big change. Adopt early, influence policy while you can :)
If you're talking about local addresses, can't you just use the short notation and use even-shorter-than-64-bits addresses?

If not, DNS is there for that.
Every so often I ask RCN if they're going to support IPv6 this century, and they reply back saying they have no plans for anything customer facing.
The real question you should be asking yourself is how hard it is to fake these. If I get hold of someones copies, can I use them as template?
That reminds me of a very dark joke that I heard in a bar in Canmore once.

- How do you become the greatest climber in the world?

- You become the second greatest climber and wait for #1 to die.
the x64 version seems to be based on Chromium 49.0.2623.110. Not sure I can tell the benefits of Lua though.
But not one uses FB. I got friends who are on Line and WeChat exclusively. Some part of the world don't have access to FB.
Though I don't exactly rehost the content. I straight link back to the Amazon link and the Reddit comment where the link came from. I'm not even reposting the comment text which I feel makes a difference on that front, but possibly not in others opinions.
Yeah, that's the problem. It's easier to be better than humans 95% of the time, but really hard for the next 4% and close to impossible for the last 1.
Awesome! Thanks. :-)