skysight-inc/HackerNews huggingface dataset:
Hello,

I made a chrome extension that shows a github repository's commits, issues and status updates against the repo's contributors in one view.

My team uses github issues and we have daily standups, and it was becoming increasingly difficult to get a cohesive view of the progress each developer was making and the problems he was running into. I tried to bring these 3 things together (commits, standup updates, github issues) to give that view.

Please try it and let me know how you like it.
As far as I know, GM was never really directly quoted about Facebook ads, short of being characterized in the original WSJ piece as "deciding that paid ads on the site have little impact on consumers' car purchases" and "its marketing team began to question the effectiveness of the ads". My impression from following the ad scene is that it's as much about not being able to measure results than the ads being 'completely ineffective'. Big advertisers like GM are used to having robust analytics behind their buys, and Facebook doesn't (currently) let people tie their purchases in to the same technology (read as: tracking) ecosystem as most other display buys everywhere else on the web. Everyone not selling something on a click-and-buy-me basis is still feeling out the effectiveness. Maybe it's good, maybe it's not. But watch that 10M canceled buy become a 100M buy if the tables are turned and Facebook can figure out how to sell folks on the same advertising tracking their exposed to everywhere else.
The web app looks great and I love how smooth the interface is (yet to try the iPhone app).

I found, however, that it wasn't immediately obvious how to add friends to a circle after creating one. On the other hand, it didn't take long to discover I had to click through to Manage Circles and then click on the circle I'd like to add people too. The process took a maximum of 30 seconds but this could be a lot quicker.

I have an idea though. What about having a button to edit the circle I'm currently in? I think that'd make it much, much easier. Another idea would be a small edit button when you hover over a circle when switching between them? This seems like it would be a little easier to fit in with the interface but would make it less obvious and could make that portion of the interface less usable.

I've put together a quick 'n dirty example of the first idea for you:

http://www.jameswdunne.com/example.jpg

I'm not really a designer though so I reckon something better could be done with more thought and skill (and source files rather than photochopping PNGs!)
yes, i think it would have been better if the y scale was ratio of current to ipo valuation.
People consumed by a bubble mania find reasons to justify continuing even when an objective observer would say they need to stop. I don't know what would be different this time. Plenty of people saw the housing and tech crashes coming, but they were shouted down by the powerful hype machine that precedes every bust.
How Much Will Facebook Make off your Data When They IPO on Friday?
The 19th century, thanks. Pretty disingenuous. You already know the content of these links before clicking them, right?

http://en.wikipedia.org/wiki/Southern_strategy

http://en.wikipedia.org/wiki/States_rights_(speech)

http://newsone.com/16051/top-10-racist-limbaugh-quotes/ (just for fun)

For what it's worth, I don't think President Bush the person was particularly racist. But he was definitely the #1 candidate among racists.
Sounds great! It was a pain running Windows on a VM. :( Is there a way I could keep myself posted about this!?
This is an affliction by which people muddle objectivity with neutrality. One can adopt a neutral (NPOV as they say in Wikipedia land) vantage point, yet be terribly biased, even if it is simply confined to what is filtered out. One can be biased to an intellectual (or political) plank, yet be objective in evaluating arguments and evidence.

Yes, tribalism can induce such ills as well as invoke cognitive dissonance, but it is not a default setting.
Yeah, they'll change 'em sometimes if the title is too linkbaity or editorializing, usually to the title of the original article or blog post. Recently I've seen a few titles being changed to the source title even when the source title is completely unhelpful, leading me to wonder if someone hasn't tried to automate the process a little too effectively.
> The audience at TED who heard it live... gave it, on average, mediocre ratings.

Without disputing the 'ratings' (whatever these may be), its pretty obvious from the youtube video that the actual audience response is very positive rather than mediocre (the majority of the audience seem to give a standing ovation and there is pretty emphatic applause all around).
Unblock Vimeo, Dailymotion, Rapidshare, Torrent links in India
Hacked up this website for the people in India. At the moment it works for most video & file lockers including Vimeo & Dailymotion.
Sign #52 that you are in a bubble, people start using the phrase 'It's different this time'.
I think it's sort of like the hacker news policy, don't post stuff that people can read about elsewhere.

If you talk to most people involved in a particular issue (eg. not politicians) they tend to have views that diverge from the party line, when a talk lines up perfectly with a particular party it comes off more like talking points than an engaging topic.

Imagine a talk on states rights that comes out against abortion and for the war on drugs. Sounds to me like Republican crap rather than an intelligent debate on the separation of powers in government. I think this is what TED is trying to avoid, they're all for an intelligent debate on separation of powers, but against spewing republican or democratic talking points.
> By loading the paginated data through javascript without a page reload, this significantly complicates the job for a lot of scrapers out there. Google only recently itself started parsing javascript on page. There is little disadvantage to reloading the data like this.

Well, unless you're visually impaired and using a screen reader... and it doesn't really complicate things for any halfway dedicated scraper, as your AJAX pagination requests probably follow the same predictable pattern as the non-AJAX ones would've.
In general I think that getting into an arms race with scrapers is not something that you will win, but if you have a dedicated account for each user you can at least take some action.

If this data is actually valuable, they should put it behind some sort of registration. Then they can swap out the planted data for each user to something that links back to the unique account, without wrecking things for users with accessibility needs or unusual setups.
It would be interesting to have a "where are they now?" slide to see how many of those companies are still around and still worth anything. And on a log scale apple, google and microsoft shouldn't blow everyone else too far out of the water.
I'm not sure that it follows that the point of the US is to extract taxes indefinitely from those who benefit from a well constructed country. If the structure of the country becomes hostile to a person, they should be able to vote with their feet. It is substantially easier for the rich to do this, but the solution is to make it easier for everyone, both coming and going. Responsiveness should be the goal on every level, local, state, federal.
How exactly does that site "unblock" them?
I don't know what kind of site this is, so it's hard to say if it applies, but do note that several of these can significantly harm usability for legitimate users as well. For example, someone might be copy/pasting a segment of data into Excel to do some analysis for a paper, fully intending to credit you as the source; if you insert fake cells, or render the data to an image, you make their life a lot more difficult.

The first suggestion (AJAX-ifying pagination) can be done without a major usability hit if you give the user permalinks with hash fragments, though, so example.com/foo/2 becomes example.com/foo#2.
Hello, just curious, why is your child so secret?
I love this concrete example of practical coding to do something quantitatively and empirically valuable. Yes, there are great analytics packages, but sometimes you need to do some custom analysis
It is exactly a matter of spite. tl;dr: he is playing by the rules. people are spiteful because they think he is abusing a loophole in those rules (I disagree).

Saverin played by the rules: he legally became a US citizen. He got the related perks (access to education, quality of life, ...) and the related liabilities (The US tax code is onerous, and while it IS competitive with e.g. Europe on a percentage basis, you get much, much less for your taxes).

He is still playing by the rules: he is invoking the "I quit" card. Note that contrary to the media hype right now, he is making a bet: if Facebook loses value between his de-citizenship and the time he can sell (possibly 6 months after IPO, depending on how his stock was allocated and how the IPO is structured), he is going to LOSE money by denouncing his citizenship.

If he is not planning to live in the US, that's perfectly understandable - read about FBAR and FATCA. the tl;dr of those is: you have ridiculously onerous reporting requirements, FOREVER, with penalty 50% of your holding, PER YEAR (that is, if you're decided to be willingly noncompliant for two years, you have to pay your liquid worth; if you are for 4 years -- well, you owe twice as much; and by default you are assumed willingly noncompliant).

Now, whether or not his decision to move out of the US was driven by the US tax code or not, is (or at least, in my opinion, should be) immaterial. Furthermore, since he wants to live in Singapore, he is required to give up his US citizenship to receive a Singapore one.

I find support to this being a matter of spite, is that all proponents of this law that I have heard talk about punishing him and his ilk (in slightly different words).

Ted Arison and Michael Dingman did this in the early '90s and avoided billions in taxes (The wikipedia article claims Arison did pay taxes[citation needed], but I remember the headlines at the time said he didn't, and http://www.nytimes.com/1995/04/12/us/some-of-rich-find-a-pas... indicates that he probably didn't).

Saverin is actually taking a financial risk here, playing by the rules that were enacted, which are not letting him out easily.

It is exactly a matter of spite.

edit: minor rewording one minute after writing.
Pivots are a Trap
US and USSR had not entered at that time thus things were quite good over there.
https://www.google.com/search?ie=UTF-8&q=boom+%22Its+dif...

I'm about to set the range to various booms and busts to see what people were saying.
Er, 'inflation-adjusted' and 'nominal' are opposites, so that answer leaves me confused.

Looking at one of the prominent early data points, AAPL:

Some online sources peg its IPO valuation at about $1.3B at the time (ie, nominal 1980 dollars), rising to about $1.7B in the first day pop. According to WolframAlpha, [$1.3 billion 1980 dollars in 2011 dollars] is about $3.5B adjusted by the CPI - close to the NYTimes $3.4B chart number.

From that I conclude that the numbers have been adjusted to "2011 (real) dollars".
Just input the link into the box, or use the bookmark bar.
AJAXification could make it much easier. GET -> json import.
وفاة وردة الجزائرية
وفاة وردة الجزائرية
وفاة وردة الجزائرية
وفاة وردة الجزائرية
That is why I suggest using as many of these in combination as possible. A lot of your basic scraping scripts won't have this functionality built in.
It Takes 6 Days to Change 1 Line of Code
I really don't understand your contention here. You're claiming that integration ruined Brooklyn? Can you explain the mechanism? I don't see how public housing projects (widely regarded as a failure that cities are transitioning away from) have anything to do with segregation (widely regarded as an moral atrocity).

Also, just because there's a lot of black people on the street doesn't mean a neighborhood is dangerous. FYI. (former brooklyn resident).
> "let's say someone had data which demonstrated that [partisan policy X is] bad.... How could one make that argument in a neutral, non-partisan way"

"It is important to help [group] overcome [disadvantage]. We have new data showing that [policy], while stemming from admirable goals, is ultimately counterproductive, leading to worse outcomes than would be expected without such a policy in place." Then discuss the data, without specifically naming any politician or political party or questioning anyone's motives. Make recommendations based on the idea of doing right by those you're trying to help, rather than making accusations based on the idea of the other side being evil or stupid.

It's certainly true that some people would interpret your statement in a partisan way. Some people would assume you were secretly funded by the Association of Partisan Conspirators. But by focusing on data rather than partisan cheap shots, you would give them little to go on, and you would be more engaging to those who are honestly interested in doing the right thing.
Not one of the methods listed here would detract a decent scraper. Moreover you would either screw with your users or with SEO if you wanted to make this or that technique more aggressive.

If your database has really great content it's not because some kid has copy of your website online that you'll lose users. Stackoverflow has been scraped to death and nobody goes to the other sites to check out answers.
Censorship is censorship. End of story.
Thanks for a full response. Really appreciated. Just one more quick question if you will:

Do you recognise yourself in the symptoms your son has, does it look like an inherited trait to you (I know that's not at all scientific). Do you have any suspicions for why this affliction might appear to be so prevalent amongst children now (other than observer bias or similar discrepancies).
> They (...) worship some mythical conflict-free land of bipartisanship and kittens, where smart people never disagree they just have different evidence.

Because that is how the world should be like and they have a mission to make it real. It's not a myth. It's a goal.
The whole argument here is predicated on the idea that Facebook won't figure out ways to provide more value to and derive more value from its userbase, and that advertisers won't figure out how to adapt to social advertising as a medium more effectively. Big brand marketing is very much in a radio-to-television-style transition right now: just because the old bag of tricks doesn't work when glued onto a new channel doesn't mean that social will never provide value to media buyers. Facebook WANTS their advertisers to succeed, and you can bet there are a lot of very smart people thinking about this problem right now.

I think the far bigger threat to Facebook is in the "it stops being cool" market fragmentation possibility. As long as a huge percentage of people in the world are spending a chunk of their time on Facbook, I wouldn't bet against eventually finding a way to market to them effectively.
» Toscanië niet alleen voor romantische zielen Richting Vakantie
Great feedback! We're working on fixing this so it's more clear.
They wouldn't indeed, but, it makes it more difficult in the hopes that they scrape a different data source.
Always assume malice.

I know it goes against the conventional wisdom, but in subjects such as politics I haven't been wrong about it yet.
Weave visualizer
How to prevent site scraping:

1) Don't have any data worth scraping.

2) Charge for access.

3) Provide APIs so people don't need to scrape your site.

Trying to essentially DRM your web site so that it's human-readable and not machine-readable is not only inherently impossible to do effectively (like any DRM), but is also solving the wrong problem.
Dealing with Information Overload: Good-to-Know VS Need-to-Know
A less aggressive approach I've encountered is to insert links to other pages of your website with full URLs (http://www.example.com/page.html over just /page.html). Usually, a scraper will copy the links too. This should then make it obvious that the content's been scraped.

This could become a nightmare to maintain if you don't automate it. It'd be trivial to automate on a CMS. I know WordPress has loads of plugins for exactly this. I don't think I've come across something that can do this for static websites though, which make up for the brunt of the websites I maintain.
your <sarcasm> tags were missing ....
So.. a proxy?
They are using the Allwinner A10. You ought to have some luck: http://rhombus-tech.net/allwinner_a10/ (See the source and kernel sections.)
Thanks! That is exactly the type of thing I was looking for.
If they can easily find another source to scrape the same data, said data probably isn't worth spending this much time and effort protecting anyways.
It also currently works for novamov, movshare, filebox, dropbox, google drive, putlocker, videobb, rapidshare, tudou, videoweed, gorrilavid, mediafire, hotfile, and over 300+ sites..
There were certainly no-go zones in America in 1962.

Most of them applied if you were black, however (or in the language of the time, "Negro").

But not all. Casablanca (70 years old this year) includes Rick advising the Germans "there are certain sections of New York, Major, that I wouldn't advise you to try to invade."
I just signed up for your service. Hope it helped. Your service will certainly help me.

The infographic about beenverified was alarming: (https://www.safeshepherd.com/beenverified) and I have actually tried to get my stuff off of there before and failed.

I'm not even worried about my own information. What I'm worried about is the accuracy of it! How can I trust a third party who doesn't even know me to provide an accurate background check when it references PRIVATE databases that I can't even verify the integrity of? My biggest worry is that some day I will be screwed out of an opportunity because of a company like this that simply provides inaccurate data because they confused me with some other John Doe.

It would be one thing to provide public records as a service, but been verified seriously ticks me off. To think they have the authority to 'verify' people irks me.

Then again, it may be a good thing, because I sure as hell wouldn't want to work with anyone stupid enough to use a service like beenverified.
No it isn't the problem, at least not according to TED, TEDs mission is not to spread the gospel about political parties. Want to spread the truth about Republicans and Democrats? Go on CNN. That's what it's there for, you can shout about how Republicans are anti-intellectual and Democrats are communists all day long on CNN, however TED doesn't want to be CNN.

There's a big difference between saying Republicans are anti-intellectual and saying anti-intellectualism is bad for the following reasons. TED is all for the latter and completely against the former.
Could you elaborate on how Google+ circles are confusing?
Try running a search engine. :-) Needless to say we get folks all the time who are trying to create or enhance data bases out of our index all the time. We even have an error page that suggests they contact business development in the unlikely event they don't "get" the fact that our index is part of our economic value.

One of the humorous things we found is that scrapers can eat error pages very very quickly. Some of our first scrapers were scripts that looked for a page, then the next page, then the next page. We set up nginx so that it could return an error really cheaply and quickly, and once an IP crossed the threshold, blam! we start sending them the error page. What happened next was something over 20,000 hits per second from the IP as the page processing loop became effectively a no-op in their code.

We thought about sending them SERPs to things like the FBI or Interpol or something so they would go charge off in that direction, but its not our way. We settled on telling our router to dump them in the bit bucket.
Justice Dept. defends public’s constitutional ‘right to record’ cops
Google really doesn't know I hit the back button, do they? I just tried it and Chrome debugger shows the page load for search results coming from cache. I guess I just don't see what information the browser sends that would allow them to know I had come back to the search results, from some specific page, via the back button.
The easiest would be to follow us on Twitter @kinesisio
CEO who rebelled against Microsoft over Windows licensing backs down
Rise of the Tech Bandits
The Jython team and I collaborate with the JRuby team a fair amount. Some work has begun to use similar techniques in Jython to improve performance, so stay tuned!
yes @adivik2000 follow kinesis on twitter - http://twitter.com/#!/kinesisio .. we will update as soon as we release the mac version
You're right, that is annoying. Thanks for the suggestion. Here's what we're going to do. On hover on the Circles list, we'll swap out the member count for an Edit link:

https://img.skitch.com/20120517-gg1dd9n3ecy5882gd8335tap44.j...
If you have registered for early access, the Mac simulator will be in your inbox very soon. Or you can get updates via twitter @kinesisio
I didn't think the talk itself was needlessly partisan. Only reason I'd say it shouldn't be posted is that a basic intro to keynesian economics isn't particularly new or noteworthy.

If I gave a TED talk that just was a fisher-price version of Bastiat's broken window, should it be aired? Should I call it censorship if it wasn't?
That's a great article, thanks!
You know a story probably wasn't HN material when you end up discussing racism and recent US presidents:-/
I used the beta to get a last-minute gift for my mom that I wouldn't have otherwise had time for. The app let me find and call the store to confirm that they had the item I wanted before having it delivered.

Amazon Prime for everything. Can't wait till the NYC launch.
Do you really think a bunch of scrapers' time is more valuable then yours? I'm assuming that you have the ability to create this great piece of content that people want to have so I think your time would be better spent either creating more of said content or pursuing other endeavors other then making some kids waste an additional 15 minutes figuring out a way to solve an interesting puzzle.
At no point the author insinuates anything about how hiring a PR firm speaks of person's character. The post just simply states the facts that a) a PR firm was hired, and b) he/this firm issued threats to TED.
So we have several datacentres around the world, and when users input a link. A server will take the task and try to download the content on the web, based on trial & error and user's response it learns how to download from a particular website.