skysight-inc/HackerNews huggingface dataset:
This needs to be in any 2013 year in review article. The implications for this with existing and new technologies is unique and doesn't happen often enough, presuming my understanding is correct :)
The data is freely available: http://aws.amazon.com/datasets/41740

and you just need to comply with the Common Crawl TOU: http://commoncrawl.org/about/terms-of-use/
I don't think it's absurd at all. As other commenters have mentioned, seeing the coupon code box and not having a coupon gives me (personally) a feeling of remorse before I've even bought what I was shopping for. This should concern you, as a merchant, because ideally you'd like your users to associate good feelings with shopping on your site.

Beyond the "feelings" aspect, I suspect that, as is argued in the article, the coupon code box does lead in some cases to cart abandonment. I've certainly seen the box, gone on a hunt for a coupon, and ended up buying the same item at a different vendor during my hunt many times before.

Personally, I think the best solution for this is either special urls (i.e. www.shop.com/summercoupon), or a "Where did you hear about us" box, which could double as a coupon box, and just an interesting way to gather data about your users. Sure, you'd probably get a lot of garbage, and you'd have to put more effort into parsing the values, but, in addition to not alienating users, you might find some valuable insights as well.

[edited for grammar]
From the FAQ: "Please refer to the Common Crawl Terms of Use document for a detailed, authoritative description of our Terms of Use guidelines, but, in general, you cannot republish the data retrieved from the crawl (unless allowed by fair use), you cannot resell access to the service, you cannot use the crawl data for any illegal purposes, and you must respect the Terms of Use of the sites we crawl."

http://commoncrawl.org/about/terms-of-use/
What you say is entirely orthogonal to the issue at hand. The question isn't whether you want to proxy dom properties - the question is what you return from a search query that conceptually may return several results, one result, or no results.

That state - that return value - does not behave like a DOM node. It doesn't quack like one. Sure, you can somehow create a mapping between the various scenarios - 0 results to null (or undefined?), 1 result to the result itself, and several to an array, but that just means that working with the result becomes harder.

As an API consumer of HTML.js as-is, I've got a few choices

- I can be hyperverbose and check all the time what the return value was (shudder)

- I can use a special-purpose api that happens to work in all cases. This is ok, but adds complexity, and since it's not enforced, I'm going to makes mistakes that will bite me confusingly at inopportune moments.

- I can make assumptions about the dom... this element must always be unique, right? and this selector always matches something, right? This coding style is hell to debug, especially without liberal asserts nor even the implicit asserts that a static type checker would make. This is the syntax the examples use, must be a great idea...

Let me put it this way: you're basically writing a query DSL, but you've chosen to make the syntax depend on the runtime state of the DOM. e.g. finding a link inside a div inside a section is written differently depending on whether there are several divs, or just one.
Some scholarships will let you defer, others will let you apply the next year - talk to them about that.
White House denies intel chief will lead NSA surveillance review
An Open Letter to Founders: Creating a Community Strategy That Actually Works
AngularJS 1.2.0-rc1 released
Typical of folks with his personality type. I've known a handful of them. Their MO is getting others to obey them, follow orders, etc. Everything out of their mouth is filtered through this lense, and so they will say whatever you need to hear to get you to follow.

They are just as 100% sure about one position as they are its opposite.

You'll find a lot of these folks in politics, as well as in C-level positions inside companies.
How does one get set up to access the s3:// links their blog posts reference? I do realize these point to Amazon S3 buckets, but how to get at them?
London Underground Visualized
But don't avoid long sentences altogether. Mix them in for some variety.
Yes! Startups/commercial companies/etc can all use the data for free. The terms of use basically say, don't do anything illegal with it and a few other things, but it shouldn't affect the vast majority of uses.

Actually, tomorrow a video on a startup that uses Common Crawl data is getting posted.
Is there something, other than funding, preventing a more regular, open-sourced crawl of the web?
svbtle blog posts:

"Here's a random thought I had the other day but didn't really think through too thoroughly"

[Discuss on Hacker News]
The $12.5 Billion Tweet
I loved Amiga as much as the next guy… I remember installing a Kickstart ROM as a fourteen year old. But what desktop paradigms does Amiga offer now that aren’t present in other OS’s?
Civilized countries generally have provisions for mail being inviolate - and for good reason. The republican and constitutionalist movements in the 19th century that sought to supplant the absolutist regimes were routinely spied on. Now we have Google arguing with a straight face that email, which has become a substitute for snail mail should be open for everyone with the proper connections. It's democracy that's at stake here, nothing less.
I can agree with this sentiment. The thing I try to avoid most is attention to my mobile screen when with my kids/family/friends, without specifically excusing myself from the conversation.

Part of what allows me to do this is gmail push notifications and ruthless filtering of messages so that only the most important things arrive in my mobile inbox.

If something doesn't need to be addressed immediately it gets archived -- I pop all my email off using fetchmail onto a server where I do my "real processing" in alpine later when I sit at my desk.

Also, I try to avoid immediately looking at my phone the second I get the emails. If I'm talking or doing something, I get the notification, and I wait until there's a natural gap in the proceedings to check what's going on, then if something requires my protracted attention I excuse myself and say what I'm doing, then reply. For example "Excuse me while I just reply to this email I'll just be a couple of minutes".

If I'm at the dinner table when this happens (hey I run a business, gotta do what you gotta do right?) I always excuse myself from the table while I type my reply.

My fastidiousness about this practice comes from a time when I observed a 17 - 18 year old boy at dinner with his mother. The boy was holding his phone at eye level facebooking (or whatever) literally the entire time, dividing his attention between his phone and the conversation he was having with his mother. It was repugnant behaviour and not something I want my kids to view as being "okay", so I have to lead by example if I don't want to have that shit played back to me in 15 years' time.
I think the service charge is a bridge idea. In the long run it'd be simpler to pay servers reasonable wages and roll the price into the cost of the meal, but that's a big step; in the short run it would be much easier to switch from "optional, customer-calculated tip" to "mandatory, restaurant-calculated service charge".
And you're talking to Unitarian! I've interacted with plenty of Quakers, and I have to say I'm a big fan. I didn't mean it as a personal attack, I'm sorry if came across that way. I just don't think it's fair to characterize the feminist movement by what happens on twitter.

I'm not at all familiar with the 'geek feminist' movement, so I appreciate your insight. I completely agree that the whole Adria Richards affair was overblown by everyone involved, however it doesn't seem like that's a typical response.

What do you think is the appropriate way for women in technology to create an equitable workplace? Is not speaking out when genuinely offensive behavior occurs really the right way?
I think it'd work fine if there were some persistent button/badge that showed the current sort scheme that also acted as the anchor for the pull action.

From the video it seems it'd feel like you're shifting gears in an automatic car.
If I understand this correctly, the backscatter is always there. It's residual radiation from the Big Bang. It's also why analogue tv sets show static when not tuned to a station. TV and Radio stations output a signal that's much stronger than the backscatter, so that's what gets received by the TV or radio set.
I could be wrong about any of this though...
I wouldn't use it because I would get claustrophobic. But I don't think it's being engineered for claustrophobes -- we'll take the train or drive, and people who are comfortable with Hyperloop will take that. No solution can meet everyone's needs.
But, you see, it wasn't a case that "suddenly efforts were made to clean it up". A very large number of Democrats considered Nixon to be fundamentally illegitimate---in fact, as far as I can tell that's true for all modern era Republican Presidents except for Ike, who was an obvious special case, not even declaring himself and his family to be Republicans before 1951---and they wanted to get him at any cost.

We can also see that this goes only one way, although that's hindered by the big discontinuity of Ford and Carter being believed to be "clean" (although maybe I'm not remembering efforts to criminalize his short Administration, but a quick skim of Wikipedia didn't bring up anything) and Republicans then holding the office for 12 years.

"Let the whole thing come crashing down", well, that tells us how much you really care for "the people" ... you're talking about ending the Republic. The idea that the public will have an opportunity to elect officials after this is very questionable. Some people claim a desire to pursue justice no matter what the cost is idealistic, I'm with those who consider it idiotic. There is a reason our Founders created an unquestionable right for a President to pardon people, and this is one of the examples.
I think these coupon codes produce this reaction because they remind us how non-transparent online commerce can be.

Walmart has a hard time at their brick and mortar store charging more for diapers to the poor person who lives down the street and has no car to get to competitors, and less to the better off person who arrived by car. But a huge amount of "big data" work is spent differentially pricing online commerce -- the travel industry is most famous for it of course.

The general trend of technology tends to be that tools once only available to the big institutions become democratized and more revolutionary as they are. Similarly I think the "big data" and tracking and etc will swing around into a more equitable balance.

That can be hard to believe, but try to imagine this -- you go to buy something online, but you pay with bitcoin, and a browser plugin you have pops up a screen when you are on the final checkout page -- this plugin uses the bitcoin chains and non-anonymity to show you all recent transactions with that bitcoin address. You can then get an instant sense of whether you are overpaying or getting a deal.

Such a system could be gamed and evaded of course.

At one time I discussed making a reverse-Priceline system, where consumers would use a browser plugin that shared what offers were being accepted and rejected on Priceline style reverse auctions.

The sum total such efforts is a lot of infrastructure invested in replecating what a simple open-outcry market would be, if the market were run by disinterested, trusted authority.
Indeed. This reminds me of "Larson Localizers" [1] from Vernor Vinge's "A Deepness in the Sky":

"Among the unsuspecting, they are an espionage miracle.
Abused, they lead to ubiquitous law enforcement, and a
quick end to civilization."

1: http://en.wikipedia.org/wiki/A_Deepness_in_the_Sky#Localizer...
It doesn't seem to be a overly large round of funding. Look at comparable rounds at Puppet Labs & Opscode (so you'd probably want to look at Bs since the market is more validated now). Similar business models, and they should be valued similarly, too.
Whenever this comes up I share this quote from Seth Klarman:

“Diversification for its own sake is not sensible. This is the index fund mentality: if you can't beat the market, be the market. Advocates of extreme diversification — which I think of as overdiversification — live in fear of company - specific risks; their view is that if no single position is large, losses from unanticipated events cannot be great. My view is that an investor is better off knowing a lot about a few investments than knowing only a little about each of a great many holdings. One's very best ideas are likely to generate higher returns for a given level of risk than one's hundredth or thousandth best idea.”
You need an Amazon account - though the data is available for free, I think you need to specify your access key to actually fetch it.

From there you can grab the S3 command line tools (http://s3tools.org/s3cmd) or load it up from hadoop or through one of the various open source libraries (boto for instance).
I completely disagree about the learning curve. In my experience, the iOS frameworks are quite complex and multi-layered (i.e. CoreData). Furthermore, you run into the fact that you have to learn Objective-C. The abundance of iOS experts probably has more to do with the fact that many Mac OSX developers easily transferred their skills to iOS development. With the Android platform, however many more developers know Java already, so that is less of a hurdle for your average dev.

In my anecdotal experience, for example, more college students try to do Android development, since they already know Java (taught in most college CS classes), whereas the students that try iOS development only do so because of the cachet of having an iPhone app.
I kind of doubt blowing his credibility with a pump-and-dump is part of his long-term plan for maximizing his return.
This is one half. The other half is an amendment to the constitution. Good luck with that second one, tough.
And all the money flying around today (its POMO Tuesday[0]) couldn't hurt either…

[0] http://www.newyorkfed.org/markets/pomo/display/index.cfm
I am just a developer and I know nothing about business. What should I do?
I had this idea for a website which I have passionately implemented. I really believe in this idea. But now I just don't know what to do next. Do I need to find a co-founder who is experienced in promoting a website/startup? But how do I trust him (and find him in a first place...)? I really like just to write code, nothing else and it just kills me that I just have no idea how to get any users. I've written to couple of popular blogs, but no one replied, because, as you can see, I am not really great with words... Any ideas, suggestions etc would be very appreciated.
No, the health inspector would be non-existing in most software shops.

What a different industry it would be if all software required independent audits and the public could get access to the results.
So it sounds like there's little chance of a truly open source cellphone. What a shame. I wonder what the privacy implications are of having a remotely-updatable module inside every phone. Can carriers break encryption this way? Or otherwise snoop on users?
Sorry, buddy...but, this is no more than a glorified Excel sheet work, or a high school science project...and you know that.
Nonetheless, it's useful..my only objection is for them to say it as if this was unexpected, something new, a discovery...which is not. If they talked to an hardware engineer, he would probably tell them what to expect anyways.
This was my question, too! According to the paper:

>"Finally, we test the interference of ambient backscattering and ﬁnd that, even in less favorable conditions, it does not create any noticeable glitches on an off-the-shelf TV, as long as the device is more than 7.2 inches away from the TV antenna."

It's discussed in more detail in 6.4. So far they've looked mostly at TV interference. I'd be surprised if it interfered with anything else at all, but that's all I could find for now.
Don't forget the "if it's too good to be true..." aspect as well. Sometimes companies throw money at people to trap them in dysfunctional environments. If you got the feeling that the people at the new company will embrace good practices, then what arink says makes a lot of sense. However, if they instead actively shut you down for "wasting time with non essential activities", then you will end up being pretty unhappy.
In this case you're probably right, but lots of HFT algorithms do use Twitter as a feed to inform trading strategies. Tweets can literally send stocks soaring or sinking.
You need to decide if you're the sort who'd rather serve in heaven or rule in hell (the analogy works both for work environment and salary).

There's also the third option- seek out a better position with even more pay.
Yes.

That link acknowledges a kill switch for malicious apps, which they've never used.
Investors have meetings with management all the time. Unless Tim Cook gave him material non-public information about the company, it isn't illegal.
google: we are not the spies you are looking for
The standard answer to articles that ask a question in the title is no. Or in this case nothing.

One of the reason's California's proposed high speed railway was so expensive was the politics involved in picking the route. It's also the same problem Amtrak has. The northeast corridor would make money, but the routs going west don't and are kept do to congressional pressure. The hyperloop's cost comparisons don't factor that in at all(nor should they). But building it in practice will be an issue.

The second part of the hyperloop's cost savings come from it being very light. We could simply build very light rail transport on the same pylons. Replace 1,500 KG of batteries with overhead electric wire and use the excess weight for a motor.

So the hyper-loops only real advantage is speed. Which is impressive, except for the fact that it requires you to build a tube with surface variances less than 5mm for several hundred miles, or the air barring will have problems. (or maybe not, perhaps you could have dynamic air barring and high precision topographic maps of the tunnel)
Right. Nixon's forced resignation, on a credible threat that he'd otherwise suffer a bipartisan House impeachment and Senate conviction---either a singular event in US history---in no way whatsoever held him accountable, nor illustrated a threat to future Presidents....
I think you'd enjoy Dan Ariely's Predictably Irrational, or any other popular book on behavioral economics. (Even better: Dan's Coursera class.)

Your view of the world is perfectly rational, but that's not how humans behave or think/feel.
Limited resources are the only reason. We are working on a subset crawl of ~3 million pages that will be published weekly starting two weeks from now. But doing the full crawl takes a lot of time, effort and money.
SaaS: Killer of the Traditional IT Department
The fitbit one came with this velcro sleep wristband.
http://www.blogcdn.com/www.engadget.com/media/2011/10/fitbit...

When I want to ride, I take my fitbit out and put it into the velcro band and tie it around my ankle. It works surprisingly well, registering approximately each pedal stroke as a step. I register around 8,000 steps for a 15-mile bike ride. Since a 15 mile ride is a lot more exercise than 8,000 steps, I'll also mark in the app that I went cycling, and that's that.
Little kids just have a burning desire to be interacting with you, and with the stuff you're interacting with. Don't drop everything, just be flexible (and sometimes creative) and involve them.

Kids love helping to fold laundry.

Well, first they "help fold laundry", then later they actually help fold it (then they lose interest, but by that time they don't have quite the same keen hunger for interaction!).

My daughter learned how to safely use knives before she was 3 because she was really, really motivated to get it right so she could be involved in meal prep.

For the younger ones, you can put them in a sling and (selectively) let them grab stuff while you're doing whatever.

The trick is to let them be as involved as they want to be -- it gradually tapers off as they master the basic stuff you do around the house, and the terrain inside their own heads gets more interesting.

A 1-year-old is a sponge, though, more than an independent thinking person. They're not going to develop their imagination much if you stick them in a room by themselves; they're mostly going to cry for you to come back, because at that age they're sucking up torrents of information about "what people do" by watching you and trying to get involved, and that all stops when they're by themselves.

I'm totally in favor of letting kids get bored (and encouraging imaginative play... we have very limited electronic entertainment in the house), but that's when they're a bit older.
I would say that the license is to a certain degree also a technical reason to use LLVM. Projects, corporations or people can integrate LLVM into their product with less hassle than with GCC. You can't integrate GCC into a product directly, GCC can only be used as an independent binary. I would think that this would make LLVM more enticing to developers. Obviously this depends on the intended use if all you need is a compiler GCC might still be the better choice.
Trees falling in the forest, etc. etc.
Clapper having any say into the matter is unacceptable; Have they not heard of independent third parties?

Here's a conspiracy theory: Clapper will sit in the panel, come up with perfectly valid reasons to veto anyone his thugs do not have dirt on, and will proceed to blackmail his agency's way into being completely unchecked. Corruption is not rooted out by the corrupt; It is rooted out by having third parties check everything until well after the corruption is gone, to give the latent seeds no chance to take root.
Politics really does destroy all that is holy. in this case free software. should I be able to extend free software for profit or not? I would say yes... but there are some cases in which I would say no. for a compiler I would say no one should be able to make money off an extension. it just doesn't make since.
Cool, that was a bug, and not too difficult to fix and must have felt great when figured-out. But sometimes on darwin you run into stuff that just is so crufty in the BSD emulation, that it's better to use the mach stuff. In this case these class of routines:

http://web.mit.edu/darwin/src/modules/xnu/osfmk/man/task_sample.html
Is the public expected to believe that a panel hand-picked by someone deeply involved with surveillance, and appointed by the administration will conclude that the investigators' benefactors were guilty of anything?
I don't think the (strong) version of the efficient-market hypothesis is defensible but Warren Buffet's track record is not proof that it is wrong - in a random market, given a large number of investors, some will do well purely by chance.
Yeah, that $100/month rate for healthy young males is going bye-bye. I'd guess equivalent coverage would be $250+ once Obamacare kicks in.