skysight-inc/HackerNews huggingface dataset:
I think its amazing that only 5,000 years ago it was much warmer than it is now, as this area not only supported grazing herbivores but a human hunting population which was eating them. That is important for a couple of reasons, mostly that from a geologic perspective not a whole lot is different from 5K years ago and today.

What that reinforces in me is that regardless of cause, climate change happens, or conversely even when human carbon footprint on the planet was nearly zero, the planet was warmer than it is today. And that suggests to me that human impact is irrelevant to the challenge of surviving in a changing climate.

Sadly that puts me in the 'climate control denier' category, that is the group of people who believe that humans cannot control what the climate does (good or bad).

That said, I'm all in favor of balancing our energy economy, I'd much rather be spending ergs much more efficiently than we do today. The more efficient our energy use the more flexibly we can react to changes in climate and we are able to create a higher standard of comfort for more people.
If you look at Redroid (a project which makes extensive use of lambdapp) you'll see how map/list/etc can take advantage of this https://github.com/graphitemaster/redroid
hashtable.c and list.c look for [hashtable|list]_foreach. Another good example is config_save in config.c.
I miss these Show HN project writeups. They're what drew me to HN in the first place, but these days I'm lucky to see one good one per week.

Excellent work, OP. It looks like you're a unicorn.. or could be one with a bit more design polish :)
You should try looking into MobileWorks. Recently they've focused more on human generated lead gen, but they might still/used to do transcription as well. Their crowd is generally much more reliable than MTurk.
Keeping track of the lineage of data (provenance) enables many cool applications; ranging from identifying malware outbreaks to recomputing workflows efficiently.

A range of papers on provenance (along with some code) are available here: http://spade.csl.sri.com/SPADE/Papers/Papers.html

Disclaimer: I work at SRI, and have worked briefly on SPADE in the past.
Right. The curve demonstrates "calibration". A separate question is daily accuracy, or what might be called "sharpness".

One way to measure accuracy is to use a "scoring rule" each day. The scoring rule takes the prediction (a probability of rain), e.g. p=0.3, and the actual outcome, e.g. "rain" or "no rain", and returns a numerical score, where higher is better. You'd expect a reasonable scoring rule to have properties like, the highest score is for predicting p=1 and it rains (or p=0 and it doesn't), the lowest score is for p=1 and it doesn't (or p=0 and it does), and so on.

The log scoring rule is a popular choice: If it rains, your score is log(p); if it doesn't, your score is log(1-p). (Don't let it bother you that these are negative numbers for p in [0,1]. Closer to zero is still better.) Notice that your expected score for predicting p is precisely plog(p) + (1-p)log(1-p), which is the negative of the entropy of the distribution, that is, -H(Bernoulli(p)).

Now, what we could do to measure accuracy is to average, over all the days, the log scoring rule applied to your prediction and the outcome. A perfect score would be if you predicted 1 every time it rained and 0 every time it didn't, which would give you a score of zero; if you're not perfect, you'll have a negative score, with more negative being worse.

So the average score will be (the negative of) the average entropy of your predictions, which makes sense as entropy corresponds to "uncertainty". (This is assuming your predictions are calibrated. If you are uncalibrated, i.e. you make predictions with little uncertainty but they are wrong, then you will pay a penalty in proportion.)

We can connect this to your idea of mutual information, if we had a more detailed setup. For instance, suppose that each day, nature picks a true probability of rain p', then you observe some information related to p' and make a prediction p; then it rains with probability p'. Here, the best you could possibly do is to observe all the information and predict p'. Then your average score will be the average entropy H(Bernoulli(p')). But if you are making poor predictions, then the theory of proper scoring rules tells us that your average score will be the average mutual information between the distributions Bernoulli(p') and Bernoulli(p). (If we are using some scoring rule other than the log scoring rule, this mutual information, which comes from KL-divergence, is replaced with a "Bregman divergence".)

Unfortunately, we don't know this true p' each day, so we can't actually use mutual information to evaluate forecasts, but we can still use the entropy, or log scoring rule.

For a survey on proper scoring rules (not very fun for the layperson I'm afraid), see http://www.eecs.harvard.edu/cs286r/courses/fall12/papers/Gne...
The issue I think is the cost to build redundant systems. We found that many times, external factors like weather and malfunctions were responsible for the vast majority of our critical failures.

If for example, some cloud cover shifts and we lose connection with our copter for just a few seconds, a lot can happen. Even though we built redundancies into our software (if no connection, hold position), those few seconds of lost control could cause some catastrophic problems. I think this is really the biggest issue surrounding drone flight; it's not the question of "Can we build autonomous drones?", and more of "Can we constantly guarantee control over our drones?"
There is readable based on each character such as semicolons, dots or curly braces and there is readable based on the shape of code.

That is two separate levels. When you first glance a page of code the first time in 1 second, you should tell what the structure of the program is. How many blocks (for/while/if) it has. How many functions, how big they. You haven't yet had time to read each individual character. That is one level.

Here variable and ambiguous indentation rules get in the way. If there is non-uniform, non-standard indentation then you have to start reading individual lines in detail. If there is standard indentation then it doesn't even matter about little commas and semicolons, it is a level higher than that.

Then past that it is about individual functions, classes, modules, and what have you. Then it becomes about == vs = or . vs , and so on. If there is ambiguity there it could be harder. Like in Python I added a , at the end of a some variable. So that turns it into a tuple. And it resulted in a strange exception down the line. In C the = vs == is notorious. But there are others. None of this make the task impossible, but just slightly harder. The problem is that if this is done many many time over the course of a lifetime of a piece of code. Maybe it take 10 extra seconds for reader to understand the code, that multiplied by thousands of times will add up.
You should realize how poor this argument is.

First, many glaciers are still in retreat from the last major ice age. There is a kind of momentum to glacier retreat and glacier advance, and that momentum plays out over centuries.

Second, in some cases there are other factors at play. For example, soot from coal/hydrocarbon combustion settling on glaciers and ice sheets reduces albedo and increases melt rates.

Third, and most importantly, glacial advance/retreat is not just a global phenomen but also a local one. Just as weather is not climate so too individual glacial change is not climate. One glacier retreating does not prove the climate is getting warmer any more than one glacier advancing (of which there are many) would prove the climate was getting colder.

So you can't point to one example and say "ahah! incontrevertible PROOF!" any more than you can tell an anecdote in support of some medical theory and assume that you've proven anything either.
Where I live (*Norway; so this post is based on observations in my own economy), 90% of the income-earning part of the population put their savings into real estate, even though this appears to yield a very poor return on capital. So I don't think this point is nearly as universally accepted as you claim.

Also, this 90% of the income-earning population earn more than enough to save considerable portion of what they earn - I earned less than the average before going to grad school, and I still saved >50% of my post-tax income through economically sensible lifestyle choices (shared housing, cheap car and low car usage, home-cooked meals, low consumption on gadgets). This situation is certainly not identical for everyone in the world, but for my five million fellow countrymen, there is vast room for beneficial changes here. Please refrain from accusing me of being patronizing without asking about the background. This is a discussion of a small part of a big issue; this is one idea of what to do for insurance if e.g. you're a programmer and worried about the future prospects of your profession.

You have a point with regards to the "working poor" and other below-median groups, and this is a very serious structural issue. I have never implied that the solution to poverty is to buy stocks.
You could do closure conversion, but then you run into problems with the lifetimes of things, oh and then you're basically reimplementing lisp.
> Sadly that puts me in the 'climate control denier' category, that is the group of people who believe that humans cannot control what the climate does (good or bad).

How are you able to reach that conclusion? Clearly, the climate on Earth has changed a lot, most of it without our help, and on a magnitude much greater than we have supposedly been able to for the last couple of hundred years.

But that doesn't mean that climate change can't be influenced by human activities. It doesn't mean that releasing a lot of CO2 into the atmosphere can't affect the climate of the planet to a large degree.
> I've been building a library of ScraperJSON definitions for academic publisher sites, and I've converged on some formats that work for a majority of publishers with no modification (because they silently follow undocumented standards like the HighWire metadata). We've got a growing community of volunteers who will keep the definitions up to date for hundreds or thousands of journals. If you also use our scraper definitions for your metadata you'll get all the publishers for free.

My approach has been to use the Zotero translators, since their 200,000 users have been alright at responding to publisher site changes. Unfortunately they are trapped in the Firefox ecosystem until someone converts their translators to generic js. Then Zotero could be a downstream consumer of the same scrapers, but also maybe maintain them as well.

zotero's scrapers: https://github.com/zotero/translators which for example I use for an IRC bot, https://github.com/kanzure/paperbot

Are these yours or are there more somewhere? https://github.com/ContentMine/journal-scrapers

I dunno about a majority following HighWire.. here's a corpus dump of what I've seen (just random debug data from paperbot): http://diyhpl.us/~bryan/papers2/paperbot/publisherhtml.zip

(Only 333 of the 1218 samples have "citation_pdf_url". But this collection is extremely biased towards things that I am reading, rather than a sample of the entire academic spectrum.)
"Democracies can have secrets, and in fact must if they want to achieve their interests."

I can see how certain things can be justifiably kept secret in a democracy, like matters related to national security (military, intelligence, etc.). But secrecy in business and financial regulation is just corruption. Especially when the interests in question are those of private businesses and may not be in the best interests of the country as a whole - and if the deliberations are secret, how can we and our elected representatives decide whose interests are actually being promoted?
The word you mean is "future" not "feature"
> ProductHunt Is Quickly Becoming the Hot New Destination for Sourcing Startup Investment Opportunities

> ...Product Hunt is an excellent sourcing tools for VCs looking to discover little known early stage startups.

If ProductHunt is "quickly becoming the hot new destination for sourcing startup investment opportunities" it cannot also be "an excellent sourcing tools [sic] for VCs looking to discover little known early stage startups." Lack of awareness of startups listed on ProductHunt is inversely correlated with ProductHunt's popularity.
This looks pretty cool. One question though: Is the "Tap again to confirm" button active before the animation ends? For example, what if the user accidentally double taps the delete button?
So, we're going back to indentured servitude by bits and pieces? Progress indeed.
I don't live in the US
As someone who is currently in the midst of dealing with 2 separate (and seemingly completely siloed) departments at the IRS as a result of someone stealing my identity, this scares the crap out of me. I've dutifully and quickly followed each department's instructions, and am hoping with all my might that I'll be 100% in the clear after their 180 day (laughable itself) waiting period, but this just sent a shiver down my spine. Hope I get lucky!
That Tablet on the Restaurant Table Will Make You Spend More
His definition is much closer to "popularity" than to anything I would recognize as "morality".

It's strange to exclude intent from your model when it's an important factor in almost all systems of morality.
Is the F-35 worth it? 7 years behind schedule and $160 billion in the hole
If after 20 years, a student (or the total body of students) has not paid off the cost of college, who pays the difference - the school or the taxpayers?

A program like this makes sense if the school has skin in the game. Ideally, the potential to lose its investment would make the school only extend this offer to students with a realistic chance of breaking even.

On the other hand, if the state extends this to all students without concern for ability to repay, it seems likely to be just another taxpayer subsidy for education - which may be good or bad, but it's not clear why a roundabout method like this is better than a direct tuition discount.
Destruction emplacements militants in Dzhobare left flank 
Destruction emplacements militants in Dzhobare left flank
http://talkingpointsmemo.com uses it
Lessons from NYC’s improperly anonymized taxi logs
I started out with the Zotero translators, but they are really messy and not standardised. Our ultimate goal is to make it trivial for non-programmers to define and maintain journal scrapers. That was going to be extremely hard with the Zotero system. We started over by building a generic declarative scraping system. I also aim to get Zotero to eventually adopt our scraper system and collection.

The stuff in that repo is a proof of principle - we will be growing the collection massively before we demo in mid July.

Thanks for the corpus dump, taking a look now.

edit: I'm not suggesting a majority use HighWire, but that we can have far fewer definitions than publishers. If we include Prism and DC along with some obvious sets of CSS class names, that will already get us pretty far.
Tech industry job ads: Older workers need not apply
>And how will you accomplish this when we have the guns, and you don't?

Well, people who pile on guns for such situations, usually aren't the smartest apples in the orchard, so to speak. So it should be quite easy to take those from them.
By reserving jobs for new or recent grads, tech companies are essentially saying older applicants have no chance. How can that be right?
In addition to resulting in more appetizers and bigger tips, there is this nifty and unexpected detail:

Paying to keep the kids busy. Chili’s offers unlimited games on the tablets for $0.99, and the chain shares this revenue with Ziosk.
My comment has plenty of substance. However the comment I replied to had none and did typical partisan finger pointing and generalizing. How was the substance of the quoted material partisan? Who cares where it comes from as long as it is the truth.
BK meaning Brooklyn definitely completely changes the way I read your post :)
Just myself.

EDIT: The answer to the rest is not generally interesting.
This was posted many times already:

https://hn.algolia.io/#!/story/forever/prefix/0/What%20kind%...
Just going to throw everything out as word vomit, remember that this is a work of iteration. There's tons of advice out there about how to write a resume, but at the end it's a very personal document to write.

Some of my per section recommendations:
Technical Experience
Remove side projects from the header, it's not necessary
Remove KLOCS, instead opt to add descriptions of your experience. Built something you're proud of? talk about it!

Your experience should speak at your capabilities, saying you know linux and git adds nothing but something like "Built a linux console application that utilizes git to achieve *" has more value.

Education:
Trim trim trim, anything before college doesn't matter, unless you have something super awesome to put in. At your level of experience, maybe list some relevant courses or a current GPA if it's really high

Languages: not relevant to your professional experience, so it doesn't belong in your resume

Professional skills: I'm mostly against giving a laundry list as these are mostly shallow. "Responsible"? "Analytic ability" what do they actually mean to the person reading your resume? You have about 1 paragraph worth of space to put something more personal in your resume and those words can be part of that: "A Passionate team-worker with great attention to detail with X amount of experience" Note that even that sounds kind of impersonal.

Other:
Doesn't belong on your resume

References:
Ditto, it's obvious that you have references upon request, why waste space on your resume?

Some general recommendations:
The text on your resume should speak about your RELEVANT professional experience and nothing else. The rest can be represented in a cover letter/interview

Anything more than 1 page is tiresome to read and messy to handle. Don't forget that this is going to pass several hands (hopefully)

Your resume is usually the only thing representing you between a stack of dozens more, it should be informative and interesting enough to get noticed.

Always tailor your resume to the job - Are you applying to a position that requires Java and Linux experience? Show that off and remove your prolog/lisp/asm experience.

Feel free to re-draft for more specifics
You are right. I think it is just I feel guilty.

Thanks.
To me, BK = either Burger King or Bad Kissingen (a town in Germany).

:-)
Can you tell the difference between a Samsung Galaxy S5 and and iPhone 5? If yes, then why isn't the Galaxy series a distinct work with its own sensibility and personality?
This makes me wonder just how open everyday Android phones are to forensic examination. I'm not sure how you would get much out of the phone without either manually installing an app with a lot of permissions or doing some kind of device-specific firmware hack. And the manufacturers often seem to be making this kind of hacking harder and harder, going by what the Android rooting community has experienced.
Advocates of splitting California into six states gathering signatures
You'r right. In a Democracy a secret trade deal could never happen because in a Democracy everything is decided on by its citizens, not elected officials.

However in the United States these decisions are not made by citizens but by elected officials voted in by citizens. Hence the United States is not a Democracy, but a Democratic Republic.
Yea, let's not support cleaning up the oceans because it requires and e-mail address.
They already do plenty of good wine in Walla Walla. Washington has a mild climate, more so on the west side of the Cascades.
True and True. That's why I quoted only a portion of the article and why I checked their source material (the link I put in its place). I originally used it only because it was A#1 on the top of Google when I originally searched for a source.
...like the main media organisations should have already got their investigatory acts together and made wiki leaks irrelevant.

On the whole, the "main media organizations" are an entrenched part of the system they'd need to be reporting on in order to do that job. That's a pretty major "biting the hand that feeds them" sort of impediment.
1) Sure, when talking freelancers / contractors you of course have to account for a ~20% deduction for sickness and vacation. So the base wage increase is often around 100% but compared to a full-time position, it is closer to a 50% increase.

2) It is only unrealistic for freelancers doing many small jobs. Not for contractors with ongoing 40+ hour contracts, of which there is a lot on oDesk. Maybe the confusion is semantics: When I talk of 100% allocation, I mean 160 hours of available work. Over a year, you'd remove 10-20% for vacation and illness, like mentioned above.

Check the work history of the higher rated contractors on oDesk if in doubt about this. There are many doing much more than 160 hours on average.

3) This is certainly not the norm :-) Not a lot of companies are interested in hiring a person a thousand miles away for the same amount of the guy next door. Especially not the type of companies who can afford developers contracting at high-cost market rates i.e. 100-300 USD pr. Hour. Again, if we are nitpicking, there are of course exceptions like especially well known developers or developers who are proven and known to a specific client. Then it's an entirely different story.
I just tried it a couple of times and it appears it is not active while animating, which is good.

EDIT: It appears the method I use disables gestures by default. Semi relevant stack overflow: http://stackoverflow.com/questions/7337363/how-to-recognize-...
Well for one thing, the Executive doesn't make laws - Congress does. The Executive has veto power. Which can't be used if the relevant bill never makes it to the Executive's desk.

The relevant bill hasn't, and I will my hat if it ever comes into existence and reaches the floor.
I have enjoyed http://darkskyapp.com/

In my totally un-scientific opinion weather.com has slowly gotten worse over the past several years. I think it's become a lot hard to monetize weather and the weather service has really stepped up the game on providing public outlets that are digestible by the general public.

My guess is in the early days what weather.com and the weather channel where really doing is translating the difficult to understand NWS messages and helping the general public quickly understand: "Do you I need a rain coat today?". That said over time as NWS has stepped up their public interfaces that value add is sliding backwards and getting harder to maintain.

That's my $0.02CPM worth.. :-)
Secrecy is just incompatible with the democratic process.

People cant do informed choices and elect other people that represent them if the people in power make choices behind close doors.We are not talking about 2 corporations which are negociating something.

So no,"democracies" need no secrets. Or it says a lot about what the people in power think about their constituent.

Secrets protect those who are in power,secrets never protect the people.

Secrecy is therefore totally anti-democratic.