skysight-inc/HackerNews huggingface dataset:
Scott, appreciate the feedback. And I've gotten several pieces of feedback like yours. And, to some extent, I agree with you.

I would never send a note to my grandmother trying to deceive her. Nor will I send these to my family.

But... If I interview with a dozen people over a weekend. I might come out of each interview, and bang out a thank you note on the spot - while the conversation is fresh in my mind.

Or... If I meet with a dozen people at a company I'm selling my product to, I might follow up with individual notes thanking them for their time.

This will never replace the thank you notes you already send - it will simply enable you to send more thank you notes to people who are still deserving.

Again. thanks for the feedback.
Fun! When I saw spherical harmonics I was confused about why spherical harmonics would come into play in a voxel universe (isn't everything flat?). Digging into it a bit I found out more about spherical harmonic lighting: http://www.research.scea.com/gdc2003/spherical-harmonic-ligh...
RE: "whereas Ruby has had decent Unicode support for a while"

Really? I'd love for some examples for where Ruby shines when it comes to Unicode handling when dealing with web content.

I know a lot of work was done in Ruby 1.9+ to bring decent Unicode encoding support to the language, but I still see a good number of complaints/articles about issues with it.

The encoding issues I've run into with python 2 have generally been whatever framework I'm using to ingest the content took a website at face value for encoding: either it wasn't defined at all or it was defined incorrectly.

In the wild wild world of web, unless you're doing intelligent data inspection, you're just going to run into that sort of thing.

In python, that's why projects like this exist: https://github.com/LuminosoInsight/python-ftfy

They let you correct Unicode content that was decoded with the wrong encoding.
Programming for the last 30-something years, and the last 20 mostly in Perl. Every few years I got a job with Java or Python, or something of the sorts, and learned new things, but returned to Perl. Every time I returned to Perl, I noticed that my code style changed, improved, and I felt better about my Perl skills. There was not one point where I thought "let's just leave this behind and go with the new kid on the block".

There was never a point where I felt that Perl won't do the job. In fact, many times I came to replace some complex ball of wax written in some other language with simply written Perl code, and everybody slept better afterwards.

Sure, there are many frameworks, and it seems easier to just write a little glue code on top of that - I always resisted that urge. I write my code as minimalist as possible, with the least amount of includes or dependencies. Things work, and my customers are happy. If there is one thing I am happy about later Perl releases is that they fixed threading and it works now as it should.
I'm an Android user, so I don't know if this is easily doable on iOS, but I sync the Google+ and Facebook profile pictures of my contacts to their entry in my contact list, which covers around 80-90% of anyone who'd call me.
Interesting post. I'd like to think of myself as 'intelligent' - as most of us do - I'm Mensa, I'm a programmer of 30+ years blah blah. I live and breath 'logic'. So take this for what it's worth.

2 is the big one from my perspective. I think it's extremely naive to immediately trust anything coming from mainstream science / medicine these days. GMOs, as an example, demonstrates the inability of some scientists to understand the concept of 'playing with machines they neither understand holistically, nor practically'.

Even 'slightly large' software projects, where the variables are all contained in a highly controlled and observable environment, go horribly wrong. I can't imagine the arrogance you need to mess with nature confidently.

Nature is a complex machine, don't f* around with it unless you a) can create it from scratch b) are absolutely sure what you're doing is not going to affect the machine's surrounding environment. We are far, far away from those necessary understandings. I would think this was obvious, but apparently it's not.

I get the impression that in America I'd be shouted down for saying this.
Federal law and California law have this crime as a max 5 year and max 1 year respectively.

http://www.law.cornell.edu/uscode/text/18/39A

http://law.onecle.com/california/penal/247.5.html

You should have noticed that this individual's sentence was lengthy because of a long history of crime. Not only that, this person was caught doing this particular crime twice.

Your example of driving like an ass can encompass things like Reckless Operation, Racing, Impaired Operation, etc. When you get caught doing these things repeatedly over many years, you see prosecutors demanding maximum sentences, multiple "strike" mandates and penalties reactivated from previous paroled offences, etc.
It seems hard to believe that I will be turning 50 soon, but I am still doing what I have done for the past 30 years or so. Every day I walk to work, get a coffee, fire up emacs, and start working.

Is there a plateau in pay? Sure, but programmers make okay money, so I cannot complain. If I want to work more I can sometimes do consulting work or teach a bit, but generally life is getting too busy for too much of either. I stay where I am because I love running up the steps every day to work, but really I've been happy in almost every job I have ever had.

My career has basically taught me that being a generalist in an age of hyper-specialization makes me very useful. Being able to code in many different languages and environments helps, but so does having domain knowledge in related fields (economics and statistics in my case). Softer skills like writing and public speaking pay for themselves 1,000 times over, as does having a sense of humor and a willingness to share credit and help out when the chips are down.

The older people in my place are doing pretty much the same things that I am doing, but a few a starting to wind down and think about where they want to spend the final days of their careers.

It seems way too early to start looking at my career in retrospect, but really I cannot imagine anything more interesting or worthwhile than the past 30 years have been in programming. It has been an amazing ride with more cool stuff then I ever imagined back when I was typing programs out of Creative Computing on my Apple ][+.
Test this real scrapper framework: https://github.com/hernan604/HTML-Robot-Scraper
agree with spartango. Cancer is extremely complex and any simplistic approach is BS (or a money grab). Staying away from the internet and asking questions directly to the oncologist is usually the best thing to do.
It's even worse than that. I once got pulled over in a small town for a rolling stop, and the officer basically said that I had two options — either he could write me three tickets — one for running a stop sign, one for disregarding a mechanical signal (flashing red light), and one for speeding ("nearly 25" in a 20, he claimed) — that added up to nearly $400 in fines and several points on my license, or else I could agree, right then and there, to show up in person at the county courthouse within 30 days and pay a $100 "fee", that "wasn't a fine", so, while it couldn't be contested, it also wouldn't show up on my driving record.

In other words, if I was willing and able to show up in court, I may as well just agree to pay the $100, because, bullshit speeding ticket aside and regardless of the truth of the matter * , it's sort of pointless to argue in court that, in spite of the officer's testimony, I did, in fact, come to a complete stop — the only way I could have avoided >$100 in fines is if the officer hadn't testified at all, which, without familiarity with the particular jurisdiction or considerable research, isn't a very safe bet, and certainly not one I was willing to make on the side of the road at 3:00am with no time to think it over.

* Truth be told, I may well have roll-stopped, as I was making a right turn at a four-way stop with no other traffic and perfect visibility in a 20MPH zone at 3:00am, and I probably was driving 25 in a 20 at some point, because I don't regularly calibrate my speedometer or watch my speed that closely, and it was one of those small towns where the speed limit drops from 55 to 20 in the course of a few blocks.
He means WordPress.
What is Google search for 
I mean if I'm Do (search) for something
What search engine searches ???
But we've been fucking around with nature for a long time without fully understanding it. In fact a lot of that fucking around has led to us understanding nature better!
Actually, yes, I do tend to disregard claims that "everything is fine" from those who are not being aggrieved.
Why have that law, and then make it legal for the shops to not acknowledge it up front? Why does the law have to be some weird kind of game where only people in the know benefit from it?
Forget the parties. Both sides have statists and anti statists. GOP senators like McCain, graham, are defending Obama on this, while democrats like Wyden, or Udall are aggressively anti nsa.

Feinstein, Pelosi, are super pro-NSA and they represent the most liberal population of the USA (California and San Francisco). Rand Paul who spoke against drones and said "if snowden should go to jail, then Clapper should join him" is from Kentucky. Wyden and Udall are from Oregon and Colorado.

I hate to generalize but it seems politicians from rural states are more pro-snowden, and those from the coast are pro-NSA.
Why Do Airlines Keep 'Black Box' Flight Data Trapped on Planes?
>I wonder why Google donated spare cycles to solve the Rubik's cube when there are problems like Fold.it that could use it for science.

An equally absurd question: Why doesn't google use all of it's man/computing power for science instead of trying to make money from internet ads?
I decided to take a look just because I saw this:

2048 (gabrielecirulli.github.io)
1337 points by frederfred 8 hours ago
So CPython think performance is about politics, but tell you what, it's also about competition. Every new Ruby release has some kind of performance tweak, Rubinius got rid of GIL entirely, Nodejs and V8 is significantly faster than pure Python, Go is one of the fastest.
jeff@jeffknupp.com
Thanks for sharing. I have done something similar as well - getting out of a role that demanded more management from me and into a role that is more hands-on.
I really think Comedy Central should syndicate/distribute/whatever StarTalk. The science is so good and the comedy is like no other. It's such an interesting combination..... http://youtube.com/watch?v=WBQn0nD27nc
Just to put some numbers behind this:

35 CPU years = 35 * 365 = 12,775 CPU days

Let's assume that your standard Google machine has 2 8-core processors, that is 16 cores per machine

12,775 / 16 = 798 machines

800 machines is a lot for your average person, but for a company like Google it is a very small drop in the bucket. And that is assuming you need to do all of the calculations in one day. If you are willing to do the calculations over a month, you only need 26 machines.

Even if "CPU year" applies to one 8-core processor, that still means it is just 26 * 8 = 416 machines, which is a very small number for Google.

And remember, the machines are still doing other things, this is just using idle CPU (generally a plentiful resource for your standard internet giant workload).
Normally I'd agree with you (e.g. I hate Blogspot because they hijack Alt-Left for back also), but in this case I actually liked the arrow keys for voting because they were quick and simple. I voted on probably ~5 screens in just a few seconds and felt really smooth.
Nice. You're on a pay plan? Which one? I assume you got a lot of traffic from HN.

Nice visualization, btw. It actually shows something, unlike a lot of vizzes.
1) Invent a disruptive technology that threatens the foundations of governments and traditional currencies.

2) Upload the idea at a semi-random time in the future, from a random location in a randomly chosen country, over a public network, using a computer bought with cash from a randomly chosen store. Have that computer link to it from as many places as possible.

3) Never speak about it.

-------------

If a highly weight goal of yours is not being found, then you limit your interactions, since you know that you'll leak information whenever you interact with something. And you randomise as many data points as you can think of that someone might correlate with you.

Then again, Satoshi obviously isn't doing 3 - assuming the Satoshi persona is the person who invented it.
me@vladzaharia.com
WRT number 3 (which I agree is the biggie): I've noticed science journalists and outreach folk often place a lot of emphasis on individual discoveries and hypotheses. Sometimes they seem to do this to make it relatable, other times perhaps just because those particular facts are "cool". Other times (usually not in physics) it's an over-eagerness to spread results that, if correct, could genuinely help people, but aren't really properly established yet.

It's easy to get people excited about individual ideas, but it ultimately has the downside that the _majority_ of these ideas will end up in the infinite discard bin.
Ask HN:What did you end up doing after a failed startup
We talk about startups, ideas and making millions. What about the founders whose start up failed. What did you end up doing ?

A. Find a job in a large organization
B. Find a job in a startup
C. Started another venture
D. Moved to Thailand
"Dramatically increase participation and time spent on your sites or apps with Polar."

With pinchzoom disabled, I just want to leave this site. -1
Startup...values?
I disagree. Stupidity does absolve people to some extent. Intent to harm is extremely important.

Would you jail a 2 year old who stabbed someone with a knife because they the poor kid didn't know what they were doing? If someone crashed into someone in a road accident(read "accident", they just fucked up, it happens), how would they like 14 years in prison? Do soldiers get imprisoned when they willingly murder innocent civilians abroad if they get in the way?

I can't accept "if not they will find out how dangerous it is at their sentencing hearing". WTF? We can surely do better than that. This isn't North Korea.

I can't comment on the intents of this dude with the 14 year charge, though.
Aye. Same here...

http://imgur.com/SMRKbPk
Complete time fuck
Why Do Airlines Keep Black-Box Flight Data Trapped On Planes?
How would you respond if theknown99 turns out to be a woman?
In reality I'm not sure what kind of loop would have an index only fitting in an unsigned type.

On a 32-bit machine an unsigned array index means one object using more than half the address space. It's sensible to use unsigned 64-bit for file sizes, but I think it's quite odd that C programers would use it for a loop or array index. Wrong, but defined, behavior is worse than undefined behavior, you know.

On a 64-bit machine, well, it shouldn't be a problem to use signed long long.
Log scale histogram?

Edit:

Actually all you need to store is the highest block achieved, and the number of times it's been hit. For instance, if you've only ever generated 2 8's, then you know that you've had 4 4's, and 8 2's...

Edit 2:
Does the game allow four 2's to cascade into an 8? If so, maybe you could also store combo stats. It'd be way cooler to smash together four 256's than to smash together two 256's two times.

Not sure how that plays into the histogram.
Generally speaking, the cost of scaling beer production is paid once. You need bigger, more expensive brewing equipment (and can't just repurpose mass-produced consumer items like turkey fryers and drink coolers) and the recipes have to be adjusted to the new capacity and setup, but your unit cost is much, much lower.

Surface area doesn't scale linearly with capacity, so both cost and cleaning time actually get _better_ as you scale up. Grain, cleaning supplies, and tools get cheaper as you scale, too.

It also only takes a tiny active culture of something bad to ruin an entire batch of beer. Each vessel, airlock, valve, and spoon is another potential source of contamination, so having fewer things to clean is a Good Thing.
It's not a rationalization at all. Get a job paying well and learn how to do it in 3-6 mos. Now repeat doing said job over and over for 5 years. The person ends up with ~6 mos. experience. I have interviewed these people. The problem is that it is a slow skill drain and by the person realizes they are behind they are often so far behind the level of effort to catch up keeps them stuck.

It is basically innovators dilemma on a personal level. In order to stay growing you have to move on and take risk, but that is hard to do when you can easily do your job and make okay money. Then one day that job is gone.
Also the inestimable pharkmillups, if I correctly read riak-users circa 24 Jan.
As a linguist and computer nerd I can't read articles like this without shouting inside my own head "NLP with no open source code is not NLP!" and then I can never trust the person again, like the author of this... analysis, so even if he's nailed it, and it's really Satoshi, to me it would be just a struck of luck and not a linguistic discovery per se IMHO.
Looks like somebody added -Wswitch-bool just now: http://lists.cs.uiuc.edu/pipermail/cfe-commits/Week-of-Mon-2...
For any benefit you'd get from -mregparm, you'd get a much better one by switching to amd64 already! Or are you having to support Windows?
Pilots don't get distracted by UV or IR, they get distracted by visible light. And glasses that effectively filter out visible light are detrimental to pilot safety for another (obvious) reason.
BTW, how do you know it received ton of flags?
The curious case of the ninjamonkeypiratelaser backdoor
I didn't terribly mind having to use Twitter for signup.

As soon as you asked for my email AS WELL, I could no longer be bothered to click through - the only value of 3rd-party login is not having to give you my email address.
> It's kind of disappointing that developers aren't self-aware enough to understand that they are essentially screwing themselves by not moving quickly in dropping "legacy" support.

I think the part that might be missing from your line of reasoning is context: For professionals and entrepreneurs programming isn't a hobby, it's a business.

The decision to stay with 2.x isn't about not being self-aware. It's about being serious about your business. Business has nothing to do with self-awareness. It would be irresponsible to send your organization down a path that could result in a huge setback.

If you are self-funded this could absolutely kill you. If you are in a competitive environment where time to market is crucial (who isn't) this could kill you. If you have investors who expect you to make responsible decisions, they could kill you.

How are you going to explain the decision to go to 3.x when the fertilizer hits the ventilator and you realize there are three choices in front of you:

1- Redo your entire codebase to migrate down to 2.x.
2- Launch a new project to rewrite the 2.x libraries you need.
This could take one week or one year.
3- Shut it down because you don't have enough cash to deal
with having made the wrong decision.

And, here's the kicker: You won't know until you hit that wall. Sure, you can do an initial dependencies survey. And hope you went deep enough. By definition, you will have no way to check dependencies you don't know about at the start of the project.

The bottom line is that in the context of a real business --not a hobby-- sticking with 2.x is probably the only responsible choice for a huge number of organizations. I really think the Python leaders made a mistake in not coming up with a smooth on-ramp onto the various ideas in 3.x. I do understand that some things need to be broken sometimes. In the real world you can only break so much of a codebase before people avoid it like the plague.

Here's the other reality: The customer doesn't give a damn whether you are using 2.x, 3.x, Python, Lisp, PHP or assembler. They buy your product or use your service because of the value they derive from it. For the vast majority of businesses and customers this has nothing whatsoever to do with the technology choices you make behind the scenes. If this fact isn't obvious, study the history of a number of prominent startups and you'll find support for this idea.

It's easy to fall back on engineering think and forget reality. I do it all the time. Over the years I've become better at avoiding thinking like that. Like wanting to build a product without doing market research and, a year later, finding out the hard way nobody wants it.

I'm not criticizing you here. I am simply pointing out something we all do from time to time.
I don't know if there's anything you can do, except for giving him comfort and maybe pointing him to resources.

As a cancer patient myself (although my prognosis was way better than his and I seem to be recovering just fine after 2 years in remission) I'd tell him to be careful about the way he reads the '35% survival' number. In most cancer studies the groups are defined by the stage of the cancer, which means all patients with, say, 'testicular cancer, non-seminoma stage IIIc (bulky)' will get put together in the same group, independent of age, physical condition, access to excellence centers, psychological conditions, etc. But obviously a healthy 19 year old with a supportive family, access to good doctors and a strong will to live will fare much better than a 60 year old with a compromised immune system and a late diagnosis. That's not even accounting for selection bias (certain cancers happen mostly to people in a certain age range, say 45-60, or 15-30 in the case of testicular cancer) so the average survival rate is even more skewed.

In other words, if he was healthy before the cancer and keeps his morale up, he's got a great chance to be in the 35%! Tell him not to despair. Chemo is a bitch, getting an infection while neutropenic is no joke (I got two pneumonias in a period of 3 months, worst pain ever) and there's every reason to feel like shit. But once it's over, it's like having a new chance at life and it gives you a completely different perspective.

Please feel free to PM me.
Snowden Speaks: NSA Whistleblower Addresses SXSW
Hmm. maybe that's why they had so many issues with single instance Redis & Mongodb? As soon as fsync() the whole db became unresponsive.
Reminds me of the sorts of techniques used in 4/64K demos.
Why not do both: support cursor keys for voting, but leave meta+ key events alone?
I didn't realize that "France", "USA", and "anywhere else" were links until you mentioned so right here. You should make these links distinctive from the rest of the text without the need of having to hover over them so that they are more obvious.
Grasslands soils offer some insurance against climate change | browntexfarms
'Airplane!'?
https://www.youtube.com/watch?v=SmHeP9Sve48
Man this ain't no weather
Androids 'drag from A to B' is a godsend in this regard.
First of all, I wouldn't even know who deGrasse Tyson was if it wasn't for sites like 4chan, reddit and hn. But apparently, he "has the world in his hands."

Secondly, I want to comment on this:

>It’s hard to deny that we live in an era in which science — as both a worldview and as a practice — is under near-constant assault. On the left, there are those who rail against the dangers of GMOs and vaccines. On the right, there are those who deny climate change and the evolution of species."

Just because people are opposed to some applications of science, or skeptical of some scientific theories, doesn't mean science is under assault. Besides, science is defined by its method, so, the only people who could possibly pose any threat to it are the scientists themselves, should they forget this fact.