skysight-inc/HackerNews huggingface dataset:
I really liked the design, but didn't want to do all the integrations etc. I created a similar HTML design for the ones who may want to use it immediately. In addition, I created an tumblr theme and submitted it to tumblr. For details, https://github.com/mertemin/purus
So some social skills and some database skills. That's pretty much the description of every IT job. What's so hard?

Predictive analytics has the possibility to radically transform many industries. This trend of hyping up it's difficulty is a dishonest tactic to inflate salaries. Pretty soon we'll get the fraudalent activities of lawyers and colleges with their accredition requirements if this trend isn't kept in check.
http://www.oneqstn.com - create simple one question surveys with no account needed (20 hours)

http://www.efficientthings.com - social product ranking for the Eco / Green market (12 hours)
Not only irrelevant, but also wrong. We say "LA County" all the time.
I just learnt something nice, thanks
I had to post this because I run into the same problem. And of course there is no support or some kind of warning that this problem exists and how to revert all these duplicate files.
Yes, you said too much already.

There was a "spotify" or music service thing leaked from facebook js code a while back. So what you are saying facebookers will integrate even more closely with spotify. Listen to music in the browser with friends? Yey.
> slightly worse text rendering

Huge, huge understatement. And I have a 2009 MacBook Pro (not a retina one). I just can't imagine how poor Chrome's rendering might be for those poor people who have rMBP...
this.
The db pattern repository is a great idea but there must be a place to discuss or at least be able to list pro and cons, intended usage, and pitfalls.

Just providing a schema and a name for the pattern is a way to get started, but it doesn't tell me why this pattern is a good fit for what I'm trying to achieve.
Would any start ups be interested in having me as in intern mobile developer?
I am a freshman CS major from the midwest looking to ultimately move to the San. Fran. Bay area to work on start ups and get my self in the tech industry. Honestly, my school has a good reputation but I am at a huge disadvantage because of location. My problem is right now I don't have much experience. I have been programming in python and have done a little bit of django for a year or so. I also have worked with javascript, html, and css quite a bit. However, I really either want to do mobile development or web development. I am an android fan and am learning java in class right now. If I focused on Android development, I could actually have taken 2 Java programming classes, and a Android software engineering class by the summer. Of course most of my experience will be coming from what I do on the side. Right now I haven't built any apps yet, but I am working on building a sudoku game with a book.

So my question is, would I be able to get an internship as soon as this summer? I feel like CS students from top Cali schools would be taken first. Also, I am going out there over winter break to network. Any suggestions on how I should accomplish this? Thanks in advance.
GitFM.com – personal recommendations of GitHub projects
>I tend to agree with you that planetary climate trends are not visible within the span of available global temperature data

Uh, we have temperature data available for far longer than 17 years, and it does show a clear warming trend. That is why you had to cherry pick the 17 year interval remember?

WUWT is not a credible source of scientific information or analysis so I'm not going to waste my time reading it. A model from 1988 is hardly relevant: climate science has advanced hugely since then. If scientists though the 1988 models were good enough why have they spent the last 24 years making better models?
C/C++ are necessary for a lot of things, things that Go isn't capable of doing or wouldn't be very good at doing.

Go isn't a systems programming language. They called it that because compared to a language like Python it's closer to the hardware.

A systems language has various properties, like strict memory layout and management control, varying degrees control over code output, being able to bootstrap an OS without depending on a wrapper OS / bootstrap VM / extensive stdlib, etc. Go fails to meet any realistic definition of a systems language.

Go is instead a compiled alterative to VM languages like Java and Python.

Black is not white just because Rob Pike said so. He's a brilliant man but he's always been a bit off to the side in terms of not really being in 'sync' with everybody else. This is just an uncommonly concrete and inarguable example of that.

He himself backed off the 'systems' descriptor when he realized his error.

You're fighting a bogeyman that doesn't exist.

>because C/C++ is so unnecessary for so many projects

People don't really default to C/C++ for anything they shouldn't anymore. They live way higher up the stack by default by FAR.

C is generally only used where appropriate (kernel, embedded, drivers, services like Redis, etc.)

C++ is the province of Microsofties, game developers, database coders, browser implementors, and OKCupid employees. (Mild exaggeration)

I mean seriously.

When was the last time you heard of somebody doing a GUI desktop app or web app in C or C++?

Dropbox is Python, most Ubuntu/Gnome/GTK apps are Mono/C#, most web apps are Java/PHP/Python/Ruby, frontend web code is inescapably JavaScript with their ongoing attempts to shoehorn Node.js onto the server-side. Some weirdos and Perl6 hopefuls even use Perl for their primary language these days.

Node.js is as good an example of the "sidegrades" I mentioned in my original comment, except it's spectacularly awful in so many ways that I have to wonder if it's trying to draw even more uninformed and informed detractors than C++.

So who exactly is using C for everything on the planet? It's a strawman. Nobody does that anymore. People have become comfortable with resorting to higher levels of abstraction as appropriate.

Mostly because of Perl, PHP, Java, Python, and Ruby.

In the end, performance and control either matter or they don't.

If they do matter, you need that last-mile escape hatch that will never-fail.

If they don't, pick something "fast enough" that makes sense for your personal tastes that suits the problem and have a ball.

There will always and forever be a place for languages like Fortran, Ada, C, and C++ even if they themselves might not survive the next century.
Is there any information about this that you can point to? I'd be interested to read up on this.
When a company declares some language X as a replacement for C/C++, X actually becomes replacement, or to be more precise, attracts engineers from some other language L, but C/C++ stays in place :)
Gary McKinnon extradition ruling due today
> I can't agree with this line, but mainly because you're talking about the future. I agree that it probably couldn't be better than it is now, but we can certainly improve it.

Oh, I'm not saying you can't improve it, even in the present. What I mean is "better" in a fundamentally different way. E.g. within the constraints of our existing society, you're always going to have partisanship, etc.
Not as sexy as some of the things you can find on this page, but :
https://github.com/madjar/pyramid_persona/ : a lib to use the persona auth system from mozilla with the pyramid web framework (that is specific !)
Great comment. Do you have any thoughts why it's so hard for Ruby people to create an efficient implementation of Ruby? There are plenty of efficient Common Lisp implementations, and Ruby implementations are nowhere near close to them. This surprises me, because I didn't get an impression that Ruby is so much more expressive (or even more expressive at all) to justify the slowness of Ruby implementations.
You actually do not contradict the author that much. The thing is, the skills that are required are somewhat standard programming and graduate level maths, which narrows down the number of people to graduate level computer scientists. As he mentioned, the data science is NOT JUST application of someone's algorithms to the data, you need to have skills to preprocess the data, be able to use distributed systems for big data, actually know what is going on under the hood, etc. Also, I doubt that the netflix and kaggle competition winners were anyones from anywhere, they probably already had quite a bit of experience with ML.
A little bit off-topic, but in what way(s) is Natwest a "dismal failure of a bank"? I had a Natwest account a few years ago when I was in the UK, and I was happy with it at least in relation to the other bank I had an account with.
"a lot of this stuff is better described as applied statistics"

This is a key insight. Bravo!

To generalize a bit more, most of ML is applied mathematics. Getting a good grounding in the underlying math is the most illuminating step to learning ML (spoken as someone who wasted a lot of time doing other things thanks to an irrational fear of learning mathematics and am still bad at it)

Deep math/stat understanding combined with the engineering bits(like programming, cleaning the data, running clusters) and the communication bits, (like visualization) brings you to (what should be) 'data science' (imvvho ymmv etc etc).

I am still not sure one person can pull it all off-it probably needs a solid team of specialists. But hey 'data scientist' is a hot job description, and so you can't blame people who know bits and pieces (sometimes very small bits and pieces ;) ) calling themselves 'data scientists' or whatever. "Machine Learning for Hackers" and all that jazz. We've seen all this before with "HTML coders" from the nineties.
Basic forms in product design: Hula-Hoop bag from the last Chanel collection
Right, it's less sexy than people think. That was my reaction when taking an Artificial Intelligence class and a Machine Learning class over 10 years ago as an undergrad. I was like, "these are unprincipled hacks". I liked graphics better. There were actual algorithms.

But in college you never get to apply them to real problems. I think if you apply them to real problems you'll have the revelation. Especially when you try other approaches first. But actually applying them requires domain knowledge, data cleaning skills, and programming skills beyond what many people have (certainly myself as an undergraduate).
>Great comment.

Thank you very much.

>Do you have any thoughts why it's so hard for Ruby people to create an efficient implementation of Ruby?

The most concise way I can put it, and frankly this is just a rephrasing of Nutter's original linked post but:

Ruby forces you to carry a lot of dynamic buckets of state and context around and make them accessible and mutable in unpredictable, hard to optimize ways.

Ruby isn't that much more expressive so as to justify its slowness, that was part of the point of my top-level comment. The slowness comes from the ease of use of the expressive power and how "accessible" it is.

Common Lisp is much more powerful, especially at "scale", but it's less accessible and trivial and forces you to be more structured and precise in how you pass around state and access data. Despite that, it still enabled powerful ways of manage conditions/exceptions, continuations, predicate dispatch, etc.

Nutter is really the guy to talk to on the nitty-gritty. I'm just speaking from a differential semantic viewpoint of how it compares to a much faster and more powerful programming language.
http://sunsetter.herokuapp.com/ - a small web app that tells you when the sun will rise or set in a particular direction (when you want to take a picture of the sunset behind Mount Fuji or when something like Manhattanhenge happens in your city)
What scala project would you suggest to 15000 students?
There are more than 15000 students in scala coursera (from the staff of the course announced in the forum) and many of them are perhaps highly skilled. We could design something valuable, do you have any suggestions?

Edited: I would like something collaborative, perhaps something better than the intelligence of insects, some form of IA agents.

Edited: Ay!, I wanted to say AI.
You missed the stats and the math.
Its normal in other countries. I've even seen dedicated field for max age on some russian job boards.
Another problem I see is that we have a snapshot of data from friday. We cannot really link our data back to any of the original OSM data. So if we want to upgrade our dataset, we have to throw everything away that we have and start a new import.

This is the biggest hurdle to overcome, in my experience. A custom data format is typically essential (most location databases arrive as CSVs or XML, which are useless for real-time querying), but imports can take forever.

It's sometimes, counterintuitively, been more worthwhile to concentrate on the performance of importing than of querying; the out-of-the-box query performance you get with (no)SQL often isn't terrible, but your import script usually starts out pretty awful.
This makes a lot of sense to me. Why bother your main DB with a lot of simple "queries" like these when:

1) They're so easy to move out to something else

2) You main DB probably runs on very expensive hardware, unneccessary expensive for things like this. This probably does not need that expensive san backing it. Not all data is created equal.

3) Redis does this faster

4) Redis is simpler

Of course there are some advantages to storing everything in the same DB, but to me, this seems like a good example of "use the right tool for the job". But, I haven't actually tried this in Redis, so what do I know..
Chroma key in Tao Presentations 1.15
Yeah, as he said, no alternative.
Requests for PHP
I graduated 5 years ago with a maxed 2K overdraft. Last year I went to the bank to reduce the limit and the nice lady informed me I hadn't been paying interest the whole time on it, she promised to not to tell.
Yeah, it basically is ... We use osmosis to preparse the data and than just parse the XML ... It is a pain.

I think what we can try is to import the data in the same format they have it in OSM and use smart indexes within the database to issue queries quickly. I think this will be the major investigation when going forward.
I love WCFStorm! We have an enterprise license and I got most devs on the project I'm on to use it to test the webservices we're building. Now I'm working on using it to automate functional testing for our code.
Very into making chiptune (LSDJ), and now using "Piggy Tracker" - a sampler which is based on LSDJ, but which runs on a lot of handhelds, linux, mac and now Rasberry Pi.
Dog - Programming Language for Social Apps
This is a great idea. Too often code review is a hierarchical process in which a single high-up checks that coding standards are being met and nothing more — this, on the other hand, is genuinely useful.

How do you mitigate the fact that it will take an awful lot of time, though? Just by appealing to the idea that it will save time in the future?
The article is somewhat poorly written with the chronology being difficult to follow, but this is what I made of it:

1. the Edublogs team removed the offending post within the 12 hours, thereby complying with the request.

2. apparently ServerBeach took it upon themselves to double check through presumably automated means and detected the file in a Varnish cache (which would be inaccessible to the public)

3. this led to ServerBeach deciding to shut down Edublog's servers on the grounds of non-compliance.

If my interpretation of the jumbled order of events is correct, it's pretty clear ServerBeach is at fault here - it's not illegal to have a copyrighted file on your server; it's illegal to serve that file without proper rights. Their system is flawed.
The science in data science involves testing hypotheses, like anyone following the scientific method would do. It's mandatory for validating ML models.
You know, the word "immigrant" (="maahanmuuttaja" in Finnish) has basically become code for "Somali immigrant". If someone is complaining about immigrants, he means Somalis, and yes, he has good reason to complain.
Les femmes au volant, fini les clichés, les constructeurs l’ont bien compris 
C’est un fait, les femmes sont plus que jamais des conductrices à séduire. Les constructeurs automobiles ne sont pas insensibles à ce phénomène et font tout pour les attirer vers leurs véhicules !
The purpose of the electoral college is to acknowledge the states as mostly-sovereign entities in their own right. This used to be quite important; it remains an issue, though largely a proxy war, today. I don't know whether or not I support the electoral college. I actually quite like liquid democracy, but I'm not yet sold on the system; I have a friend currently working on implementing it and it's interesting to watch him work through its issues. It's one of those things that wouldn't have been feasible in 1800 but is far more feasible today.

Digression aside, the acknowledgement of the states is a neutralization of pure people power. It is the same reason that the Supreme Court is not elected, and executive appointees are not elected. These are things that are intended to be a check against the people. This is also why the tax-exempt status of churches is supposed to depend on the fact that they are to be politically neutral, and why Kennedy's Catholicism was such a hot issue when he ran for office. This is why charities frequently remain neutral in political discourse, why HN was divided on whether a business should be allowed to take sides on a political issue. This is why you're not allowed to discuss who you're voting for, or campaign for a candidate or issue, within a certain radius of a polling station.

Because "one person, one vote" never is. In any group of people larger than approximately 25 and definitely larger than 150, you will never actually get "one person, one vote". You will get political parties, who give you flyers saying "Vote for these 5 dudes, vote yes on A, B, and D, vote no on C and E," and those flyers will be followed to the letter.

It is probably possible to maintain the argument for "one person, one vote" despite all of these reasons not to, of course. I'd like to see the argument made that can account for the problem of demagoguery, the problem of charisma, especially enhanced as it's been by the advent of television. I haven't seen it yet.
I too love Marie Curie and the 1927 Solvay Conference's picture (which sits in my living room for the edification of my kids!)

She's a hero here in France but I don't know about her reputation in the English speaking world.

She was a very amazing person. Born in Poland, she studied secretly for years in her native country, because higher education was not opened to females! Then she moved to Paris to join her sister and continued her education during the day, while tutoring in the evenings to pay for it.

- - -

There was a nice play (in French) that I saw in 1989, called "Les Palmes de monsieur Schutz"

http://fr.wikipedia.org/wiki/Les_Palmes_de_monsieur_Schutz

A movie was later made from the play. I didn't see the movie but hear it's not too bad for that kind of adaptation from scene to screen (and it has cameos from Pierre-Gilles de Gennes and Georges Charpak).
As practicing data scientists have pointed out in this thread, that is the least part of the job. And, really, how hard is it. As icelander points out, it comes down to plugging data into standard algo's.
Replacing WebKit, WebCore and JavaScriptCore frameworks is a bit risky because many system components depend on them. I would replace only inspector files (mostly JavaScript) instead as described in https://gist.github.com/3898054
'As practicing data scientists have pointed out'

The OP and resulting discussion is about whether people calling themselves (or having titles saying) 'data scientists' actually are 'scientists' or know anything about 'data'.

so one guy having a 'data scientist' title and spending his time plugging data into black boxes says very little about what 'the least part of the job' in general is.

If anything your "some social skills and some database skills" is an even poorer description. By that measure, the business analyst next door who can write some SQL scripts is a 'data scientist'. But then otoh, maybe he is, who knows? ;)

Edit: I just noticed you are the "Are there practical applications for proving theorems? It seems like it's the full employment act for pencil pushers." guy.

http://news.ycombinator.com/item?id=4634969

My apologies for replying to your comments. Won't happen again. (beware @jacquesm !)
I'm wondering if they removed it because the definition of a 'page/document' changed to the point where it's no longer a meaningful number. I'm talking about realtime search etc. A shift towards viewing data as being delineated by the information it contains instead of the documents that contain it.
I built among others http://recovermywebsite.com, which can retrieve your page from the Yahoo or Bing cache. It took more like 100-300 hours instead of 10 :)
Sounds interesting — it would definitely be worth a follow-up post if you do manage to get that working!
A bit of stats and a bit of math are not that hard.

Really knowing your stuff in either one of those fields is hard, knowing them very well and knowing enough computer science to apply it all (properly) is more the work of a small team than a single individual.

People like that are rare. There is nothing stopping anybody from calling themselves 'data scientist'. Just like there is nothing stopping anybody from calling themselves software architect or system administrator.

In the end that's just people marketing themselves as good as they know how but that does not mean there isn't a sliding scale between warm body and excellence. I think that is the distinction the article tries to make.
That's a bit of a strawman I think — surely by the logic you're using, the existence of a profit motive would mean that the company was interested only in serving its shareholders and would ignore its consumers? There are plenty of examples of this, but it doesn't mean it's true generally of profit-making companies.
> they scour the landscape, repurpose the most exploitable material, then shove the resulting monstrosities into the faces of an unsuspecting populace.

Not quite the dispassionate analysis I was hoping for...
The original gigaom article was about neophytes (people who only took coursera course) beating out people with much more experience. This has occurred many times on kaggle. All the preprocessing etc. you're talking is not a new thing, a lot of database developers have been doing that for decades (and that's in addition to my original claim that pretty much anyone with a science or engineering degree having those skills as well). As I said elsewhere, this data science is hard meme is just a ploy to inflate salaries (which every career does anyway, so there's nothing particularly sinister about it).
Year?! This problem can be solved in minutes (SVN/Jenkins: svn ls http://.../branches | xargs -l1 copy_project_template ). But another problem arises: CI server become overloaded, so you will need to add more hardware for slave nodes, and spend more time on maintenance of whole setup.
It seems a bit sad that we apparently only can have one woman in science. Why not have two?

I think it's perfectly legitimate to celebrate Marie Curie but at the same time also celebrate Ada Lovelace, and I don't see how the two are in competition.

If we're going down that route, why are we paying so much attention to Alan Turing, who elected him as the man in science? Aren't there other computer pioneers worth celebrating? Well, yes, but talking about Turing doesn't lessen them.

And, for that matter, why do women have to be their own category at all? Why does "Ada Lovelace Day" automatically mean "Woman Day", does that mean that we should also elect one single man to name a day after?
Downvotes? I don't believe it. To that title, I now humbly add: A scientific audience that doesn’t get humour!