skysight-inc/HackerNews huggingface dataset:
So, here's the deal. I've run and hired data science teams.

The first obvious problem is location.

The second obvious problem is money -- you're probably wildly overestimating the value of math, and underestimating the value of knowing your way, in a non-theoretical sense, around the standard ML and nlp tools, and the toolkits that implement them.

Third, I dump all resumes that say mathematics, particularly phd math, unless there is a very strong indication you can code. The problem is this: most data science, in practice, is at least 50% coding / coding type activities. Data is scattered across multiple databases, requires serious cleaning and merging, requires merging external data sources, etc. I also need at least some productization of the output, rather than tossing a hacked-together R/python script with a pile of un-automated db extractions to an engineer.

So I'm faced with a dilemma: if you can't code, where code means talk to multiple databases, extract data from them in a somewhat self-sufficient matter, and deal with a lot of the other tasks, I either have an incredibly unproductive data scientist or I have to dedicate half to 3/4 of an engineer to you, leaving me with a severe negative productivity increase from hiring you, because I don't exactly have too many available engineers.

Now, as I'm sure you'll protest, you can learn all these things! Yes, you may well be able to (though some math people never get particularly competent at them.) However, that's 6-18 months where you'll be pretty unproductive for me, and I need the productivity much sooner than that.

And yes, lots of companies essentially lie about data science jobs, and they're really data engineering / writing data pipelines. I left a former employer after 8 weeks because of this...
From what I understand, there were political consequences to challenging the espionage state, in which Church was marginalized his last term and pushed out. Most of Church's outspoken efforts against the espionage system took place after his 1974 re-election. It's not quite as bad as Otis Pike, but then Church was more powerful -

http://pando.com/2014/02/04/the-first-congressman-to-battle-...
Hi - author here. Completely agree - if you want to make much more complex data graphics, learning the nuts and bolts of d3 is vital. You certainly can't escape that.

But I would add that not everyone wants to make more complex ones. For a lot of needs, 'using a library like this will only get you so far' is often exactly what folks need. Many of us just want to make charts that work really well, and are really simple to use. We grew tired of having to re-implement the same ideas over and over again for new dashboards and reports. Hence this library - a way of simplifying what we've already done, and making it easier to add new features in a principled way.
Sadly people tend to use clickbaity titles. That leads to pointless meta discussion about choice of words.

I agree that I'm probably missing interesting content that is poorly named. But I support moderators / software revertg to original titles.
The post didn't fall in rank because of a title change. Rather, it was flagged by several users, including a moderator, presumably because they felt it was off-topic politics.
View Documents Online with Google Docs
On the Effectiveness of Traffic Analysis Against Tor Networks Using Flow Records [pdf]
I'd also like to add that even if you're not a professional webdev (which I'm not), coding can be an immensely rewarding hobby and recreational pursuit, in addition to providing you with greater general insight into how a lot of everyday technology works.
It was asked here: http://security.stackexchange.com/questions/72434/how-differ...

It's no more secure than using the password everywhere.
The talks are being recorded (I am organizing the conference).
Tcl is pragmatic. I still use it for one-off projects with simple GUIs via Tk. I get grief from co-workers for the language, but my projects are typically done and correctly functioning in a fraction of the time it takes our Java and C# devs to even prototype a utility.

Below is a walkthrough of Tk which compares identical implementations of examples in Pearl, Ruby, Python, and Tcl. See if you can spot which of the scripting languages are more concise. Hell, I'd even call Tcl more readable in most of the cases:

http://www.tkdocs.com/tutorial/

Kudos to the author of Tänzer for doing his part to keep the oft-overlooked Tcl alive.
I just wrote this as a response to the BBC article:

https://thoughtstreams.io/higgins/thoughts/6764/

Twitter's self immolation

I just read BBC's article about Twitter not being able to make a profit. It's the classic 'investor story time' narrative where Twitter now have to scramble to make money via whatever means necessary - even if that means harming the product. Example of harm recently are:

• Many spinoff projects not related to Twitter, like Music, Flight, and a myriad of other, quite splintered attempts at adding new features.

• ADs getting more aggressive; instead of a simple injected AD in the timeline - now we have newsletters and 'sign up' with the email you have registered with Twitter. Twitter cards are also being used to show rich media for 'partnered' brands. A far cry from small, polite injected ADs. Very few people make time for watching video in a Twitter reading session.

• A constantly shifting API that developers cannot trust, and have to relearn constantly. On top of sunsetted in-house features. Remember Twitter Anywhere? I feel like Twitter Widgets will vanish over-night and without much warning too. It turns out; I rely on these solutions very heavily. The 'very little adoption' argument is used to sunset these features, and it's a terrible argument, because it destroys webs of trust with developers.

What Twitter must realize is that Twitter is plumbing. I know that microblogging existed before it, and there are countless (better) alternatives like app.net - but things like app.net are geek toys just like Diaspora. Sure - the greybeard hackers love services like that - but it's not especially for the masses, and also services like Diaspora/ADN will never achieve the status of 'plumbing' (despite app.net's tagline as a platform for Apps.). Twitter got there first, and they must realize this.

So Twitter should give us back the API we all grew to love, and not deprecate it to impress investors. It needs an eco system. It's what made Twitter take off in the first place. When I first joined Twitter in 2007; it was classic bottom up technology, built by the people and the API evangelists. The recent bait-and-switch to 'consumer product' annoyed a lot of people. It's time to see whether Twitter can do another bait-and-switch and go back to its roots.

If they manage to achieve this bait-and-switch - it will be monumental. It will be big news. And I will not be muting Twitter in my timeline for it.
The Symbols of Signature Marks
That is a cool idea because the spreadsheets are probably not backed up so you have no reference to compare it to. This is not exactly the case in the markets. For instance when I send my order into NASDAQ, I get an order accept message back that includes all the parameters in the original order message. If you artificially cancel my order when I think the order should have executed immediately or been posted to the book, I'll notice that and call the exchange trade desk to ask wtf happened. For displayed, non-IOC orders I'll also see my order in the market data feed. When I get an execution the price of the execution should match (or improve) the price of my order. I'll also see copies of all these orders and executions in the DROP copy from my clearing firm. In other words there are a lot of places to insert your own surveillance to make sure your trading is happening the way you expect it to, and many firms already have such surveillance schemes in place because 1) regulatory requirements and 2) software has bugs and sometimes things break.

* This is all re US equity markets because that's my area of expertise. Maybe it's different on other electronic venues.
It would be easier than SoMa to commute by car from the South Bay. But it still wouldn't exactly be "readily accessible" from anywhere south of Millbrae...
i love the new "?."
similar to coffeescript. definitely make our lives easier.
Well you're moving faster than all of the major banks in America. All of the top 5 or so banks that I checked don't bother with HSTS.
This is awesome! Thanks for sharing. Can't wait for Eigenvalues to be covered! Shameless plug: I created a similar visualization for explaining Monte Carlo simulations by computing Pi. http://montepie.herokuapp.com/
When speaking of dash, one usually means 'Debian Almquist SHell'. [In the context: 'dash is now available on iOS' to make it abundantly clear]
The most important Internet law was written in 1934
The US is a very large, highly regulated, highly taxed welfare state, in which the total government system spends roughly 40% of the economy (that's about as far from the structure of spending that a Capitalist government would have as you can get). It hasn't been a Capitalist nation in a very long time. 30 or 40 years ago, it might have been a mixed economy. Regulations and the breadth of taxes have grown substantially since the early 1970s.
> And parts of it are just so horribly over-engineered it is scary, because it makes me wonder what it is they're missing to think it was necessary to make things that convoluted, and what they're missing because they've made it so convoluted.

So the source code for Amazon Web Services is clearly architected, free of cruft and under-/over-engineering? I assume you've worked with AWS's source code in order to be able to make such a comparison. In my experience, the design and architecture of closed-source internal applications delivered to customers only as a front-end is usually a nightmare.
Curious what your team thought was a good exit and what your definition of win handsomely is. For me, I'm at a startup where I gave up 75k-100k in salary for the first 2 years. Owning 1.5% of the company, <20M exits only make sense the first 6-8 months. At 2 years, I would have done much better elsewhere.
It all looks really promising. Love it.

I'm a little worried about "nameof" in the hand of amateur programmers though. Efficiency aside (because it's not efficient), code readability might take a hit.
Because you can MURDER it.
If you think that way, then C# left you behind a long time ago. Because if functions had no place in C#, then there would be no static classes in the first place. The static class is nothing more papering over object oriented bureaucracy that "everything is an object" to provide functions. And using a static class as a namespace furthers that.

I get that the CLR expects a certain way of implementing things. But your own example of Lambdas are an excellent example of how we can use syntax to overcome bureaucracy in the runtime, or else we would be stuck in Java land with anonymous classes implementing interfaces.

Ultimately, it's all sugar. If a static method of a static class can be made to look like a function in calling code, then it makes sense to make it look like a function in the definition.
Show HN: Provably Fair Algorithms for Sharing Rent, Goods, and Credit
Yes, but my point is that ads in the empty space around the central feed would not be "overwhelming" to anyone except chronic complainers.

Ad blocking is a problem for all ad-supported web sites. There are heavy-handed ways to thwart it, and I personally wouldn't mind if Twitter used such tactics — Twitter is a valuable service and I don't have any objection to them making money to keep the lights on and making a ton of profit on top.
I rarely see the deeper meanings that people claim are in these stories . . . I highly doubt many are put there deliberately. However, I do find it interesting what meanings people find. In the first instance, it is an interesting commentary on the way their minds work, but also, it is fascinating how ideas and new lines if thinking can be generated from truly unrelated material (which, in my opinion, is usually a good thing as long as you don't claim those ideas were put there by some sort of conspiracy).
You asserted that they get subsidies. The subsidies turned out to be largely a) (1) not double taxing them, and b) (3) a tax code clarification that exploration costs are valid expenses.

If you want to establish that oil gets subsidies, please be specific about what they are so that I can learn more about them and confirm it is not simply a case of "something everyone gets".
Agreed, I hardly ever used auto-implemented properties for that reason. But, Is the backing field for a read-only auto-property still readonly (i.e. only assignable from within a constructor body)?
Very glad to help. :D For those reading this, the best URL is https://github.com/18F/tls-standards/blob/master/configurati..., which is heavily based on the nginx config I maintain personally at https://gist.github.com/konklone/6532544
The Secret to Evaluating Tech Startups
Hi - one of the authors here (Dygraphs is fantastic, btw!)

We've talked about this quite a bit internally (nothing formalized in a github issue), and are still figuring out how we want to handle it, if we want to.
Yes, it has. No it does not do the same kind of population monitoring.

Brazilian budget is much more transparent than the US, and the Brazilian ABIN does not have enough physical space, energy, and staffing to pull out a NSA-like "let's gather dirty about everybody" initiative.
How to launch tomorrow
You could also try virtualenvs inside Debian packages:

https://github.com/spotify/dh-virtualenv

One reason to keep virtualenvs is that the system Python (VM or container) includes extra Python packages that your app may or may not need. If you use a virtualenv, you exclude these system-installed packages and guarantee a clean starting point.
Looks like it'll be in the ball pack of 100 PetaFLOPS (~97.7 PFLOPS). Which should triple the Tianhe-2 (current #1) in computing power.
Replace "level playing field" with "low barrier to entry". Basicay I think that the markets should be distorted to a small extent to create a "free layer" for people and companies to get started and have safety nets etc.
+1. Have a couple of nice ideas on the new things I'm learning e.g. matrices, page rank etc. and I would love to contribute visualizations!
VCs Start to Swarm on Drone Deals
That's not true. If you look at http://kangax.github.io/compat-table/es6/ you'll see IE11 preview (their "canary") has more green than any other browser including Chrome or Firefox. Yes, even more than Firefox nightly or Chrome canary.
His innocence "wasn't decided upon"?

Per the 2012 appellate court decision that freed him, "his conduct did not constitute an offense under either statute" for which he was charged. It's hard to find a clearer statement of innocence than that -- which is why the judge ordered that his conviction be reversed, and that he be immediately released.
Is it safe to use SPDY implementation at that point? I've seen critical flaws in the past...
you explained the concepts very well...I am especially impressed with the way you effectively used animation to bring the concepts to life.
I would like to know what tools you used to create the analytics (R language?) and visualization(D3.js?).
Do you have to encourage your colleagues to use it? I've enabled HTTPS on all our sites yet when the links are distributed they are the typical HTTP.

I partially blame apps like word and Gmail. When you type in www into a Word document, for example, it will convert it to a link without the https. I've enabled some of our servers to automatically redirect to https but when you are working with a few dozen web servers it gets cumbersome.
> Do you know a Brazilian company that has the knowhow to face Amazon/Microsoft though?

Doesn't matter if there are contracts or laws forbidding doing business with American entities.

Even if they can't compete at first, though, this gives them impetus to learn.
I knew I'd seen that somewhere before, good call. There's a lot of things in coffeescript I'd love to see in other languages.
Tcl was at the core of StoryServer (aka Vignette, aka OpenText) - a Web Content Management System. Some large enterprises were (maybe still are) running their Web sites on StoryServer 4.2 (Tcl) until a few years ago. It was certainly quite popular in early 2000. Then StoryServer was renamed to Vignette, then they added ASP support, after that JSP, after that outsourced everything and that was the end of it. An elegant, small and fast engine turned into a mountain of jar files and APIs that take 200 man/hours to add 2+2.

Tcl is a beautiful language, very easy to learn and very powerful. I remember reading an article by the creator of Tcl where he was amazed that Tcl is used in very different way from what he envisioned. He meant to have Tcl as a glue, high level logic layer, while low level performance-critial stuff would be done in C. That is why Tcl (1) has great support for C and (2) has ugly way of doing arithmetic (e.g. [expr $x + 1]). Truth is that Tcl was never meant to add numbers. But instead people started writing all kinds of software in it, that went far beyond glue layer.

Anyways, yet another great forgotten language.
When did I say I couldn't code?

When did I say that I wasn't comfortable munging data from various sources?

I don't know the source of the chip on your shoulder. I have no idea who you think you're responding to when you read my post above, but it isn't me.
A friend told me the other day that only "static" scenes really work, where you stay in one place. And when the player starts to "move around" the lag causes nauseousness. Is this true?
Seriously, "one usually means"? I could see that phrase being applied to the meaning of "dash" as the punctuation mark, or "run fast," but an obscure UNIX shell only used in a couple of Linux distributions? I hope that was a joke.
The Vampire Diaries Season 06 Episode
Fulltext: https://pdf.yt/d/dr3uP9XOtT1BPimU / https://dl.dropboxusercontent.com/u/5317066/2014-yolken.pdf / http://libgen.org/scimag7/10.1073/pnas.1418895111.pdf
Ask HN: What stack would you pick in 2014?
fellow HNers,

In my forever quest of keeping up to speed and for the sake of having a pulse on the community, what stack would you pick (backend, frontend, databases, server..) today given the variety available in each?

Thanks!
VR didn't take off until now because the right convergence of other technologies hadn't been reached yet. The smart phone explosion lead to cheap, high resolution displays, much like the popularity of the Wii brought the price of gyroscopic sensors down. Graphics hardware also became powerful enough to render scenes twice and reverse the fisheye effect of the cheap lenses used in the Oculus, which in my opinion was the real light bulb moment for the project. The value and application of VR has been obvious for decades, but the previous attempts were hampered by some serious technological limitations.
Looks amazing and fun, thanks for sharing! Please post if they are ever going on sale or kickstarting as I'd love to have one.
They don't have to trust them entirely. They just have to trust them more than they trust us.

Honestly, I'm not sure I blame them. At this point, I'm not even sure I trust us to do the right thing and I live here.
It doesn't seem to have any Apple documentation, which is a common use case for Dash.
Privacy is the new killer app
I grew up reading SciFi in both Mandarin and English. In my impression, though not flawless, this series is the only long-form novel produced in China that can stand among the best SciFi literature in the west.

It deserves to reach a larger audience :)
I really don't think .gov cares all that much.

Over a year ago, I came across a vulnerable .gov site that was first reported in a news.com article from 2005! Sadly, it's still vulnerable today. The author of the original piece states they contacted the Department of Labor back in '05, who responded that they were 'working to address the issue.' Before I wrote the blogpost, I tried getting some attention too, but never got a response. It's now been 9 years, and the site is still vulnerable.

http://jarmoc.com/blog/2013/10/14/open-redirect-in-gov-for-e...

.gov sites are littered with trivial vulns that never seem to get addressed when reported. HTTPS is great and all, but it's far from the only thing that needs to be done in .gov.
Howdy - one of the authors here. I believe to my knowledge the only thing that requires bootstrap.js is the popover stuff, which we plan to decouple anyway.

Make an issue on github and we'll get to it soon: https://github.com/mozilla/metrics-graphics/issues
The author sees other languages and frameworks as implementation details and wants developers to get rid of them and actually define solutions to problems. What he misses is, that these technologies are actually the language you use to define solutions.

He argues, that his tool uses a declarative style to define the solution. There are other solutions which do the same. (lordbusiness already provided the xkcd, so i will skip this.) In my experience, declarative is great when it works, until you grow out of it and have to fight it.

I already wanted to comment something like that on the first thread he started but hesitated. With a linkbaiting title like this I feel they finally deserved it :)
Jolla: Something BIG is about to begin
Ask HN: Washington DC Internships
Does anyone have any suggestions for programming internships in Washington DC?
I wonder how string interpolation interacts with translation though? I thought the whole idea of the numbered placeholders was so that you could translate the string and rearrange them for different languages. Now do your translators have to be careful not to break your code if they're editing it as part of the string?
It's true: everything you don't already intuitively understand is just a prank, and everyone who claims to get it is either a trickster or a mark. Isn't it fortunate that you already know everything worth knowing!

How are your Blub projects going these days?
This does look like where they are generating the mouseover/highlight regions for the multi-line graphs. And the highlight regions for the scatterplot are being done here
https://github.com/mozilla/metrics-graphics/blob/master/js/m...

For both they are using D3's built-in voronoi function which will generate the appropriate interaction regions when given a list of points. These polygonal regions surround the given points and fill the graph, acting as large unmissable mouseover targets instead of the tiny points. It's really useful.
https://github.com/mbostock/d3/wiki/Voronoi-Geom

More on voronoi tessalation
http://en.wikipedia.org/wiki/Voronoi_diagram
Ideally that'd move into the standard suite and you'd have to do something like compile with --repeat-the-mistakes-of-c to skip it.

I've noticed most of the intention error punts in dense code where it looked like someone got tired of repeating checks and only checked the errors which happened while they were working. I'd bet a read-before-overwrite policy on _ would catch mostly infrequent environmental failures (i.e. the kind of stuff which only breaks when you're out of space, file handles, etc.).
I am totally going to buy one of those when it becomes available.
You can use the memstick image to boot and check hardware without installing.
Interesting approach. Could be a use case for the ByteBuddy library at http://bytebuddy.net
Don't be fooled! I doubt the many developers of third party clients were happy to be surprise informed overnight that their apps would all be banned or limited to 100k users.
CCA?
Somehow related, i reminds me about this article:

http://www.telegraph.co.uk/news/worldnews/europe/france/8554...
Review Board isn't as good as it could be. Sometimes it's diffing tool provides far too much noise to be useful.