skysight-inc/HackerNews huggingface dataset:
That's just the original it is based off. There are a few more recently updated forks floating around also. We maintain ours in house.

Either way, if you want to tinker with opensshd I can recommend it as a starting point. It's very small, readable and easily tweaked.
Process of shipping side projects
At our current growth rate, Backblaze deploys a little over one Vault each month.

That's a full rack of storage pods a workday. Some back-of-the-envelope math says that's almost a tractor-trailer worth of hardware a month. Wow.
high entropy in information theory is as much information per unit as possible as I understand it, but I confess I had to look it up to make sure :) I think the confusion is from physics where entropy is more about disorder

http://en.wikipedia.org/wiki/Entropy_%28information_theory%2...
To an outside observer, no. The tropes are exaggerations. But to someone in public school at the time, it can certainly feel that way.
It might employ programmers by people who are not.
For disaster recovery Nearline's speed restriction can be prohibitive. Not everyone can afford to wait 3 days for their backups to download.
Baobab: A JavaScript data tree supporting Om-style cursors, with React mixins
> I think the difference there that goth is a subculture, while tech and software development is a job.

And here I think is the crux of the problem; it's what the article was about. Tech became mainstream, and attracted people who look at it as a job. From the point of view of us native nerds, we became colonized and are being pushed back from the thing we built as our little place in the universe where we would feel safe from the society calling us "weirdos". It's not just a clash of cultures, it feels like an invasion - contemporary tech industry is not the place it used to be. As a native tech nerd I honestly feel threatened by it.
I do. The falsetto scream is indistinguishable up until the kids hit puberty. Boys don't use their falsetto as much as they socialize with other boys.
The information on the Equations Group/TAO are coming from Kaspersky Labs via Ars Technica. They are unaffiliated with Snowden/Greewald/et al.

The leaks from Snowden that I've read thus far they do not mention anything about what TAO does. They are hinted at as the "big guns" you go talk to when you have actionable intelligence.
I can't believe you made a 1.38 hour long video for this post - how long did it take you to come up with the idea and then create all the content?
We have been using this bug tracking software for a couple weeks now, and it is really great! Much simpler than any other program I have used before, and perfect for communicating with the entire team!
Fail fail fail
Safari doesn't support navigation timing api, you are not comparing apples with apples, just showing off the failings in your analytics provider.
> the last excuse for not using self-hosted, secure backup tools like Arq[1] disappears.

Hardly. I pay for support. I pay for liability. If something goes haywire with my backups, I have a phone number I can call. A number that's not software developer/ sys admin who has no idea why I'm calling about my mom's missing holiday photos.
Except for the Glacier retrieval fees which can be insane if you choose to retrieve more than 0.17% of your stored data per day.

https://aws.amazon.com/glacier/faqs/#How_much_data_can_I_ret...
> But if the tests were getting harder, and the average score was steady at 100, people must have been getting better at them. It would seem they were getting more intelligent.

But the average score of IQ is 100 by definition. It doesn't matter whether the test is hard or easy, since the score system is determined by the average performance of people on the test. So even if a test was nearly impossible and nobody got more than 2-3 questions right, the average result would still be 100, because the points would be computed accordingly.
Despite the plethora of Docker articles here on HN, I haven't paid much attention to containers. Reading this article, I get the impression that they occupy a niche somewhere between a chroot jail and a VM.

The question is, how to deploy an application in this kind of environment? Maybe I build a minimal container and find that a DBMS works fine until it does something like dlopen("/usr/lib/libxml2.so"). Oops, rebuild the container with another library and try again.

After fixing one of the broken links in the blog post, I found this article, which describes an Oracle container:

http://rhelblog.redhat.com/2014/10/29/containerizing-databas...
Glacier pricing is surprisingly complicated, and the actual cost can be much higher than $0.01 per GB-month if you don't read the fine print.

The biggest gotcha is that you can only access 0.17% of the data you've stored in any given day without extra charges. So if you've stored 1000 GB, you can only access 1.7 GB per day for free.

The cost for going over your daily "retrieval allowance" can be large, because cost is driven by "peak retrieval rate". They find the highest hourly retrieval rate over the entire month, and charge the whole month's retrieval at the peak rate.

This can get expensive fast. Again, with 1000 GB stored, if you retrieve 200 GB over the course of 4 hours, your hourly retrieval rate is 200 GB / 4 hours = 50 GB per hour. Your free retrieval allowance is 1.7 GB per day / 24 hours = 0.07 GB / hour. So your excess retrieval is 49.93 GB per hour.

Amazingly, that 49.93 GB per hour for 4 hours is charged for all 720 hours in the month, so that's 49.93 * 720 * 0.01 = $359.49.

That's an astonishing $1.79 per GB just to retrieve one-fifth of the data from Glacier storage.

So Glacier only makes sense for true cold storage, where you are very unlikely to touch more than 0.00007 of it in any given hour.

Google's Nearline is much simpler and faster for the same storage cost -- and far cheaper if you need to access more than a tiny fraction of the data.

Source: http://aws.amazon.com/glacier/faqs/#How_much_data_can_I_retr...
One of the reasons I hate traditional media.

Articles generally get built around a story such as what we see here, leading with a human-directed hook, and then proceeding to build up the human backstory - even when it's only vaguely related to the actual topic. In this case I skimmed past maybe half the article as useless fluff.
I'm considering switching from Backblaze to Arq to backup personal files (photos, etc.) from my rMBP. Anybody have any experience doing this and can recommend one vs. the other? I have a 500GB drive, probably only 300GB to backup. Backblaze is only $5/month, and let's you encrypt, so I'm wondering if it's even worth switching.
I guess it depends on the work the code is supposed to do. There's the proximate business problem for which the code provides an answer and then there are all the other business problems which a piece of code might create despite solving the proximate business problem.

There's a business case for optimizing on each...and one for everything in between.
VIP: Finding Important People in Images [pdf]
I'm not surprised readable is so highly ranked, nor do I disagree that it should be. I am however somewhat surprised that SOLID doesn't have a higher representation. I find that in general, as long as you keep code clarity and readability sacred, you can write testable code by following the SOLID principles. Seems to me it provides the basis of 'good code'.
At least with Glacier I get the option of retrieving faster. Nearline is going to take more than 3 DAYS to retrieve my data if I only have 1TB stored (3MB/s).
The scope of these activities, especially when combined with the NSA's (and GCHQ's) indiscriminate "hack everything" attitude. When the NSA attacks so much infrastructure - including standards they are supposed to be supporting - at some point they start creating a reasonable doubt about the true actors behind any network attack.

This could have various consequences, but one obvious one is how it affects a jury. It would probably be a lot easier to conclude there is a reasonable doubt the accused did not commit some type of computer or network crime when the NSA is attacking so much infrastructure. If the NSA was known to be targeting legitimate targets with limited, targeted activities that did not affect everybody else, the doubt that any random computer crime could have been the NSA's responsibility would not be reasonable.
This would seem to echo Hastings' Netflix culture slide deck published in 2009[1]. It's worth reading even if you disagree. The deck was the first time I had heard of a major company having a "no vacation tracking" policy. It was presented in the same context as the HR manual. The policy of having no policies is built on employee trust. Employee trust is built on the standard of only hiring top quality employees.

I've never worked for Netflix or any other company willing to make such bold statements so can't speak to the reality. It would be interesting to read a first-hand account from someone who has been at Netflix since the time such non-policies were enacted. At the time, it sounded like a fantastic experiment. I would love to see the results.

1. http://www.slideshare.net/reed2001/culture-1798664
Civil liberties groups file suit against NSA
I see. So if it tries to run and gets revoked, you're screwed until Apple comes back up. But in theory, if you had been in airplane mode the whole time this incident has been going on, you'd be fine?
Is Differential Privacy practical? (2013)
Replace "company" with "tech industry" and it's exactly what happened.
Yesterday's legit NSA operation and toolkit is tomorrow's cybercrime and hacking toolkits.
"Some of the first US presidents would argue this government is in huge breach of its original contract with its people."

I've never heard this argument made in a way that wasn't ahistorical, irrelevant, or both.

I also have no interest in revering people who lived centuries ago, as though they had the answers and we just have to follow their golden path--what they got right, great, let's go with it, but what they got wrong, let's ditch without sentimentality.

Governments are for the living--for us, not for some ancestor-worship.
There is no such thing as a linux user land. So no, the only thing you can count on is the kernel.
I'm interrested in bioinformatics. I would like to know where should I begin ? Should I take learn the basic of biology before starting or should I approach it with informatic first (like rosalind appear to be)? Is this link a good starting point ?

Thanks. (I hope it's not too much off-topic)
Studying Dwarf Planet Ceres: Q&A with Dawn Scientist Chris Russell
Just a correction: the city name is Sao Paulo with a 'u'. It has the tilde at São but if you don't want to you can omit it. The thing is that Paolo with an 'o' isn't a Portuguese name (it's Italian). In English it's written like in Portuguese. I see it sometimes so I just got in the habit of reminding people, wasn't calling you out, just trying to prevent future mistakes like that.
Your comment leaves some context to be desired. Are you disgusted or impressed?
It's an odd definition of personal privilege you have, where the privileged person suffers two years of harassment and abuse, and the person without privilege immediately returns to a lucrative career.

It's also an odd definition of professional victim, where publicly being a 'victim' results in you getting booted out of the profession.

I don't want to comment on the event itself here -- but I think that the aftermath, and the continued reaction to it, say a lot of sad things about the tech community.
I don't think we need to go off on the tangent of fake vs. real democracy here.

It is widely and correctly agreed that the "best" democracies have a combination of characteristics, including elections (so you can throw the bums out), personal liberties of the social kind, economic liberties, rule of law, etc. But it is fiercely debated -- to an extent irrelevant to this thread -- exactly which characteristics are most important, what constitutes having such a characteristic to excess, etc.
It has a scene in it where recruits are approached using a cross-word puzzle in a newspaper followed up by a much tougher test.
Super impressed! Sorry for being unclear!
I've worked with ciphers before so I'm familiar with the concept. Coming up with the application was easy and short, but making a write-up / documentation was the time consuming part.

The write-up took about two hours which I then used as a script for my video. The video took 1.38 hours not because I was slow to explain things, but it was just a lengthy topic.

Let me know if you have further questions!
Yev from Backblaze here -> Fair point! Our costs keep decreasing as well -> https://www.backblaze.com/blog/150-petabytes-of-cloud-storag... and we're able to grow quickly (https://www.backblaze.com/blog/vault-cloud-storage-architect... ), so even if avg. user size goes up, decreasing costs make up for it overall.
Intermediate Japanese Grammar
Backblaze lets you add a personal encryption key. I guess they could log that key when you try to decrypt and restore, although I trust they don't. I suppose the NSA probably gets the key when it gets transmitted, but I don't really care. Am I missing something here? If Backblaze's encryption implementation is substantially worse, I may switch.
Thanks for getting things cleared up :-)
Full Stack Developer | Toronto, Canada | Cossette

ROLE DESCRIPTION:

The Full Stack Developer will build incredible digital experiences for our clients, leveraging current and emerging technologies to bring those experiences to desktops, devices and displays. This role will report into to the Director of Strategic Technology.

Required Experience:

• Comfortable with HTML, JavaScript and CSS and have experience with some modern web frameworks. (Whether its Rails, Grails, Sails, Angular, Express or Hapi; the most important thing is that you love what you do, you test what you do, and you do it well)

• Experience with relational databases like MySQL or Postgres, and NoSQL databases like Mongo or Cassandra.

• Experience integrating with third-party APIs, systems and developing RESTful services

• Version control and issue tracking (We use GitHub)

• Experience working closely with creative teams and a believer in the Art/Copy/Code model

• Able to produce rapid prototypes, proof of concepts and production ready applications equally well

• Experience with continuous deployment, cloud based environments and general DevOps tools is a definite plus

• Mobile development experience or an interest in mobile development is a plus

Qualifications:

• A GitHub account with some code in it

• Some URL’s or Apps we can see

Email: joe.dee@cossette.com
That is of course a very stupid behaviour of such company - by letting someone go because of SE rankings or DDoS attacks of angry, misguided crowd, you're just showing that this is a great way to influence you. So the next time the misguided crowd wants you to fire someone? They'll find something to get themselves offended about, get angry and DDoS you.
No worries, I was just trying to get a gauge. While I'll allow him to concrete this, a video that long would like take a 8-12 hour investment building the content along with the video and editing. Interestingly enough there would have been additional time involved with transcribing that into the blog post.
Orrrrr it brings him into line with appropriate workplace expectations in a world not dominated by dudes.
There are program tiers for all types (cost, years of experience, already-netoworked folks, lifestyle, specialization, etc.) With the abundance of variety, generalizations about opportunity cost don't hold up as well.

My understanding's that you don't just "learn a handful of concepts and words," though some go to b-school for the stamp.
I didn't just say "vote." I said, "get involved."

In the sense that I'm saying, be a part of the democratic governance process, yes, that is a definition the government would put out there, but I'm not saying, "toe the line and choose between a big mac and a quarter pounder," I'm saying, "work to make the world you want."

I want to live in a country with a democratically-selected government, not one with a government instilled by revolution (and definitely not one without any government at all), so being involved and involving my fellow citizens is my tool of preference.
Bitcoin Default Swaps: Blythe Masters Joins Bitcoin Startup
Yev from Backblaze here -> We're VERY proud of our datacenter techs, and you'd hear more about them if they weren't so shy. It IS a monumental achievement though, considering that a few years ago we only had two guys running our entire farm.
I can really only speak for the guys, but certainly at my school it was very much like that. Broadly speaking, sports, smokes, geeks, money. They each had their own click and hung around well defined areas during lunch and recess for obvious reasons.
failing off and on it seems. 5 minutes ago it was working for me, now it's failing every time.

Surprised to see Microsoft having issues on a blog _(don't mean that in a snarky way, just commenting)_
> IMO the biggest tragedy is Mozilla's unwillingness to put other languages in the browser. Dart was developed in public, far more of an open standard than the original JS, fixed language design problems that ES6 still isn't addressing, had an adequate approach to running in JS-only browsers, and would have added much less complexity to browser implementation (the reason given for rejection) than many standards that Mozilla has been happy to support.

It's also Google's failure to exploit their market position. Instead of using Dartium, they should've just integrated the Dart VM into mainline Chrome and began paying web developers to use Dart. Mozilla would then have no choice but to implement Dart or find their users complaining about not being able to access their favorite websites.

On a similar note, it's kind of a shame that IE's support for VBScript never took off. Not because VBScript was a good language, but because it would've laid down a precedent for the web being a multi-language environment. Browser vendors would have developed pluggable scripting architectures to compete. Imagine if, say, every browser on Windows could have allow scripts written in, for example, everything offered by Windows Script Host (and I'm sure some equivalent architecture would have been developed for Mac and Linux -- maybe even something as simple as "any script that can be interpreted via a shebang line").
At Kifi (https://www.kifi.com), we use LDA quite a bit for document classification, and have open sourced our Scala library: http://eng.kifi.com/reactive-lda-library/
This is a fair point of course, but running it on a second laptop is probably more secure than running it as a mobile app. You wouldn't run it on the same machine you are pushing production code out from, it could be a personal laptop with no access to company systems. I didn't make this point clear in my original comment though.
You're comparing it against itself since Yosemite uses Xeon D.
If you have malware, it can also act as a proxy requesting your codes and forwarding them (e.g. to disable 2FA). 2FA protects against password theft.

If your machine is compromised, it's over.
Not really efficient. The junctions have way too many vertices and that should be way slower than the simple textured pattern approach. Also, for AA you would need subsampling that is times slower than the methods that allow to draw AA lines without it.
Join PersistIQ (YC S14) as our first marketing hire
This other quote seem horrific as well.

> A single specialist in Java distributed systems is managing the entire configuration without any commercial storage tools or help from engineers specializing in storage, SAN, or backup.

So this person is either a genius who has specialized knowledge in these areas, or it's been abstracted by the platforms people to the point where it's only Java knowledge. Either way, it sounds like this person never gets to take a vacation or be not on-call. Hopefully there's not just 1 person responsible for all of the configuration, it just takes 1 person to run it.

> Process prevents problems. At many companies, the standard response to something going wrong is to add a preventative step to the relevant procedure.

The linked section goes on to talk about HR process with the "Act in NetFlix's best interest". It totally avoids the concept of technical processes. I'm betting "best interest" is a bit more formal on the tech side. Bad process is process for process's sake. Good process serves a very important role for offloading what people have to remember, as well as knowledge transfer. From time to time, steps of a process become irrelevant because of other changes and it has to be pruned. Sometimes companies forget about this step.

If Netflix has ever seen a problem with their builds/deploys and added a test to check against that problem, guess what--they followed the standard response to update the procedure. It's not necessarily a bad thing.
Well this is what iPython is morphing into. iPython is going kernel agnostic and you can actually use dozens of languages already. Juypter is the new name.
Ask HN: Is Apple being hacked like Sony was a few months ago?
I remember when the Oregon and California Lottery were passed in the early 80s. I was highly controversial, but advocates really pitched the "more funds for schools!!!" angle.

What legislators didn't tell the public is that after the bills passed, the existing education budget would be cannibalized for other expenditures, thereby not actually improving the education situation and in fact, making funding more volatile.
This is a durability metric, not an availability one. This typically tells you the likelihood of losing a given object in a year. (5 9's would be quite poor for this, implying a loss of 1 object out of 100,000 every year)
Is Envato Legit? (Themeforest, 3docean, Codecanyon)
Can you think of any scientific reason to defend why that would be the case Mania? If not then it's not nature it's nurture. Which is my point. And somewhat ironic you used the term "macho" wouldn't ya say? :)
I'm not sure how Facebook is particularly relevant to ZeroCater. What about the thousands of companies that have died before they got anywhere near their endgame? Maybe their visions and strategies were flawed, and that was reflected in ridiculous mission statements and nonsense marketing copy about "changing the world." I don't think "they technically could become a big important company one day" is a reasonable defense or excuse from judgment. And, funnily enough, I don't remember Facebook ever talking about "changing the world" in its early days.

It's hype, it's marketing bullshit, it's cliche, it's premature, and IMO it speaks to a lack of grounding and a focus on the wrong things.
Fakepreneurs, a Modern Epidemic
Possibly, feel free to e-mail me: [redacted]. Take care!
It's unlikely that someone who knows about this would serve on a jury in a computer crime case, or that evidence of NSA activities would be admitted in trial.
Please take this test ( this must be the result: http://www.amanithvg.com/screenshots/stroke_hot_case.png )

STROKE_LINE_WIDTH = 200
STROKE_CAP_STYLE = CAP_BUTT;
STROKE_JOIN_STYLE = JOIN_ROUND;
<identity transform matrix>

float xy[8];
int j = 0;

for (int i = 0; i < 4; ++i) {
// x coordinate
xy[j++] = 20.0f * (float)cos((i / 4.0f) * 1.7) + 128.0f;
// y coordinate
xy[j++] = 20.0f * (float)sin((i / 4.0f) * 1.7) + 128.0f;
}

<draw stroked polygon whose points are the xy coordinates>
I'm thinking (unrecoverable data loss / total data stored) in their system per year.
HEADS UP TO IOS DEVS: You may want to update your iPhone to iOS 8.2. You'll need to download the new XCode to deploy the app after that but it's not possible at the moment due to STATUS_CODE_ERROR.
Soon to be followed by a new browser called "Spotify".
The case would also have been simpler if KPC was run like a real company that understood that it can be found liable for the discriminatory actions of its employees and the atmosphere that follows.
#HongKong for Twitter