skysight-inc/HackerNews huggingface dataset:
Agreed...

The "broad health", security-wise, of the U.S. is best served by allowing end-to-end encryption...in other words, protection from external threats for the vast majority of civilian users--the "main body"...

But, there's most likely a trade-off...listening to him explain how meta surveillance began I can only come to the conclusion that if end-to-end encryption survives the current "Apple" test, and is deemed "allowable", meta data collection will intensify...

I think it's important to note that Hayden "empathizes" with Jim Comey, even going so far as to say he would share Comey's position if he were in his shoes...we all want better tools to do our jobs...

When I think about the difficulty of protecting the "broad health" of the U.S. in a digital age I shudder...I have no doubt that things will become more complex as time rolls on...
Sorry, but you greatly overestimate the ability of the courts to restrain the FBI. There are many examples of the FBI submitting false declarations to the courts, accessing password-protected files without a warrant, using improperly obtained evidence, and more. [1]

Intelligence tools are pitched as counter-terrorism, and then used in whatever cases they feel like it. For example, the Stingray phone surveillance device, which the FBI loans out to be used by local police departments, without warrants. [2]. Or pretty much the entire Patriot Act.

Of course the FBI wants the power to do this independently. And this is exactly how they go about obtaining this power.

[1] https://www.eff.org/wp/patterns-misconduct-fbi-intelligence-...

[2] https://www.eff.org/deeplinks/2013/02/secretive-stingray-sur...
Estimating World GDP, One Million B.C.-Present (1998)
Chip Design Glossary
Fortunately that argument is being made in the NY case which is not the terrorism related case in CA.
> If they're given a foot in the door on this specific example, they'll use it for almost everything else imaginable.

Yeah like hand over the keys to foreign governments or corporations that they wish to curry favor with the better to land a sweet sweet gig once they leave government service.
Nothing matters nihilistically,

but from a practical standpoint I'd like to know if this is something I have to worry about now when I'm in San Francisco - getting punched by random homeless people.
It can take a while for results to get published - it's often up to the whims of the journal/reviewers.

Just make them release the raw data. That will definitely encourage people to publish.

Although these stats look bad for the researchers, the other side of the story is that publishing anything these days is a pretty painful and not exactly transparent process.
I made a donation anyway with paypal, much appreciate your work. Also checkout funding from Travis foundation and DuckDuckGo. If you need help with traffic to your site, let me know, I work at a CDN. http://foundation.travis-ci.org/grants/
I've wondered the same for quite a while, or just to see similar projects for other languages. I would love to see an IDE like this for D definitely.
Thank you for helping out a random stranger on the Internet. I will run some simulations using your method / information. This will help tremendously!
California ordered to disclose students' protected personal information
I disagree. One of the reasons we're in this position is we keep making drastic changes without thinking them through first. I'd like to see some evidence proposed changes are actually workable before they're enacted.

In my life I've seen this cycle maybe five or six times, and each time we fiddle with campaign finance laws they get more complicated, leaving more gray area. When the power brokers act nobody can even tell if they've broken the law.
Everything about the writing was perfect. Even the tumblr name, "literally words", is great.
> SemVer works great for libraries, but it falls apart for actual software IMO

SemVer is for APIs. From the spec:

> 1. Software using Semantic Versioning MUST declare a public API.
It might be worth noting that 'getlazarus' is an independent project from the Lazarus IDE itself, it uses more up to date releases that are yet to be available and is designed to be much friendlier to use.
It's stories like this that make me wish as hard as I do for better pre-birth screening for mental disorders, including autism, and continued support of abortion. It's an unbearable burden - to the parents, society, but most of all to the children themselves, who are utterly blameless and must suffer the rest of their lives as a result. I try to debate rationally and understand that other people have their own opinions but I feel sick arguing with people about this. My family has had it easier than many, certainly nowhere as bad as the family in this story, and I love my brother, but if we could choose between him existing and him not existing the latter is clearly better for all involved, including him.
The Most Precious Cargo for Lighthouses Across America Was a Traveling Library
It would be remiss to mention Civilization and Gandhi on a tech site without discussing why he was such a crazy warmonger.

In the original Civilization, Gandhi's "aggression" rating was set to 1 to make him a pacifist. Except that when a civilization adopted the Democracy form of government, this reduced the leader's aggression rating by 2. The ratings were unsigned, so this wrapped around and gave Gandhi an "aggression" rating of 255 once he adopted Democracy. Oopsie.
Let me guess, II was the first you played? Everybody has a special attachment to the first one they got addicted too.

In my opinion II was the worst of the five. It was basically the same as the first with more of everything. More techs, more unit types et cetera. Didn't really add anything to the game except make it longer. It meant you couldn't finish a game in a single sitting which really lessened the appeal to me.

Starting with III they started added more dimensions like religion and culture. Sometimes it worked, sometimes it didn't but I appreciated exploring how strategies changed.

Edit: did a really poor job of reading your post or else you edited it. Oh well, just pretend my comment stands alone, please.
Why does unix timestamp imply that Facebook sucks?
Agreed... It's a really nice, smooth experience... ConEmu is close, but not quite the same in Windows, and I haven't seen anything that even compares in Linux.
Quoting from the court order: "Failure either to submit a Objection Form or letter to the Court by April 1, 2016 will be deemed a waiver of your right to object to the disclosure of your or your child’s protected personal information and records as described above."

And yet it doesn't actually say that "objecting" will prevent them from disclosing anything.
I studied Engineering like you. I graduated six years ago and the rust has definitely set in for me. At my university our Math courses were split into three streams, Statistics, Calculus and Linear Algebra. coincidently I had a Russian Lecturer as well.

It was after those core subjects where I fell in love - Thermodynamics and Fluid Dynamics was the 'aha' moment for me. It made all that core stuff make sense when I finally got a sense of the applications. Bernoulli, Euler, Fermi, Dirac - The shoulders of giants...
Good notation certainly aids understanding, but math is a vast endeavor where the details matter. In switching from one programming language to another, often a rough understanding of corresponding concepts is enough: how to print has different details in different languages but it's not that different, and the details are easy to look up. On the other hand, just switching from topology to symplectic geometry involves asking entirely different questions -- having different values and pursuing different goals. Maybe it's more like switching from web dev to scientific computing as well as switching languages.

Yes, a lot of mathematical papers are incomprehensible to others in the field. But it's not just because of notation. You wouldn't ask a content marketer who is great at A/B testing to deal with tweaking something in the linux kernel because it's all "computers".
It is interesting to compare this with Apache Spark, which won the open source Graysort competition of 2014 [1].

Apache Spark completed a 1PB sort on 190 EC2 (i2.8xlarge) instances in 234 mins. Google did their 2011 1PB sort on 8000 computers in 33 minutes.

Moore's law is at work here and the results aren't very comparable but it would be interesting to see a head-to-head test on similarly speced clusters.

[1] https://databricks.com/blog/2014/10/10/spark-petabyte-sort.h...
It varies a little bit on whether you're using the Cloud or Server variants of JIRA & Bitbucket. The blow-by-blow Cloud integration guide is here:

https://confluence.atlassian.com/jiracloud/getting-started-w...

Feel free to drop me a line if you run into strife, my email is in my HN profile info.
Why your new gas can is ridiculous and evil
working on strong AI is, in my mind, the ultimate challenge.

So is working on antigravity, free energy, and backwards time travel, but people don't do that because they are no reasonable approaches we can try.

Glorifying "AI AI AI" is silly because — there are no approaches we can try. Sure, we can identify ten million images per second, but none of that involves the least bit of "thinking."
You can just turn chat off: https://www.facebook.com/help/www/215888465102253

Any messages you get when your chat is off just go to your Facebook inbox so you can still get messages even with it off you just kinda lose that online live kinda element. I mean this works just like most chat applications work. They basically all say you're online or not too.
Given the amount of fussing required to get the most of Supply Crawlers in SMAC, I'm surprised to hear that viewpoint.

Nevertheless, the scope of SMAC's vision continues to inspire: https://paeantosmac.wordpress.com/ is analysing the canon and implications from the various quotes and project videos.
Note: there is a lot of new information in this article relative to the previous articles this week. (!) Such as the party culture and the influence of a16z.
Paean to Sid Meier's Alpha Centauri
Gods the amount of time i spent on civ.

But didnt that article seem to stop all of a sudden? I checked twice on my phone to see if i missed a more button.

Didnt civ 4 get an award for audio?(and i loved the music on 4, was so disappointed with 5s audio), the article left me with a , meh, what about. . . ! for so many things.

Being only 32 i would imagine a great article to show me things i didnt know.

Sigh. The temptation to play more right now is strong, but i need to get this work done :-)
Free hint: my parents weren't even born yet, and I'm at the early end of Generation X.
I think what the GP was illustrating is that Google is extremely conservative. For them to hire people outside of the strict boundaries of, "dimensions of skills as represented in an interview," is kind of a rejection of the Robustness Principle for corporate purposes.

I mean, heck, something like this? They interview multiple magnitudes of people necessary for this kind of job. I respect it as a hedge, but it probably also takes people out of the industry who could do more vital work someplace else.
Why Apple Is Right to Challenge an Order to Help the F.B.I
Hi there. Sorry if the scores misled you. That's not the intent at all. The scores that you see next to each discussion/comment are exactly that: a score. It's not intended to represent the raw number of people who have voted.

For example, on Reddit, the score that you see is extremely simple/primitive: upvotes - downvotes. The entire premise behind Caucus is that content can and should be scored using much more sophisticated algorithms. Some of the many factors that we use to generate scores: poster's reputation, voters' reputations, posters/voters' activity levels, community size, number of times the post has been seen by voters, etc.

If this all sounds very abstract and you're wondering what a sophisticated scoring algorithm looks like, here's a famous one that we drew inspiration from: https://en.wikipedia.org/wiki/PageRank.

Anyway, long story short: the scores that you see on Caucus aren't an indication of the number of people who voted on it. They are the output of our reputation-system-based scoring algorithm. Hope that clears things up!
I weirdly haven't even tried BE. It's like I'm worried I'm going to break the spell.
The biggest recommendation for YC is: if you founded a company in YC, would you do so again (or recommend that other founders do so?)

I would, although I have some very specific things I'd be sure of before doing YC; doing YC "correctly" is worth some effort. (not too early; with specific goals achieved during YC, and with focus on the right things)
I force my students to use this overloaded notation because I want to make very clear to them the commonality of ideas. They need to know that determinant of a matrix, length of a vector, and absolute value are all ways of measuring "size" in different contexts that fit together into a harmonious whole. abs(Matrix) just doesn't... do that. Doesn't make sense.
I didn't have a computer that could play civ 1, so I had to go to a friendly family's house who kindly allowed me to come over and play because the dad was equally addicted to Civilization. Whole saturday afternoons would pass this way.
My favorite thing about Civ is that its creator has kept control over it, and continues to evolve it. We'll probably be enjoying a new Civ in 2026. The charm is that it's the same game in many respects — parts evolve, but the core remains.

This seems unusual; I can point to several popular 90's games that peaked there and never recovered (Roller Coaster Tycoon, Age of Empires II, and arguably SimCity 4 if you include the early naughts). I wonder why; as a player, the Civ model seems preferable (you always have modern versions and new, but not heretical, variety).
We'll likely see more developments like this from other large iPhone markets. It's a noble but ultimately untenable position for a manufacturer to take.

If the courts, the owner and let's suppose the majority of the people of a jurisdiction (in this case US law) legally make this request I don't see how a company can get from out of complying by saying "we made it impossible". The courts will say, fine, in the future make it possible and not complying will forfeit the right to sell such a device.

Either the US, the EU or China will make their case economically and Apple will capitulate or exit a market --and I don't see them exiting large markets.

There is also no historical precedent where the notion of privacy has meant "secret forever" so this is new territory and where it ends up will probably depend on how society values new notions of privacy versus providing legal access to information for the purposes of crime investigation. In the US, and China, people have typically sided with the state, so I don't see this changing.
Hi, looks interesting...

Some questions:

All based on what we do at Kentik, where we run a large distributed column store with high speed data ingest layers feeding it, and a relatively more easy core cluster of portal/high-level metadata nodes. Ingest nodes are 20 core low-disk and data nodes 36-core 24x2tb disk w/ ZFS, which we rely on for compression.

We use docker but on top of known equipment types of deterministic latency and performance. Machines are netbooted and much of the system is controlled by puppet push. Typical clusters range from 10 to low hundreds of nodes. We do on-prem but they are typically on top of bare metal and using our control stack.

So with that as background...

For an application that requires high speed native (in particular disk) performance and persistent disk to run, how is Gravitational requiring that at deployment time?

Is there an ability to add metrics to dashboards for on-prem 'operators' to access? Send those through logged mail gateways for SaaS companies to watch on-prem status remotely, at least at an aggregate level (dashboards plus perhaps some log excerpts)? Have part-time (customer-controlled) logged ssh gateways for supervised and/or logged remote access by SaaSco engineers?

How do you do versioning, deployment, and distributed rollout to running systems with 24x7x100% uptime expectation? Is there the ability to support partial upgrade of only some nodes of specific roles followed by automated and/or human checks? How about rollback?

Thanks, and good luck with the company!
You don't even have to sign out of Hangouts - Hangouts has an option to not display "last seen" status which will make you always appear offline (though you can still send and receive messages).
This is a pretty big problem. I've given it some thought, but haven't cone across a good answer. Incentivizing this is hard right now.

The best idea I've had is to minimize effort for negative experiments. Like arxiv, but perhaps a even less formal. Allow it to be easily searchable. It's still not incentivized, but it's a fuckton easier to put it out there.

I could also see dedicated data analysts publishing negative data of open data sets.
Sounds like a really good analogy, in fact :)
This was hilarious and really cool!
If you found the article funny you may also enjoy one of the author's other projects, Swagify[0].

The source code[1] for said project is pretty great.

Kind regards,

[24x7BLAZEIT]XxXhUCkYau$XxX

[0] http://swagify.net/
[1] http://swagify.net/static/js/swagify.js
godebug. Nuff said.
http://www.pixpit.com

It queries reddit.com/r/funny every ten minutes and collects the top 1000 images submitted. You as a user can then browse an endless stream of images much like Instagram.

At the end of the night it takes all the collected images from that day and parse them into 20 picture albums that user can be accessed by pressing the shuffle button on the top bar.

It's a never ending stream of funny images
It is probably more accurate to claim the GPL was designed to be incompatible with an entire class of licenses that includes the CDDL, and the MPL on which it was based and any future licenses similar to or based on licenses in that class (of which the CDDL was given that it was made after the GPL).

There is no clause in the CDDL that places restrictions on other files in a combined work, but there is one the GPL. There are people out there who dislike the GPL for that, there are some people who explicitly go out of their way to avoid GPL compatibility because of that and I am sure that some of those people existed at Sun, but I really doubt that the design of a license by a huge organization with many people giving input can be simplified to one guy thinking GPL incompatibility is a good feature.

I also think this happened years ago and there really is no point to living in the past. People cannot distribute a vmlinux file with ZFS linked into it (i.e. not a kernel module, but part of the binary itself) because of that, but that does not stop people from distributing it as a kernel module and that is how filesystem code is loaded these days, so it is a non-issue.
You're right, of course, and that's why I said 'thousands' rather than doing the math assuming the least charitable interpretation (giving your 63.5k).

If the guns the TSA detects are carried accidentally, it seems that using x-ray or metal detectors to find them is overkill. Just ask 'please remove your laptop, liquids, and guns' before putting your bag through the x-ray.
> They need to employ people to manage the program as well as run shelters, pay rents, etc. $4444 is not so high that it's obviously too much.

Who will they pay rent to? The pier belongs to the City.

That much money gets a homeless basically a cot in a large warehouse. How is that worth $4K/month? And which other city spends $50K/homeless person?
Really, that's it? I thought it'd involve something about concurrency, networking or some IOCP magic going on.
Great observation. This is a core issue addressed by our reputation-system as well. All reputations are community-specific. Ie, your reputation-score on the politics community will have no impact on your posts/votes in other communities.

This ensures that if anyone is ever dis-satisfied with the way the highly-reputed-users in a particular community are using/abusing their voting-power, they can simply create/migrate to a different community where those individuals will have no voting power at all. In the equilibrium, people will self-select into communities that match the tone/character that they are looking for.
I don't think Draftkings or Airbnb have 'won' - they are both facing significant legal challenges in various states (and in the case of Airbnb, globally) - it's not clear that either of them will emerge with a viable business.

Zenefits is an example of the exact opposite of your point - financial and state regulators have little tolerance for companies that break regulatory laws, regardless of how fast they are growing. See also Sand Hill Exchange [1].

[1] http://www.bloombergview.com/articles/2015-06-19/bitcoin-buc...
"Fuuuuuuuuu" -- everyone else

Because now we know not to try it again (and there may be interesting things we haven't found yet). We can also review the methods and see if it can be done better.
At Cortex (http://www.meetcortex.com/) we are using this and technology like it to help brands be smarter about marketing content on social media. Really cool stuff.
The FBI Effort to Conscript Apple's iPhone Engineers
I think the saying is "pulling up the ladder behind you".
So...you matched with your parents as your driver and found a sexual interest to carpool and play with? In a Dodge? (In China?)
But if we aborted every deviation from the norm, we'd probably slip into monoculture as a species, and risk falling prey to a mass extinction event, beyond our understanding.

Somehow, the cold statistics of DNA mutation would leave us behind, and we'd become creatures with no means of adapting, until one vast catastrophe forces the issue.

What might feel practical in the moment, for one, might be terrible for the collective.
In the last day you have complained about HN four times. I'd prefer to read real answers over snarky comments. 'Ask HN' was always a mix of good and bad/weird questions.
Pragyan_ctf_2016
The encoding actually used is that the first bit of every byte is a flag for if there's a next byte, for a maximum of 10 bytes.

Fun facts: those are commonly known as "vbytes." They are the slowest kind of variable width integer encoding. The simplest (naive, and generally considered "wrong") implementations of variable-width-by-continuation-bits uses 10 bytes maximum. A proper implementation uses 9 bytes maximum.

There's actually no reason to ever use 10 bytes in this encoding. If you use 10 bytes, that means your last byte only holds one bit of actual user data. That's not very cool. But, your next-to-last byte holds seven bits of user data and one bit of metadata. We can easily say "if we're at the next to last byte, don't use metadata, just use all the bits we need." All you have to do is say "if we are currently at 9 bytes, don't use a 10th byte, just use this 9th byte directly." bam. Your 9th byte now has 8 bits of user data and you don't roll over a useless 10th byte with one bit of data.

The "slide all continuation bits into the first byte" sounds like a trick, but it's really using a TLV encoding where the first byte just holds a number between 1 and 8, so the entire integer+metadata is now [1 type byte][1 to 8 user data] = 2 to 9 bytes total. Using this scheme also kills any "1 byte, standalone, variable width integer" capability (unless you're storing partial values in the first T/L byte, but then that limits you to a much lower max value for one byte).
Not sure if you're seriously asking but OP was likely saying it's a great article because of the witty writing. The remark about FB sucking was related to the article's substance.