skysight-inc/HackerNews huggingface dataset:
I am urging you shoot down my little thought experiment:

Connecting the dots in the last few days, with the leaks, software like Adobe Insight apparently located in a building 5 minutes from NSA HQ, and the Utah data center, the leap to dystopia seems infinitely small.

If data storage size follows an exponential curve both physical and digital, i don't see a reason anything will be deleted.

People 60 years from now be able to search through their grandfathers, and everyone elses highest thoughts, dirtiest fantasies, and with advanced algorithms profile his personality to the slightest detail, from psychological and political leanings to cultural tastes and his exact social network mapped both in real life, in in the digital sphere. Maybe you could even follow him around real time in his day-to-day business, and see who he met and how interacted both actively and passively.

This might all be a little imaginative. But i really don't see the limits in creative data
analytics, with decades of complete profiling data. Maybe it can even fit on a small disk in the future and every historian or future despot will be able to trace your complete mental lineage.

The present and the future may, if any of this data leaks, or is used extensively, become an exercise in perverse voyeurism. Everyone will have zero secrets.

I am getting a little paranoid.
This is what the app (a game) looks like: https://lh3.ggpht.com/YYpdtrkXsIPU-I_CW3_vbYHXk1av1Qug4EYsrP...

The icon is a perfect representation of the game. I don't have to guess what it might be.

I chose icons I consider good looking. If you think they are ugly, that is a subjective matter. Also keep in mind that they are displayed much smaller on the screen.

The point I was trying to imply is that icons can much better represent their app if they are not forced to abide to a standard of shape or style.
Interesting article on Adobe's recent strategy here: http://tech.fortune.cnn.com/2012/12/10/adobe-cloud-strategy/
Australia has never had anything like the 4th Amendment. It's common knowledge amongst people who care that active monitoring of phones has been going on for decades, no-one pretends that it's only foreigners who are of interest. Email and web metadata wouldn't surprise me either, in fact it would surprise me if they didn't collect it.

On the bright side, the fact that it's not maintained in deep secrecy seems to mean it's governed better. Operating under a shroud of complete denial is probably the enemy of good process, oversight and management.

Anyway, the only thing that's being "revealed" here is that apparently they need a new DC.
This is a fundamental problem of our time. Perhaps the fundamental problem.
Nice implementation. One thing to note is that this doesn't seem work on desktop browsers; open it on your phone!
Link appears broken - I just get an msn.com sign-up page.
It actually works for me on my MacBook (in Chrome)!
Unless they fix their 64bit Linux version [1] I'm not bothering try it out again and give up within a few minutes.

http://www.reddit.com/r/Python/comments/182siy/pycharm_27_is...
i'm a big fan of jetbrains, but this is a poorly written article.

> Here is a poignant example of Vim being overloaded.

i don't see how this is any different from opening every toolbar window in PyCharm and cluttering the interface.

> Nothing can replace Vim, but IdeaVim feels closer than any other editor’s attempts

emacs evil does the best emulation. IdeaVim fails at two of the most important emulation tasks: escape and undo.

i used webstorm for a while to do javascript/html, but once i got proficient with vim it wasn't even close. just like how people are going crazy with livereload and how it makes development awesome, that's how i feel with using vim. it does what i tell it to do NOW, not 3 seconds from now.
I guess apps would have to provide a static function that returns an updated icon, which iOS would call every X minutes/hours. I don't think it'd be hard for developers, it's Apple who would have to do most of the job.
Hubble May Have Discovered A Planet That Shouldn't Exist
Maybe we won't get it exactly right, but I think the answer is greater than 0 which means right now, we're doing it wrong.
This is not really borne out in the economics. Wireless is only cheaper if you have a big wired trunk line somewhere you can drop a tower on.

It's not cheaper if you have to build that trunk line, and the latency and equipment start getting costly when you're looking at going tower-to-tower over a long distance, since with a single fiber you can run over 100km before you need another relay (and carry a lot more data).

Where this initiative by Google works is getting the rest of the world onto the internet somehow, and profiting off being the base-level service provider. Which would be quite a thing - a world where everyone could send some packet data at any time, would be very different to today where even leaving my house raises serious questions about how online I maybe over the next 48 hours.
I can imagine if Space X was Google it would be stated that the only reason for the project is that they want to serve ads in space.
Awesome - how can I reach you to schedule that? TechBreakfast is huge here and glad to host you at our 200 person venue.
I love this application. I use it everyday.
It is brilliant to know that people can still go out and discover things like this.
From the article:

> Rope-based completion was always unreliable, slow or both.

I haven't used rope. Is the author wrong about this?
> They're pretty much just defending that it's legal, which I think we can all sadly admit is true. I just don't think it's right, our government should not be keeping that kind of records on its citizens, or anyone.

but that's the entire point. it isn't legal. the supreme law of the land is the Constitution and everything after it is inferior. I could careless what Congress passes or the NSA writes in its policy documents -- it's not legal. it's all very much illegal.
Another cool part about this is the balloons will be floating at twice the height of commercial flights. That would mean commercial flights could get internet through these as well.

Commercial airliners travel at 30-40k feet. Twice that would be very high. Won't the service be sluggish and slow because of that?
As somebody who has to wear glasses, I can assure you that the day I was diagnosed, my ego took a hit. One of the worst aspects of getting old is that one is forced to accept the increased loss of independence from aides of any sort. Of course you get over it, in time (well, some people don't), but it's far from a pleasant experience -- and "I'm not good enough" is exactly what you think, deep down, especially if you're male and proud. It's bad enough that we all have to go through that by default, but being forced by Apple to relive the experience for no good reason, it's fairly humiliating, wouldn't you say?
Learn Angular.js in 5 steps
When the media is defending the government, you know your country made a wrong turn in history somewhere.
Absolutely, but the bar for news is low. As long as people recognize something and then think "Oh!", it's good enough for release. "Pole dancing" may be a hobby for some folks, but it still is uncommon enough to be a tiny bit remarkable.

I read the fact about the pole dancing stuff and thought "Oh.". So there.

Once again - I completely follow the train logic and it could be that way. But it isn't necessarily proof for a theory about propaganda or "the elites".
Works fine for me. Try again, or open the link up in an incognito tab maybe.
Article is from April 10. Was ignored then. Maybe people will have a second look now.
Which model is it? I remember the MacBooks and MacBook Pros that people use to smack to trigger actions. Developers figured out a way to take taking advantage of the motion sensor on the hard drive. I'm only asking because on my rMBP; it doesn't seem to be working.
Worked for me too. Here, try it without the unnecessary part.
http://money.msn.com/credit-rating/irs-tracks-your-digital-f...
I find this to be really clever and it kind of reminds me of The Pirate Bay's plans to build servers that actually float above the ocean to prevent being taken down. People laughed at The Pirate Bay for the ridiculousness of the idea, but here Google is essentially proving it's not a pipe-dream and bandwidth capable balloons can one day be a reality.
Looking at the solar information (on the left), power doesn't look too good.

Would these balloons still work during the night? Would they need to stay in the day? Would that even be possible, given the speed of the wind?
Link is fine for me.
When I wrote that I definitely debated whether to include tpm in the list because of concerns along those lines. But in the end it's a widely deployed example of that type of technology which makes it a good example. It definitely wouldn't be my first choice in any case just due to the complexity of it - there is > 10k loc inside your typical tpm as i understand it. One thing to keep in mind though is that tpm is a spec/standard that's been implemented by several different vendors. They're the ones that write the code that goes inside as it was considered an implementation detail in the spec. So that means you can buy a german tpm (infineon) or a french tpm (stm) or a us tpm (intel, atmel?) and so on including taiwan and china. So you can sort of pick your poison, presumably they aren't exactly sharing their backdoors with each other at least not france+us+china.

Even assuming it's a compromised platform it's still a hell of a lot more likely to keep your key material safe as compared to having it sit on disk or in addressable address space. One presumes backdoors like that are used sparingly as they become considerably less valuable once publicly exposed.
"Ethics aside"....

What a world we live in! :(

But no, it isn't, because it can be gamed like any other rules system. The NSA probably thinks their system hasn't been explored yet, relying as they do primarily on security through obfuscation.

One of the greatest pleasures in life is examining "black box" systems and figuring them out. The NSA would be fools to expect that their system is not already being gamed.
Thanks for sharing your experience. I don't have much experience with static analysis with ruby except the ones from rubymine - it checks for some easy errors, and it's real time which is good. but I think you still need to rely mainly on tests.
I think this can work, I'm fairly sure I got this working on kurobox (another ARM based computer) - you need to find a java implementation + you're good to go.
I love it. An IRS audit based on trawling public data is more likely to wake up the moronic "I've got nothing to hide" clowns than any total surveillance by the NSA or the massive cyberstalking by Facebook, Google e.a.
Try adding these lines:

-Dawt.useSystemAAFontSettings=on
-Dswing.aatext=true
-Dswing.defaultlaf=com.sun.java.swing.plaf.gtk.GTKLookAndFeel

to the pycharm64.vmoptions file.
Does that mean, on average, the minimum anual pay to get someone off the couch in the U.S. is $20K+? My wife is from Colombia, and she tells me people there are motivated to go work and hustle each day for a few bucks. Of course that's off the books. I wonder how off the books work, if counted, would change those U.S. statistics?
Working nicely here too. Late 2008 MacBook unibody 13"
Because he want's to keep his previous messages secret even after his computers are seized or hacked?
Sounds cool, but there is one issue: latency. I remember using the Internet in the mid-1980s, specifically using servers in Norway and other locations from my office in San Diego. Because of a few satellite hops, the latency was about 2 seconds. It made remote use of Emacs interesting :-)
It sorta works on my 13" rMBP, but not well.
Non paywalled version: http://stream.wsj.com/story/latest-headlines/SS-2-63399/SS-2...
My back-of-the-envelope first-approximation math suggests you'd need "only" about half a million of these things to cover the entire surface area of the Earth. To me, that seemed a surprisingly low number.
Peak Google, Apple and Facebook
Passing the Patriot Act must've been the most anti-patriotic thing the US has ever done. It destroyed Americans' beliefs about what it means to be American, and it also destroyed the foreigners' belief and hopes about America, too.

As a non-American, that's how I see it, and that's why I was hoping Ron Paul became president, because I knew he was probably your only hope to keep America what it used to be, and revert this awful trend of the government killing every American value and the American Constitution.

The worst thing about "tyranny" or anything similar, is not the tyrant himself. That's the easy part, because he can at least be removed. But what do you do with the destroyed culture? The culture that you have free speech and rights to privacy, and the culture that authorities need to respect the spirit of the law, not just the letter (while always seeking loopholes, so they can still "respect" the letter of the law, but do whatever they want. And what do you do with all the millions upon millions of people that believe in the "new" culture, of spying on everyone, and so on?

Once the culture is changed, it takes decades to bring it back.
This is exactly the argument I've been making to people when we discuss PRISM.

Think about the heterogeneity of the data, the lack of structure, and the unpredictable nature of its generation. Frankly, I have no doubt that the NSA is not monitoring phone chatter on a mass scale, probably not because they can't, but because if they did there would be no way in hell to parse, store, process and evaluate the data generated.

We (the scientific/big data community) can barely get recommendation engines working well - engines which have one set of data (what you watched) and do one other thing (suggest what else you might want to watch). Unless the NSA is decades ahead in a number of fields (like data warehousing, statistical analysis of massive datasets, machine learning) how are they getting useful information in a systematic way, considering the pressure from the data-firehouse involved?

My guess is they're probably not - instead the data are collected, and then used in conjunction with traditional approaches. e.g. little johnny buys some fertilizer and one way plane ticket - so who's he been talking to, what's he been saying, etc.

Honestly, how the NSA is using/dealing with/storing/accessing these data is actually an incredibly interesting question, from an academic/systems perspective.
Thanks - same result though for some reason...
I'm not sure what this is supposed to do, it doesn't work for me in Chrome 28. I get 2 JS errors.
If you feel a need to do that, check cmccabe's comment on the top about intrusive data structures. These let you do your own memory management, in a way that the data structure implementation doesn't need to know about.
It appears the current Australian government has plans for DSD for the next 5 years due to "the G20 Summit and the Commonwealth Games": http://www.pm.gov.au/press-office/2013-defence-white-paper-r...
> Of course she is in the public eye: Friends and family of interesting parties always get pulled into the public eye

I find this aspect and the fact that is obvious to most people, barbaric at best.
It probably won't bother the ones that diligently and conservatively determine their tax liability. I would guess there is quite some intersection between those groups.
Wookie: An asynchronous web server for Common Lisp
Vim is a vi clone with a massive number of improvements and extensions. The title should have read:

Vim as a Python IDE or Python ID with some vi stuff added

Because, I don't love vim for hjkl and "some" ex commands.
Here's a cross-platform opensource clone: https://github.com/cpbotha/nvpy
Instead of a character attack. Maybe they're just trying to pull clicks in from people hoping to see provacative photos. Pathetic either way.
One interesting point though is that current consensus is not that ice is slippery because it melts under pressure, but because of how air interferes with the bonding of the molecules at the surface.
Personal Drones Coming Will Follow You Home
Meanwhile the fat cats pay little, or no taxes...

GE paid 7% in 2010, partly due to the poor economy.

How many of us wish we could get away with only paying 7% tax?

http://money.msn.com/taxes/latest.aspx?post=26d490bd-7317-4f...
Yes, the same with torture. Hey, if torture works, maybe we should just allow it in every police station on everyone we ever arrest. It should make getting those confessions out so much easier! Say hello to the 2 centuries ago society! Glad to see the past 2 centuries have gone to waste in terms of what in means to evolve as a human in a modern society.
It doesn't necessarily make people think the state of crypto has changed so much as suddenly take note of and wonder about the state of crypto. Many such people ignored it completely prior to this but are now interested in it.
Enable scripts?
Apache Commons Net 3.3 released (ftp client, mail client ...)
Besides that SSL has CA's, what is the difference between SSH and SSL?
Using D3.js with Angular.js
There weren't any landmines at all in Cambodia until at least the early 1970s. Most of them were placed in the 1980s.
Privacy wasn't lost to technology, nor was it given away voluntarily, at least not consciously. It was stolen by greedy corporations. Governments came second, they mostly just leverage the work of said corporations.

This is not a sign of the times, an inevitable result of technological "progress". It is a conscious act of greed and disrespect which can be undone by democracy and law.

Of course we can never stop the abusive invasion of privacy through technology altogether, but neither can we completely stop theft, burglary, vandalism, murder and rape. That doesn't mean it should be legal.

To live in a world where smoking weed is illegal but violating the privacy of millions is a respectable business model is not the result of some irreversible force of nature. This is not "normal". It's a choice.

This can be changed. What Google does to the detriment of the privacy of millions can be made a crime. Privacy is not doomed to be lost forever.
Heres a short post from them:
http://www.aerovelo.com/2013/06/14/take-a-deep-breath-and-ho...
I'm going to build a new one but I would make something that people really use. Shall you want to talk about your project?
Plese, email me (my address is on my profile)
This reminds me of the "swivel eyed loons" of last weeks episode of The Now Show
They don't publish all requests including fisa requests, I think they're still negotiating about that. See the first sentence of the page you linked.
There's a (imo) superior fork called nvALT: http://brettterpstra.com/projects/nvalt/
I imagine the efficiency of their algorithms depends on what they're looking for.

If they're looking for patterns similar to those of historical terrorists, then their false positive rate is likely reasonably low considering the scale of their data set.

If they're looking for patterns or traits of hypothetical terrorist behavior, that's another story.

Systems-based trading in the financial sector comes to mind. Constructing a trading system that performs well when tested against historical data is easy. Constructing a system that performs well on future data isn't.

The solution to the latter usually involves using more generalized indicators when building the system to avoid the pitfall of curve-fitting your system to the data.

In this case though, it might just mean more false positives to sift through.
Byron Sonne - Open Source the deep web (2011)
We use flask at fusic.com and find it very reliable and easy to work with.
Our peaks have over 1m rpm, and it has never fails us.
We did a huge project migrating from Django, and now we don't have to jump through hoops so much.

I think flask has a front page that discourages newcomers, as it does not look as serious as Django, and gives the feeling that is it not mature enough, or documented.
I tried convincing a new startup to use it and failed for those reasons.
Doesn't seem to account for orientation on an iPad 4 but works fine otherwise.
http://googlepress.blogspot.com/2004/04/google-gets-message-... :D
what if its not just all about terrorist behaviour
The most clear and concise write up of monads I've seen. Explaining how monads remove the need for boilerplate code is the equivalent of how loop constructs remove the need for goto is when I had my aha! moment.
I used Notational Velocity but I switched a couple of years ago to one of its forks: nvALT:

http://brettterpstra.com/projects/nvalt/

Which adds a lot of very useful features, I can heavily recommend it.
Can't we assume that the largest employer of mathematicians in the US [according to Wikipedia] has given this some thought?

So either they know it's ineffective and do it anyway, because they can. More money, more power, more influence.

Or it's not being used to generate leads, but as a way to look up retrospectively what people have done online once they become of interest from tip-offs and traditional investigations.
I just posted its same link. Brett Terpstra makes so many amazing little script.
Really, commercial software shitting over opensource alternatives is bad taste.
>The other road users are operating at a slower speed so it is considerably easier to get out of the way.

You're assuming the other traffic is the problem. Speed humps etc. will considerably slow down e.g. a fire truck even if there are zero other cars on the road.

>emergency access is affected by the issue causing the emergency ( a crash for example )

Again, you're assuming traffic to be the primary problem. If my house is on fire or there is some intruder then there will be negligible effect on the local traffic but structural impediments to haste will still delay the emergency response.

>normal congestion will put the effective speed lower anyhow.

Traffic again.

>traffic calming can actually increase the throughput of a street For example, converting a street with 2 lanes each direction to a single lane with a central left turn lane: eliminates the congestion caused by people stopping to make turns from the left lane.

That's not really traffic calming, or to the extent that it is, should be distinguished from what I'm complaining about, e.g. speed humps or other measures solely designed to reduce traffic speed or annoy motorists into being diverted onto other roads.

Also, the better solution in such cases is to make the road have 2 lanes in each direction and a central left turn lane.
I'm working on an NFC card for Bitcoin for my final year engineering project. Aiming for a credit card sized final product.
The answer depends on what kind of key material and applications you use. Sadly there is no one size fits all system.

https://www.opensc-project.org/opensc/wiki/OverView

this would probably be the place to start, at least to figure out which type of card you'd want. The main choices are a) support pgp and ssh b) support x.509 certificate based signing c) support time or use type tokens (like smartphone 2 factor apps) or d) some non standardized system running custom code on a tiny jvm inside the card.

a) would be what you'd want in the context of this conversation, but b) is much more supported and has a wider set of use cases.

In most cases it amounts to making sure you buy the right card & reader, plugging it in, and compiling the opensc and related packages
The NSA has us snared in its trap – and there's no way out
Natural language processing improves at a fast pace, and these records remain there to be processed at an increasingly large scale as technology allows.

I don't think most people are ready to comprehend what keeping a comprehensive digital record of private communications allows.
Go to hotmail.com, click sigh out, try this link again.
Sounds like Sweden.
Some guy got a fine for saying something on his own Facebook page about his RV that was under the company. BOM. 400k to be paid.
2010 13", the last one with a Core2Duo if I remember correctly