skysight-inc/HackerNews huggingface dataset:
If your goal is to stop engaging in domestic bulk surveillance, it's a pretty simple first step that you shouldn't be looking at any domestic bulk traffic that never crosses the national border. You don't have to look at the content of traffic to determine its geographical location.
in the US, any giving to the church is tax deductible -- as long as the church documents it. This is why churches often have little envelopes that you can write your name on when giving cash.
Read up on the "base rate fallacy" (http://en.wikipedia.org/wiki/Base_rate_fallacy). Specifically example 3 from the Wikipedia page (http://en.wikipedia.org/wiki/Base_rate_fallacy#Example_3).

The result of the "base rate fallacy" in the context of the bulk data collection program is that the false positives will swamp the true positives in any general search results from the data-set.
I just finished my undergraduate senior project, which involved investigating whether or not the normalized compression distance[1][2] could be used to build a featureless clustering and classification system for Thai-language documents.

An interesting use case for the NCD is authorship attribution and plagiarism detection[3]. At one point during my project, while I was collecting documents for the corpus we used - I noticed very low NCD scores between some of the documents.

Sure enough, all of the documents with a compression distance between ~0.01 and 0.1 were either complete or heavy plagiarizations of each other! We lost around 15 documents, but at least we knew the NCD functionality was working! :)

if you think including NCD measurements in your system could be helpful, be sure to check out the findings from [4] if you'll be working with any larger documents.

[1] - http://en.wikipedia.org/wiki/Normalized_compression_distance

[2] - http://homepages.cwi.nl/~paulv/papers/cluster.pdf

[3] - http://www.inf.ufpr.br/lesoliveira/download/FSI2013.pdf

[4] - http://www.ims.cuhk.edu.hk/~cis/2005.4/01.pdf
It seems like this info should be front in center in the test. 1M/s 100kb writes is much more impressive than 1M/s 16 byte writes.

That said, there's a previous benchmark linked to at the top of the post:

http://techblog.netflix.com/2011/11/benchmarking-cassandra-s...

The client is writing 10 columns per row key, row key randomly chosen from 27 million ids, each column has a key and 10 bytes of data. The total on disk size for each write including all overhead is about 400 bytes.

There are 3 replicas, so figure that in as well.
Things like Clear are designed as home internet solutions so they have very small coverage areas. They don't work well for travelling.
Being from Detroit, I found the map particularly interesting to look at.

Personally not a fan of the UI currently. However there could be a lot done with the itself- such as providing safer routes by utilizing the data.
Churches suck. (sorry church goers). I won't go into all the reasons why. The reasons are well documented for those wishing to confirm.... or just go to a church of your choice half a dozen times to find out personally.

But there are a few thing churches do really well. Social networking it one of them. Facebook is an anemic imposter compared to First Assembly. This app is awesome. There is a lesson for general society in here somewhere. You know... for those who have ears.
There's no doubt that most supposed constitutional rights make law enforcement and public defense more difficult. The idea is that it doesn't matter, because these rights are more important than the alternative.
According to Google, compete means: strive to gain or win something by defeating or establishing superiority over others who are trying to do the same. I'm reading "competition" as a zero (or negative) sum game such as stack ranking for career advancement. In a competition you seek for others to fail.

I think that we already have a primarily cooperative industry culture and that stack ranking is a bad idea in general, not because of gender concerns. I disagree with your statement that this is "a deeply, irretrievably competitive industry" though perhaps we mean different things by "competitive". Seeking capital is, to a degree inherently competitive, but even early stage enraptures are more often than not willing to help each other succeed.
Realize that one screwed up person with a gun and opportunity could action the first scenario. Pilots licenses are more of a matter of cost than ideology, and private planes aren’t subject to many of the security measures commercial airliners are. And the only group of people in the history of the world who have used a nuclear weapon to harm innocent civilians was the united states government.

Chaotic events happen. People are terrified of them but having billions of dollars worth of surveillance state does not reduce the risk one iota.
well, how do you define a spam? Is it any document that has been constructed around some key phrases or some urls that are in the spam database? If that's the case, why not just do a similar document evaluation see if the similarity of the document and some sample in the DB reaches certain threshold?
Could you please provide clear installation instructions? I can create a live demo for you.
This is great news! Keep up the good work.
Regarding Example #3, you investigate ~10,000 citizens and only ~100 are real terrorists, when we are talking about peoples lives, it's worth saving as many as possible in my opinion. There is also the fear aspect that is difficult to calculate. How does fear of a terrorist attack affect the economy?

Just look at the Ford Pinto. It was calculated that it would be cheaper to pay the families of victims than it was to fix the exploding gas tank.
> My main thought is that the US must stay ahead of other nations intelligence agencies.

The solution to this is to make surveillance hard for everybody. Pass laws and build technologies that make bulk surveillance not only prohibited but impractical regardless of third party lawlessness. The goal is not to thwart only the NSA, that barely accomplishes anything. You also have to thwart China, Russia, organized crime, malicious corporations, etc.
Sorted Food, a Cooking Channel, Is a YouTube Hit
"the computer on which I am writing this could not possibly have come into being through the agency of physics alone.

The issue is that these scientists are focusing on some strands in the web of causation that actually exist, and ignoring others that are demonstrably there – such as ideas in our minds, or algorithms embodied in computer programs. These demonstrably act in a top-down way to cause physical effects in the real world. All these processes and actual outcomes are contextually dependent, and this allows the effectiveness of processes such as adaptive selection that are the key to the emergence of genuine complexity."

"they should stop indulging in low-grade philosophy in their own writings."

I think Dr. Ellis needs to take his own advice on this one.
Hehehee...
Amazing. 15 seconds after the post the first downvote.

Not surprising... no, not that. Just amazing.
Self delusion is the first self replicating virus I suppose. And manipulation never dies.
I apologize if I miss-characterized your position. Are you are insisting that Good Old Games never primarily focused on old games?
First ever Live nation-wide economic conference in Taiwan's democracy history
cool result! Is this the basic assumption that close documents also have close information entropy?
It's pretty amazing how much influence Rails has had on web development, even in ecosystems other than Ruby.

Personally I've found myself fighting Rails when trying to do things in it, but it is one of the tools I started out learning since the number and quality of tutorials out there seem vast. I too owe something to Rails for being of generally good quality.
That's really cool! I wish China can have such live streaming event to let citizen be able to discuss politics freely on internet！REALLY！
http://en.wikipedia.org/wiki/Russell's_teapot
I'm almost certain my business was targeted by this. I even got an anonymous email from the competitors threatening me to stop the ads, at the same time mysterious click traffic drained my adwords budget. Is anyone out there an expert in this field that could help me investigate?
For what it's worth there is a similar social networking site already out there with a lot of traction: nextdoor.com
I'm not a physicist.

But I look at statements like the ones in this article--that we've probed pretty much everything we can probe--and I think, what have we learned? Aren't the best estimates now that dark energy makes up 68%, dark matter 27%, and normal matter 5% of the mass-energy of the universe?

If the dark stuff does not interact electromagnetically, then wouldn't we need gravitational observatories to probe 95% of the known universe? Which are in their infancy. We haven't reliably detected one gravity wave yet, let alone probed all frequencies.

Like I said, I'm not a physicist, but when 95% of the known universe is a mystery, it seems early to call the game.
Angular's history is also similarly older - it was created in a rough form in 2009 for data binding purposes. The creator used to work on Adobe Flex, so Angular probably owes much of its design from that.
Using CoreOS as a "base image" under docker would serve little purpose because CoreOS isn't really designed to run anything other than its core services. People usually use Ubuntu or CentOS.
Personally I thought it was going to be skewed a lot more towards the top developers. It looks like there is a lot more success based on the numbers. I found it somewhat motivational as I enter into iOS.

That said, I'm looking to supplement my current income rather than replace it.
> Unfortunately, equal opportunity is now a mirage. Indeed, researchers find that there is less economic mobility in America than in class-conscious Europe.

Class conscious Europe? Oh sure, broad stroke it up. Meanwhile, when it comes to superficial signs of class consciousness and the social norms related to that, I see American doctors introducing themselves as "Dr. <Name>", in both medical and civilian situations. People emphasizing or hinting at having gone to prestigious universities like the Ivy League kind. People referring to their bosses by sir/ma'am. Casually denigrating certain professions, especially janitors. All of these practices are kind of foreign to my part of Europe.
Well the mantle of the Earth (including its radioactive components that power plate tectonics) is literally pouring forth into the depths of the Atlantic Ocean (in the valleys of the mid-Atlantic Ridge) and that seems to have not caused noticeable calamities... which is because yes, the ocean really is that voluminous.

As it turns out the ocean is also really good at both shielding radiation (water is what the nuclear experts use in large amounts, after all) and diluting radioactive contaminants, if it came to that, until the radionuclides themselves decay away and become stable.

Additionally it's not as if radioactivity is infectious or permanent. If something is radioactive here and I move it over there, it can't be radioactive in both places, which is why dilution is so effective.
I grew up in a poor family, and would say the downvotes are for stereotyping and gross generalizations I vehemently disagree with. That may be his story, but it's not mine.
wowwwwww!!!
one big step
That's perfectly fine, but this case is built on testimony from Mark Klein concerning Room 641A, which is right on the coastline (it's in San Francisco). That seems to me to likely be an ideal place to capture international traffic.
Into the deep: it's time to learn how to play Dwarf Fortress
This seems likely brought on by the mass drop going on right now.
He's not conflating cause and effect: There's plenty of Psychology and Behavioral Economics research on this. People end up thinking that the money they save will disappear with unexpected expenses, so they spend it, because the stress of not having enough money to eat is 'healed' by wasting money, which later makes sure you won't have any money to eat. It's a feedback loop, as bad choices lead to bad outcomes, which increase the chances of even more bad choices. I've seen it happen in people that you'd originally think that they had a whole lot of self discipline: For instance, a very Ph.D student that constantly stressed about how poor she was. Even after her income moved up, it took months for that mindset to go away, because the fear of something wiping her out just made her decisions completely irrational.

You had the discipline to fight it: That's great. But that does not mean that other people's experiences are like yours. Go read the literature.
Interactive shader school
Sometimes it's just fun to build something from scratch and make it awesome.

Also, if I had built OneBody using PHP I certainly would not have lasted this long in keeping it going. Ruby is great language that I really enjoy using every day.
This is such a key point. I launched a startup in 2003 that was successful, and did it for four years. But at the end of that project I knew that if I had to go back to using a LAMP stack, I was out of the web development industry. Learning Rails brought back my enthusiasm and love for programming.
I would give it away for free, and sell it. My process would be pretty simple. I would go to Guidestar and download the financials for the last three years(click free
preview). If the church is legit, and not a moneymaker for
a few select people they would get the software for free.

You are a good man--
This is the most unlikely but deserving post to spend all day atop HN. Great, great piece of software, deserving market, it's just great. Our company was originally started to serve my co-founders church as well believe it or not (the church was worried that credit card fees were usurious and so he tried to build a solution). I hope you do commercialize it purely because it will spread and serve more people that way - doesn't mean you need to try to make a lot of money on it, but some level of commercializing helps sustain and spread a project like this.
I see three questions here.

1. Why don't Miracles get documented? This one is less difficult to answer for me than it might seem. First of all by definition a Miracle is not an everyday occurrence, is out of the ordinary experience, and is unscheduled. Given those items it's not too surprising that they would not be documented at any time relatively recently. Second I would consider the the Miracles in the Gospels to be documented. However you likely don't count those since they are not recent enough to be recorded by something more permanent than a written word that has been copied multiple times. Either way I don't find this to be a significant blocker to faith. Even in scripture Miracles were pretty rare except for during Jesus 3 years of ministry.

2. Why allow large amounts of people to live lives of pure suffering. To answer this one you have to ask what are Gods motives for creating us?

2a. Motive #1 is for God to be worshipped freely. In order for him to be worshipped freely we have to be free to choose. If we are free to choose this implies that we can choose not to. The Christian Faith holds that we have freedom of choice.

2b. It boils down to God having a choice between Robots who all worship him due to programming or Human beings of whom a subset worship him out of choice. He values the Human beings more than Robots. You will either find this a harsh decision by him or a loving one depending on your viewpoint.

3. I don't believe he is a force from afar.

All of that said my faith is personal and much of what I believe I believe because of personal experience that I interpret as Him taking action in my life. Not in the Miracle fashion you describe in your questions but action nevertheless.
Where is Taiwan?
A lot of places block all of AWS. Even stackoverflow does it.
How does preventing the NSA from looking at traffic crossing an internet backbone serve to thwart China, Russia, organized crime, malicious corporations, etc.? If anything, I'd think it would give them an advantage.

(Note that I'm not saying that there shouldn't be limits on what the NSA can do, only that stopping other malicious actors isn't applicable in this case)
>Being poor does not make it very difficult to think long term

>I lived a significant portion of my life in pretty severe poverty

My experience suggests the opposite. Much like the study.

The fact that you suggested that it takes discipline, to me, also suggests that you felt the same uphill struggle to be able to do forward planning.

It takes no discipline for me to do forward planning these days. It's easy to focus on now that my income far outstrips my outgoings.
It is not a gem yet, so projects currently have to built off of clones or forks. So I would git clone https://github.com/websitescenes/cms_admin2.git and run bundle install. Not too much overhead in setting up but some things may need to be tweaked for deployment.
I will probably have one up in the next couple of weeks. Thanks for asking.
OK, I look forward to seeing your methodology.
You're right, just because 100% of bitcoin businesses have stolen all their users' money and disappeared, there's no guarantee that this one will too.
Isn't Facebook one of the ones that have done this?
Any links on relevant material? I'm okay for delving into current research topic.
For those interested, a good source for a lot of publicly reported crashes, accidents, incidents and whatnot is The Aviation Herald. Here's the list of all their recorded crashes sorted by occurence date (toggle the icons next to "Filter" to see more kinds of events): http://avherald.com/h?list=&opt=7681
Well thats an interesting finish to the "Can Google Hear Me" story.

http://googlesystem.blogspot.com/2008/03/idea-behind-can-goo...
I'd be cautious about that. You can easily have a dark foreboding alleyway just off a bright, well-lit street. Safety gradients (perceived and actual) can be quite steep.
Hm, fair complaint. At some point I found that hitting ESC immediately after typing became habitual. I find myself accidentally doing it outside of vim quite frequently. I've heard others make similar statements to yours, though. If rebinding to a different key doesn't solve it, then modal editing may not be for you.
If things have changed so drastically, then you should have no problem securing a constitutional amendment.
Good point, I guess that may have had a bit less controversy if it was only a couple of buckets. Also it is sad to see something core to our humanity moderated off the front page.
I'm talking about spatial intelligence and not the difference between Aristotelian and Boolean logic. Obviously I have no idea what it feels like to stack shorter than a pancake (i.e., existing in 2 dimensions). Pedantry aside, the difference between existence and experience seems obvious.

I've never seen a human fly and well over 99% of my work is performed in the x and y axis. When communicating directions, I'm rarely concerned about z. Simple graphing tools (e.g., paper and pen) can be used to illustrate my point further.
For fast and larger scale near-duplicate detection see Google All-Pairs Similarity Search: https://code.google.com/p/google-all-pairs-similarity-search... . The SimHash algo: http://matpalm.com/resemblance/simhash/ and Gensim's Similarities Class: http://radimrehurek.com/gensim/similarities/docsim.html

For blogspam detection can't PG whip up a nice Bayesian model for that ;) ? Again if you want fast and large scale spam filters see Vowpal Wabbit: http://hunch.net/~vw/ . For something more advanced see scikit-learn: http://scikit-learn.org/ which has many algo's up for this task.

A new option you may not have considered yet, is to crowdsource this task. Just offer a labelled dataset and let the HN and ML community have a go at it. I'd love to do content and URL-based spam modelling.
Maybe I'm a bit dense, but when are asynchronous commands a pain point in an editor? I mean, you can run eg a script that forks into the background, right? I'm not sure I really want to do "r! long-running-thing-that-updates-buffer". I can see me wanting to do "! long-running-compile &" (in the background). And I can do that in vim?
It's actually well understood which landscape features contribute to or prevent crime. Things like sidewalks and bright street lamps have a positive effect (no surprise there). Bushes, certain fences and other objects that obstruct the view from the road can have a negative effect. As a reporter I once did a ride-along with a police sergeant who took it upon himself to cut a set of hedges (with the property owner's permission, of course) that helped facilitate drug deals and prostitution.

The point is, I wonder if the machine learning approach used here is overly complex. After all, the set of environmental factors affecting crime is so well understood and thoroughly researched that you could focus on detecting tried-and-true things such as sidewalks. This would entail applying a clear set of rules instead of using the relatively unsupervised approach with training data. To be fair, ML is a complicated subject and I'm not an expert; maybe their approach draws heavily on these things.

EDIT: I understand that perception, rather than the actual crime rate, is the focus of this research. Still, there seems to be a tight correlation between the features that are known to be dangerous and those that appear sketchy. The major ones - an absence of lights, few walkways, etc. - are obvious to most pedestrians.
To be fair, first-hand anecdotes don't rank high as evidence. But, for what they are worth, I'll add my own.

I am where I am today because my family had enough money to own a computer (and never threw out the old ones, so the kids got to mess with the cast-aways—my first program was for a Kaypro 2), because my brother's interest in programming inspired my own, and because I was able to spend years without adult responsibilities learning everything I could.

That, and my parents fully supported every dive I took into every crazy interest. My parents kept books around and bought me toys to feed my interests—I had a chemistry set, an electronics kit, a violin, multiple microscopes, and access to books on subjects from photography to biology. I lived in nerd heaven… except for that bit where my parents expected me to clean my room.

I was working on a hobby OS in high school (1) because I was smart and dedicated, but also (2) because I didn't really have much else to worry about. I had plenty to eat and a safe place to sleep. Eventually, I even had a dial-up Internet connection, so I wasn't stuck with the local library's computer books from the 80s. All this was straight-up handed to me in the hope I'd do something great with it.

That advantage continues today. Because I have a stable job in middle-class territory, I can spend my free time on whatever crazy experiments I want. I do, and they continue to teach me things, even when the end result only 2 people on Earth actually care about. (Case in point: https://github.com/LnxPrgr3/crossfeed)

I know people in rural Tennessee who see an Internet connection as an unnecessary luxury, and the first bill to be cut when money gets tight. I imagine my life would be dramatically different had I grown up there.

Would I even know what I'd be missing?
Awesome tim. I remember seeing this for the first time when I attended the Tulsa Ruby group. The one and only time I went to that particular meetup group ;-P
Use the relative protocol (//) instead of http: for your jQuery script include, so HTTPS everywhere doesn't break your demo site.
Finally, It Will Be Legal to Unlock Your Own Cellphone
> it's worth saving as many as possible in my opinion.

You don't mean this. If you did, you would support mandatory exercise regimens and diet monitoring, and aggressive eugenics programs that include mandatory sterilization of folks at very high risk for nonviable offspring.

> [Pinto anecdote]

The facts seem to disagree with you. Read page eight (listed as page 1020 in the text) of this PDF: http://www.pointoflaw.com/articles/The_Myth_of_the_Ford_Pint...