skysight-inc/HackerNews huggingface dataset:
The robots.txt thing really ices the cake.

The whole benefit of online discussion in general is to create as wide and persistent an archive of both questions and answers as possible. To that extent, I applaud StackExchange, even with its aggressive moderation (not too different from better-managed subreddits such as /r/askhistorians or /r/askscience): the audience isn't the person asking the question but all people who might want to know the answer to a given question. And they're better served by having a canonical response.

Quora blocking (explicitly) TIA means that that knowledge stays locked in their silo. Pretty much forever. Fuck that.

Just yesterday I was musing on energy (something I do a lot) and the fact that even in such advanced energy systems as nuclear fission and fusion powerplants (real or theoretical), all this advanced energy, provided directly in the form of electron volts, is degraded to heat, used to create steam, and then to spin turbines. That's fundamentally a technology that's hundreds of years old (and I think early steam or heat turbines go back further). Windmills date from the 1400s.

So I checked AskScience on reddit, and it turns out the question's been asked a few times. And I could read the responses. And, while, yes, I've got an account there, it's not necessary for that purpose:

http://www.reddit.com/r/askscience/search?q=electricity+nucl...
Criminals have always had lots of tools available to them; by definition, they aren't restricted by law, which opens up many possibilities not available to the rest of society. Nobody ever said police work is (or should be) easy.

Despite that, the answer to how you grant increased surveillance capabilities is easy: you get a warrant.

It isn't a terribly difficult bar to reach - judges will hand out warrants quite easily. We - the citizens - just ask that those asking for such capabilities ask for them (each time...), and at least show they have some minimal sort of reason to want such easily-abused capabilities.

Requiring the warrant therefor shouldn't slow down legitimate investigations more than a trivial amount. If enforced, on the other hand, it does act as a "limiter" to sweeping abuses.
New Gmail Interface?
Screenshots suggest Google is testing a completely redesigned Gmail interface
#golang: The next great teaching language
1) Android is a Linux, it's just not marketed as such:
http://en.wikipedia.org/wiki/Android_%28operating_system%29#...

2) If you're someone like me who drops in to distrowatch.com occasionally, you might think a tweaked version of Puppy or Tiny Core would be more appropriate for older computers. And you'd be right in terms of hardware requirements, but...

3) Android is supported by Skynet, er, Google with massive resources. The installed base in the US is north of 80M and it has support for 47 languages.

So it's really the answer to that classic question, "what's the simplest thing that could possibly work?" If I were in the project manager's shoes Android would be at the top of my list as well.
Thanks for bringing up Telemann. I wouldn't say he's unknown today, but definitely not in the "pop" composer category the way Bach is. His music is definitely in the repertoire of most serious violinists while studying late Baroque.

Here's one I studied for a while when I was studying the instrument many years ago.

https://www.youtube.com/watch?v=9OQ0jPy8FrQ

and another I never had the chance to study but enjoy

https://www.youtube.com/watch?v=y2rt5sPHc98

I was always torn between playing Baroque music in the modern style or in the contemporary style. I find incredible enjoyment in hearing the music on period instruments played in the style. The music's texture changes so much.

https://www.youtube.com/watch?v=UhTqpmHu5yg

https://www.youtube.com/watch?v=vosK-NKq9FQ
It's funny how maxcdn.com loads stuff from cloudfront and rackcdn (according to NoScript).
You're going to want to check out Laravel.

Laracasts.com is a great place to get up to speed.
https://laracasts.com/series/laravel-from-scratch
https://laracasts.com/series/digging-in
True, probably not truthiness without statistics. However, I think a richer vein of correlation is probably to be found with internet nick names and email names. Here very few people go for very long nick names that are variants of their surname (however I am sure that 'bartholemew_simpson_1986@hotmail.com' probably exists).

P.S. This is the internet, not Saturday afternoon on Radio 4 - they won't get the Milton Jones reference, and if they did, they would not get the humour.
Here is my metaphor: your book is a pudding stuffed with apposite
observations, many well-conceived. Like excrement, it contains
enough undigested nuggets of nutrition to sustain life for some. But
it is not a tasty pie: it reeks too much of contempt and of envy.

Bon appetit!

I think I've never seen such a marvelous way to say "eat shit". Dennis Ritchie sure was a fine gentleman.
Maybe I was not clear - this is not about stopping the NSA reading my support emails (I pretty much assume anything I do that is digital is caught, even if not read)

My concern is winning business with UK public sector - the Data Protection Act and ICO are clear on processing data only inside legal regiemes that share the same data privacy protections - in other words EU companies must process inside EU borders.

Or rather we don't have to but it's a pain in the arse to explain why not and I have enough to do so please please please either stick processors inside the EU or can I find a bunch if similar parties who fancy shouldering the cost of doing same.
Submitted 12 days ago[0] with a few up-votes and no discussion, then submitted 6 hours ago[1] with no up-votes and no discussion. Now submitted again with /?attempt=2 on the end of the URL to avoid the minimal dup-detection that HN does.

This submission gets traction. Maybe everything should be submitted again and again until it gets traction. Then again, maybe there's nothing wrong with lots of re-submissions of the same stories over and over, and I'm just grumpy and need more sleep.

[0] https://news.ycombinator.com/item?id=7659277

[1] https://news.ycombinator.com/item?id=7725858

Edit: And yes, I've made this point before. Perhaps people are tired of me saying the same thing repeatedly. Well, I'm tired of seeing the same stories repeatedly. I guess I'll just have to take a break for a while. Feel free to vote me up or down as you will.
Snort is a rule based IDS/IPS and BroIDS is a policy based IDS. In their default configurations rule based IDS reacts (alerts, blocks) based on the rules loaded where policy based systems like BroIDS interpret the traffic they see and can react to kinds of traffic if configured.

In practice Snort (Suricata, etc) can read, understand and react to individual streams on the wire very quickly. This is especially important for intrusion prevention (IPS) inline.

BroIDS (prelude, etc) generate detailed logs and highlight interesting traffic (as configured) and are excellent for gathering intelligence. One of the recently popular features of BroIDS is to decode and save to disk all files in traffic it sees, checking the hashes of those files against blacklists as it goes.

If you are at all interested in these systems you should try out Security Onion at www.securityonion.net, an awesome pre-configured Linux with many network security monitoring (NSM) tools already installed including Snort, BroIDs and many many others.
The secret for creating amazing products
What's CPSC?
Unless you need to evaluate JavaScript or take screenshots of the rendered page is there any point at all in using a webdriver like that instead of building a plain old scraper?
Are they affiliated with the Open Source Initiative? If not, why are they using the OSI logo?
The Amazon Reviews Of a $36,295 Rolex Watch
CIA LEAVE HOMS?LOL,ASSAD CHESS PLAYER,
That's true, but any system that reached Unix's scope would have to be evolved and not designed. It's a failure caused by its success.

If SmallTalk or Genera grew popular enough to satisfy the needs of billions of people and hardware devices, then they would be infested with evolved cruft as well. Systems may feel more "coherent" or "designed" with tight coupling. I'm certain that such systems systems would not have made the jump from servers to desktops to mobile phones like Unix did. They would have been replaced with something more loosely coupled.

The core principles of Unix are still there. It's just layered under a lot of cruft. It's true that much of it is caused by incomplete understanding. I've been hacking on Debian internals and this has become very clear to me.

People say FreeBSD is more coherent... it's been tempting to me to switch. But it's more coherent because it does less (has less features than) Linux or OS X.
I don't know who 'they' are, any more than I know who Milton Jones is, but I got the humour.

Anecdotally, all of my children have names with more letters from the right side of the keyboard - but I'm left handed.
Also this, not sure where the original link went.

http://www.art.net/~hopkins/Don/unix-haters/login.html
Analysis of Federal Appeals Court Decision in Oracle v. Google
Conchita from Austria wins the 2014 Eurovision Song Contest [LIVE]
MDIL is designed to solve a different problem than LLVM IR. LLVM IR is an exchange format between a compiler frontend and backend. MDIL is designed to solve certain fragility problems in binaries.

.NET Native uses MDIL to create a looser coupling between NUTC and the runtime. This means NUTC doesn't have to understand the precise binary layout of the runtime. The binder takes care of fixing that up!

MDIL has more advanced capabilities too. For more background on MDIL, I highly recommend watching the video I linked to in the blog post: http://channel9.msdn.com/Shows/Going+Deep/Mani-Ramaswamy-and...
Betty Translates Plain English Into Command Line Code
I'm rude? WalterBright is being rude and dismissive to everyone who must work at a job that consumes all of their time and energy just to survive, saying that they should just go ahead and quit and start their own business, because it's so easy and you can do it with nothing. His statements are ridiculous, completely ignoring the need for income or pre-existing savings to eat and live while trying to create a business that can be self-supporting.
Sad that this hasn't been as popular this year! Good work though, looks like I've made my annual loss on betting.
You are free to pick black berries in much of Friday Harbor and the rest of the San Juans (and they are everywhere). Many people hunt shrooms in national forests, and then there is the sea. The Pacific Northwest is a nice place for these kinds of things.
It's actually worse than that. I did my PhD in a lab that did brain computer interfaces as part of the same DARPA initiative. We were supposed to use the DEKA arm but they insisted on owning all IP to come out of the research, even if it had nothing to do with robotics. Obviously that didn't happen. DEKA is basically Intellectual Ventures with better PR.
Vacuum trains: a high-speed pipe dream?
I think the main issue here is that people don't clearly delineate making games from making money.

You wanna make games? No one's stopping you from creating the most whackier experimental game this world has ever seen.

You wanna make money off that? You gotta wade through all kinds of shit, as is usual in most businesses. And before someone mentions Minecraft - it is such an outlier that it's not usable as argument in any discussion.

I don't subscribe to the self-entitled tone of the article that making games in itself is something virtuous and should be basically subsidized. I love Koster though, Theory of Fun for Game Design is what made me really interested in game development.
This paragraph made me think of the masses of office drones who are performing repetitive tasks using poorly designed software on inadequate machines:

Ekkers and colleagues (19791) have published a preliminary study of the correlations between control system characteristics and the operators' subjective health and feeling of achievement. To greatly simplify : high coherence of process information, high process complexity and high process controllability (whether manual or by adequate automatics) were all associated with low levels of stress and workload and good health. and the inverse, while fast process dynamics and a high frequency of actions which cannot be made directly on the interface were associated with high stress and workload and poor health. High process controllability, good interface ergonomics and a rich pattern of activities were all associated with high feeling of achievement. Many studies show that high levels of stress lead to errors, while poor health and low job satisfaction lead to the high indirect costs of absenteeism, etc. (e.g. Mobley and colleagues, 1979).

- incoherent information: PC LOAD LETTER

- low complexity: Email/Calendar/Address Book, a 12 year old could do it on pencil and paper

- low controllability: "Hold on a minute, I'm just waiting for the computer," says ever receptionist everywhere

- poor ergonomics: sitting in a cubicle using software written by the lowest cost bidder

- simple pattern of activites: click, click, click, click, click, click, click

EDIT:

Thus, they do jobs that are seen as easy (low status), with minimal training and an environment that is hostile to wellness, attentivity, and focus, and totally outside their control. An environment which directly interferes with their principal purpose of interacting with people, understanding people, and using their judgement to help people or the company.

Add to that the common flaw of push-based throughput oriented high-utilization management, instead of pull-based availability oriented high-output management .... welcome to the psychic prison.
I believe there have already been at least 2 cases of the FBI using the very mass exploitation technique discussed in the article. The 2012 investigation dubbed "Operation Torpedo"[0] and the Freedom Hosting exploit in 2013 dubbed "Torsploit"[1].

There were 25 arrests in the first operation and those suspects are currently fighting the search warrant because the FBI failed to give notice to the those who had the virtual search warrant executed on them within the required 30 days.

Nothing has really come of the second operation (after over 10 months now) except for an arrest of someone the FBI was able to identify without the help of their exploit (they used the same user name on Tor as they did on the clearnet).

[0]: http://www.wowt.com/news/headlines/Fed-Tactics-on-Trial-in-P...

[1]: http://www.propublica.org/nerds/item/is-the-u.s.-government-...
It's income without the need to work for it, which is basically the same thing as having an investor or being able to live off savings, in the sense that it allowed her the time and opportunity to write. If she didn't have those social security payments, she would have had to get a job, and she probably wouldn't have had the time and energy to create the vast amount of wealth she was able to create.

This is a great argument in support of Basic Income. How much wealth is currently not being created because the people who would create it are trapped scraping a living from useless low-pay work?
Thanks for your testing! We have fixed the script / meta tag strip problem. We keep improving our code base, making sure emails are rendered correctly on web pages. We won't use user data for anything else.
http://i1.wp.com/www.raphkoster.com/wp-content/uploads/2014/...

This image from the article is so true it actually hurts. The number of times our company has had a conversation like this would boggle the mind. We are not even a mobile game. We are a free to play PC title and we still get this garbage.

It's interesting that publishers for Asia don't have this mindset. They are willing to actually put money up front, something that no non-asian publisher has ever offered us.
I don't see how themes/plugins have anything to do with an (A)GPL licensed end-user application that doesn't support any sort of plugins (at least not to my knowledge).

Even if you did write plugins for apps and license/sell them, that would stop you from using a useful app just because you couldn't do it for that app?

I'm having a hard time following how AGPL affects you as a user of the app, not someone who's selling addons for it and not as someone who provides the app over a network.

It seems you could modify the source and run your own version without releasing your modifications and without violating the (A)GPL.
Everyone loves the low-prices of WalMart, but they then turn around and bitterly complain about the low-wages that WalMart pays their employees.

Even if these employees could get a second job, what makes you think they will be able to find one? Unemployment is sky-rocketing in the US.
>If you are referring to a vindictive mob singling out a low-ranking individual for mob justice, nowhere.

It sounds really terrible when you say it like that.
Also http://corp.galois.com/halvm.

Those three have in common the trait that they support single language runtime: Erlang for Erlang on Xen, OCaml for MirageOS, and Haskell for HaLVM.
And bottles of Club-Mate strewn across the otherwise empty apartment floors.
Hm, sqlite3 would be slow for large collections of small individual files.

However their approach is awful. Imagine what will happen if you tag video/audio files.
That is partly true. But if there is nothing to hack into, there will also be nothing to log in to for an admin or an ops person.

In the case of Erlang, for instance, it provides a built-in remote shell which allows one to connect to a running Erlang process, get multitude of information about the VM, loaded code, etc.

As long as there is a convenient way to maintain a running system, that same way can be used for hacking.
What To Know When Debating Type Systems
> projects such as DROPOUTJEEP confirm that the iPhone isn't to be trusted

That iPhones used to completely trust physically connected devices without any verification was obvious to anyone paying attention even before it was verified at Black Hat USA 2013 [1]. This was fixed in iOS 7. The evidence we have of DROPOUTJEEP says it is installed via "close access methods" [2]. I wouldn't be surprised if remote vulnerabilities exist that could be used to install it remotely, but I am aware of no public evidence that they are being exploited now.

1. http://www.zdnet.com/researchers-reveal-how-to-hack-an-iphon...

2. http://www.zerohedge.com/news/2013-12-30/how-nsa-hacks-your-...
Works fine for me, and it has Eugene as an option after typing only the first few characters.
Austria wins Eurovision Song Contest
I wish the FBI weren't so picky about irrelevant factors in hiring -- it would make it a lot easier for them to get top-quality talent in technical areas like computer security (for internal use and for computer crime investigations).

It's really a two-class system, where people who are full agents (the badge/gun/etc. thing) exist pretty separately from support. There are certainly reasons to want people involved in investigations to be full agents when possible, but it does make hiring a lot more difficult.
The criterion is simple: a small number of reposts is ok when an article is solid and hasn't had significant attention on HN. We want good stories to have multiple cracks at the bat, or sheer randomness would prevent many from ever getting seen.
If you pay close enough attention to HN that those two previous submissions counted as already having seen the story, you're way beyond the 99th percentile!

That's why we leave the dupe detector so porous. HN's goal isn't to build a database of unique urls—it's to have the most interesting front page possible.

This system is easy to abuse, so we ask people not to abuse it. For example, don't delete things and then repost them. But I don't see abusive reposting as a huge problem on HN right now. We catch most of it, and alert users catch nearly all the rest.

Edit: I should mention that we're going to be releasing a new approach to /newest that addresses the tendency of good stories to lose their chance at the front page too quickly. Exactly when we release it depends on how much code I get to write in the next month or two.
In case you wonder why this submission doesn't get the up-votes and discussion you might expect, some of us have seen it before. Here are some of the previous submissions, some of which have discussion:

https://news.ycombinator.com/item?id=7727064
https://news.ycombinator.com/item?id=7263243
https://news.ycombinator.com/item?id=7149634
https://news.ycombinator.com/item?id=6953863
https://news.ycombinator.com/item?id=6504217
https://news.ycombinator.com/item?id=6234361
https://news.ycombinator.com/item?id=5804668
https://news.ycombinator.com/item?id=5728844
https://news.ycombinator.com/item?id=5728843
https://news.ycombinator.com/item?id=5695816
https://news.ycombinator.com/item?id=5377944
https://news.ycombinator.com/item?id=5129062
https://news.ycombinator.com/item?id=4586462
https://news.ycombinator.com/item?id=3507566
https://news.ycombinator.com/item?id=3503896
https://news.ycombinator.com/item?id=1475826
https://news.ycombinator.com/item?id=1327746
https://news.ycombinator.com/item?id=1310127
https://news.ycombinator.com/item?id=599164
not quite the same thing, but a few years ago i built a library that would print test results to a web framework (can dynamically add graphs, tests, analytics, etc)

Ran an example where i find the pupil of an eye:
http://users.ece.cmu.edu/~jsmereka/eye/imgtst2/index.html
Orangutans and Koalas
> But there's significant cost in building infrastructure that can deliver more bits.

Here's the problem with that: You have to build capacity for the peak load you want to be able to support. But the reason peak load is peak load is that everybody is using bandwidth then. If you buy a fast connection and you expect that fast connection to be fast the one day a year when they're streaming the Superbowl, you're contributing at least as much to the need to build infrastructure as the guy who watches Netflix nine hours a day. Since everybody wants to use the internet when everybody is using the internet, everybody should pay the same amount.

> How much cognitive effort do you spend factoring in the cost of electricity, gas and water when you're making spaghetti?

You make spaghetti every week, it has roughly the same utility and cost every week, and there is no real risk that you could quadruple your electric bill by not paying enough attention to how much spaghetti you make.

Bandwidth doesn't work like that. Most people have no idea how many bits it takes to do something on the internet, it's extremely difficult to determine whether something is worth seeing until after you've already seen it, and it's incredibly easy to sit down at a computer for "five minutes" only to realize you've been watching YouTube videos for 14 hours.
I think they're worried about being sued for accusing Mr. Smith and Jennifer of crimes which they haven't been convicted of, whereas Mike Davis just admits to crimes directly (for a good cause, but it certainly seems like he's exposed to some legal risk here, in the US and especially India, although I suspect no prosecutor in the US would go after him, and no jury would convict, because he's doing it for a good reason.)
Perhaps deployment and management practices will change to take into account this approach to management, rather than forcing the existing insecure approach onto dedicated applications/servers.
Hardware for deep learning
China building high-speed rail line from Beijing to the United States
Worthy of "Hacker news"?
Kind of hard to take your seriously when it's hard for you to take mature software that has been in circulation for over a decade 'seriously' because of 'bro' in it's name.

Time to move on, it's no longer a 'cool' thing to circlejerk over.