skysight-inc/HackerNews huggingface dataset:
Netflix and other high bandwidth content delivery services should have used Bittorrent from the very beginning, and now are hitting a lot of resistance from ISPs because of their stubbornness to use CDNs instead.

I predict that companies will not be quick to embrace technologies like these, because they are stuck with the legacy of the DMCA (and region coding) so the loss of net neutrality is inevitable.

I’m hopeful though that the tech community will anticipate this and come up with a metric for broadband that only measures p2p traffic. That way when Comcast and others claim to provide a certain connection speed, it can be trivially verified and consumers can steer clear of false advertising.

Also the public needs to be made aware that the primary cost of internet traffic is still long distance, basically anything that has to travel out over the backbone. The connection from your home to the ISP is a one-time cost. So p2p traffic like Bittorrent actually lowers overall costs for everyone by sending data over the backbone just once and then distributing it from the local caches on everyone’s hard drive in the same city. Eventually that cost will be so low as to approach free, which is why I think self-organizing meshnets and darknets are also inevitable.
Happiness from Ordinary and Extraordinary Experiences
I made an earlier comment about that perception you have. You are likely and upper class US citizen who looks down on things like taxis and the bus. If "providing value" means playing into stereotypes, then I guess you are correct. I also am an US Citizen, born and raised, and your comments make be believe that you are a bigot against the lower classes and see them as dirty. Or maybe your issue is that there are too many non whites driving taxis. I can assure you that I have stated my beliefs accurately.

As a side note, the term "value" has been so overused at this point that when people use it I tend to think they are idealists and I don't take their comments as seriously as if they had not used the term.
The new React-based Brackets project tree
By getting the user to give me control of it, same as if the user was moving everything to a new computer. You don't have to do this via a website; you use a website to create a problem and then make yourself available to fix it.

Not that I'm into this sort of thing, but I've had a few people attempt to co-opt me into criminal activity in the past so I wouldn't be at all surprised to read about such attacks.
Or a text file or spreadsheet containing passwords, in a TrueCrypt container (I still trust it).
It looks like someone is systematically downvoting rational arguments in this thread without explanation, yours among them..
It would be nice to hook up a GoPro in the corner of the room and automatically record each matchup. Given that the system knows when games start and end and who's playing, you could even overlay a scoreboard and live stream or upload to YouTube.
As a denizen of HN, maybe you're the kind of person to have been exposed to "synthetic programming" on the HP41?
It would be interesting to see an alternative to Twitter that is as open as email is. eg: A microblogging system that is built on open standards in a distributed and federated way. Where no-one owns the platform and protocols.

There has been for years, it's called StatusNet (now GNU Social, apparently) and it's based on the open OStatus protocol. I had my own server federating with the reference instance (Laconi.ca), on which I followed a few users, like Tim Berners-Lee (who mostly cross-posted from Twitter).
The Webhook CMS Layer Is Now Open Source
And there are things like this: http://www.arrl.org/news/amateur-radio-transponder-will-acco...
This is really easy. You have one good password for 1pass, and one good password for iCloud.

If you can manage to memorize one, you can memorize two.
A more recent photo of Edith Macefield's house:

http://i.kinja-img.com/gawker-media/image/upload/18uugtoshe2...

Nice balloons. Won't quite lift the house up though.
i have to laugh at all this shit.

these celebutards have been posing nude of decades and crave the attention and the “me too” sluttiness of it all.

all it takes is for ANY women to catch their fuck-partners with nudies of some other freak for a women to join the party and start snapping away.

in fact, every chick i know loves taking butt-naked selfies of their twats and asses and sends them to every dude they are interested in dorking.

its a cootche arms race, plain and simple

who in the hell in this day, ESP CELEBRITIES, and age thinks digital privacy exists??
A position just opened up :)

Most inappropriate HN job posting, ever.

Is it perhaps a culture/language barrier? Do they even realize how callous their little segue is?
Please don't post
What’s for Lunch? Postmates Daily Specials
Union Metrics - http://unionmetrics.com - San Francisco, CA and Austin, TX

We are a fast-growing, profitable startup building powerful social media analytics software. Every day our systems process more than 130 million social events and deliver analytics for thousands of paying customers.

We have three open engineering positions:

* Data Engineer (Austin, TX)

We need an engineer who wants nothing more than to wrangle massive amounts of data. Do you love to build on top of open source technologies like Hadoop and Cassandra using hundreds of servers? Do you enjoy working in a polyglot environment with plenty of variety? If you're passionate about building the infrastructure to process, analyze, and store hundreds of millions of events every day, then we want to talk to you.

Responsibilities:

* Implement stream processing pipelines to handle hundreds millions of messages and events daily with Java and Ruby
* Use open source tools and data stores to analyze and store billions of data points
* Build workflows to make data accessible to end users

* Full Stack Ruby (& Rails) Engineer (Austin, TX)

We're looking for an experienced Ruby (and Rails) engineer who's passionate about the craft of building software. If you're interested in working with a small team of engineers to build software that not only scales but delivers an amazing user experience, then we'd love to talk to you.

Responsibilities:

* Implement core user-facing functionality in a Ruby on Rails application within a large service oriented architecture
* Design and build backend services and APIs
* Integrate with massive analytics systems and data stores

* Support Engineer (Austin, TX)

As a Support Engineer you'll work within our engineering team and be responsible for both automating internal processes and building web-based administrative tools to improve how we run our products and help us serve our customers better.

Responsibilities:

* Work with other members of the engineering team to automate and document common administrative and technical tasks
* Coordinate with the customer and engineering teams to gather requirements for improving internal web-based administration tools
* Perform technical administrative tasks to assist the customer success team in fulfilling customer requests

You can find more info about these positions at https://unionmetrics.com/company/careers and you can find out more about us at https://unionmetrics.com/company/about/.

I'm a member of the engineering team and I'd be happy to answer any questions about us or the positions: mando@unionmetrics.com.
Hubspot
Just to be pedantic: By the same logic, Google is also grossly hosting tonnes of illegal material.
I've toured several observatories in Chile (and had a blast doing so.) That being said, I studied astrophysics and spent a few months doing astronomy research in Chile, so I wasn't really taking public tours or anything.
Hacking my head empty
Even if you build a decent clone, it will be hard to break the monopoly due to one key feature: reliable factory reset. Teachers will require a device that can be reliably reset of all user data to prevent cheating. If the student can hide or mask the factory reset, it will never be approved for testing, and thus will never be approved for classroom use.
except google collecting data doesn't mean google shares that data with advertisers. its a common misconception of how the ad model works.

moreover google has one of the best records of security for a consumer facing company. your data is more safe with google than apple - no question about that.
Perhaps "not even close" was a bit strong, but I'm talking about a neural net as a specific mathematical model here. To say that the brain "is" an instance of a particular mathematical model isn't even really meaningful. At best you could try to argue that the brain is "modelled well by <formalism> for <purpose>", although I think you'd lose that argument for all but the weakest of purposes.

I'm not a neurobiologist (if you are please correct/clarify!), but here are just a few of doubtless many significant differences as I understand them:

* Real neurons don't update in a bunch of coordinated discrete timesteps, as an ANN learning algorithm does. They can fire independently and in continuous time.

* Real neurons' activation behaviour is closer to sudden delta-function-like spikes, rather than a smooth activation function or something which allows them to stay in a firing state for longer than a short pulse.

* The structure of the connection graph of neurons in the brain is incredibly more complex than that of artificial neural net models, can change over time, isn't split into obvious layers from input to output, there isn't a clearly-identifiable error signal which is used to train it at the outputs, ...

* A real neuron is an incredibly complex biological system whose behaviour can be modulated in all sorts of ways and which I expect would take a nightmarishly complicated set of PDEs to model with any degree of realism even as an isolated unit. To think we've captured all aspects of their behaviour relevant to human cognition with a simple weighted sum and a sigmoid (say) seems pretty naive.

Details aside though, the idea that you can start drawing deep philosophical conclusions about the nature of human thought, our ability to conceive of our own limitations etc, based on an analogy between a complex biological system and a simple mathematical formalism which is at best loosely influenced by certain limited aspects of it -- it's just silly, one of those "not even wrong" sort of statements.
why does reality somehow offend you?
I don't imagine* things would ever be as bad as "linux not being able to run", but Imagination are indeed going to have to seriously rethink their hacker-friendliness if they want to get anywhere in this market.

* pun acknowledged
The problem with using a per-capita dollar figure as a metric of police militarization is that, when you look at the list of the actual items provided, you discover that most of it is pretty innocuous stuff: flashlights, first-aid kits, tool kits, hazmat suits, canteens, etc. The kind of stuff that's available in any army/navy store in the country.

A lot of the counties that appear to receive a high dollar value of military equipment are getting entirely this sort of stuff. Conversely, some of the comparatively low-dollar-value counties have items like grenade launchers, APCs, full-auto machine guns, etc. in their lists. This is the worrying stuff, and the map doesn't offer a good way to distinguish it from the harmless equipment.
Microsoft begins dropping OneDrive's 2GB file size limit
I replied to a hypothetical question and pulled some random ideas out of my arse.
For those of you in this thread that are dismayed that some of us don't enjoy being tracked, I highly recommend a short, entertaining documentary that's currently available on Netflix, iTunes, etc. called:

Terms and Conditions May Apply

http://www.rottentomatoes.com/m/terms_and_conditions_may_app...

http://tacma.net/

Actually, I think even some privacy-conscious folks might learn a thing or two from it as well. I know I did. :)
https://www.google.com/search?q=ti+calculator+fake+factory+r...

Sounds like the actual requirement is to only be secure against people who never think to try.
I judge startup names too (agree "Toodu" is bad) but there is at least anecdotal evidence that bad names do not guarantee failure. My favorite example of the moment would be Whatsapp. I didn't check it out for years simply because I thought the name was trite and indicative of being a throw-away quality app effort. I suspect if one could do a real correlation study, it would back up the bad-name-to-failure theory.
It doesn't matter. If you have malware lurking in your computer it will just snarf your passwords from the wire and then you're owned all the same. If you use some sort of auth signing system, the request can just be intercepted and modified on the fly.[0] The Trezor is next to useless even for bitcoin for this very reason. Sure they can't steal your money directly, but just replacing the addresses you see and send to accomplishes exactly the same thing. If your platform isn't trusted, no amount if smart crypto or hardware dongles can make it safe.[1]

[0]: The rebuttal for this will be signing every request with details of it with a hardware dongle, but would you want to do this for every action in your email client? If the answer is "no", you're owned. Ultimate security is unusable, and doesn't really solve anything outside of the most astute of professional users. Just writing this post I would need 4 signatures, one to log in, one to post, one to fix a typo, and yet another to add this footnote. Would I be able to handle that? No way, I'm far too lazy for that.

[1]: The issue is that perfect compromise is impossible to detect. I can be reasonably confident on a heavily sandboxed device like an iPhone that there's little in the way of malware that would affect me. The downside being that I have no tools or methods of analysis if I thought it was compromised. There's no such confidence on the computers I use on a daily basis. I've always thought we have confirmation bias with malicious software. We only notice the dumb stuff while the smart goes unnoticed.
>I realize this might be difficult to account for, a lot of analytics actually just happens in Excel. For quick and dirty statistics or basic linear regressions, Excel represents a widely known quantity. In particular, I've been stuck using Excel in the past just because the final product is heading off to an individual or group for whom anything else is "too technical".

As someone who has/can use any of the listed software, another benefit of Excel (in addition to its pervasiveness and popularity with "non-technical" people) is its rapid prototyping capability. If your data is small-ish and requires no serious stats calculation (which accounts for a lot of data analysis, especially in the early phase), Excel is super fast to prototype in. You can do basic math, aggregation & filtering and charting all within a few keystrokes.

Another benefit that I see is that as an interface, spreadsheet shows you to show each step of the work. As a programming environment, spreadsheet is just a mess, but I find it easier to track what I am doing in Excel than working inside R/Python REPL and staring at my history or currently defined variables.
There's also the fact that the email format (something that is specifically not instant or near-instant, is primarily text, and works well in limited bandwidth situations) is well suited to interplanetary messages. I hope we will have that "problem" soon!
Since I always use IMAP, the local archive format is irrelevant to me - my mail entirely lives on an IMAP server.

I did have to migrate twice: once when switching from Eudora using POP3 to using IMAP, I moved the mail from the local Eudora archive to the IMAP server. Then other times when switching servers - either by moving the maildir or using IMAP synchronization.

I subscribe to the old archiving adage: if it is not spinning, it is dead !
Brian Krebs' post which broke the story: http://krebsonsecurity.com/2014/09/banks-credit-card-breach-...
Many people on the internet immediately minimize any argument they don't agree with as "trolling". It's easier to just call the other person a malintentioned degenerate than to actually address the points they raise.
Want to Program a PLC with from an IDE? No Problem: IDE4PLC
Divide and conquer.

Find a way to split it into something like 10 pieces of 10m LOC each in a way where you can understand and [re-]document the data and control flow between them.

Repeat with further subdivision, as much as you have people.

Then, if you really need to re-build this from scratch, do it per component - first, make automated integration tests for its functionality, and only then attempt to rebuild that part of the system.
That may be true of doctors with coffee bars, but it is absolutely NOT true of Google. Google is an advertising company, period. All of the thousand things they do are for one purpose: to sell advertising based on getting better and better at knowing the customer and targeting ads you're likely to click on.

Even if Google does say that some app is firewalled, the implied follow up is "...until customers stop caring" or "...until the law allows us to use it". Everything they do is intended to facilitate advertising, even if not yet.
I hate those so much. They lock me out of my accounts more often than they help. I always enter bogus answers because I think I'll never need to use the feature, then I run into a situation like:

"Resetting your password via email? Ok, you also have to answer these security questions that you entered 'akjhdhksdfsdf' into when you made your account!"

or

"You've logged in from a new computer! Please try to remember what you thought your favorite band was 4 years ago. You have 3 tries remaining."

Shit people, if you want me to write this stuff down, at least tell me when I'm creating my account that you basically expect me to have 4 passwords.
See also the fantastic Color.jl, a Julia package with similar functionality. Makes very pretty IJulia notebooks! More info at https://github.com/JuliaLang/Color.jl or just run Pkg.add("Color") at your Julia REPL.
"it requires an FPU, which wasn't guaranteed until ARMv7"

That was true until ARM went and broke this rule with the Cortex A5 (which can optionally have the FPU removed)
That's a very interesting read, and I'll have to give some thought to the implications therein.

I was originally thinking of something more along the lines of Radiohead's In Rainbows, released online for a donation, but may combined with a kickstarter-like fundraising effort to pay the upfront costs.

http://en.wikipedia.org/wiki/In_Rainbows
I've seen this argument come up before and I don't understand it. Why do you trust KeePass more than 1Password? In both cases you are sharing the datafile however you'd like (Dropbox, thumbdrive, etc...). The primary difference is if you have access to the source code or not.

If KeePass purposefully injected a vulnerability, it would just be that dev/project that would fail. If 1Password were to do the same, that company and all the people that work for it would go down. I'd personally see this as more of a reason to trust 1Password over KeePass.

The primary argument is that the code is open and you can audit it, but in reality that doesn't really happen unless there is a real drive to do it (like we saw recently with TrueCrypt).

I trust/distrust both about the same amount. But 1Password has more resources behind it so they are doing more to try and secure the data within the encrypted store.
Ask HN: International tax advisor for H1B moving?
Hi,

I'm a H1B worker, thinking about returning to my home country. I'm looking for a tax- and/or legal advisor who has experience with internation tax laws, FATCA and cross-border investments. Any pointers, suggestions, contacts are appreciated.

Thanks,
Cool to see your journey during this project.
Typesafe’s Commitment to the Scala Ecosystem
I use fastmail, I'm happy to pay for an email service instead of seeing ads
If the dongle sends cleartext passwords to the computer then the passwords may still be captured. If the dongle sends one-time passwords then it's basically a Yubikey.
Coq disallows stream crossing

Epic. Coq is the Dr. Egon Spengler of programming languages.
For passwords you're right, but at least it prevents theft of every password all at once.

For Bitcoin hardware wallets like Trezor, IIRC they either do or will support BIP-70 "Payment Protocol" payment requests that are signed with an X.509 cert, allowing you to verify the request on the dongle's screen.
But somebody who wants to burglarize your house, or worse, could figure out when you're likely not to be home.
The thing that bugs me is that you could have good password practices. But if you're having a party, having a fun time (and lets face it, people are going to do shit...), and one of your friends is snapping photos of you, and they have bad password practices, then you are kind of screwed. People don't typically make friends on the basis of: do you have good password practices.
My real problem with this is writing the password with numbers, punctuation and stuff on a mobile keyboard. Feels like surgery even if I'd memorize it.

I use 1P on my laptop most of the time so it's not a huge deal. Everything else on the iPhone just remembers credentials.

I know I can force myself to use a great password for iCloud but my point is that most of the time, I'd go for an idiot password rather than forcing myself. Just like most people.
> I tend to think of most "tracking" not as "stalking" but as "relationship building."

That is just another term (and a significantly creepier one) for the same thing, for those people who don't want that kind of relationship. A good rule of thumb would be to assume that people who "don't want to be tracked" have already considered the fact that tracking may help the company in question improve its service to them -- after all, this is frequently given as the justification for tracking.

From this viewpoint ("I don't want that kind of relationship, and am prepared to live with the associated service degradation"), it is logical to switch to services for which your envisaged greater accountability isn't necessary.

Incidentally, I have issues with DDG simply because it will return Android programming results from 2011 in preference to those from 2014, despite the entire state of play having changed in those three years, because it was a really good result in 2011 -- or because it simply doesn't seem to index as much of the Web. These are just anecdotes, but in my personal experience the "relationship" I have with Google search isn't a very large part of why it's good.
Anyone else disappointed the post didn't go into all that much detail? Scaling databases is hard if you're not privileged enough to have access to large pools of money to hire good DBA's.

Interestingly, I would love to see companies like Github opening up their database schemas to the public with mock data. Scaling is one aspect, but the best thing you can do in the beginning is to create a solid schema (normalise, denormalise...) it would be interesting to see what Github uses and why. Still awesome to see MySQL being the choice most large companies like Github choose in the face of new and untested NoSQL databases like MongoDB.
Don't compiler plugins provide a way to provide a way to experiment with language changes more quickly?
You mean like modern industry? Yeah, almost no one benefitted from that.