skysight-inc/HackerNews huggingface dataset:
One more warning... Two years ago I was on a project that spec'd inexpensive transducers from China. We bought samples from multiple factories and they were all terrible. Datasheets were vague, and a lot of the transducers didn't even meet those weak specs.

Ultimately it didn't matter much for our beauty product but it would be a big problem if we tried to use them for imaging.
I actually intend for my private data to die with me. I have gone out of my way to guarantee that it will. In my view, if I haven't published it, then it shouldn't be accessible.

I have absolutely nothing to hide. I have simply always treated my privacy as something that was valuable in it of itself. Perhaps even more valuable than the photos I clearly opted to not share with others, to go off your example.

I also don't understand why it's so absurd for some people to conceptualize non-malicious things you wouldn't wasn't to share with anyone but yourself. Hell, I have tons of notes and things I write to myself that I definitely do not want to be seen by anyone. They simply weren't written with the intention to be read by others. So I don't sympathize with desire to make a deceased person's private things accessible, even to family. Let it burn. It might have been the owner's intention all along.
Mailgun, Sendgrid, Postmark are all alternatives. Mailgun is what I mostly use.
There's also a 48 hour window and touch ID doesn't work initially after booting.

https://support.apple.com/en-us/HT204587

Great design.
They aren't many bird species that mate for "life" procriate with other mates during the actual mating season but nest with their original mate.

It seems that there are 2 nearly opposite evolutionary drives one is that long term bonding increase the likelihood of offspring survivability and the other that promiscuous mating increases the overall group genetic diversity.

Some bird species that also present same sex bonding will have single sex bonds nesting and having another female lay eggs in their nest, other species that operate under more communal care for their offspring show behavior akin to what we would call adoption.
50GiB/day is less than a megabyte per second. Surely you wouldn't be bandwidth-limited on a real device, even consumer SSDs are in the 100-600 MiB/s range IIRC. Can you do anything to increase your bytes per IOP in your current environment if you're IOP-limited?
I guess you could send pre-encrypted data to iCloud to try to avoid Apple's backdoor... but of course if you do that from an Apple device, there is no guarantees...
It seems to also depend very much on who the website is for. The reality is that many organizations (small businesses basic organizations restaurants schools nonprofits etc.) need sites that do basic, routine things, in which case, the hard problems are solved, and good templates are available. In that case, having an in-house person who understands the company's needs is better than having a sophisticated specialist. It seems like, as the # of websites has increased, one would have expected the demand for web designers to increase proportionately, but it hasn't, because the orgs with the most complex site needs were the first to build.
They could just as well be asking, "Why is Salesforce so expensive when the marginal cost of each additional user is negligible?"

The answer is that the market price reflects a lot of other costs than just parts for adding an incremental user.
Yes, and yes! The 3D avatar in the app moves in real-time with you.

The best spot to see videos of the current app in action is our Instagram @getenflux.
Flooding the (tech) market and lowering the average wage of "experts" in the field in 5+ years.
Nothing says "market forces" like Unions.
The CFAA has nothing to do with stealing cable or tapping phones, both of which existed (and were almost certainly illegal) before the CFAA and before digital cable or digital phone systems.

Regarding buying random phone numbers, I'd say again, analogies are only useful to demonstrate the existence of an area of law in which something is legal or illegal, but not useful for designing in detail the laws governing digital/networked activities. There's not a sufficient parallel to make any decisions based on any analogy to a previous situation or technology; there's only enough parallel to prevent closing off the discussion of making privacy violations illegal by saying "it's not".
Perl's algorithm has more power than an NFA, therefore, it is not an NFA. It's as simple as that. That certain inputs happen to correspond to a configuration solvable by an NFA does not make it an NFA. The worst part about calling it an NFA is that it misleads everyone about the theory and suggests that the engine is less powerful than it really is.

I completely understand why it looks like an NFA.

> What the heck do you call it?

Anything but an NFA? My personal preference is unbounded backtracking (still not quite right), or just "Perl regexes."

> (As well, that is how it was described in a number of popular and widely read books. For example pick up _Mastering Regular Expressions_.)

I read that book when I was a young pup and remained hopelessly uninformed about the entire situation until my first complexity theory class during my undergraduate study almost ten years ago.

That book is fantastic if you care about optimizing Perl regexes. It otherwise does a great disservice to theory and has likely been the cause of uncountable confusion. When pointed out the inaccuracy, Friedl essentially had the same response as you. It's tragic, frankly.

PCRE's documentation even cites Friedl's book when describing their implementation by calling it the "NFA algorithm." PCRE also has a supposed "DFA," but its description makes it sound more like the actual NFA algorithm (since it maintains multiple states simultaneously).
The issue here boils down to process. Turn-key solutions like Wix have sprung up to cater the low hanging fruit. For everything else, the diversification of our digital lives across web and mobile devices have forced new interactive constraints on the traditional graphic design process, meaning its print media process foundations are no longer workable. Rather, the modern design process has to be much more agile and interactive than a flat design file can allow. The result is that we now have programmers trying to design, and designers trying to program.

But it's a short term problem, because design software with interactive and adaptive tools are being constructed to help designers accommodate the new constraints and allow them back into the process.
Indeed, the cloud is a huge problem.
> How to calculate this “shortest unambiguous string” efficiently is more tricky than you might expect. In fact the best known algorithm for calculating it was published only in 2010, in the paper Printing Floating-Point Numbers Quickly and Accurately with Integers

That's no longer the state-of-the-art. The latest approach - and possibly the end of the road for research her - is Andrysco et al.: http://cseweb.ucsd.edu/~lerner/papers/fp-printing-popl16.pdf

It's been on the front page previously: https://news.ycombinator.com/item?id=10915182
Torture to get detailed info, use details to establish plausible parallel construction.

Enter parallel-constructed information as court-sanitized evidence.
Twitter's missing manual
There have been studies with over 5-sigma confidence intervals that are not taken seriously simply because it's controversial. It's just we're wired to the status quo and nobody likes to be tricked.

And you can't keep say, a factory or a house running on snake oil, so it will be evident pretty quickly.
> It amazes me that people still think that strong typing isn't useful.

I've heard people argue that its not always a net benefit, but I've never heard anyone argue that it doesn't have benefits.
Doing real time query for report generation for data growing by 50gb per day is a hard problem.

Realistically, this is what I would do (I work on something very similar but not really in adtech space):

1. Load data in text form (assuming it sits in S3) inside hadoop (EMR/Spark)

2. Generate reports you need based on your data and cache them in mysql RDS.

3. Serve the pre-generated reports to your user. You can get creative here and generate bucketed reports where user will fill its more "interactive". This approach will take you a long way and when you have time/money/people, maybe you can try getting fancier and better.

Getting fancy: If you truly want near-real time querying capabilities I would looks at apache kylin or linkedin pinot. But I would stay away from those for now.

Bigtable: As someone pointed out, bigtable is good solution (although I haven't used it) but since you are on AWS ecosystem, I would stick there.
I agree, the author confuses "business to business" with "business related" or perhaps more specifically "not a personal/recreational network".
This is a not a good guide. Avoid Graham too.

PCL is much better. Keene too. Seek out Joe Marshall's Warp Speed intro too.
That's normal style in mainstream journalism, weird as it is. If you read a lot of sports journalism for example, you'll see a ton of articles which are literally just a summarized transcript of a phone call a reporter got from an agent, written as if it's just pure factual information that appeared from thin air. At least in those cases it's trivial to guess who the source actually is.

Again, it is objectively very strange to not even hint at what the source of your information is. But it's also standard practice.
Another price comparison.

$20 w/Postmark: 13,000 mails

$20 w/SendGrid: 100,000 mails

Postmark also doesn't offer the option to upgrade to a dedicated IP later on, which many larger companies find is better for deliverability.

Full disclosure: I'm a SendGrid engineer.
Word Map
does stripe support personal bank accounts? I have a U.S personal bank account but I don't live in the U.S. nor do I'm a U.S. citizen, in my country there isn't anything as awesome as Stripe, the bank infrastructure here is pretty bad and non existent for online payment processing of credit cards. All my clients will reside outside the U.S. but I want to use U.S/Stripe as a proxy for getting paid.
Honestly, I've done a lot of support for seniors and non-technical users, and I'm absolutely positive there are people getting feedback like "we don't know where to get Office" and the like. And that decisions like this (along with the questionable methods of streamlining Windows 10 installs for Windows 7 and 8 users) are primarily motivated by a desire to make Windows not seem harder to use than popular mobile platforms.

But there's been a huge breakdown, I think, in realizing that it's not correct to treat all users the same way. The fact that my Pro-licensed, domain-joined PC auto-installs Candy Crush on it is kinda an indication they're missing this critical piece.
I like this, because it points to addressing user silence with respect to expectation of privacy. Take your idea one step further.

Suppose Tor provided a box that users could (optionally) click to affirmatively declare they were using Tor with an expectation of privacy. Maybe this selection could be locally stored in an encrypted form so that users, if they later needed to prove they had an expectation of privacy, could show they had ticked the box declaring that.

This could provide an affirmative declaration that the user expected privacy when using Tor. Would that be useful? Thoughts, anyone?
Power-cycling can be done relatively quickly - in 10sec with two fingers (no swipe), or 5 sec + swipe if you only have one hand available.
Perhaps that's not the goal of this study? I think there's benefit in knowing that there is a difference, even if it's just in the ability to get further, more targeted studied funded now that a fundamental question has been answered. Now, instead of answering both whether there's a difference, and whether it affects a specific aspect of blood testing, future studies can focus more on the second aspect of that. I imagine that makes funding quite a bit easier to get.
These issues have actually been litigated in court. The broad consensus is that yes, the police can use a surveillance plane can take pictures of you without first obtaining a warrant (Florida v. Riley), but no, they can't use infrared camera to look inside your home without a warrant. (Kyllo v. United States)

None of these cases are really analogous to the Tor case. Generally speaking, you have no reasonable expectation of privacy that information that you voluntarily provide to a third party will be kept confidential. This is why the police doesn't need a warrant to get your phone records or to obtain your IP address.

You bring up mail, which is an interesting case. Conents of a sealed mail IS protected by the Fourth Amendment - it's just that the government usually relies on the "exigent circumstances" exception to the warrant requirement (basically, showing that there is probable cause to search the mail but that there is no time to obtain a warrant). The government can't just mass-open all sealed mails and look at their contents.
This is about as tasteful as they could've gotten and I applaud them for their choice. It's visually appealing concept art showing a cool setting, and it's completely devoid of logos and obtrusive indicators of brand. It doesn't say "TOMB RAIDER" in the corner. There is a call-to-action, but it's absolutely tiny, and takes you to their Store app, not some sketchy website.

This is product placement at it's best, really. It's subtle, attention-catching on its artistic merits, and stays out of your way if you're uninterested.

I'll even go as far as suggest that this is exactly the kind of advertising I'd prefer, if we must have advertising (that point can be debated).
Nice way to throw us under the bus! Not even a grandfather. Spending hours hunting down api keys and installing new libraries. Thanks!
I concur, most of the job offers I get are relevant and some of the big companies' internal recruiters contact me via LinkedIn: Google, Facebook, Amazon. It may not be perfect but it's far from useless. My impression is that it allows skilled recruiters to make solid connections and lookups. Poor recruiters will always be poor matchers and spam folks.
If your data is growing at this rate (and you plan to keep this data around), you'd want a distributed database that can scale to terabytes. But it might be overkill if you dont care for data consistency (i.e., you dont need to read it "right away" after you do a write):

If you just want reports (and are okay getting them in the matter of minutes), then you can continue storing them in flat files and using apache HIVE/PIG-equivalent software (or whatever equivalent is hot right now, im out of date on this class of software).

If you want a really good out-of-box solution for storage + data processing, google cloud products might be a really good bet.
That is also an interesting point. It certainly comes up often when next-of-kin go through the private physical possessions of the deceased and discover secret love letters, diaries, etc. They probably wanted those to stay private.

But for bank account records, most photos, etc., you probably don't want those to disappear in the event of your death. You want those to pass on.

Given the choice between the two defaults, it makes a lot of sense for Apple to make "accessible to next of kin" the default, and "dies with you" the opt-in.
Yeah their paid accounts are horrific
I'm using sendgrid for transactional. Sendy + ses for marketing. Costs me cents per month.
Used it back in the day, Wonderful duplication tool for CD/DVD
Thank you Apple. The FBI forced the end of the encryption debate. This is good news.
Mick is one of my fellow co-founders :)

You'll also be able to review your motion capture video post-workout to study your form and improve.
Beware that sendy comes with many backdoors though. Put it in a vm with a strong firewall.
I've been a voip engineer, a network engineer, a software engineer and a devops engineer. I've never taken a CS class in my life.
For the people like me who were happily using Mandrill's free plan and would like to continue to do that:

- Mailgun offers 10,000 emails/month for free

- SendGrid offers 12,000 emails/month for free

- Postmark gives you 25,000 free emails when you sign up, but they start costing money when those run out
The article's about statistical averages, and their implications for the modern social sciences, not about historical classes and castes.

Indo-European society probably had three castes: medicine men (responsible for law and justice, good relations with the gods, and magic; "wizard-priests" would also work as a description of their role, but feels too flattering for such an early, primitive society); warriors; and commoners. India split commoners into two classes (artisans etc., and laborers); Europe and Persia grouped skilled and unskilled commoners together. Europe and India both saw intense competition between the two top estates -- roughly speaking, magi and knights -- to determine who would rule society; in Persia, the magi more or less won without a fight (and sacralized the knights), thanks to Zoroaster.

In short, it wasn't nearly as simple as royal versus non-royal, at least not in the Indo-European world -- and the high-ranking estates had obligations as well as privileges.
Apple ordered to provide access to 11 more phones
Switching to 'dumb' phones is probably not feasible to me at the moment, for several reasons:
1. When I'm bored or waiting for something, usually I read books/comics. Not so much on games anymore.
2. I'm into digital photography. It's much easier to send your photos from the camera to your phone via wifi and do the postprocessing there, instead of using Lightroom on your PC/laptop.
3. Messenger apps like Whatsapp or Line. Curiously, I use them more than phone calls :p
4. Blogging
OK - So why should I use ZeroDb when it seems to be using Crypt-DB for encrypted query processing [which is the USP of ZeroDb] when cryptDb is fully open source, free and verifiable?
https://blog.twitter.com/engineering
This is such a shame.. I have no idea need for any of mailchimps services, yet now I'm forced to pay for it? Why? From what I can figure out from the pricing page, this nearly 10x's our monthly cost. NOPE

Later Mandrill.

I'm more sad than angry.. it was an incredible product.
Since you're responding to me I'm assuming you mean me, but I have no problem conceptualizing non-malicious things you would want to keep private.

The problem here is that a lot of the stuff stored on phones falls somewhere between "dies with me" private and "should pass on to my family" private. Or "should be recoverable if I lose my key" private.

Strong encryption makes it impossible to recover in the event of a lost key or pass on to family in the event of your death. So that's not necessarily a great default for, say, decades of family photos. It would be a huge tragedy if that was lost.

The good news is that Apple does provide tools to opt-in to stronger security, rather easily. For example, the Notes app was recently upgraded with note-level strong encryption. That might be a good solution for your most private notes, without endangering the survivability of your digital memories and assets.
Compared to an MRI machine it's very cheap
A few.

http://wiki.cyanogenmod.org/w/Devices

Open source means there's no such thing as a "Gatekeeper". As with every other open source project ever, you can just fork it. How many open source projects today are forked from their original repo because a large enough portion of the users and developers disagreed with the ones in control?

Honestly, this argument is just silly. https://developers.google.com/open-source/projects read that list and name one time where Google abused the control they had over the project they created. They already have a good track record for open source. This "gatekeeper" nonsense is just a bunch of unnecessary FUD.
Large list of contacts in your industry allows you to quickly vet new contact or prove to new contacts that you are not a newbie in your industry.

That's how connections who you do not personally know - help.
The original story has changed its title to "Apple Is Said to Be Trying to Make It Harder to Hack iPhones".

I was a bit surprised by the clickbait-y nature of the HN title, but we can see in the nytimes URL that this "Apple Is Said to Be Working on an iPhone Even It Can’t Hack" was the original title, eh.
First of all, 50GB per day is easy. Now, maybe contrary to what they say below, do the following:

* Don't use queues. Use logs, such as Apache Kafka for example. It is unlikely to lose any data, and in case of some failure, the log with transactions is still there for some time. Also Kafka guarantees order of messages, which might be important (or not).

* Understand what is the nature of data and what are the queries that are made later. This is crucial for properly modeling the storage system.

* Be careful with the noSQL cool-aid. If mature databases, such as postgreSQL can't handle the load, choose some NoSQL, but be careful. I would suggest HBase, but your mileage may vary.

* NoSQL DBs typically limits queries that you might issue, so the modelling part is very important.

* Don't index data that you don't need to query later.

* If your schema is relational, consider de-normalization steps. Sometimes it is better to replicate some data, than to keep relational schema and make huge joins across tables.

* Don't use MongoDB

I hope it helps!
This is more or less the direct rise of "digitisation".

Companies now realise that their online/mobile experience is no longer a "me too", but good customer experience is a powerful differentiator in market.

Freelance will go away. High value consulting will not. If you're not helping the average Digital Director in solving their challenges (be they scaling, conversion rates, cross device compatibility, load times, security, cost of maintenance, uptime).
There is evidence that the USPS has been logging all that metadata.

http://www.nytimes.com/2013/07/04/us/monitoring-of-snail-mai...

https://en.wikipedia.org/wiki/Mail_Isolation_Control_and_Tra...

I'm not saying that it's right but it apparently is happening.
They can have perfect hardware crypto, but they can always send a new OS update to every phone with "if your account id is in top 100 wanted, send a copy of everything to x.y.z". Nobody would ever know (until it's too late, at least)

(of course if the phone is not in use anymore it doesn't apply)
Just to add:

$20 w/Mailgun: 50,000 mails
> sticking to Windows 7/8.1

Well, you know, you can't walk into the same Windows twice.
(Unless you ignore all updates.)
When I worked at Sonic 10 years ago they sold (and still sell) a footlong hot dog. It's cooked on one of those gas station hot dog rollers.

I like a roller cooked hot dog, so I should look into whether or not BK is using rollers to cook them this time around. Can't say I care for a microwaved hot dog all that much.
There are plenty of "connected" GLUCO-MONITORING systems. A simple Google search with those 3 keywords shows plenty of results.
I'd start by asking if you are solving the right problem.

Does the business really need exactly this? What is their actual goal? Are they aware of the effort and resources required to get this report?
There is no clear line where total privacy starts and ends with technology currently available on the consumer market. Even if you don't use any proprietary software at all (which is very difficult to do for most people), your privacy could, in principle, still be compromised by the underlying hardware.
Palo Alto GlobalProtect Web Interface DOS and Possible RCE