skysight-inc/HackerNews huggingface dataset:
What really burns me is that this strategy is so well known. 1984 was written almost 70 years ago, and yet we have millions of people begging for persistent, unavoidable surveillance by authorities as part of a never-ending war with an ambiguous enemy that our own policies are strengthening.
It keeps me up at night too. I am thinking we should establish a list of all those politicians who have actively impeded efforts to fight climate change. then at least we will have a least for our children to work through when they decide on a fitting retribution
Did nobody mention Xanadu?
In 1982, I read Herman Kahn's The Next 200 Years and got pumped about power from nuclear fusion. The tokamak was hot and the wisdom at the time was that it was 20 years away. I talked with my Dad, he said fusion power had been 20 years away since he was also 17. It's still looks like it's 20 years away.

My point isn't that practical fusion power is a scam. But to me it doesn't look appreciably closer to practicality than cold fusion and a whole lot more money has been spent on it [which as a metric of grift is probably among the better ones]. Which is to say that my point is that what constitutes a scam is in the eye of the beholder. We celebrate Charles Babbage.
To save you some time, we have a blog post covering the criteria to use: http://blog.sendwithus.com/which-email-service-provider-shou...

I'm biased (as the cofounder), but I strongly believe that you should treat email delivery as a commodity and use a product like Sendwithus.com on top of it.
Bottom of this page: http://vazor.com/unicode/
We can still imagine a state actor spending the megadollars to research a reliable chip-cloning process, to bring parallel brute-forcing within reach. I wonder if the NSA have been on a SEM/FIB equipment buying spree lately.

The ultimate way to defeat physical or software attacks is to exploit intrinsic properties of the universe, which suggests finding a mathematical and/or quantum structure impervious to both.
I wrote Yet Another UUID [1] for my own purposes recently as well. Mine's based on Firebase's style UIDs [2] -- they sort roughly chronologically, because operationally, I find that irritates me less. Arbitrary choice? Entirely. Regrets? None. Do I recommend it for use? Also not at all. Unless you feel like it. It's fine. I guess.

I've kind of given up on there being any purpose to a One True Spec for UUIDs. Count how many bits of entropy you want. Shove some CSPRNG into it. Call it a day.

¯\_(ツ)_/¯

(This a fine implementation, fwiw. I only mean to share my honest question as to whether there's any real utility to UUIDs-as-a-library.)

[1] https://github.com/polydawn/repeatr/blob/dd41ca72421a173b5aa...
[2] https://www.firebase.com/blog/2015-02-11-firebase-unique-ide...
Honestly, someone using Tor should know that your communication details are being held by exit nodes. Isn't it kind of common among the community to not trust your exit nodes?

I would say that the assumption is that your communication is public.
The Trichotomy of National Security, Data Privacy, and Data Protection
Today’s airship designers share a vision: magnificent amounts of trucking going on in the sky—regular convoys of enormous airships carrying timber, coal, wind turbines, prefabricated homes, or an entire summer harvest, puttering gently along at about a hundred miles an hour, ten thousand feet over our heads.

So, airships are the next container ships? Sounds intriguing. Do they emit less CO2 per mile than the container ships?
I can't believe this. I use their free plan because I send a minimal amount of email per month. Absolutely no way I'll consider going to $20 per month for my basic needs. I'll probably go ahead and switch newsletter services over to something else too. Who knows when they may get a wild hair and do away with their free account there too.
The market has been flooded for a while. It's not a shortage of quantity but of quality.
How to convert video to iPhone 4 3D
Seriously? Even I knew the first one and unless I'm quite mistaken the second one can be felt by just raising your arm -- or, better, turning your head upside down.
Of all the kinds of automation you could choose to argue against ...

There will always be a need for people lending money to have salespeople, loan adjudicators etc. But interacting with the teller is only necessary (or enjoyable) for certain demographics. For most people it is no fun to wait in line to get your $100 while the tellers chat away ("quill and pen" indeed).

As far as the cashless society goes, I reckon the effect on the poor would/will be far worse than the effect on consumers of retail banking services.
I agree. That's a front-end programmer. A modern UI/UX designer's realm extends to HTML and CSS. The more JS they know the better but is not necessary.
We love those projects at my company (Inovia Team). Your load is not that big. You won't make any big mistake stack-wise, you just have to pick something you already have operated before in production at a smaller scale. Mysql, Postgres, Mongodb, Redis will be totally fine.
We have a training on how to insert 1M lines a second with off-the-shelf free open source tools (SQL and NoSQL). Ping us if you are interested by getting the slidedeck.

Tip: focus on how to backup and restore first, the rest will be easy!
As an aside from the topic at hand, this article is 3 hours old and has 52 points. Why is this hidden on the 11th page?
What data is likely on someone's phone that is not also in the cloud one way or another?
I think the argument I summarized in https://news.ycombinator.com/item?id=11171344 is reasonable. In a nutshell, they say that we should apply the third party doctrine as if we're in a world without third parties. So in the tor case, if they would need to manually transfer information, then the identity of both people would be known. The basic intuition is that technology shouldn't allow more hiding. (This is a simplification, read the sources to understand the point being made.)
I use ZaNavi, from the F-Droid repository.

It's not great, but it's OK.
This is good advice but lz4 and it's chunked couterpart 4mc are much better suited for big data imo. This is the difference between 1 hour and 4+ hours for an archive of 300GB uncompressed on a single SSD based node.
The BBC used to distribute software for home micros via teletext pages. Not source to type in, but encoded pages.
They shouldn't be. Chess is just a game.

When they add in gambling to it, then they can raise an objectionto it. But not because of the game but that people are placing bets on it.
The Role of Statistical Significance in Growth Experiments
Website is also a minomer now more than ever. If it's online and you access it via the web is it a website? A product? A web product? A web app? SaaS app? Is it mobile? Is a webkit app a website? Is a website wrapped in a mobile browser ported to a phone a website?

One could certainly argue in either direction for all of those questions. The skills are all very similar, the technologies are mostly the same (foundationally).

I don't think work is drying up nor demand going down. I think designers are more important now more than ever, they just might not be traditional web designers.
Could Apple not push an OS update that can compromise everything they are doing to make the iPhone unhackable? As long as user has to trust Apple there's always going to be the possibility that FBI/NSA/Whoever force Apple to update a target's iPhone to enable tracking/recording of whatever information.

It's not an attainable goal in practice. Today they generate a per device customized update that can be installed without user intervention. Even if they tomorrow enforce user intervention they still retain the capability to push a targeted update for a specific device on law enforcement/court order. The user has no way of telling what the update did.
I would highly recommend looking into Elasticsearch. Clustering and scalability are its strong points and can help you with your quest.
Show me a house running on an eCat then.
Can confirm, don't use mongo.

We're stuck with it now, and I really wish we had used Postgres for biz data and Cassandra for the high volume non-relational data. They're just materialized views on-top of your event stream anyway.
Just to add a bit more information, the Kyllo v. US case was decided based on what a person would reasonably expect a member of the public to own.

Many people have planes that fly about, drones or whatnot. So you could expect random members of the public to have ways of taking arial pictures of your house. Therefore those do not violate your right to privacy.

It's very unlikely for a member of the public to own a helicopter with an infrared camera, so using it without a warrant is a violation of privacy.

The basic example used by a court is binoculars. Most people have access to binoculars, and own them. So if you do something next to your window, police can totally look through your windows with binoculars and act on the information.
Not quite the entire Internet has gone that way. However, it's frustrating seeing sites that offer original content with paid access being criticised all the time, as if they're somehow evil or trying to rip visitors off by honestly charging a reasonable price for their work instead of giving it away for free and making a deal with demons to fund it some other way. This is what we get for letting $0.99 ifart apps become the benchmark for a whole generation, I guess.
I think they could do all the stuff that makes it unhackable in hardware, and/or they could make it so updates aren't installed while the phone is locked.
It's very difficult, especially since they aren't open source. However, they could attain a state where to compromise a device requires the user accepting a malicious update, which would make the FBI's current request moot.

(although there's a whole separate set of legal attacks unexplored)
Not many downsides, if implemented right. Problem is, most languages have very simplistic type systems, which get in your way, specially if you are trying to code a function that will operate with many different possible "types".

Then they add kludges to make life bearable (see also: Generics), that will then add complexity. And are sometimes horribly implemented (see: Java's type erasure), or C++ compiler authors struggling with its template system (and users struggling to this day).

Or sometimes they don't even add the kludges, making life tedious (see: Go, and endless discussions about adding generics to it)

The other category of hacks is what's usually called "Reflection", or "Introspection". Any time a language designer feels necessary to add such a name for the ability to lookup things, then you know you are in a world of pain. The contortions required to by some languages to implement Ruby's 'respond_to?' method can get ridiculous. So much so, that the usual workaround is to add 'interfaces', which are a type(that does nothing useful), and so you can check the type. Or pass it around to something that will expect that over-arching type.

Sometimes you just don't care about a thing's type. And, many times, the types that you should care about are not the ones that are actually specified. If I'm doing something important, I don't want the compiler to check if the type is integer, I want it to check if the type is, say, Miles, as opposed to Kilometers. That's what's important, or my costly space probe will literally crash.

A language should make it easy to do so, otherwise people won't bother. Or probes will crash. Even though the program compiled. And the UML diagrams are spotless, with the factories all building the object types they were supposed to.
Here's what I've done for ~200GB/day. Let's pretend you have server logs with urls that tell you referrer and whether or not the visit action was an impression or a conversion and you want stats by "date", "referrer domain", "action":

* Logs are written to S3 (either ELB does this automatically, or you put them there)

* S3 can put a message into an SQS queue when a log file is added

* A "worker" (written in language of your choice running on EC2 or Lambda) pops the message off the queue, downloads the log, and "reduces" it into grouped counts. In this case a large log file would be "reduced" to lines where each line is [date, referrer domain, action, count] (e.g. [['2016-02-24', 'news.ycombinator.com', 'impression', 500], ['2016-02-24', 'news.ycombinator.com', 'conversion', 20], ...]

* The reduction can either be persisted in a db that can handle further analysis or you reduce further first.
It is reasonable to assume that you are attempting to keep the information private. It is reasonable to assume that the US govt would not hack the information on that basis.
If you assume it's public, why the hell are you using TOR at all? Use of TOR shows the assumption pretty clearly.
Absolutely this. If you're in the AWS ecosystem then move away from the bare-ish metal and onto the tools they provide for doing this stuff. MongoDB in particular really doesn't seem to be relevant to the problem at all. Throw all the data into Kinesis, and then push the bits you need into Redshift the other end.

If you want to keep a lot of data for ad-hoc queries but only use a subset for regular queries then consider setting up separate dense compute and dense storage Redshift clusters as appropriate. As far as pricing goes there's a hell of a discount for going reserved once you've got things set up the way you want them.

Once you've got that running and the immediate fires are out you may want to look at Spark to pre-compute some of the reports (you can still push the computed data into Redshift tables to save changing the reporting too much), although I don't think spark as a service isn't really there in AWS right now, and running up an EMR cluster is seriously going to cost you.

Bigtable provides similar capabilities to Redshift in the google ecosystem, and looks okay although I wasn't blown away by it.
Here here ; +1.

Kafka = good.
Postgres can do a TB; if you plan bigger than that consider Cassandra.

Also consider protobuf instead of json.gz.
Yeah, actually that would be ok with me. Because those are "things". But if there is a legal precedent for demanding services, then I guess my point is mute. I guess Apple could charge one billion dollars per person/hour. That MIGHT be enough to cover their costs.
Google wants us to change our name from 9to5Google
Stop spamming your service all throughout the thread. It's annoying and certainly turns me off to it.
A helicopter with an infrared camera costs about $100.
PrimoPhoto – One Simple Utility Solves Many iPhone Photo Management Problems
Abortion gets murky in a narrow range of cases, but torture is never murky. War crimes are war crimes, and they're off limits for everyone, under all circumstances, by definition.
That advertising was false, and Tor project developers have specifically said that it's not intended to defend against global adversaries like the NSA.

I wonder if false advertising can create a legal expection of privacy. What if I sell a red filter for you to hang in your windows, and advertise that it protects against anyone seeing through. But you can just apply an anti red filter to a camera and see perfectly. Is the government allowed to do that? (I don't particularly understand optics, and this likely doesn't actually make sense, but you hopefully get the idea).

An argument can be made that if someone's using something they don't understand, they shouldn't have a reasonable expectation that it's as described, especially if they aren't paying.

Many people have misconceptions about VPNs as well. That doesn't mean the data they willingly hand over is reasonably expected to be private.

(If there's precedent for a false advertising interacting with the third party doctrine, I'd be interested in seeing it.)
Check out HDF5 for your old data.
Glad you liked it!

I just checked, and CueCats are as low as $7 on eBay. Barcode readers convert barcodes to plaintext (and barcode printers go the other way), so CueCats are good for more than just scanning ads...

I wonder if there's room for a CueCat Users' Group. :)
I actually prefer the client, but gog works just as fine without it. To each their own.
Scientific American has a great article on why airships will probably not be part of our transportation infrastructure[0]. In short the energy required to move a specified payload is about the same as that of an airplane, but the payload gets there at a much reduced speed.

[0]https://web.archive.org/web/20150701151003/http://blogs.scie...
Bye Mandrill. I've converted some of my clients' free accounts to paid once they started needing more features or sending more email, but going forward I'll be using someone else.

Amazon SES or alternatives might be a pain but at least they are an option for people who need good deliverability for transactional email but don't have the budget for a paid MailChimp account.
I agree with stay away from AWS, but centurylink does have lower prices for compute servers comparatively and google cloud has a better pricing model for compute. I'm about to test this out empirically but based on my initial research this is what I think.

But I agree with 'bare metal is your friend'.
I think shopping around and recommending/evaluating these tools is pretty fun that's why these threads are always a blast.
It is not that certain inputs happen to correspond to a configuration solvable by an NFA. It is that if you give it certain inputs it internally generates a data structure that actually IS a description of an NFA. And the same is true of most RE engines.

As for _Mastering Regular Expressions_, you've demonstrated both what it says and that it is popular. And further that it affected the terminology of a widely used project which has been embedded in many other projects. (Like PHP.)

And yes, I agree that it did a lot of people a disservice. But the damage is now long-done. See for example https://msdn.microsoft.com/en-us/library/e347654k%28v=vs.110... for yet another non-NFA that is described as one somewhere that programmers are likely to believe it.
I had a flip phone until two years ago but it became a professional liability. I was interviewing at a tech startup in SF and the interviewer saw me pull out my dumb phone after the interview to check the time -- I got an offer, but not before the interviewer made a condescending follow-up call to ask if I was "willing and capable" to design for mobile because I had a flip phone.

Needless to say, I declined their offer... but I bought an iPhone shortly after so I wouldn't ever face that situation again.
The Cult of the Boss: Why Do Americans Admire Businessmen? (2014)
If you're paranoid, you don't have a cell phone.
If you can reliably externalise the timestamps into Postgres for the documents, then yes. Just index and primarily query on the timestamps and you will be golden.

Also switching from mysql to Postgres should see performance gains (though unlikely to be a bottle neck).
But more than 5 out of 10 PCs are still running Windows 7, and more than 2 out of 10 are still running other older versions of Windows.

Windows 10 has reportedly now passed 10% market share and just overtaken Windows 8.1 and Windows XP (individually, not combined).

For an operating system that Microsoft are so aggressively promoting to current users of 7/8, not to mention literally giving it away to them, that looks like an awful reaction from the market six months in already.
It's not -- I will go check the model number. There are about 12 I saw that looked almost the same when I tried to find the model number online.
"intended to do something" does not magically make Tor actually meet the smell test that the courts have set up.

The expectation of privacy (at least in the US) is not necessarily about what the users actually think about their level of privacy, but of what a well-informed user might expect.

A well-informed user of Tor knows its handing the exit nodes a lot of information, and thus using Tor makes what you're doing semi-public.
Yes but to add to this, for generating reports it sounds like they will probably not be working with really complex SQL queries in which case bigquery might be better.

But the full solution to their problems is to write the solution using google dataflow (they can test this for free by using the apache flink execution engine for dataflow).
Back in 1975 I had a leather motorcycle jacket with a similar claim. It had a center lining of aluminised mylar (?) with some kind of white filament woven in and out of it. It was indeed very effective, and reduced the bulk of my inclement weather wear considerably.
Ask HN: Does anyone else, other than myself, need a secure note app?
Hi friends,

I'm working on a secure note taking/saving app. Think Evernote + Wunderlist + 1Password with a hardy layer of encryption combined with a unique(?) way of note discoverability/consumption.

I'm an engineer so I tend to just dive in, prototype and code. I've been focusing on the core key management system, pretty far along (I think). Then for some reason, today, I woke up and realized: "shoot! do people really want this stuff?" Because, not to offending anyone here, but good key management stuff is pretty hard core work and requires a little bit more time & attention than the usual engineering project (at least for me).

My wife and I need this for our own purpose and I promised my wife I'd build it for her (heh!). So I guess, I'll ask an honest question, without any ulterior intention here: does anyone else need this? I would love and appreciate any thought one way or another about this.

Thanks,

-V.
I think it is enforcable because of terms of service agreements and hidden stuff in them.

Pushing advertisement is one thing, but if they push adware and other malware it starts to become out of hand.

It is like Soutceforge and CNet Downloads adding toolbars and adware to apps you download from them. It makes them unpopular, but they are trying to earn money.

Expect more of this sort of stuff as companies use it to earn more money.

Many network devices are old and don't have firmware updates and can be exploited.
A treemap is a good static alternative to a literal tree of nodes. There are already programs like WinDirStat that use them to visualize file systems.

https://en.wikipedia.org/wiki/Treemap

http://windirstat.info/
I agree, was simply sharing because it was a need we had, which might be a need someone else had as well. Anyone can feel free to use it or not.
It has been posted numerous times here: you can only rely on AdSense for earnings if you are either a large company with both PR and legal departments (e.g. MySpace or NYTimes) or a $300/mo blog where the sudden loss of AdSense revenue is insignificant. Google treats individual publishers like servers in a datacenter: they do not care if one is out. If you are a small company making a living for a couple of employees, Do NOT rely on Google for your revenue unless you are prepared to lose it instantly with possible confiscated of already earned money on your account.
As a complete tangent, "hourly-chunked newline-delimited .json.gz pushed to S3" is exactly the format I ended up using to hack around the free-tier database limits on Heroku. It's a nice format!
* You need strict typing
* You need well defined numeric formats
* Message volume is high enough that the parsing costs of messages outweigh the savings on implementation time
* You cannot guarantee plain text messages won't be managed in transit.

You can get around the strict typing by adopting a schema format, but then you have a tooling problem that all the languages you need to support may not support your chosen JSON schema format.

Other solutions such as protobufs exist and are far better for transmitting large amounts of binary data.
Sharp Agrees to $6.2B Bailout from Foxconn, Nikkei Says
I wonder this too. The only personal data on my phone are my text and email messages. I'm not sure how other data would get onto the phone.