skysight-inc/HackerNews huggingface dataset:
It's due to the decompression algorithm, gzip gets better file sizes and is a better general solution. lz4 is usually 10% worse but will get vastly better decompression speeds. The I/O of an SSD is usually 300+MBps, lz4 will usually be around 270MBps, gzip will usually be <80MBps.

lz4 will put less load on your cpu allowing you to get more throughput from your processing tasks. But I agree most people don't reach these bottlenecks because most people use tools which are not optimized for performance like using jackson or jq instead of boon or rapidjson.

Look here for a reproducible test I ran on real data: https://news.ycombinator.com/item?id=10721645
My portfolio is about 50% medical supply and machinery manufacturers, and they're incredibly steady investments which pay strong dividends even and especially when the stock price is down. Furthermore, they're often able to make biotech plays and their guaranteed revenue means they're strong candidates for acquisition: http://www.bloomberg.com/quote/HSP:US

Do you have any sources for your claim that regulatory compliance is hurting profits beyond a one-off anecdote? Because my experience has been that it's an industry rife with windfall profits.

Also, what's the name of this Indian company, and what's the brand name for the device? If it does what you say it does, you would be pretty foolish not to invest.
I believe he is referring to a thermal imaging camera, which can see heat sources. They're still somewhat an expensive specialty item. The police used to use them to look for people growing marijuana in their attics, but higher courts now say that would require a warrant.
The report (I don't even want to call it "research") is not quite scientific. However, I have a lot of faith in my fellow HN readers.

What would be a good experiment to test your hypothesis?
Pretty powerful stuff. Puts paid to the notion that economics is "not real" or all handwaving, as you sometimes read here.
I designed an opthalmic ultrasound in the late '80s. The article describes "b-mode" ultrasound which actually creates an image (in some fraction of a circle like you see when someone shows you their unborn child). Back then, the electronics to electrically steer the beam were very hard to create (20MHz was a fast clock back then) and so the b-mode transducers were often mechanically steered. there was one transducer that was moved in an arc by the steering motor and coupled to an acoustically transparent housing by some gel.

Central Pennsylvania (from whence I'm writing tonight) played a key role in the creation of ultrasound systems - and Johnson and Johnson still manufacturers their transducers about 15 miles from where I'm sitting. The technology originally developed for SONAR came to the Pennsylvania State University where some of the engineers though of cool other ways to use transducers. Good thing the human body has so much water (or other components with a similar density and propagation speed.

When you get a b-mode ultrasound, you see the interface between two types of tissue (or bones) due to reflection. If you look at an image, it takes some practice to even "see" what the picture is.

So back to the cost issue - the biggest single expense in creating an ultrasound unit was getting through the FDA approval process. It was grueling - requiring a lot of testing by outside laboratories and a lot of internal engineering time for paperwork. Once you start to manufacture them, you're making (for a small company like ours) hundreds of units and even the large manufactures aren't making them like the Coca-Cola company spits out cans of soda. You're amortizing a lot more development costs into each unit.

And then, once you start selling to hospitals and doctors offices, the mark-up is huge. They in turn pass a large chunk of the cost of the machine to the insurance companies. If you were charging $500 per scan 20 times a day, you'd pay for your $8000 machine pretty quickly).
Practical Two Way's How to Remove iCloud Activation Lock
Even Java would have caught that assuming .show() is Java's .toString().
Many small objects seems fine -- where small is 50-500MB per object. You can't have super huge compressed objects since BigQuery and perhaps other systems won't ingest a file with more than 1 or 2GB of decompressed data.

20TB a day is a lot -- what is your stack, and what compression/file format are you using?
I know enough about the system to know that every installation requires a signature by Apple. There's no "belief" required here.

Note that the creator of cydia, the software that pretty much every jailbroken iPhone runs to install packages, has said that Cook is lying in the letter. He's also said that many people, including him, could create the software in less than a week, and all they need is the signing key.

You can trust Cook, but perhaps educate yourself to the point you don't need to trust anyone. Read https://en.wikipedia.org/wiki/SHSH_blob and https://www.theiphonewiki.com/wiki/SHSH, and you'll see how there's no additional risk by creating the software, as long as the key is not released.
What I posted this a day ago.
FB is often baked into the OS image, but any reasonable recent Android (4.1 an newer?) still allows you to disable those preinstalled apps. For all intents and purposes that's the same as uninstalling, you just can't get it out of the app manager.
Note: very few, if any, of these examples failed because someone on the team didn't pass a coding test. Next time you interview someone remember: bad code could bring your project down, but there are 9 other factors that are more likely to bring your project down.
I think if you can master Bayes' Formula you'd have everything you need. Slight note: takes many years to get an intuitive understanding. http://www.math.cornell.edu/~mec/2008-2009/TianyiZheng/Bayes...
After reading this article, I had the thought to view the html source. I wasn't disappointed. :) Very clean and minimal. Very little html, very little css, very little javascript.
Hmmm... this absolutest attitude by Apple begs the question for me, are we SURE we want to have phones that absolutely cannot be unlocked when the owner is no where to be found/dead?

It's such a grey area and I will probably get down voted for commenting this way. I 100% agree that the power, in the wrong hands, is horrible, but can't we talk about this in a way where there's some kind of middle ground? All I've been reading are either extremes.
How much easier? If all they had to do to not have access to it themselves is to ask the user for his password when there's a new update, that's hardly that inconvenient...
Cool -- good stuff. Those compressors should arguably be more widely supported.
For further reading that spans more broadly with the underlying idea here, I recommend: https://mitpress.mit.edu/books/objectivity

I'm not done with it but so far it's been an epistemological history lesson that has me thinking a lot about how the current era of Big Data / rising ubiquity of mechanical objectivity (esp photography — from WWI photojournalism to google earth) has been altering humanity on all fronts, from the sciences to the arts to the justice system... particularly how seeking truth is seemingly no longer a burden when everything is recorded by computers, yet at the same time there is still the very real burden of communication (presentation/interpretation) when said data is given an audience.
Well first you have to decide what is ethical. Good luck with that...
I don't think CEF API compat is good enough. Look at other Chromium based applications in Electron or nw.js. They use up multiple processes and are bulky. What is needed is a low level embedding API that does not have IPC and process forking baked in. Sadly we are on the path to losing a lot of that...even the Servo devs said that while they expect it to work at that low of a level, multi process is all they are concerned about supporting[1].

1 - https://news.ycombinator.com/item?id=9541721
By design, if the three or six nodes that you used compare notes, they can tell who you were talking to. That seems roughly the same as breaking a key into 6 parts and giving it to 6 different parties. I think the government would be able to go to each party and ask for their part, then put them together. Therefore, there's no expectation of privacy.

What actually happened is the researchers found a way to bypass the middle guy and reconstruct the info just from the two ends. That's still just comparing notes, but from fewer people.
My father is a "true" engineer. He has said to me that the amount of education I have and work I have done would make it easy to be certified as a P.E.
We've actually had feedback from some startups using Rust for low level stuff (where their teams comprise mostly of Python/Ruby/JS devs) that Rust teaches systems programming and memory management quite well (since you're forced to work with it), unlike C++.
We were trying out the filesystem -- it was clearly alpha/beta quality at that time, so it was no surprise it didn't work, and perhaps it's improved in the last two years.
Thanks, but I've been through that without a solid answer. It appears they're doing a standard desktop screencast then running it through a stylus-based app to write on top of the video.

Would have been nice to hear from anyone who's familiar with this.
The issue is not over fitting. In fact linear regression is extremely exploitable with this method. See http://karpathy.github.io/2015/03/30/breaking-convnets/
Ask HN: Who will GitHub acquire?
In the last couple of months, GitHub has really been called out for no longer innovating, and rightfully so. This article even suggested innovation will mostly likely not come from within:

http://www.infoworld.com/article/2960468/application-development/githubs-next-big-innovations-wont-come-from-within-github.html

Given the funding they have, it does seem strange they have only acquired two companies in their history.

Is GitHub waiting for the market to tank so they can get companies/technology on the cheap? Or has GitHub been drinking their own kool-aid for too long and don't see that Bitbucket, GitLab, Gogs, et al. are seriously catching up.

Given the cash they have, it would seem logical for them to look at acquisitions to help them regain that untouchable aura that they once had.

So who do you think GitHub will acquire?
You can disable the app entirely. It will not be removed from the phone but it won't bug you ever again. Go to settings > Apps and select your app.
Only slightly cheaper than an entry level pfSense box, and much less powerful and flexible.
For those interested in this topic, I highly recommend episode 181 of the Omega Tau podcast, "Why Megaprojects Fail (and what to do about it)" [1].

It's a fascinating listen into the psychology behind gigantic failures.

[1] http://omegataupodcast.net/2015/09/181-why-megaprojects-fail...
Write your pass code on a piece of paper, put it in an envelope, and staple the envelope to your will and deposit it with your lawyer. Nothing prevents you from telling loved ones your pass code.

They give you the choice.
Skype on Windows Phone is horrible. Updates come to iOS and Android, and only then WP.
Isn't this problem already solved in the non-tech world through a last will and testament or a bank lockbox which contains passwords you want people to have in the event of your death?

I'm not sure it's a perfect solution but might be better than counting on someone to reverse engineer or hack into your phone.

If you're serious about encryption you should always have a backup key somewhere... unless you want a single point of failure (you). Both should be an option.
Yeah, I agree, I'd love to know the details as well.
“That was a really bad Friday for us:” WIRED warns four stories were plagiarized
All bets are off if the iPhone is power-cycled.

Except, you don't have explicit control over the iPhone's battery, so how do you know if the power is actually cycled?
This is a great read. I'm especially surprised about what it means to be an "Average Person".

"Average" or an "Average Person" now (at least amongst my social circle) is actually a bad thing, something that people will put effort into _not_ being. Describing something as "average" (or just "av" in conversation) is a way to describe something as disappointing.

So strange how the meaning has pretty much completely flipped on its head.
I agree, disk is cheap it's compute that's expensive. One thing to note though is that lz4 will use a lot more RAM relative to gzip but compared to processing tasks it's not much.
As a fellow Indian, but without a business atm, I'd love to connect.
Or if the phone runs out of batteries and restarts.
From my observations it's a matter of picking a nice wordpress theme and customizing it for your brand.
Google Self-Driving Car Testing Report on Disengagements of Autonomous Mode
Silverlight is abandoned, but Winforms (especially) and WPF are mature products; I use the latter two (as well as Xamarin for Mac) in my consulting business to make good profits each year, and don't see anything changing except for better in this respect.
I also work on a note-taking application and my thoughts are: ability to have secure notes is somewhat important but it's not important enough to make it a primary benefit.

Your app would have to be great at non-secure notes AND have an option to add secure notes.

Evernote, btw, does support secure (encrypted) notes. They have a lousy UI for them but the option is there.

If you don't think that your app is better in at least some ways than existing note-taking apps, that having secure notes will not make a difference.
Yea, anecdotally there is more work than ever, especially now that everyone is online, and the selling everyone on "the internet" is from what I can tell is over.
Is hydrogen completely out of the question if these airships are unmanned? Doesn't it generate more lift? With today's technology, could an fleet of smaller, "drone" hydrogen airships be effective or is it just too difficult to prevent disaster dealing with hydrogen gas? Honest questions.
heroic stuff for miguel
They appear to take some very specialized training to operate them well also. There is all the overhead of training the operators and attempting to build something that is reasonable for them to use
Over the past few years services have been slowly starting to phase in a way to specify a person who can "inherit" access to your account in the event of your death. I know Facebook has it fully set up now (you can go into your security settings and specify a "Legacy Contact"), and I expect that in the near future it'll be a standard part of any service that intends to operate long enough for this to become a worry.
This is one of those moments I wish Jobs was still here.

Had he lost to the DOJ, here is what would (might) have happened:

- he would gladly unlocked this phone and bill DOJ for the time spent on redesigning IOS

- going forward, he would label each phone's box in red letters: CONTAINS GOVERNMENT-REQUIRED BACKDOOR (I doubt Gov can forbid him from doing that)

- he would then stop selling devices in Apple stores directly and only allow to order them in stores with direct home delivery from Apple website hosted and operated outside USA.

- all the shipping would be done directly from China by-passing US-tax system all together.

- shortly after he would remove the backdoor IOs for devices that are not directly sold on US soil

That would be a big fat middle finger to the DOJ.
I think, like Patrick said there, there's not much reason for Servo to stop working single process (in fact, we still are single process by default?) aside from cruft buildup and lack of interest. If there's a need for maintaining a single process mode that's not too much effort.
Because it doesn't work that way. You can't validate the framework, you have to validate the product

Actually you have to validate the iteration of the product. So if your software changed significantly enough from version 1.0 to 2.0, enough that the results of processing data may have changed, now you have the pleasure of going back to validate the entire product to ensure it still works as expected instead of just doing a software verification.

Sucks, but it's the price of safety.

One of the stories I love to tell from my medical device days was spending about 6 weeks getting the validation procedure document for a software build machine approved and then spending all of 5 minutes actually building the product (which had to be separately validated), never to use the build machine again. Now, that's crossing the line into stupidity!
Bay Area Rallies Against FBI Threats to Privacy and Security
Actually the FBI's current argument is very close to saying that the All Writs Act has no limits, and can compel literally anything the FBI thinks would "help" them with investigations.
We're looking into how that test is being run, but it's not at all reflective of what actual users experience on the platform. There are many factors that could impact what is being sent to spam that aren't disclosed in these kind of tests.

It's true we offer a premium product, but we do so at a competitive price. At scale, our pricing model compares favorably with Sendgrid. Our pricing strategy is all about simplicity and providing lower prices as you grow with us. We don't have any kind of feature gating pushing you into higher tiers nor do we have punitive overages.
Yes, I know how it was broken. But the question is what the expectation should have been. And given that expectation, then whether they should have had a warrant.

In our surveillance society, the government's theory is that it should never need a warrant, because terrorism. I strongly oppose that theory. I'm OK with taking down Silk Road, but get the warrant first.
I'm at a loss as to how alphabet agency can determine a weak passcode vs strong passcode was used. how does a pin get stored on the phone? surely, not plain text of a 4 digit pin. if they do any encryption to the 4 digit pin, how would it appear any different than a significantly stronger passcode?
There's a reason this Atlas thing supports Delaware C Corps and only Delaware C Corps. I agree that founders have a lot to worry about. So just get the Delaware C Corp and move on.
I don't think "already fenced off if people were savvy" is really valid. That's the security equivalent of "no type errors if people were savvy", which is the same as "probably has type errors".

It was near-impenetrable, but it could have been inevitable if it weren't for the fact that Apple could push OS updates without user consent. They could have made it impossible for anyone to get in even if your pin was 1234, but didn't.

Kind of disappointing given their whole thing about the Secure Enclave. Bunch of big walls in the castle, but they left the servant's door unlocked.
I wrote about this a while back:

http://www.b-list.org/weblog/2013/jan/29/persistence/

Since then I've started noticing services rolling out the ability to specify someone to take over your account after you die, and I suspect the legal framework around wills and estates is robust enough that you could leave instructions (and have them enforced) to delete things.
I clarified my comment a bit. The type of designer from my anecdote is becoming less and less common while simultaneously there is far more front end work available and designers who are willing to step up to the task.

So when someone is bemoaning the lack of work available I suspect the real problem is their inflexibility or technical stagnation. This is especially apparent when a novice roped in from the mail room can out-compete them and eat their lunch. The problem is the designer's skillset, not the industry trend.
I _totally_ remember it.
It's kind of a headache to get started if you just want something quick and dirty.
> Quetelet’s invention of the Average Man marked the moment when the average became normal, the individual became error, and stereotypes were validated with the imprint of science

I wonder what would have happened had he used a statistical mode instead of the mean. He was coming at the problem from the experience of correcting error in astronomical measurement, but it seems like there were some mental gymnastics required to equate individual measures of humans as errors.
I think what has changed is that now there is less work, not that there is none, what the article was trying to point out, and what I'm seeing in all these comments if you read through the lines is that a lot of the work has been moved in house.

Previously you contracted a freelancer to put together your website piece by piece, now, thanks to improvements to the tools available you contract a freelancer to customise a cms for you. You then hire a marketer to manage it going forward.

The work is still there, it's just the freelance work has dried up because you no longer need them to put copy on the site.
I'm pretty sure (3) is a generational thing. I and plenty of 20-somethings I know won't answer their phone if they don't recognize the number, yet my parents get up and run for the phone when their landline rings during dinner time. When someone unknown tries to reach you their default mindset is "But what if it's an emergency?" and ours is "It's probably spam"
I read the whitepaper, and while I have many questions one detail in particular jumped out at me:

"The client authenticates with an X.509 certificate or a self-signed certificate
where the private key is derived from a passphrase. When a passphrase is used, the scrypt algorithm is used to derive
a private key from the passphrase. Information about the salt is stored server-side and is given before establishing an
authenticated encrypted connection.
... The symmetric key is derived from either the passphrase,
the private key in an X.509 certificate, or provided by a key management service (KMS)."

You're deriving a private key from a user-defined passphrase, then storing the salt used to derive the password on the server, which is defined to be untrusted. I understand you use scrypt to derive the private key, but this still seems like a massive, massive footgun. Database systems are usually kept up and running for a long time, like maybe even years. If the server gets the salt, isn't it only a matter of time before even a very slow brute-force attack can re-derive the authentication credential and make whatever queries it wants?
I didn't say that multiprocess is all we care about supporting. I said that we'd support single process mode as long as there's interest and a maintainer.
He is referring to how the default franchise tax is calculated using the "Authorized Shares Method" which gives many an MI when they see they owe $20k+, without realizing you can use the "Assumed Par Value Capital Method" and your bill suddenly becomes like ~$500.
Ask HN: What are good practical programming books?
I am looking for practical programming books.
Think "Practical Common Lisp", "Automate the Boring Stuff with Python" or "Ruby on Rails Tutorial". These examples happen to be freely available online, but I am looking for free or paid options for the following languages/frameworks: Clojure, Go, Rust, C#, React, Flask, Django, Swift.

Any others that you may know of and care to share would be welcome.
As I mentioned in the other thread, we're looking into the details concerning this test. It's not at all reflective of the actual customer experience.
Well, it's only a few PB a year. But, I'll say that 20 TB is the higher bound per day. It's seasonal, and maybe the average is 10 TB per day.

Personally, I've found the best results with bZip2. But, we use LZO and LZ4 and even Snappy for different things.

Spark is money, but we've forked it to make several important customization / enhancements. We have proprietary indexing, and we do all of our processing in-memory, of course.

Oh, and some of our data is sharded in Redshift. Redshift works well with GZip, so we do use it there. But, that particular part of our warehouse (or data lake, or whatever you call it these days) has much less data than we ingest since we reduce a lot.
This Is Shameful: Reviews of Columbine High School on Google
Samsung Galaxy Unpacked 2016