skysight-inc/HackerNews huggingface dataset:
If there is no risk of surveillance or lock-in, he'd probably be ok?

After all, "cloud" is a pretty ill-defined term. He certainly doesn't object to things because someone calls them "cloud-something", but because of the power structure they entail--which happens to include stuff such as surveillance and lock-in with a lot of the stuff that's currently being sold as "cloud services".
> Facebook paid $1 billion for Instagram, mainly to hire its 13 employees.

I don't usually like to nitpick, but this just seems totally incorrect.
Memcmp requires pointers to fully valid buffers
Money is created when anyone gets a loan from the bank, not just companies.
http://www.sciencedirect.com/science/article/pii/S1057521914...
Totally comiserate with you. I'm not up on all of the latest frameworks but I hate not having a good compiler that catches syntax errors, typos, case mismatch, etc until runtime.
How would you script a protecting against the issue described in the article? Unless you make sure to check the cost before each single request you can't stop it (and if you accidentally send one massive retrieval request even that isn't enough)

For other services it is easier, but even then, setting up and managing my own cost control mechanism is a level of complexity (and risk of failure) I'd really want to avoid, esp. since I probably use AWS to avoid management overhead.
> This article is a little disingenuous in how it represent this as something revolutionary.

We can quibble over the use of the word "revolutionary", but it certainly seems to be effective: "In the past few years, she has spotted thousands of previously unknown tombs, temples and entire ancient cities, mostly in Egypt".
Google Indic Keyboard Introduction
I'm not certain that's correct, only some people predicted AI within 50 years in the 60's.

Presumably modern researchers have a lot more information by now so their predictions are likely to be more accurate. As we get closer in time to it, it will become more predictable and obvious. You can't really have expected people at the time of the very first computers to have predicted the date of AI accurately.

Note the prediction has large error bars, with researchers predicting a 90% chance by the end of this century, but "only" a 50% chance within 25 years.

Anyway what's the alternative prediction? If you don't take predictions from the experts, who do you ask for predictions? Lay people? Just make stuff up? It's the best we can do.
I see you've reused the zscan DB schema. It's a good choice, we used it to inspire our schema too.
We went a bit beyond because we also store ciphersuites (from cipherscan) and chains of trusts, so the DB schema had to be more relational than what zscan uses.
Thanks, this is particularly useful information as I have a growing interest in all things embedded. My experience at this point is pretty minimal and is limited to messing around with an Arduino which, as I understand from reading about bare-metal AVR programming, is fairly high level by comparison. How does that translate with what people in the industry are using?
Introducing Apex: Serverless Architecture with AWS Lambda
As an engineering student, I was told that technicians often have a better grasp of their domain than the engineers. It's the result of a narrower focus than the engineers get.

Actually, the shop floor often can have valuable feedback as well. They know more about the actual assembly than the engineers. Sometimes the engineers make things unnecessarily difficult to assemble simply because they don't know that something simple on the wiring diagrams is hard in real life. Like thick cables that can't bend easily.
Considering the fact that bugs in the official APIs resulted in multiple retry attempts, he should demand some of his money back.
Right there with you, given the network effect of the underlying business, it seems crazy that this wouldn't be most or all of the value of the company.

Moreover, it is not a stunning realization that not everyone likes their job ...even in tech. Or that employers with a lot of technical drudgery would have to offer higher wages, perks, and more job security to recruit.
Interesting, I hadn't heard of Password Alert -- we should definitely share notes if you're open to it -- I'd love to be able to generalize what we're doing to other domains if we could -- it's unfortunately cpu intense how we're doing it.
Microsoft has really sold silverlight before abandoning it and it really did had quite a few features.
SL allowed you to run very complex code through the web which allowed people to easily migrate rich clients to the web like they've done so with activex before.
Companies that build scada are most likely big and old software houses so they'll use enterprise software which means Java or .net since it's easier to sell to thier old fashion clients than "were running nose.js and go with a python wrapper".

Netflix used SL as previously mentioned since it could be integrated with vista's built in DRM which allowed Netflix to sell it to the content owners as a way to ensure that their content will be safe.
I find it odd that a comment urging us to interpret others' words charitably begins by attacking the motives of the author of a comment under discussion. If you were jacobolus, would you find this response charitable?

It's entirely possible to come to a different interpretation of a text without having an ulterior motive.
Mr. Canfield's thoughts on the matter:

>> Of course, though the facts of the case are yet to be seen since no one in Germany is talking to us, I will definitely never host anything in Germany ever again

He was trusting of authorities and purposely did not use TLS (beyond STARTTLS) or encrypt his hard drives. And this is what happens. They take his hard drives immediately and seize his entire service.

How are we supposed to trust the authorities when they make themselves untrustable?

How are we, as server admins, supposed to stand down and backdoor our servers for law enforcement when this happens, when we know we can't trust them to use their powers responsibly?

Every time some big NSA exposé is unveiled, every time someone gets raided for no particular reason, I get to reaffirm my distrust of the Internet police, in whatever form they choose to take.

Policing the Internet is untenable and useless. Don't help the authorities attack your users, because oftentimes...

you're their last defense.
> from a quick look at SmartOS, it looks like yet another implementation of containerization

It is the first ever implementation of true containers (zones were released in 2005), and it is modeled on BSD jails.

What is or is not familiar to most developers is irrelevant to me when I am engineering a solution, because my focus is on encapsulation, stability and lifecycle management. What others are familiar with is irrelevant in that case, especially since correctness of operation and data integrity are priority, with everything else taking a back seat to those.

> WRT your specific gripes about subsystem rollback - the usual Docker best practice is to have each container run only a single subsystem

But it doesn't have to be: http://phusion.github.io/baseimage-docker/

besides, if there is an issue, and one were to follow running only one service inside of a Docker image, one could not ssh in to troubleshoot the image. With Solaris zones on SmartOS, it is completely unnecessary to run a single service or process inside of a zone, because zones offer full isolation. I see no sense in opting for a harder approach with Docker, especially when that approach does not offer full isolation nor security.

> If you need to upgrade or downgrade, you spin up a new container running a different image, fail over to it, and kill the old one

Which I imagine means that I have to build a whole new image, presumably based on the old image, then deploy an entire image (what if it is an Oracle database software, which is anywhere from 800 MB to 2.5 GB, not counting the database?) It is much cheaper and faster to just rebuild the affected package, and upgrade it in place inside of a zone, than having to respin an entire image, especially if that image is several gigabytes.
I sold a product and it was paid for by gift certificate or a special promo. I want to send a $0.00 invoice for the customer to see it and enjoy the feeling (Sweet! Free jerky/flowers/socks). It's great marketing and the customer will remember you the next time they want some jerky/flowers/socks.
I just wish people would stop acting like food was "designed" for us.
I have a strong feeling that he would get a refund if he contacted Amazon support, considering it was caused by a bug in the official SDK and he didn't ACTUALLY use the capacity he's being asked to pay for.
Meanpath Releases Dataset of 191M Top-Level Domains with NS Record Lookup
So depending on how the "average monthly storage" is computed you could get 20x more data in one month and then retrieve the 5% (previously 100%) that you care about for free, and then delete the additional data?
In my experience, it's a simple matter of it never being done, and people always being unhappy with it. You can anticipate every possible need

IMO that's the exact problem - you can't anticipate every need. You need to do user testing, iterate over UI layouts, etc. etc... by comparison, backend work is straightforward.
I read it as the SDK had a bug, but that wasn't what caused the costs.
Uh no, actually this is really a case of a bug in OFFICIAL SDK that caused a higher bill than expected.
For technical questions (problem solving) StackOverflow has a good number of very active and knowledgable people. For opinions and more general talk, the Google+ community is a good place: https://plus.google.com/communities/103113685381486591754
The only use case I would be willing to commit to glacier would be legal-hold or similar compliance requirement.

The idea would be that the data would either never be restored or you could compel someone else to foot the bill or using cost sharing as a negotiation lever. (Oh, you want all of our email for the last 10 years? Sure, you pick up the $X retrieval and processing costs)

Few if any individuals have any business using the service. Nerds should use standard object storage or something like rsync.net. Normal people should use Backblaze/etc and be done with it.
Class-action settlement against Paypal
Via negativa: Avoid what is most likely bad (food processed by industry, sodas, excess sugar, excess salt, trans fat and food blogs). Beyond that there isn't too much you can do.
It doesn't even have to be identical, it just has to be acceptably humanoid. For example I imagine that in 5 stars restaurants human waiters will still be the norm for some time, but enterprises like McDonalds or Starbucks would probably not blink an eye in replacing people with machines if possible, as there is no human element in a McDrive. Would go hand in hand with the edible substances they sell as food.
I didn't downvote you, but from what I've read (mostly here on HN), there are people in the industry advocating for easier work visas to bring skilled developers into the US to fill a talent vacuum. I'm not sure how accurate that is (I'm going on memory here), but perhaps that's why you were downvoted.
Interesting choice of slugname:

nutrition-science-complicated
There's very few front-end jobs at the moment that require hardcore CS thought. You're best to get a job in WebGL or WebAssembly work if you'd like that.
Are you taking advantage of your college alumni association? They may have a job board or career counseling; related, you may want to find an alumni meetup in Chicago for networking. The alumni angle can be surprisingly effective.
Buffer removes bonus for dependents from salary formula
18MB/s sounds rather low. It obviously rather depends on the source of data, format of data (e.g. lots of floating point columns is slower than large fields of text), and whether parallelism is used. But you can relatively easily get around 300MB/s into an unindexed table, provided you have a rather decent storage system.
I agree. Every way the government has of depriving you of property without legitimate recourse is BS.
The commenter was making a comical reference to Yakov Smirnoff:

https://en.wikipedia.org/wiki/What_a_Country!
No, requesting all his data at once alone determined the rate. The retries didn't cost extra.
We've been sharing the planet with intelligent creatures since before evolution made us human.

That's not the issue. The issue with AI is that we may be sharing the planet with an intelligence that's both nastier and more capable than we are.

I still tend to see this as projection. There's a huge gap between wiring together neural networks and developing something with self-awareness, strategic agency, and some potential to expand both at a rate we can't imagine.

Bostrom's paperclip monster is facile, and no worse than the kind of resource plunder we do already in the name of profit.

Whatever challenges AI brings are going to be quite a few levels beyond that.
Layperson methodology here: http://www.buzzfeed.com/johntemplon/how-we-used-data-to-inve...

Detailed methodology/code here: https://github.com/BuzzFeedNews/2016-01-tennis-betting-analy...
I have a feeling that inventory control, price accuracy and the ease of training cashiers are considered reasonable trade-offs for how long it takes to ring customers.
> Why (almost) everything you know about food is wrong

They tell me every other year.
Third posting in last 2 hours.

https://news.ycombinator.com/item?id=10921008 10+ comments
Even with the large data retrieval bill he still saves ~$100 vs the price of keeping that data in S3 over the same time period. Reading this honestly makes me think glacier could be great for a catastrophic failure backup.
i do wonder what aspects of Go make it good for the container use-case. both Docker and the other container system mentioned at the top of the article are written in Go.
The retries don't cost extra. Sending off all 150 retrieval requests for all the data at once set the retrieval rate and the price, they should have been staggered over a lot of time to keep the rate low.
https://news.ycombinator.com/item?id=10921008 10+ comments
PG referenced/tweeted a quote by someone "Eat food, not too much, mostly plants". That sums things up pretty well.
This article claims that glacier uses custom low-RPM hard disks, kept offline, to store data.

Does s/he substantiate this claim in any way? AFAIK glacier's precise functioning is a trade secret and has never been publicly confirmed.
This is no longer necessary, they now allow you to specify ranges of partial files. So you can split a single large file into multiple requests to keep you within allowance or within budget.
Software Development and the Pink Pony Backpack (2009)
They're both difficult to grok but for different reasons. (Well, the same underlying reason - bandwidth - just accounted for differently).

Glacier, as the article points out, is difficult to grok because there are provisioned bandwidth costs.

Nearline is difficult to grok because it simply caps your bandwidth at 4 MB/s per TB stored. It starts at 1 MB/s.

Basically, both are optimized to make retrieval slow and/or expensive because the cost optimizations they're doing internally are incentivizing very cold data, very big data, or both.
Thanks, I appreciate the suggestions. My problem is that I have very little work experience in the industry at this point (< 1 year), so I don't think any "senior" positions would be open to me yet.

I am somewhat strongly considering the data science route, so I definitely appreciate the nudge in that direction.
Is iOS Really Better Than Android?
I briefly used Glacier for daily backups as a failsafe if our internal tape backups failed when we needed them. The 4 hour inventory retrieval when I went to test the strategy and the bizarre pricing quickly make me look at other options.
This sounds a lot like demand-billing [1] [2] that's common with electric utilities, particularly commercial, and increasingly, people with grid-tied solar installations. [citation needed]

You pay a lower per-kilowatt-hour rate, but your demand rate for the entire month is based on the highest 15-minute average in the entire month, then applied to the entire month.

You can easily double or triple your electric bill with only 15 minutes of full-power usage.

I once got a demand bill from the power company that indicated a load that was 3 times the capacity of my circuit (1800 amps on a 600 amp service). It took me several days to get through to a representative that understood why that was not possible.

[1] http://www.stem.com/resources/learning

[2] http://www.askoncor.com/EN/Pages/FAQs/Billing-and-Rates-8.as...
Impressive that Amazon can choose to serve a request at 2x the bandwidth you need, with no advance notice, and charge you double the price for the privilege.
That would be Michael Pollan[0]

[0] http://www.amazon.com/In-Defense-Food-Eaters-Manifesto/dp/01...
I think this is a huge marketing problem, stemming from the ability for large companies to market directly to children, and I don't think it's a coincidence that the U.S. is one of the few industrialized nations (if not the only, I couldn't find another in a quick search) that has ZERO regulation in terms of what and how companies can advertise to children (outside of bans on cigarettes and alcohol of course.) Kids are extremely easy to manipulate with ads because they don't have the experience and the awareness to understand the differences between the shows they're watching and the ads they're consuming.
You're welcome :)

What really excited me were the multiplayer competitions: they have a ladder where your algorithm will be matched against other players, giving you a rank. You can start really simple (and be at the bottom of the ladder, but there's always someone below you!), and see it rise as you gradually improve it. Unfortunately it seems you now need to subscribe unlock those, but while I wish they went for another revenue system if it interests your kid it's definitively money well spent.
Unrelatedly, but calling SmartOS "yet another implementation of containerization" is a bit like calling a Bugatti Veyron "yet another implementation of a car". Technically true, but implicitly missing the point.

SmartOS and other Solaris derivatives have the only container implementations that actually work well. They are where Linux will be in a decade.
"I felt a great disturbance in the EE field, as if millions of Atmel vs. Microchip arguments cried out, and were suddenly silenced."
I wonder if these new nanocatalysts are having an impact in organic chemistry in general. Anyone know?
This was fully covered in "In Defense of Food" - good intro read for nutrition. Read that, not Vox, which is rife with strange opinions, like "overeating" being the cause of modern disease? You damn nutritional science then come up with your own solution to everyone's problem, not based in evidence? Neat.

It's oversimplifying to say the only studies nutritional science can use are observational ones. There are plenty of high quality, controlled studies on specific aspects of nutrition. We learn from those. That's also not to say that observational studies are all bad. They can be useful for determining when things don't work and aligning controlled evidence. The fact that nutrition is a hard problem doesn't mean it's not a real science.

TL;DR Learn who you can trust on nutrition (Vox is not a good start)
There is a really low bar for human nutrition in the short term. Depending on body fat, a person can go many weeks without eating anything, so a juice "cleanse" will seem to work, low-carb will seem to work, high-carb low-fat will seem to work too, vegan, paleo, etc. Nutritional deficiencies might not develop for years!
At Tesla we have lots of embedded software opportunities, ranging from code that runs in very tiny microcontrollers to beefy ARM host processors. If you, or anyone else in this thread, are interested, contact me on email. My inbox at Tesla is sbrugada.
Well, the cashiers memorized the EAN, the barcode.

Even today they often type the barcode faster in than it can be recognized.

For inventory control and price accuracy you get the same advantages as with barcode, but you can be faster and work without a barcode reader.
Thanks. I actually did think of that explanation. But it doesn't hold up under scrutiny. Google Voice, of all services, is exactly the kind of service that should be able to access the user's contacts, for things like dialing and showing the names on incoming phone calls. Super hard to believe that's an issue. And if the permission isn't there, it's easy to ask for it. And if not, just use a generalized list of names.

Yes silly me for focusing on contacts. They could have just built a general name dictionary for various languages. If they cared to. But (judging by the poor recognition performance of the system) that doesn't seem to have happened, at least the last time I used the service, which admittedly was some time ago.
Wow, I feel kind of dumb for admitting it, but I completely forgot to consider this as a possibility. I went to a somewhat smaller university in Michigan (GVSU), but I bet there are a decent number of grads working there. Thanks!
You can't in this particular use case, but I can't envisage AWS providing a cost-control system that would stop this, either. It doesn't make sense--they're not calculating costs as they go. What I'm saying is that what Amazon would provide you is not functionally different from what you can do yourself right now.

I would be a lot more worried about a risk of over-charging myself if AWS wasn't incredibly good about refunding accidental overages.
Glacier's pricing structure is complicated, but fortunately it's now fairly straightforward to set up a policy to cap your data retrieval rate and limit your costs. This was only introduced a year ago, so if like Marko you started using Glacier before that it could be easy to miss, but it's probably something that anyone using Glacier should do.

http://docs.aws.amazon.com/amazonglacier/latest/dev/data-ret...
https://aws.amazon.com/blogs/aws/data-retrieval-policies-aud...
The whole reason why all the perks and high salaries have to be offered is because there aren't that many people who want to do the work. Otherwise, people would be willing to work for peanuts in order to get a foothold in the industry, like in entertainment, journalism, or art.
The Godfather Epic
We used that (more or less) for the title above, since the article title is linkbaity.
Nice. I also upload par2 checksum files for each chunk so changing things now would involve a bit of script rewriting, but that's good to know for the future.
From the op:
"I enjoyed its minimal install to create a light environment, intuitive installation process, and it’s package manager."

CentOS is neither minimal nor light. Ubuntu also isn't either of these things. Both of these distributions are more targeted towards convenience and ease of use, which means a lot of features/services that are generally unnecessary are enabled by default. The main reasons to use CentOS is compatibility with proprietary software made for RHEL, Ubuntu for people already familiar with its desktop version, or if needing to buy enterprise support for either.

If the op is primarily looking for minimal and light, he should look at pretty much any other major popular Linux distribution like Debian proper, Slackware, or Gentoo before CentOS or Ubuntu.
Yes, there are Debian, Ubuntu, Centos, SUSE, CoreOS, RHEL and Windows Server images available for launch. You should see them in your cloud dashboard as choices when you go to launch an instance.
Older technology is useful, too. Dr. Stephanie Dalley used old Corona Program surveillance images in seeking a historical location for the Hanging Gardens... but not in Babylon:

https://www.youtube.com/watch?v=F6vVxbAJAog
Who Built The Hanging Gardens of Babylon?

(PBS.com's version is paywalled)
Increase Google Adsense Earning Using This Simple Trick – Onenaija Blog
Toddlers mesmerised by surreal world of unboxing videos (2014)