skysight-inc/HackerNews huggingface dataset:
With large volumes the real issue is not the storage but the upload speed. I've done some experiments and with the Comcast link (20Mbps down/whatever up), I got 1 Gb/hour upload rate. So, it'll take 11 full days to upload 256 Gb. Or, more realistically, if you do it overnight (8 hours) - the entire month.
I know nothing about Monads, I know nothing about Haskell except for the fact that it's a functional programming language that has Monads. Yet I still found this really informative... Makes me want to play around with Haskell and see if this article makes it easy to grok how Monads work
GE (aka General Electric) is probably the archtype for this type of diversification.

Virgin has been already mentioned, but is a really interesting example. It really is just a brand - there is no single controlling company.
Duplciity supports S3, so I'd watch it for Glacier support: http://duplicity.nongnu.org/
Here, we are producing logs of simulation runs that may be needed in the next couple of years. Most of the logs will be destroyed unused. This is a perfect use case for glacier. We do not care about 5 hours recovery time.
I had to create a special E-mail filter to send that endless stream of bullshit to the trash from the mailing list.
The CSS spec's :hover was never made for dropdowns, it was made for simple on-hover effects, IMO.
One tip I use with icons, especially on colored backgrounds like alerts, is using a class like :

i.icon-blend { opacity:0.8; }
And 30 days is only for free accounts.

Packrat is a Dropbox Pro add-on feature that saves your file history indefinitely.
Normalize v2.0.1 - optimized for modern browsers
"Paying $12 to store a gigabyte of data for 100 years"

I'm not sure what kind of organisation I'd actually trust to store data for that length of time - a commercial organisation is probably going to be more effective at providing service but what commercial organisation would you trust to provide consistent service for 100 years? A Swiss bank perhaps? Governments of stable countries are obviously capable of this (clearly they store data for much longer times) but aren't set up to provide customer service.
The domain seems to be gone altogether now -- there's just a generic search results page based on the domain name (wells, water, get well soon cards, that sort of thing) at the main domain and at www, and the blog subdomain is all 404.
No, that's not right. That's only the data transfer rate.

If you check the FAQ, they bill you based on your peak hourly retrieval rate.

If I download 4TB at say...10MB/s, not only do I need to pay $480, but I also have to pay ~$257 as a retrieval fee?

Their wording is confusing, but ignoring the free retrieval amount (negligible difference on a 4TB transfer):

Fee = Peak hourly retrieval * number of hours in month * $0.01

https://aws.amazon.com/glacier/faqs/#How_much_data_can_I_ret...

Admittedly ~$737 isn't the end of the world if your house has burned down and you need all your data back, but it's still important to know the details.

I think in that situation, it would be cheaper to use their bulk import/export, which would be roughly $300 for 4TB
The new totalitarianism of surveillance technology
Tape drives. Lots and lots of tape drives.
http://www.haystacksoftware.com/arq/

I assume they will support Glacier soonish.
Cash Mob: A very modern boost for a bright button
Here's to hoping that duplicity and git-annex could somehow make use of this service. I'm far more optimistic about duplicity support though, as incremental archives seem to fit the glacier storage model much better. A git-annex special remote [1] might turn out to be much more challenging, if at all possible.

[1] http://git-annex.branchable.com/special_remotes/
In a corporate environment, I wouldn't want to depend on the cloud as my primary backup solution in the first place. I'd be much more comfortable using it as the offsite mirror of an onsite backup. If you're at a point in disaster recovery where you have to restore from your offsite, you (likely) have bigger problems than a 4-hour wait time.
Het Internet Baas Systeem
Great project and idea, congrats !

It seems as useful as easy to deploy. I'll give it a try.
I would guess it's a non-trivial expense ;-)
My Favorite Board Meetings
If you don't mind the additional cost, you can physically send Amazon a harddrive: http://aws.amazon.com/importexport/
After reading about this yesterday, I found myself going through the catalog of Apple products at my house. Some are old and not used anymore, but at 15 Apple products in a household of 2, it's no wonder they are the biggest company in the country....ever.
I wrote this analogy to explain this situation to my Facebook friends:

Hypothetical cooking analogy for the non-techies: Back in the day, if you wanted to cook up a fancy meal, there was only one butcher in town, and he did things the "right" way. He only used one variety of beef, because it was the "best", and he only sold the "best" cut of that beef. Similarly, there was only one farmer, who only sold the "right" crops, because they had the "right" flavor. When you wanted to cook a fancy meal, you didn't really have any decisions to make, because there was only the "One True Way": one "correct" cut of meat, one "correct" vegetable selection, etc.

Since then, an explosion of variety has occurred. However, perhaps we have swung too far in the other direction. Rather than choosing among the 6 different makers of pasta sauce, you now must choose among 6 varieties of pasta sauce from each of the six makers. This way lies decision fatigue.

However, the community of grocers got together and came up with an ingenious artificial intelligence agent built into a pick-packer system. Now, you don't need to even know a single brand name of pasta sauce. You can simply arrive at the store, tell the system what recipe you are following, tell it that you prefer your tomatoes from Spain, your beef the organic grass-fed variety, and your garlic from the Mediterranean, but you'll take whatever variety of pasta is local and most fresh. The system then assembles your grocery cart automatically for you, and you can choose to remain blissfully ignorant of all of the decision-fatigue inducing choices which occurred under the hood.

However, if you are of the crotchety-old-man sort, and you "Only buy my rib-eyes from Lambert and Sons, because he's the only butcher who does it right", you can of course choose not to use the AI pick-packer, and you can take it upon yourself to select the "best of breed" ingredients for your meal, and pretend that the explosion of variety never happened.

So here's the deal. Poul-Henning Kamp wrote an article lamenting the fact that the explosion of variety happened and that the AI pick-packer was invented, because now everything is a giant mess, and back in his day, there was only one right way to do it, dammit.
Like you say, many of the big Asian companies are prime examples - Yamaha manufactures Motorcycles and Synthesizers, seems like a good combination!
Why aren't security experts and hackers mixing and matching the characters that make up the password? I.e. instead of super!!!think3rs, try Supr3Think0rz. Is the added required processing too large of a trade off?
interesting process how this works here:

http://cashmobs.wordpress.com/want-to-cash-mob/

http://cashmobs.wordpress.com/about-us/
Actually, John Hicks did the Firefox icon: http://www.hicksdesign.co.uk/journal/branding-firefox
Exactly. I doubt Amazon will be around for another century, but even if they do survive, their services won't be the same for that long...
You're right it is complicated. But it also depends on how much you have archived because you get to access 5% of your data on a prorated basis too and that's based on your peak hourly rate.

But ultimately, this product isn't designed for backup purposes. It's designed for archive purposes. If you have 4TB of customer data from 3+ years ago that you never access, but need to keep in case the IRS does an audit, then this is the place to put it.
Though you make a good point, your comment could have avoided sounding pretentious if you shortened it by removing the first few words.

Also, please don't use uppercase for emphasis, as mentioned in the guidelines [1]. If you want to emphasize a word or phrase, put asterisks around it and it will get italicized.

[1]: http://ycombinator.com/newsguidelines.html
Absolutely, it's an archive product, not a backup product.
I am genuinely happy you have that freedom and such a refreshing outlook.

However, first you have to attract the attention of a nice open-minded company of the kind you describe. Of which there are not really so many. Getting that attention requires being much in demand. So I don't know that it is much of an exaggeration to call this an unattainable luxury for most of humanity.

You personally have enough visible merit and momentum that you can admit to screwups and not suffer much in your reputation. (Like how peacocks can have huge unwieldy tails and still get away from predators - the idiocy of the tail advertises fitness by self-handicapping)
Startup Communities are Neighborhoods, Not Cities
"I even mentioned that I have a NAS and off-site backup... so either you didn't read it all or you stopped the moment you encountered the word "Dropbox" and started typing."

No offense, but this post doesn't quite match what you wrote originally. My sigh was in response to the phrase "Dropbox should work here, ...". You didn't state security as your concern as to why not use Dropbox, rather it was cost. This might lead someone who only needs <2GB backed up to believe that Dropbox is perfectly fine for that task.

"DropBox is used for backup because they've made file sync so damn easy that most people can be convinced that if a file exists in many places, it is backed-up."

And that's exactly what I'm scared about and why I'm saying it again and again that you shouldn't do it - if only one person listens and avoids potential data loss because of it I've already reached my goal.

"One of the things about backup is that it needs to be easy. Currently the size and cost of backups make it expensive, and the only way to reduce the cost makes it difficult (HDD local copies stored at a friends' house for example). By reducing the cost, perhaps we can finally increase the ease... and then a day may come in which most people have a real backup solution."

Agreed. IMO no consumer backup system is quite there yet. TimeMachine is very close, if only it would do better logging and have some more intelligence about warning messages.
Crying loud is a pretty good mammal trick for most situations other than an imminent predator-grabbing - being trapped in an airtight refrigerator is definitely an evolutionary edge case.
Interesting to note - those of us who used Iron Mountain/Data Safe for years - 4 Hours was considered a "Premier Rapid Recovery" service that we paid a lot of money for (as recently as 2003, actually).

In a true disaster recovery (Building burned down or is otherwise unavailable) - it usually takes most businesses a week or so just to find new office facilities.

But - agreed, there will be some customers for whom Glacier wouldn't work well for all use cases.

Now - a blended S3/Glacier offering might be very attractive.
Seems he forgot the link. Another excellent book for learning Scala is Scala for the Impatient. The first 9 chapters are free: http://horstmann.com/scala/
I know a lot of people seem to have jumped on the backup options of Glacier here and, whilst there is some potential for home users to make use of this product for back, that is not what Glacier is intended for.

Glacier is an archive product. It's for data you don't really see yourself ever needing to access in the general course of business ever again.

If you're a company and you have lots of invoice/purchase transactional information that's 2+ years old that you never use for anything, but you still have to keep it for 5 - 10 years for compliance reasons, Glacier is the perfect product for you.

Even its pricing is designed to take into account that the average use case is to only access small portions of the total archive store at a reasonable price (5% prorated for free in the pricing page).
Alright, I've edited it, thanks for the heads up. Dropbox and backup in one phrase tends to awaken my temper as I've had some horrible almost data losses (as in I've had to restore data from the dropbox cache folder that could basically be purged at any point).
Derail.

Can you actually tell me why identifying personally with the things we buy is a bad thing?
offtopic.com which had registration closed for a large amount of time in 2002-2003ish? It was still a massive forum but the community kind-of "solidified" and didn't grow larger, for the most part quality was pretty good.

It seems to me that once critical mass is reached, closing registration is a good move. It works for other quality-oriented social sites like Oink too.
The dropbox client itself keeps the old versions of files around for a few days. It doesn't matter if the backend gets confused.
Glad to see Bruce Eckel involved. It's interesting to see just how many Scala books have been cranked out in the last 6-12 months or are currently in progress.
Amazon should complement this service with data contact centers which are connected to their data centers network. Then people could go to these centers in person and hand over their hard drives full of data for back up. It will be like bank lockers but only digital. At this low price people would want to upload terabytes of data which will be pain to upload/download.
Yeah, I'm kind of wondering the same thing. It's certainly the kind of timeframe that changes your perspective. Maybe a tiny bit of Danny Hillis rubbed off on me from working at Applied Minds (man, I sure hope so!)

Because as we answer issues of cost and availability, a logical thing to wonder is "how long can I really depend on it though?" As quickly as cloud services (where "lifetimes" are measured at six years) have entered our economy, that's a question begging to be answered.

Amazon at least seems to be an "eventually durable" datastore, though. Meaning that if you are told in the future that it will go offline, you have an excellent chance to make other suitable arrangements. Say there's a 0.01% chance of this product being discontinued next year, up to a 10% chance 5 years from now. I have to think there will almost certainly be other services you can move your data to, on similar terms, for a long time.

That's assuming you're around at all, and nothing reeeeeally bad happens even so. Making data last after your death (or even after you stop paying!) is a lot harder in this environment, and achieving true 100-year durability is a tough nut indeed.

I like your bank idea, since the preservation of a bank account is just a specialized simple case of data preservation. Data preservation seems rather more reliable when the data is directly attached to money. Then again, maybe banks themselves are on their way out for this purpose — Dropbox could become the new safety-deposit box.

But there are 100-year domain registrations, after all. Maybe we're ready for organizations to at least offer 100-year storage, too.
It's strange to browse a website while someone changes pages from up underneath you. I'm trying to develop here!

That aside, thanks for creating this. Bootstrap makes prototyping a pleasure.
For me, trials only work if the price point at the end of the trial is attractive. Personally I would probably be more likely to sign up at $1.50/month than $9.99 / year.... I know its crazy, but it just seems less risk. I really think you should keep the low monthly cost option.
Interestingly enough, the University of Waterloo runs its co-op program through a website called Jobmine which allows students to search through job postings which they might be eligible for. Coincidently, it is also only available until midnight on weekdays and just recently started being available 24 hours on weekends.
Shrug. You don't like autoconf, great; that's clear. As a user of it, I think it's sometimes ugly, but basically fine for its intended purpose (easing portability amongst POSIX-compatible systems). [If you like Windows, you're probably outside its target audience.]

CMake, SCons, etc, all have their pros and cons. They are hardly paragons of virtue though. [Yes, even as a mere "consumer" of CMake (someone who occasionally needs to build packages that use it), I've been bitten and frustrated by it.]

As far as I've found, there really isn't any build tool that really gets everything right -- which suggests that the problem is harder than you suggest. [Although judging from the number of people who try to write their own build tool (most of which languish and eventually die, but cause some pain along the way), it's clear enough that many people think it's a simple problem...]

> autoconf needs to die, die, DIE

Decaf?
For many users, though - they will never use the restore capability. And for those who do, with Backblaze, they'll usually get a FedEx of a Hard Drive - so Recovery time is measured in about a day or so. I wouldn't downplay the consumer backup/restore angle so quickly - for many (most?) consumers, the ability to restore rapidly is balanced by their desire to have low monthly payments. I think we're going to see a lot of consumer backup applications built on top of Glacier in the next several months that will be competing with (the already excellent) backblaze and friends. (Note - Backblaze has excellent real-time restore, with date versioning, for those of us who use it as an online data recovery tool as well)
I don't think DR is the correct use-case. I think it more likely to be (as in the case of banks which I know best) a regulator asking for electronic documents or emails relating to a transaction from 6 years ago (seven years is the retention requirement).

In that case, 3-4 hours would be more than acceptable.
NASA planning Mars mission for 2016 to investigate the planet’s core
Ask HN: Free kindle books related to programming
What are the free kindle books related to programming.

Following are the books i know, do you know more?

https://github.com/twcamper/sicp-kindle

https://github.com/downloads/danchoi/kindlefodder/jquery_fundamentals.2012-01-22.mobi

https://github.com/downloads/danchoi/kindlefodder/rails-guide.2012-01-18.mobi

https://github.com/downloads/danchoi/kindlefodder/unix.2012-01-22.mobi

http://git-scm.com/2010/06/06/pro-git-on-kindle.html

https://github.com/zacharyscott/whys-poignant-guide-for-kindle

https://github.com/visionmedia/masteringnode

https://github.s3.amazonaws.com/media/progit.epub [Can be converted to mobi]

https://github.com/igstan/learn-you-some-erlang-kindle

https://github.com/igstan/learn-you-a-haskell-kindle

https://github.com/turesheim/Guide_to_Fortran77

https://github.com/propella/DesignPrinciplesBehindSmalltalk
This sounds like it's an issue related with your bank trying to scrounge more money off you. I have a European debit card and I get charged the equivalent in EUR, nothing more.
For me the Turkish grind is king but I don't like the miserly portion of a traditional Turkish. When I have access to good beans I'll get a bag of it in fine Turkish grind and keep it in the freezer. To cook the coffee I add a two or three tablespoons to a saucepan and bring it to the boil, then pour.

Once in the Middle East I came across a cafe that does it in a similar way, that is a much larger than standard Turkish. They managed to filter it in some manner too and it was delicious. Turkish coffee will not go through normal filter paper and so I don't know how they managed it. When I do my own I just let the sediment sink to the bottom of the cup like a normal Turkish.

If Turkish grind, or great beans aren't available I'll just get a regular medium grind from a supermarket or coffee shop and put it through a peculator.

This is a good source for a variety of beans in London, UK : http://www.coffee.uk.com/
from a non-Haskell programmer here. It looks like monads are just a way to call functions in difference context, in js

map(myObj, someFunc, contextObj)

Or am I missing something here?
And, since you mentioned Danny Hills, it's also worth mentioning that (ironically?) Jeff Bezos is one of the principle supporters of http://longnow.org/clock/.
One Night With Clojure Makes a Scala Guy Humble | Agile Zone
I'm not so sure that temporarily changing the market cap of apple really would count as controlling it.

It's like saying: I can jump on the field at a Yankee game and "control" 50k spectators and 50m viewers. You may influence them for about a second, but the farther you try to bring the situation from the market's desire, the quicker you'll be corrected.

Sinking 1b into selling apple short would make a small, temporary dent in their market cap.

If you think something is overvalued, you should sell it short. If you think ycombinator companies are overvalued, you should contact the investors and give them odds against the ycombinator startups successes, and it would be in their best interest to take you up on it as a hedge.

In general terms, if you claim to have knowledge of a mispriced asset, there always is an implied economic action you should take to make money off of your unique knowledge.
Yes, I'm aware of that. This helps, up to the point where you don't notice that something's gone for 'a few days'. Let's say you have your student project's folder shared with two other colleagues. You take a few days off, use your PC for casual browsing, meanwhile your colleagues are working on the project. At the end, one of them (who doesn't quite understand how dropbox works) deletes the files while the other is still working on it and dropbox gets confused. Your PC gets synched at a moment where you don't notice. Come back from your holidays and you will have a nice surprise waiting.
Eat, Fast, and Live Longer [BBC Horizon]
Probably what would be required is an array of arrays of separate storage providers and services providing "RAID" on top of these storage providers - and you won't want to trust any of these you'll want a few of them... (hence the array of arrays).
Thanks. Will give it a try.
> What is state of the art today will be laughably archaic in 5 - 10 years

That depends on what you mean by "state of the art".

If you mean the cutting edge of computer science research, then it might not even appear in the mainstream in the next 20 years. For example, type inference was invented in 1982, and 25 years later a very limited version of it entered the mainstream in C# 3.0. Heck, some people even consider lambdas innovative, even though they were invented before computers.

If you mean the most widely used parts of computer science research, like algorithms and big-O notation, then it seems pretty clear that those won't become archaic any time soon.

If you mean the syntax and libraries of today's popular programming language, then well, duh. You shouldn't be asking about this stuff at interviews in the first place. Your own argument perfectly explains why.
We've just added support for Amazon Glacier to http://www.PlanForCloud.com so you quickly forecast your costs and compare it with other options.
I've been living in a hotel for a few weeks. The internet is just a little expensive - $20 for 50 MB or 3 hours, whichever comes first.

I had some time on my hands and got TCP over DNS working. It's obviously quite slow, but certainly useable. A fun exercise anyway.
Crashplan is still cheaper for storage larger than 400GB.

Crashplan+ Unlimited is USD 2.92/month if you take the 4 year package. When I upload 300GB to Amazon and pay 0.01 * 300 = USD 3/month. Amazon would be even more expensive for larger amounts of data.

Is there some fine print I'm missing with Crashplan unlimited?
How to automate JIRA ITIL - based ITSM process