This is just magical thinking.

Not really -- this is "it's less effort for them to deploy everything on their existing, robust tools" thinking. I personally don't second-guess it, because once a tool proves itself worthy at the GOOG, it tends to stick around for a long, long time. Some of my cave-man Python code is probably still kicking around in ops/SRE. (It's hard to write really bad Python, although there have been valiant efforts over the years, and we're sure to see many more)

Your skepticism is warranted, but I just think it's misplaced. The one thing that Google has proven they can do as well as, perhaps better than, anyone else is get tasks to run transparently across a whole shitload of computers and datacenters. Maybe everyone there is turning evil nowadays, I don't know, I can't know -- what I do know is that it would be more effort to turn around and fuck up the existing building blocks than to simply open them up (with appropriate restrictions) via GAE. That's all.

Normally I find your commentary extremely perceptive, but this time I think that you're off the mark. JMHO

nor are they going to lend me an entire datacenter's worth of computers to ensure that my naive attempt to bubble-sort 1e6 database rows per pageview will "scale" out to 10 million hits per day.

If the price is right, I'd bet you they would rent it... That's really what AWS is all about. Although it will be a while before the GOOG has entire excess datacenters' worth of capacity -- somehow, Google always managed to soak up all the deployed capacity and then some, at all times. As someone coming from a supercomputing background, I thought that was really fucking cool, because when you're deploying racks an 18-wheeler at a time, you might expect some lag between powering up and going to 1mW steady. Nope.

I've never seen a company that could scale infrastructure like Google, and I worked at IBM Microelectronics a couple years before GOOG, along with another one of the biggest websites on the planet, and deployed my own multihomed network in the interim (as mentioned elsewhere, one of my bigger triumps as an 'architect' was beating Microsoft at their own game with a staff of 4 people during that time). No one I have ever seen comes close to Google in terms of operational efficiency, and I've seen a lot over the years.

Your Google Apps site is going to have limitations

No shit, that's why it's free. I honestly cannot see how those limitations will include a lack of fault tolerance, the provision of which is their biggest selling point (IMHO). Everything else (again IMHO) pales in comparison.

The original poster notes, correctly, that half of Google Apps' limitations are restrictive compared to those of a $7-per-month web host

For certain conditions -- you can't be a Pythonista or the comparison goes out the window. Moreover, if you create several GAE accounts (do it! do it! Just because I worked there doesn't mean I don't support taking advantage of them), you now have a framework for freely deploying a bunch of pilot projects for $0 down and $0/month.

Just don't marry yourself to the Google toolset (Users, ObjectStore) too tightly and you get a LOT of good shit for free. AWS is more open and more loosely coupled, so for many (most?) non-larval startups it's probably the better choice at this point in time.

But if you're a cubicle dweller plotting your escape? FUCKING GO FOR IT, MAN! The price is right (free) and Django is an awesome framework for pilot projects. If you strike it big... well, burn that bridge when you come to it.

Oddly enough, I'm going to have to invoke DHH's "build first, scale later" maxim here -- "build first, limit lockin, migrate later" for many people. Not all, maybe not even most, but for individual developers with a little self-discipline, this is a HUGE step.

And (this is killer) nobody says you can't farm our your long-running jobs to AWS/EC2 and call them via REST from your GAE app. Just like the ticket for urllib2 support is mostly about RESTful auth and data transfer. A LOT of us want to decouple GAE from those bits -- instead of complaining, some of us are working on it, and it seems like Guido and others at Google are supporting the effort.

Never attribute to malice that which can be adequately explained by the GOOG's internal disorganization and 'organic' (to be generous) growth pattern. ;-)