skysight-inc/HackerNews huggingface dataset:
Can you describe what you guys do and your infrastructure? Is there a need to test in production or has it just not been important enough to prevent it?
It's actually not just GKE, there have been issues creating normal VMs since late Friday night. It seems anything that required creating VMs gave back resource exhaustion errors. I finally got a cluster for us-east1 setup last night so it looks like the resource issues are clearing up though.
> Can someone please tell Google that protocols are not Chrome-releases?

This is why browser marketshare matters. One player holding such a dominant position gives them according control over how web standards evolve.
reich's book is really fantastic, totally readable for non-specialists. i liked razib khan's review:

https://www.nationalreview.com/2018/03/book-review-david-rei...
> It’s our fault?

Probably talking about Web Developers, of which there are many here.
The major issue is that outages are global instead of regional, effectively making it impossible to design around using the typical region/zone redundancy.
So the thing that is lacking here is the human user UI to go with this. What I mean is some sci-fi like vision overlay that allows you to approve someone reading the implant. If they had that and it means I never needed to carry an ID, credit cards, cash etc. it would be very interesting.
That is a really bad excuse. I’m glad iOS doesn’t allow that.
That's really not what happened. Spdy (HTTP/2) and quic were in development simultaneously at Google before the standardization process began in 2012. HTTP/2 solves a bunch of performance challenges around running web applications over HTTP (a protocol designed for simple, static documents). Part of this was adding pipelining and multiplexing to solve the HTTP/1.1 problem of head-of-line blocking. (A problem which previously people solved by opening a bunch of connections and even using different subdomains so they could bypass browser limits). And to be clear, you can still do that in HTTP/2, it's just less necessary.

However there's only so much you can at the application level. Some problems need to be fixed at the transport level, and there's where QUIC comes in. It's not fixing problems in HTTP/2 (at least not compared to HTTP/1), it's making things even better for high performance web applications.
Time to find that radio signal from Vega.
The Problem is that both the cooling and the power supply both work with one simple number, and we have to know what the CPU needs in order to put it in a system.
How did it pull it out, lacking hands and dexterity?
You can sell microphone data for correlating ads you see on TV to sites you browse to.
> So Spotify must compensate for the los[s].

why?
Understandable but in my experience the incident manager assigned is still supposed to keep track of progress during weekends when you have a major incident.

And this is likely a major incident with significant customer impact.

The way google is handling all this gives a pretty poor impression. Seems like this kubernetes is just a PoC.
There would be an upper limit, but where is it? Maybe something less exotic than liquid nitrogen (like water cooling), though who knows without trying it. Maybe even a solid air cooler could do it, or at least get within a few percent of it.

The concern is that a lot of the cooling solutions that are common in the market could be substantially worse than that, or even motherboards that can't supply that much power and are correspondingly configured not to.

It implies that a small form factor machine may be a lot slower even if it has the same processor in it.
I'd put it differently. Not that aesthetics have changed, rather that the technique of displaying what you see (through painting or sculpting) has gone through considerable evolution since the days of the pharaohs. And thus the aesthetics of things were a result of that.
I saw quite a few arduino sensors so you could build your own. I've linked a couple, but I haven't bought them yet.

https://www.amazon.com/KEYESTUDIO-Particle-Monitor-Arduino-R...

https://www.amazon.com/Keywish-Detector-Mega2560-Raspberry-B...
More to the point, why would you depend on Google for any critical infrastructure after this?
Let me put it this way. HackerNews, or in fact, any news outlets are not official. Customers should be getting emails from Google and be informed on its official webpage to explain what's going on. You don't want your neighbor to tell you you owe taxes. You want the government to send a notice to you.
Have you used iVim[1]?

[1]: https://itunes.apple.com/us/app/ivim/id1266544660?mt=8
Cities in the US are a bit smarter now. Atlanta refused to pay for the Braves' new stadium. There was a big rush of stadium-building in the 90s as mayors tried to outdo each other.
You seem to have a very simplistic view of how voting works. Why would you assume downvoting is a feedback mechanism to signal negative posts only? People downvote for all sorts of reasons.

I for instance downvoted your comment, for supporting a blanket regulatory attitude across the IT spectrum. It's tantamount to proposing a single programming language across the whole stack. That portrays a very narrow view of the world. Not to mention it can lead to being counterproductive.

Do note, human communication is a complex endeavor. We employ all kinds signals and techniques for information exchange and a simple downvote in an online forum is a perfectly valid signal, albeit an ambiguous one.
> I would feel pretty ripped off if I made a big, delicious cake, and as a reward I get one tiny slice while I had to watch everyone else eat the rest. Maybe not if making cakes is just a small hobby for me, but definitely so if it's my career.

this analogy doesn't even begin to approximate the real dynamics.
5 years? I remember a major outage maybe in the past year.
I have a question. At what point does k8s make sense?

I have a feeling that a microservice architecture is overkill for 99% of businesses. You can serve a lot of customers on a single node with the hardware available today. Often times, sharding on customers is rather trivial as well.

Monolith for the win! Opinions?
No sweat; it's impossible in a typical HN-length post to cover every possible expansion of an argument; I took no offense to the post that ended up flagged/dead [by others] and hope I gave no offense with my own.
This is a problem in the web ui creating additional node pools, there is a very simple workaround to use gcloud. What major impact are you referring to?

It's likely the fix is checked in and will start roll out on Monday.

Disclaimer: I work on Google Cloud and while I believe we could use more words here, this doesn't seem like a huge problem. It's embarrassing the the issue with the ui was shipped, and I'm sure this will be addressed in the post mortem as well as whether it could have been mitigated quicker than a roll forward.
I think it's more that _every_ group tends to make some other group "the other" or the out-group. The current US progressive/leftist's out-group are conservatives/Republicans.
This outage really doesn’t have much to do with K8s.
The only issue raised in the post you replied to was that TCP head-of-line blocking can be a bigger issue in HTTP/2. Claiming this makes the protocol "fundamentally broken" is a bit of a stretch.

Plus, this wasn't "found after less than a year". It was a known drawback from the very beginning, when the protocol was still SPDY, and deemed an acceptable tradeoff.
Best feature of it is that it is fast to load.

Also, being able to listen to WW2 Nazi Propaganda (and a fun commentary about it):

http://radio.garden/history/warsaw/ghost-voices/
> exposed without any safeguards around it.

I get the idea that that's a bit of a theme. Its a bit like how the root user always has the ability to run `rm -rf *`
India requires one to surrender the indian passport asap after acquiring any other citizenship
Advanced Debugging in the Linux Environment [pdf]
What is stopping you from doing this with TCP?
The default is : https://status.cloud.google.com/incident/container-engine/18...

People who respond here could be employees of Google, caring about it and respond here because they know it.

What he can mention ( a lot of people are working on it) is what you can suspect when something is going down. All other cloud providers do the same.
Palmer here. I am not a racist or sexist, and if you think I was funding "memes with blatant racist/sexist undertones", you probably don't have a good handle on what actually happened.

I funded a single billboard that depicted Hillary Clinton and the text "Too Big to Jail". That is it. This whole racist/sexist/anti-semitic trolling machine narrative was invented from whole cloth. If there were any examples to back it up, you have to imagine someone somewhere would have something to show.
It's too bad we lost blue waters.
A lot of the clothing you buy has RFID in tags sewn into the item. If you don't know this and don't remove these tags, you find that they will set off the exit/entry scanner at various stores unrelated to where the item was originally purchased.

I have a pair of shorts that this happens to on a regular basis. I cannot be bothered to remove the RFID tag at this point.

So if RFID tags are inserted into your body, how often will you trigger such scanners when you are doing your normal business?
I'm guessing for fucking about with the title or for being tediously political. The article has "Why Did Facebook Fire a Top Executive? Hint: It Had Something to Do With Trump".
Men electric shaver kemei km-5600 vintage leather case
I think typically they're done on Reddit these days, but I bet you could do this kind of questions post you refer to on HN and then follow up with a link to a video or stream.
Part of the mentality is that extra effort -- cleaning up code, adding comments, adding documentation, etc. -- may not be worth it. Using the number of likes is an objective way of asking "Will anyone actually care if i do this extra work, or should I do something else with my life?".
And if you do that you go back to the performance of one instance or (probably) worse.
> apparently there's a large talent pool in carbon composite fabrication in NZ

Wonder how much of that was from building faster yachts for Team New Zealand?
I suspect this is a very difficult problem however just because of how varied individual plants can be... telling plants apart can be hard even for trained humans.

Actually, it's not. Despite all the hype surrounding deep learning, tasks like telling similar looking plants apart is precisely what's it's good at. In fact, it will probably be better than most humans at this task. Moreover, it's simple to implement. You take off the shelf model (e.g. ResNet-50) trained on ImageNet, and finetune it on a dataset of specific plants you want it to recognize (~1000 examples of each plant). Then you can run that model on an iPhone (or even on much cheaper hardware)

A much harder problem is to make the robot move through the terrain without getting stuck. But even there, looking at what Boston Dynamics is doing, it seems like we are not that far off.
Facebook Groups are biggest threat to election news and information integrity
> Thing is, with pledge you never really know what the promises actually are, or if they make sense, in that you cannot work around them.

This makes no sense. Of course you know what the promises are, they're in the source code. You can also use ktrace/kdump(1) or even strings(1). The names of the promises are obvious and their intention is clear. There are subsets of POSIX.

> The assumption that with Capsicum you wouldn’t be able to sandbox stuff is blatantly false.

That is not what I said, I was specifically correcting your misinformed statement regarding pledge(2) and those programs that explicitly permit exec, like shells. Capsicum has no solution for this, and as such these programs cannot be sandboxed on FreeBSD.
The default you linked to has not been updated in 2 days... which is my whole point regarding having to rely on hacker news for any status updates.

edit: The default is also only about the UI issue and there's no issue tracker for the broader non-UI disruptions going on since Friday.
That shouldn't, but they do. S3 goes down [1]. The AWS global console goes down, right after Prime Day outages [2]. Lots of Google Cloud services go down [3, current thread]. Tens of Azure services go down hard [4].

Are software development and release processes improving to mitigate these outages? We don't know. You have to trust the marketing. Will regions ever be fully isolated? We don't know. Will AWS IAM and console ever not be global services? We don't know.

Blah blah blah "We'll do better in the future". Right. Sure. Some service credits will get handed out and everyone will forget until the next outage.

Disclaimer: Not a software engineer, but have worked in ops most of my career. You will have downtime, I assure you. It is unavoidable, even at global scale. You will never abstract and silo everything per region.

[1] https://www.theregister.co.uk/2017/03/01/aws_s3_outage/

[2] https://www.cnbc.com/2018/07/16/aws-hits-snag-after-amazon-p...

[3] https://www.cnet.com/news/google-cloud-issues-causes-outages...

[4] https://www.datacenterknowledge.com/uptime/microsoft-blames-...
TCP is a general stream oriented protocol that must cover a variety of use cases and situations. That's why there are so many OS knobs to tweak it if you have a special use.

Since HTTP is the use case here, it is possible to create a protocol that is optimized for it, whereas TCP cannot be optimized specifically for HTTP.

Source: I've implemented a reliable, stream oriented protocol over UDP which has been in use for many years.
> Chad Marlow, a senior advocacy and policy counsel for the American Civil Liberties Union, says efforts to put cameras in street lights have been proposed before by local law enforcement, typically as part of a “smart” LED street light system.

> “It basically has the ability to turn every streetlight into a surveillance device, which is very Orwellian to say the least,” Marlow told Quartz. “In most jurisdictions, the local police or department of public works are authorized to make these decisions unilaterally and in secret. There’s no public debate or oversight.”

Well there goes down the toilet all the sanctimony over Chinese street surveillance, when you realize they are merely more open and unapologetic about it.
“Final” episode of the Great War video series
Me too.

Most of my friends don't go to the gym - they drink. Maybe I hang out with the wrong crowd.
Restoring an Apollo Guidance Computer, Part IV
It's tragic that the unbanked (unable to get credit, often paid in cash, just don't have bank accounts) are the ones most likely stop be stopped by police and subject to unjust forfeiture. (With the exception of the Amish.)
But, check out Indy Neidell's new history channel also, TimeGhost: https://www.youtube.com/channel/UCLfMmOriSyPbd5JhHpnj4Ng It has a between-the-wars series and just started a WW2 week-by-week.
If this is the streetlight in question, "hidden" isn't quite right. http://dailysentinel.com/news/image_ce44ea7c-f195-11e3-8520-...
Well some power is used to run the fans which ends up partly turning into kinetic energy of air leaving the case. Sure, that may also manifest itself as heat somewhere down the line, but not in a way that is relevant for this discussion (and indeed you have to draw the line somewhere).

It's probably fairly neglible though, probables less than a watt in most systems.
> nature is incredibly smart

No, nature is not smart. If some feature helps you survive - even if it would be 'judged' bad in some other context - it is being selected for. That's evolution

> a modern bulldog's health is frail compared to its ancestors, hardly what one would call evolution.

And yet here it is, survived. The difference between selective breeding and evolution is just nuance and speed really, from the fact that it has some intelligent being with 'purpose' selecting deliberately.
Ups, just realized I messed up on the title. It's working name is Odin, Oden is the one written in Go... ;-)
I know-- right? Especially in light of UDP encapsulation of SCTP being "a thing"[1]. Instead, we're stuck with this hack.

[1] - https://tools.ietf.org/html/rfc6951
SCTP packets would need to be allowed through the networks. And networks don't bother if nobody is using it. So it's a chicken-and-egg problem.

But google is big enough to push through that problem, IMHO, as long as browsers fail back to HTTP/2 or HTTP/1.1, the widespread acceptance of SCTP would be a boon to e.g. VoIP and game developers. But alas it's too late. QUIC has been in development for six years now.
Adobe seems to be putting a lot of effort into Photoshop CC for iPad to make sure that moving back and forth between the desktop and iPad versions is effortless if you choose to work that way.

>the biggest change of all is a total rethinking of the classic .psd file for the cloud, which will turn using Photoshop into something much more like Google Docs.

“The beauty of it with Creative Cloud and the Cloud PSD and the innovations there is that you can just pick up where you left off, and you can be somewhat agnostic,” Belsky says. “You can always go back in history. You can share it and have other people be able to go back and undo things you did.”

https://www.theverge.com/2018/10/15/17969754/adobe-photoshop...
That is not a bug with HTTP/2. It is designed to be more efficient by using a single TCP connection, thereby magnifying any efficiency issues that TCP had all along. These issues are not only about HTTP but include the massively increased amount of devices, network types, security features, and general throughput over the years.

Perhaps a new version of TCP could've been made, and that's a valid concern, but it's a slow moving standard that takes decades to alter. QUIC evolved faster on UDP so that's what we have. What strategy do you suggest for improving TCP faster than the current process?
"There are about 4 billion people waiting in line to enter the US if they could."

You really should stop listening to the politicians and learn more about the world.
If you’ve ever read PG’s classic essay "What You Can’t Say," Quillette may be recognizable as a publication unafraid to ask all of today’s unaskable questions.

http://www.paulgraham.com/say.html

https://quillette.com/
It works for me, seems like they fixed it. They use LetsEncrypt so must've messed up the auto-updating of the certificate. In my defence, I've done this before as well.
I don't find it large compared to other uses of electricity that waste large amounts, or other forms of pollution that don't provide any use to the world.

If you find it useless then sure vilify it, but not everyone feels that the creation of an entire industry that has allowed certain people financial freedom is a drain. I feel there are much bigger fish to aim an ecological spear at.

(updated the previous comment to show production not consumption btw)
People outsource to cloud providers because building / hiring / maintaining a team of decent engineers that provide a baseline industry bar of SLAs, SLOs is much more expensive than the eye watering costs of most cloud providers at even a IaaS level. Opex is tough.

Most companies I’ve been at don’t offer multi region support for their services because it’s too expensive for the service provided even in so-called “price insensitive” enterprises (you can’t just make up a price that’s huge, they do have budgets still) and most of their customers are unwilling / unable to pay more for the extra availability. If your software is designed from the start better, multi region failovers should be fairly inexpensive though. But all the bolted on “multi region” software I’ve seen has been hideously expensive and oftentimes less reliable due to the design being soundly not able to tolerate failures well.
i agree with you on major points.

Also, migrating to microservices for existing services might not be worth it, especially if you don't operate at a massive scale.

Keep it simple stupid is still a solid design decision, despite all the microservice/container hype.

Most bussinesses only need a couple of servers that provide the service, spread redundantly with a HA capability.
That’s not how Terraform works. Each provisioner has separate syntax depending on the cloud provider. The template for AWS wouldn’t work on GCP or Azure.
Maybe so, but you won't be affected by this outage if you never decided to deploy k8s in the first place.

Even if you deploy k8s privately, or over at Amazon, I think there's enough horror stories to make you think twice about the technology.

Then, if it isn't going to be k8s for microservices, what's a more reliable alternative?
The full list of 25 apps HubSpot provides to generate more leads, and sales
I also grew up in New Zealand, and it's not for me. It's great if you want to start a family and have a very quiet life. I think I might retire there if I can somehow afford a house.

One of the main reasons I left is that I could never afford a house, or even the down-payment on a mortgage. If I had lots of money then New Zealand would probably be more appealing to me, but it's not a good place to earn it. I don't know if you'll be able to get a very competitive salary, but it might be worth it if you're really excited about the company, and you'll be working on some really interesting things.

One thing to mention is that most shops will close at 5pm, and many cafes even close at 3pm. I think once a week, the shopping malls will stay open until 10pm. The streets are completely quiet at night, and you won't see anyone walking around. After living in bigger cities for a while, I'm always really shocked when I go back for a visit. It's like a ghost town. It's an important factor for me because I work remotely, so I hated being stuck at home and having nowhere to go at 8pm.

Another very important point: You will probably have to cook almost all of your own food at home. Going out to eat at cafes and restaurant is extremely expensive, and it's probably not something that you can afford to do every day (especially not on a NZ salary.) I'm used to living in cities where it's normal to eat out at restaurants most of the time. But you can't do that in New Zealand unless you're very wealthy.

Anyway, it's great if you want to live somewhere quiet and raise a family. You can also spend lots of time at the beach, and go for walks in nature. But you can do that in lots of other countries, too. Personally, I prefer to live somewhere a bit more vibrant, where there's a lot of opportunities and things to do.
>This is a problem in the web ui creating additional node pools, there is a very simple workaround to use gcloud. What major impact are you referring to?

Based on comments in this thread even gcloud is failing and so are other non-kubernetes services. Which may be inaccurate but there's a lot of people saying the same thing so maybe it is.

You're right however that the linked issue is only about the UI. So Google isn't even tracking the service distribution issue in it's issue tracker much less updating people on. I personally think that's even worse...
Why a laptop the ergonomics are so much better with a dual screen proper keyboard and mouse.
>really amateur for an organization the size of google.

There is a reason while Google have been having hard time making inroads in the enterprise cloud. Kind of impedance mismatch between enterprise and the Google style. That 2 stories like high "We heart API" sign on the Google Enterprise building facing 237 just screams about it :)
Curriculum Vitae of Yuri Orlov [pdf]