skysight-inc/HackerNews huggingface dataset:
We followed this idea at my workplace! It worked wonderfully; we slowly containerised every project we have, then deployed the containers as "dumb" "programs". Yesterday I began the orchestration step, and everything has gone extremely smoothly. Altogether this has taken about 12 months of on-and-off work, maybe a man-month all up.
That's not wrong.

In [1]: import json

In [2]: json.dumps("\N{PILE OF POO}")
Out[2]: '"\\ud83d\\udca9"'

Quality detective work there. JSON, being JavaScript [Object Notation], is standardized to UTF-16. What you see here is "PILE OF POO" in UTF-16.

YAML specifies that the recommended encoding is UTF-8, but should be able to parse UTF-16 and UTF-32. And, if you want that, then you need to tell YAML to expect UTF-16. You can do that by including a BOM (Byte-Order Mark).

PyYAML is documented as only supporting UTF-8 and UTF-16, but not UTF-32.

I'm scratching my head on how to get that "UTF-16 encoded" UTF-8 string to a proper representation (in Python). If this were Ruby, I would use str.force_encoding() which doesn't change the bytes at all. If the solution comes to be, then I'll update this comment (or reply).

http://pyyaml.org/wiki/PyYAMLDocumentation
http://yaml.org/spec/1.2/spec.html#id2771184
An open-source, ultra-low cost, portable screening device for retinal diseases
>If you have kids, you have DVDs. I don't know why. They just appear. There is no avoiding them - even in 2016.

I'm not sure how that plays into account. Where would the DVDs come from? It's not like schools hand those out.

Even school plays and such nowadays people video with their smartphones or cameras, and have on hard disks or USB drives.
Mark Shuttleworth on OpenStack: HPE layoffs prove 'big tent' approach has failed
If SaaS is cheaper, then that's the only argument we need. But it isn't clear that SaaS is cheaper.

I run a small SaaS thing for which I charge $19/mo from a dozen clients. Each one of these clients could run it for $7 on Heroku. Someone could easily write a "Deploy to Heroku" button in no time.

I also thought about the free plan Sentry.io offers. That, as you said, eliminates all the small projects need to host themselves, but (I'm guessing) it isn't something that all companies can afford: offering so generous free plans.

I want to open-source it, but I'm afraid I'll lose all my income.
Oops, edited. Thanks. It's https://www.youtube.com/watch?v=SCAGc-rkIfo
I would posit: your perception of "total douche-ness" (your words, not mine) are largely driven by marketing and/or culture.

Glass definitely failed in the marketing, branding, and roll-out departments (among others) -- but they're no more or less doofy (to me) than many other perfectly-accepted fashions: baggy pants, beats headphones, crocs, etc.
Just for a note, those 1TB cheap SSDs are not very good or very compact SSDs. The new ones we associate with such stellar performance are still more expensive.

This device has some pretty intense performance requirements for the form factor. Could we wait a bit for some hands-on with reviewers before saying MS botched it?
People in this thread keep stating things about how AirBnB provides affordable hotel-like space in NYC as if there is no clean, safe, convenient low-cost alternative.

I wonder why they keep disregarding the safety of NYC residents when they can go to Union City, NJ?

"For clean, affordable, convenient, hotels when visiting NYC, don't use AirBnB, use the hotels of Union City, NJ"
I'm really glad this is happening. Wikipedia needs to clean up their broken links, and this could help the archive get a wider sampling of websites, so as to preserve more data.

Websites going offline is a huge problem. For example, the now-famous thread from which sleepsort originated (on 4chan's /prog/ textboard) isn't archived anywhere: textboard threads are immortal, so nobody thought to archive any threads until dis.4chan.org went down for good.

Thankfully, some bright spark managed to save the sqlite databases for most of the boards on dis to the Internet Archive, so I was able to track down the thread eventually.
I agree that they were both created with different problem domains. I mainly take issue with the fact that they selected a single query in a large benchmarking suite and used that to claim that BigQuery was categorically better than redshift. Hell, I actually really like BigQuery! I do find the pricing for queries a tad opaque and difficult to estimate... and the variability in performance is fine for my pet projects but I imagine a larger enterprise would prefer something more predictable. I agree with your statement that they are two very very different products. I enjoyed reading your post.

Disclosures:
I wrote the parent article.
Basically describes the US oil reserves strategy
spoken like someone who hasn't used the product. snapchat's ads fit the format amazingly well, and now that snapchat is also paying for content directly everyone's incentives are aligned to make a deeply engaging product that monetizes well without alienating users.
I wondered that too, but I whois'd the nameserver IPs and they're all owned by Spotify.
With more uptake of IPv6, do people still use NAT? I thought NAT was just for IPv4?
Who+Can+Troubleshoot+Computer+
http://www.appsloaded.com/2016/10/who-can-troubleshoot-compu...
Ask HN: What good open source projects written in React that I can learn from?
The reason why it uses `className` is because we're in javascript land (https://developer.mozilla.org/en-US/docs/Web/API/Element/cla...) So it's not a DSL when you really think about it. It's javascript.
The code in the examples is not valid in any historical version of C. The use of the -> operator with an implicit int as the left argument ("entry" in the examples) was only valid from 1975 in Unix C (but not in GCOS C) until K&R C in 1978. The use of C++ style comments ("//") is only valid in standard C since 1999.

There's no point in arguing over pseudocode as if it's C.
Benchmarking Amazon Aurora vs Google Cloud SQL
I'm surprised there are UPNP implementations that even allow mapping to specific, low-numbered ports.

(Well, not surprised as much as disappointed.)
It is going to take about 3 years for competition to reach where Tesla is right now with regards to range and charging networks.
I think Fort Minor had the recipe right if we're talking people behind large, enterprise projects:

"This is ten percent luck
Twenty percent skill
Fifteen percent concentrated power of will
Five percent pleasure
Fifty percent pain
And a hundred percent reason to remember the name"
Racket-android – deploying Racket on Android
(red heart)(yellow heart)(green heart)(blue heart) Internet Archive (red heart)(yellow heart)(green heart)(blue emoji)

There are fewer more noble pursuits than archiving the sum of human knowledge.
Maybe I'm jaded, but 330k a year or so for the very backbone of your entire real time query analytics infrastructure just doesn't seem unreasonable? This is highly specialized software, tuned and architected for the purpose of running relatively complex analytics queries and aggregates fast enough to allow interactive real time exploratory analysis.

I dont think it's insane to believe that a profitable mature data informed business should be expected to spend 1/3 of a million a year for the ability to have all that data live and available without deep latency.

I can also agree that this is quite a bit for a startup, but if the unit economics of the startup require that this kind of data be available for interactive exploring, there's going to be a deep challenge down the road in scaling it I think?

To your point, if a startup runs through 20 million and their biggest problem is paying AWS bills, then they are probably a failed startup and folks should move on towards whatever next exciting thing is on the horizon.
Thank you! I appreciate the help
Redshift absolutely dominated the other benchmarks, so while the author chose the largest instance, it's not likely to be necessary to still beat BQ.

I don't work for or have any relationship with either, but I do use Redshift.
.Net and Swift are languages/runtimes. I fail to see the analogy with application software.
> I do find the pricing for queries a tad opaque and difficult to estimate

BigQuery just introduced flat-rate pricing for this exact reason:
https://cloud.google.com/bigquery/pricing#flat_rate_pricing

Disclosure: I work for Google Cloud
Tools of Titans – New Book by Tim Ferriss
This depends upon the business case. Some just do not permit reloading the whole page for every server interaction. Very interactive multiplayer games come to mind.
Alphabet Creating Stand-Alone Self-Driving Car Business
Murderous Games: Gladiatorial Contests in Ancient Rome
Well this is some pretty depressing news.
Meanwhile, lately it seems like all too often, you'll be pounding nails with a hammer and then in between swings, it suddenly turns into paint brush or a screwdriver or an Allen wrench.

Or you're working along one day, and all of a sudden, every machine screw in every piece of power equipment on the job site just up and disappears into thin air, and all of that equipment shakes itself apart into a maelstrom of shrapnel, because that little hidden component nobody thought about winked out of existence.

Construction workers would not put up with this bullshit.
There are many reasons why they failed, but I think the main one is because they literally didn't let people use it.

I don't even know why (Probably a combination of the technology far from being ready, and their foolish idea that keeping the exclusivity will hype it up and get more traction).

From what I've seen, these developer oriented projects only succeed by working their own way up to the top instead of trying to use gimmicks like this to gain traction.
Guaranteed lets you select a specific day. If it falls within the bunber of days it gets that pricing.

However selecting a shorter turnaround time reduces the pool of interested artists, so it shouldn't be used unless necessary.
My team uses AWS for all of our servers, CDN, SQL and cache boxes but use BQ for all of our telemetry data - about 20 billion metrics a month.

Not having to manage a redshift cluster and just let BQ do all the work for us is worth the query time; even then, most of our complex queries run sub 30 seconds over hundreds of GB. If your data can be queried using a date-range then use date-partitioned tables. There is a 1000 table query limit so there are some pit-falls but BQ makes it easy for you to aggregate data into weekly and monthly tables to query against.

Disclosures:

1. I don't work at either.

2. My employer, however, partners with both.
I did say the answer to this problem was "all of the above". We're talking about human beings dealing with each other. That means there's an infinite amount of problems. The ones I mentioned are just a few out of many. They're just often overlooked by engineers for obvious reasons.

I hate to use the 10x developer meme...but I will. Personally, I've been around a while...and I worked at a lot of places. A lot of obscure little startups, some non-tech companies, many big and huge names... And 10x doesn't even begin to describe the difference between what some companies consider a "super star" and some consider "bottom of the barrel".

I've seen big name tech companies do with an army in a year, what some of the engineers I worked with would have done in a few weeks, alone, -in the same environment- (thats the important part).

Once you've seen that happen enough, you just can't deny it anymore. The difference between engineers is so great, it matters a whole lot. At one company, a PM will come with vague or shitty requirements and the engineers will run away with it and produce garbage over several months... while another dev would just call it out for the bullshit it is, point out what's wrong and pump out a correct solution by the end of the day.

And all that doesn't even consider the time some will spend googling basic shit while others can just infer the right thing by thinking about it for a sec. The end result is a massive difference in $$$.
I am pretty sure that the plant they are operating from (NUMMI) has a lot of potential for increase. I think that it peaked at over 400k units a year before Tesla bought it.
I don't understand how that will create silence, not just "different noise".
Your minimum instances would always be 1 in the autoscaling group associated with your ELBs (or now, ALBs).

Regardless, neither the Internet Archive nor Wikimedia use AWS or other cloud providers, as it would be prohibitively expensive. They both run their own infrastructure/ops.
React Hardware
> If you think about it, that might be a game changer. Maybe it might make sense to ship e.g. smart phones with wikipedia, OSM and satellite photo (e.g. Sentinel-2 is free data) on disk.

I don't think this is a sensible use of local phone storage, but I do think you'll see a lot more P2P edge cache nodes if/when IPFS takes off (OSM tiles are already served on the IPFS network).

It would be a simple matter of picking a VPS provider or hardware colo provider near expected heavy use, launching IPFS, and having it pin the relevant content locally.
The United States was a country last time I checked, unless Mexico and Canada have mysteriously disappeared. A country roughly the same size as Australia, which has a significantly smaller population.

The Australian government came up with a credible plan to provide high speed internet along the lines of the Swedish model being described. It has subsequently been modified to be less fast, but the concept of providing government-owned infrastructure to be leased by multiple providers on a competitive basis stays.

If it's possible in Australia, it's definitely technically feasible in the US too.
Klosterman?
You are delusional if you think I said anything about Clinton.
Mostly a joke, just trying to think of what that term would mean.
Nice find, that helps. My reading is that it's slightly more than an artifact: Tesla is guaranteeing a residual, so the sale to the bank is conditional and so cannot be recorded as a simple sale.

GAAP strikes me as a set of things that, alone, are good intentions but combined are more confusing than they need to be.
Elon Musk works too hard to fail.
A list of items in an array. Some items in that list are of particular note.

(Say you have 15 items in an array. For whatever reason, such as you not being in control of the expected input structure of whatever you're giving this JSON to, you have them grouped with comments at the top of each block.)
> There are plenty of ways the moonshot could have failed.

Yes, and they were explored extremely thoroughly by Apollo missions 1 through 10.
> I really think it's not an OK choice. A config file format that doesn't allow comments provides some of the worst possible UX.

Are we sure about that? E.g. mostly when messing with configuration files, I have to visit the documentation anyway, which could explain key-value pairs in the json file. Furthermore there are configuration files which consist mostly of comments to explain all kind of edge cases with actual configuration data commented, which can be a mess on its own.

If good code should be self-explanatory then why not configurations?
They're literally building them in an old Toyota plant, that at peak output was 426,000 vehicles annually.
Just noticed I said billion, meant million. Looking forward to VR displays with that kind of resolution though.
OneNote (both offline and synced) and https://github.com/greggigon/my-personal-kanban-server
Quoting Dijkstra from 1968 on goto as argumentum ad authority in 2016 should be considered harmful.

He had reasons for saying what he said in the context of the times. Remove that temporal context and the why becomes more important than the what.
The number of IPO shares floated and underwriter fees have more influence on the amount raised. It's not entirely driven by need.
Yeah, this is a great move. That said, again, here's the philosophical difference: with BQ, you need to "Contact your sales representative if you are interested in flat-rate pricing". There's nothing wrong with this, but it reflects their philosophy that compute should be something pay-per-use, not pay-to-procure.

Again, I expect this "talk to sales" part to change in the future as BQ matures, but I imagine this kind of CIO friendly thinking to be new (if not de-prioritized) at Google.
You're still dealing with query slots though -- which remains difficult to estimate. As far as I know the only way to figure that out is to actually run the query and then check how many slots it used. Am I wrong? I'm certainly not a BigQuery expert.

If you're downvoting do you mind leaving a comment on why I'm wrong? I'm interested in knowing more. The documentation for BigQuery doesn't really explain how slots are allocated and what they're capable of.
I think it's also important to keep in mind when Groupon was founded and started getting big: 2008.

Everybody was suffering and cutting costs. I don't think it was so much as wanting to be price savvy, but rather, wanting to go out and not being able to afford it.

Groupon actually stemmed from a different startup that was supposed to be about something like community building. (The name alludes me, but I used to work for the "parent" company of Groupon and in the same offices as it was getting big. That startup never materialized, but the one they did was got a campaign that if they got x number of people, Motel Bar (which is bar in the same building) would give a deep discount. Andrew Mason, Eric Lefkowsky, Etsy al, quickly realized that that was a real business model, pivoted, and exploded.

Had it been in a different when people were not so price conscious and businesses were not on the edge of going bankrupt, I'm not so sure it would have done as well.

The businesses in that space that seem to still be going strong (see Gilt for example) tend to focus on more luxury items/markets, where they're either selling factory seconds (in the case of retail) or experiences that will likely target a higher class of consumer and will bring them back.
What are successful startups that raised a seed round from family and friends?
Buildings are totally different in that they are all, roughly, the same or small variations on the same design. Consequently it is very easy to reuse massive amounts of reusable components in extremely predictable ways and to define standards for review that can be broadly applied across the majority of projects.

This is not the case when builders are doing something that is actually totally novel in that they don't have many existing examples and it is built of entirely custom components. In cases like that it is actually exactly like software in that there is a lot of figuring things out as you go along, schedules are usually laughably off by orders of magnitude, and there are frequently major screw ups (Big dig, Seattle big bertha fiasco, SF Bay Bridge, ... to name a very few)

Of course in software we aren't always reinventing everything as people unfairly complain. We reuse way more than we reinvent - postgres, elixir, phoenix, browsers, OSX, etc, etc, etc represent 1000s of lifetimes of work and the majority of the totality of work behind an actual product.
The time we do spend, and consequently the variability in schedule, is due to the fact that most software is actually quite different in its requirements from all previous software and usually previous examples (aka competitors) have not made source code available for reuse.

One huge difference between software development and "custom" building development is that good software developers embrace this variability and uncertainty - hence agile. Most other fields of engineering are still caught in an archaic and delusional world of gantt charts and hard deadlines with feature lists developed by architects. It never works that way insofar as the work is _custom_ - in any field!

The thing I really hate about this conversation is how so many people are so eager to just chalk all this up to software developers being half-assed hacks. Well there are lots of teams at places like HP staffed by only "certified" software engineers and guess what? They still are terrible at predicting outcomes and they are actually far far worst in general at their jobs than small, modern, agile teams who make the best of the chaos by addressing that reality in how they work (again, agile).

This is software development people. It isn't about bad devs and lack of certification, it is just hard.
For comparison I did integrated circuit design for 7 years right out of school up through being a lead on multiple larger teams before switching to software. The rigor you perceive in other areas of engineering is a total fantasy. Bridges and buildings are maybe the exception but again this is only possible because it is such a canned art by comparison. If you disagree please just enumerate some specific "building codes" or "certification requirements" that you think would actually make any difference on your average complex software project.
+1. They'd have a much stronger case if they didn't drag in silly complaints such as "[Google BQ] does not support the ANSI SQL syntax of 'substring'. Need to change to 'substr'".
There are far worse arguments, as well.

"I want my kids to be safe" isn't automatically a bad argument.
Examples of good persons to idolize, please? :-)
Co-founder problem. Pls vote
My cofounder has serious personality problems where he is insecure, inexperienced, looks down on people, very emotional, changes company direction all the time and most overall,, because of this person three people(out of six) already quit because they can't deal with him.

Our company is seed funded and have beta launched. Idea/direction wise it's going quite well. Except that people are quitting only because of this one person.

This person has the most equity in the company. And realistically pushing out this person may be a big challenge due to few reasons..

Option 1. Still fight to push out this person

Option 2. Quit. It's not worth it.

Please advise!
Who knew an insecure cofounder would bring down the company.. fyi I brought in all the team members except this person.
> I think that just using containers by itself will force us to be disciplined about how we package and run services (you have to install all the stuff the service needs inside the container, otherwise the service will not work!).
>
> There’s no way for it to silently depend on the host configuration, because its filesystem is totally separate from the host’s filesystem.

I don't buy this, at least as presented. /etc/awesome/blah.xml does not spontaneously come into existence on a host on its own. No matter if you're building a docker image, a VM image, or managing long-lived hosts via a configuration management tool, you have to specify that /etc/awesome/blah.xml is created and has certain contents.

It sounds like the author is working on a poorly structured and documented puppet codebase, where all the dependencies of services aren't clear. Presumably if they can figure them out in order to build working docker images, they could also figure them out and then refactor the Puppet code to make it more maintainable.

At that point they could use their puppet code to generate their docker images, which fits nicely into the "horizontal change" philosophy.
Not a lot of people use it yet. I have about 16k followers on IG and an average of 500 views/story.
I feel that once IG (if ever) start adding more filters, people will use it more heavily.
With 10TB of data, you could also do it a hell of a lot cheaper and faster on premise.
From Wikipedia:

"The doctrine of at-will employment can be overridden by an express contract or civil service statutes (in the case of government employees)."