skysight-inc/HackerNews huggingface dataset:
> What's at stake here is more fundamental than federalism: it's self determination.

Yet, Britain has done its best to deny the same right to self-determination to its subjects.

Self-determination seems to be an excuse trotted out to support existing power structures. "We should secede from _____ - but nobody should secede from us."

Britain and Ireland, Britain and India, Britain and Scotland... Britain had to be dragged, kicking and screaming through every single one of those conversations about self-determinism.
>it wasn’t a coincidence that the industrial revolution was followed by three centuries of war

This is woeful selective reading of history. Warfare was a constant everywhere in the world before the industrial revolution. Also 19th century Europe (since Napoleon's fall to WWI) was largely free of war.
> Wikileaks exposed a few (not all that many, but some) shady actions on the part of the DNC, the media, as well as shining some light on HRC's true views on issues (having a "private" and "public" position, corporate speeches, Clinton Foundation donations, etc.) All in all, not that big of a deal.

Really? Because I know for a fact that tons of people jumped on those leaks to say that Hillary was untrustworthy. They absolutely exacerbated the rift between Bernie and Hillary supporters. This is how swaying elections works, by pushing a specific narrative. When that "dirty laundry" (nothing illegal) is illegally dug up by a rival nation state, you think nothing is wrong? There's nothing to look into here?

No, we don't have definite evidence of collusion yet, but why don't you ask the FBI which is actively investigating Trump? This isn't Pizzagate. This is happening: the intelligence community already knows that Russia was behind the WikiLeaks hacks, and now they have found Trump suspicious enough to be worthy of investigation. You can't handwave that away.
> "...but not as much as Comey's last minute lie about finding a laptop full of Hillary emails."

Comey did find emails on a laptop confiscating during an investigation of Anthony Weiner because Weiner was texting/sexting a 15-year-old. Weiner was the husband of a chief Hilary Lieutenant and there were email exchanges between her and Clinton. There were missing emails because Clinton had destroyed 30,000 emails that the FBI had asked her to turn over to them.

When Secretary of State, instead of using the official government email server which was necessary not only for security/hacking reasons but because by law a record of correspondence needed to be stored on government servers for future Freedom of Information Act (FOIA) requests, used a private email server in her home.

She did this precisely so that her emails could be hidden from FOIA.

When requested by the FBI to turn over her emails, Clinton had 30,000 of them destroyed.

The Democrats never, never should have had as a candidate someone who would feel they were above the law and set up her own home email server. To me, it is simply baffling that they would ever nominate such a person and shows a profound lack of judgment on the part of DNC leadership and the Democratic elites.

Nothing Trump or the Russians or whomever has ever done comes close to the seriousness of using a home email server for Secretary of State emails. Of all people, HN readers should understand that.
> I think a better question is if society can adapt quick enough to fill the void left by the absence of work.

i think that question has been answered to some degree by research (cant pinpoint off top of my head) which seems to indicate that generally humans fill that void by watching more TV and sleeping. i think its idealistic to think that people will suddenly become creative and culturally inclined.
I work with those people on a daily basis. There are legitimate critiques of the creativity, often tacitly acknowledged or fully ignored.

There's no one in the field making any legitimate claims to computational creativity. Maggie Boden did a fine job by inventing a few definitions of creativity and finding them in the output of machines, but it's all ultimately explicit rule-following.
You Don't Want XTS – Quarrelsome
But don't we already have that with city/major councils? Are you arguing that these councils should just be given slightly more influence than they have now?, or that we don't need anything larger than them at all?
Have a Chairman or Woman probably ought to be #1
I was not the one who pulled the trigger as luckily I was out on vacation, but it is one that I keep in the back of my mind whenever I am playing with stuff.

Early in my career a fellow team member working with me at a fairly well known fortune 500 company was testing out a process where using Microsoft Forefront Identity Manager we would cleanup in-active accounts and shuffle things around to various systems auth systems. Since this service was used to sync our prod AD and test AD there was a "connector" into prod. From this single FIM instance you could hit dev, test and prod ADs. Sadly there had never been any rules put into place to prevent a push from test -> prod.

On the day that this co-worker was doing some testing he somehow managed to push a change that he though was going to our test AD but instead went to the prod AD. This change ended up wiping out quite a few prod AD accounts. As in totally deleting them. All of our systems, including the phone system (not sure why) were tied into AD. All of the sudden people on our floor were saying they couldn't login to anything or send e-mail. Soon we found out that the CEO of the company was feeling the same pain and on top of that, was not able to receive or make phone calls. My co-worker took a look at the process he was running and realized he had screwed up big time. He killed the process but not before about half of our production AD had been wiped out.

Like most backup systems, restoring our AD from a backup had not been tested in awhile. Between figuring that out, since it naturally didn't work as designed, and having to get the backups from our off-site backup company most of the company was unable to do anything for about 8-10 hours. This included remote sites, field techs, customer support agents, etc.

What sucked is that this co-worker was one of the top members of our team and had been handed this FIM environment that somebody no longer with the company had built. On top of that he was not provided any sort of formal training and was really learning on the job. They let him hang around for another week or so and then let him go.
This is absolutely it. I worked for 2 different start-ups and as an engineer it is damn near impossible to get tangible value out of equity options, yet they're being used as a mechanism not to pay market rate salaries with the notion that it'll be "worth it in the long run".

Maybe it can be, but I haven't seen it, nor has anyone I know working in the valley.
Reminds me of a Steinbeck quote:

"Socialism never took root in America because the poor see themselves not as an exploited proletariat but as temporarily embarrassed millionaires."
Tantalum caps have much worse leakage current than ceramics.

The debate for most designs is not tantalum vs. electrolytic, it's electrolytic vs. solid vs. ceramic. And ceramic usually wins.
And he knows this because she is an absolute loon who went on to tell him all about it, I presume?
> generally humans fill that void by watching more TV and sleeping

The good news is they're only wasting their life for themselves. Those of us that enjoy other pursuits are still free to enjoy them, regardless of how many people are watching TV and sleeping.
"plenty of economists that think Brexit will work out fine"

Whom? I would be absolutely thrilled to see a credible study which suggests Brexit will be good for the UK.
Don't forget 90day expiry if you leave. Even though you already sacrificed the salary for them. Also very unclear legal ramifications if the company is sold. ie, do you get immediate vesting, do your options disappear, do they become some number of options in the new firm (how many, why that ratio?)... They can deny the sale to anyone until IPO.

Its comp they can take away, block or otherwise control.
Won't happen. Why get energy from incredibly rare and cumbersome isotopes when the sun shines every day?
The Internet is a game changer for music artists, fresh from sxsw
Put the waste in Antarctica, and it won't kill anybody.
Destitution sucks worse.
Could you protect the ice with giant drone-dragon-sunsails?
I have no idea. It's mentioned lots of places though. I just chose one more or less at random:

https://duckduckgo.com/?q=dnc+leaker+murdered&t=ffip&ia=web

Irrespective of the accuracy of that report, the rest of my comment still holds though. People in power aren't going to punish themselves.
Big Money is, in itself, in a different game level

Taking in mind the recent past we can expect that Juncker will represent the interests of Juncker. Maybe also the interests of a small fraction of Europeans. No more, not less.
I mean, there are plenty of very happy people sleeping with eachother's spouses right now. Debauchery can be fun in it's own right.
Sewbo's scheme is clever. All they have is a tech demo, though. No production. It's too bad American Apparel went bust; many of their garments could have been assembled that way.
Hopefully, UK will now get rid of onerous, business-strangling regulations of the EU. That's at least one good aspect of Brexit.
Ultrasound is a bit different because it's "active looking" - if after a cursory scan the technician isn't actively directing the device at (and around!) the suspicious spot, you won't get the images required to be sure about what's there.
Another useful metric is degree of surface convolution, with larger surface areas correlating with higher intelligence. Dolphins and whales have a degree of surface convolution similar to humans, although the thickness of their neocortex is about half that of humans.

But the biggest factor is likely structure and organization of the cortex, not just size, density, or surface area. A good representation of structure is the homunculus [1], which emphasizes the mouth and hands. Undoubtedly, verbal and written communication have contributed enormously to the explosion of human intelligence.

[1] http://www.rci.rutgers.edu/~uzwiak/AnatPhys/APFallLect19_fil...
Because it goes dark every night.

Because solar farms are disastrous to the environment as they sterilize the ecosystem in their shade.

Because Thorium is neither rare nor cumbersome.
> However, as architecture grows organically, it doesn't take too much understanding or experience to know that using a single Redis instance for three different use cases would probably run into issues. That's more than likely not a symptom of "organic growth," but of poor decision making.

If one always had time to reflect upon problems during development you were right. But during crunch time one makes a lot of decisions without proper evaluation just based on a (more or less) educated guess.

> Trivago received a $4,000,000,000 valuation. Why does their engineering deserve the benefit of the doubt here?

Because a lot of readers here have worked in (potentially over-evaluated) environments that constantly underestimate the time required to build something. That someone reflected upon their mistakes and published a post mortem is a good sign someone found the time to finally re-visit all those previous decisions with a rested mind and some distance to the frantic time of "just getting things done".
Are you making customers too happy?
I used a very simple model for my estimate:

5 years to exit * 20K yr opp cost = 100K total opp cost

I think my payback should be twice my total opp cost, so I want 200K at exit

1% chance of exit at 600M valuation after those 5 years

I would expect my initial equity to be diluted to 50% of original value.

Hence, I want 6.7% equity at the beginning of the 5 years.

Note that, IMHO, I am being very conservative in calculating my opportunity cost for the lost salary.
> There's a recent estimate that about 50% of jobs are automateable with current technology. The future is already here

It's been here for a while. Agriculture used to be ~80% of the U.S. labor force, now it's ~2%. We've already seen most work get automated, we just didn't notice it (because we moved on to other work).

Though it's worth pointing out that in recent years, automation has slowed down quite a bit[1].

[1] https://www.bls.gov/lpc/prodybar.htm
> I don't know what kind of peace of mind you get by living for your own pleasure

The peace of mind that my non-existent children cannot get hit by a car or get cancer or get killed in Iraq or any of the myriad worries that are at the forefront of every parent's mind.

> On ability to travel: most people eat sleep go to work go to the bathroom and spend time with their families

I'm lucky to have a lot of opportunities by living in a first world country with a high salary and a strong passport. It seems wasteful to give them all up just to live like 'most people'.
The fact that the author even knows about radare let alone put quite a bit of effort into building a ui for it suggests that he's no stranger to lower level programming tho.
The idea that I need other people to tell me what to do (which is generally what a paid job is) to have meaning in life is insulting.
Yea, for myself it was a combination of things for they way I voted. Those leaks played a part. They were like advertising--we all say we are immune to.

I disliked Trump, and his family, but agreed with 90% percent of that 100 day pledge. Actually, the only reason I read that pledge is after all the leaked emails, and it wasen't just one. The emails just showed me how devious some politicians/their staff are.

I would have voted for Sander's if he wasen't blackballed.(evidence in emails--which made me more leary of Hillary)

I was so torn, and read many of those emails.

The last day I could vote by mail, I left the decision up to the last hour. All the emails, promises, personalities ran through my mind.

I didn't like the guy, nor felt he could do what he claimed, but just couldn't vote for her. The Clinton foundation, her condensing attitude, her staffs devious plot to destroy Sanders, all of it combined made me vote for that guy.

The emails made a difference.

I think Russia looked at it was psychological warfare. They knew most politicians knew squat about the Internet. They knew American politicians looked at the Internet/Technolgy as a toy. Hillary was actually smart in having her own servers, but her staff was sloppy. It was all so innocent, and fun a few months ago. Trump is telling Russia to find her lost emails--crazy?

Anyways I made a mistake, and hope I'm around to vote in three plus years.
It certainly wins on tiebreaks
I really liked Lincoln Stein's Network Programming with Perl. Excelent examples and clearly explained from the basics.
I see no real issue. If millions of pensioners and potheads can find meaning without work, quite rapidly, we'll do OK.

Oh and btw, work bringing meaning? many jobs don't.
That reminds me of one of an engineer's maxim: If you make something idiot proof, the world invents a better idiot.
From Streams to Tables and Back Again: An Update on Apache Flink's Table&SQL API
That's a painfully stupid question. Machines have already created lots of meaning that's interesting to me, including stuff that couldn't be done without them and unexpected behavior due to some patterns we hadn't previously recognised. There are really too many examples to even get into it.
Something for your hangovers
rent-seeking

Tangent, thanks. This is the phrase I was trying to conjure to mind earlier today in a discussion about the very topic of this thread. Ended up taking a long, exhaustive and context-laden road to get to my point; after which I had already lost an audience but so it goes.

For the interested: https://www.wikiwand.com/en/Rent-seeking
Actual link:

https://www.searchinternethistory.com/
Yeah, this is good stuff. I'd like to also mention explaining the mathmatical symbols before stating the equations is useful since most technical papers tend to gloss over that and it ends up just looking like gibberish to people who don't have the academic background to understand it. This is super useful, wish there was more content of this level out there.
Can a computer give us first-person insight on the human condition? That would be one working definition of "art."
Free and Open Sourced Logos for Your Startup
Best Blogger SEO Tips
>But the life of an animal bred for human consumption is not "somewhat unhappy". It's closer to "absolutely depressing" or "shockingly inhumane".

I've seen plenty of pastures with lazy, grass-munching cows to believe this is universally true. Sure, the life of many factory-farmed animals isn't great at all (particularly thinking of Tyson chickens here), but this isn't universally true. Livestock in many other parts of the world does not live this way. There's more to the world than America, you know.

>Is it better for a human to never exist or for it to be born and then at the age of 6 we murder it? The obvious answer to that is that it's much better that that human never exist.

That isn't obvious at all. What if that child has a nice, happy, carefree existence until it hits the age of 6? Who are you to say that life isn't worth living?
A post about BMW Engines: http://thegarage.jalopnik.com/bmw-engines-are-gigantic-piece...
Scientists want to create ‘red teams’ to challenge climate research
>What I can suggest is stop thinking of food as tasty. I'll eat dirt if it gives me the right vitamins and proteins, don't care how food tastes

Wow, this really sounds like a ringing endorsement for veganism! I'll bet a lot of people will try it out immediately after reading this!
> The deadliness of all forms of power depend strongly on regulations.

If this your contention, then you immediately want to stop all coal and oil plants pending regulatory overhaul. Coal plants release 100x more radioactive material than any other source in the world.

And that's not even to mention the operating dangers, from poor work environments to accidents. And that's not even mentioning the environmental disasters. Fossil fuel accidents have routinely devastated entire ecosystems, from Exxon Valdez to Deepwater Horizon.

Nuclear power has the 'airplane safety' problem, people are terrified of air travel despite repeatedly being proven to be the safest form of transportation. The same is true for nuclear power. It is by far and away the safest form of energy generation, with the common myths repeatedly debunked time after time.
Interesting. Generational thing possibly? I'm mid-20's and those kind of things are talked about openly, even in mixed gender company.
Except the NRC doesn't have a tolerance for erosion of safety, at all. Look at history, if anything they've gotten more strict over time. Once identified, there is strict procedure about rectifying it.

The problem with nuclear is that it is so heavily regulated that every little mistake that would fly under the radar in any other industry is instead explicitly called out, cited, and a resolution demanded. Which gives great visibility. But then some people misleadingly characterize it as "more unsafe" simply because its more visible, when really the alternative (followed by coal, natural gas, solar, wind, hydro) is to not call problems out at all in the name of "deregulation" which is an absolutely more dangerous way to go about things.
It's evident from previous examples that it's a significant increment from legalizing a bad practice, that is anyway going to be done by law enforcement and other government organs, and by stealth even if it was illegal, to making software or protocols contraband.
I can't imagine what they would be willing to do for a luxury like health care!
You start small, and earn trust with the unhoused in your city over a long time of being a reliable presence. Then you teach other people to do the same, and they start small...

Despite the fact that homelessness writ large is a Societal Issue, social work succeeds or fails two people at a time, and over the course of months and years.
Unfortunately, this does not answer my original question. Please provide me the constitutional amendment that grants individuals the right to privacy while using the internet.
Original author here.
Thanks for your comment. I don't think you mean everything bad or snarky here. I like to read critical feedback. Thats how you learn.

But i guess you mix things up.
So yes. This architecture has grown over the time. And the whole story didn't happen yesterday. It starts September 3, 2010. So >6 years back. The first _Real_ problems appeared in 2013. So ~4 years back.

With our current knowledge, i agree that those three use cases should not fit in one redis instance.

> I think the post could have been more useful if it would have conceded the point earlier that they made bad decisions from the get-go, that they had to play catch up with those decisions, and that the advice was for attempting to catch up to these decisions.

This post is written as a kind of story. Of course it would be possible to conduct this post to learnings.

> It would be very interesting to understand why they made the choices they did.

Feel free to ask every question you want to know. I am here and happy to answer.

> Why are they running memcached and Redis at the same time?

Because this are two different systems with two different concepts for different usecases.
If you use caching, i agree. Both can cache data.
But on use cases where you need master slave replication (maybe across data centers), memcached may not fit.
IMO it is hard to say both systems are the same.
E.g. if you deal with caching data that vary a lot in size per entry (same data concept), one memcache instance / consistent hashing ring might be the wrong solution, because of the slap concept of memcache.

> Why wasn't a regular database suitable for data persistence or temporary data?

This question is not answered in general.
But i use one use case.
We had a MySQL table running on InnoDB that was really read heavy with ~300.000.000 lines. The indexes were set for the read patterns. Everything fine.
An normal insert in this table took some time. And we wanted to avoid to spent this time during a user request. This would slow down the request.
One option the dev team considered is to write it in redis and have a cronjob that reads this data out of redis and stores them in the table.
With this the insert time was moved from the user back to the system.

> Why wasn't the cache for search installed on the application server to remove network latency altogether?

There is a cache on the application server. But we have several cache layer in our architecture. This was just one of them.

> Why weren't they running php-fpm from the get-go?

We are working on a switch to php-fpm from the typical prefork model.
Such a task sounds easy. But in a bigger env this can get quite a challenge.

> I made the comment because doing some research or having some understanding from the beginning, might have avoided the post altogether.

Agree. The challenge here was, that the people who introduced Redis at that time has left the company. So in short: We had the problem, and had to fix it. With our current knowledge, we would fix this in a different way and maybe choose different approaches. But yeah, i assume this is a normal learning process.

Anyhow. Thanks for your feedback.
You'll always need intelligent humans using your product to tell you what to optimise for. An optimisation is almost always a trade-off and you'll need your end users to tell you what's ok to sacrifice. For example, I expect my mum would trade about 50% of the processing power of her phone to get 10% more battery life, but the most important feature of her phone right now is that it's white so it's easier to find in her bag.

My point is that you can't just tell a machine to go optimise. You need to tell it what to optimise and that's often a complex indeterminate culturally specific interaction between poorly defined attributes.