skysight-inc/HackerNews huggingface dataset:
What are the Big Problems?
I'm leaving this open-ended, there's no specific criteria for responses.

I'm interested in both your list and the reasons why. Submitting your list before reading other's contributions would be preferred.

Optionally: who is (or isn't) successfully addressing them. Individuals, organizations, companies, governments, other. How and/or why not?

I've submitted this question previously to HN (most recently over a year ago), and ask it periodically on several forums for four years now. I've written fairly extensively on my own views, reasonably findable if you wish, but my interest here is in gaining fresh input, resetting my own biases, and not colouring the discussion overly myself.

In the past year, a notable development on the question itself is the MacArthur Foundation's "100 and Change" program, putting a substantial financial backing to a specific proposal to address a large global social problem (submissions are closed for 2016, the award will be made every three years).
Perhaps more accurately: San Diego man makes incredibly risky gamble on untested treatment and bad things happen. Given that, I'm curious what your point is here? This is a multiphase clinical trial. That was someone going to another country to bypass the very safety measures this trial is a part of.
If life can have many different bases, I wonder if we’ll even be able to identify extraterrestrial life when we do encounter it.

I have a hunch that we will, soon enough, but it’ll be a much longer time before we encounter anybody near enough to us in size, shape, longevity, intelligence, chemistry, and temperament that we could really interact with them.
I'm surprised there's no mention of Id:

https://en.wikipedia.org/wiki/Id_(programming_language)
thegrugq just wrote a persuasive analysis of the calculus that intelligence agencies must go through with this kind of event. In short, the benefits of revealing that they're aware of the leak aren't worth it. All of the benefit is in passively monitoring what the adversary does with the information. You can find it here, it's quite interesting: https://medium.com/@thegrugq/mind-games-international-champi...
IIRC there are services archiving all github repos. It would be better to just change all the codes that were leaked.
I've found that postal companies ignore the option to "Leave at Door" even when it's marked in their system. (Canada Post, sigh.) The only thing that consistently works for me is to make the first line of my address read: "(Leave at Door; Do Not Card; Buzz XXXX)"

So far, I've only had to go to the post office 1 out of ~10 times, and that because the postal company said they were contractually obligated to get my signature. (So I don't get Dell shipped to my unit any longer.) It's striking how that one line changed everything for me.

That said, re. startling's comment elsewhere in this thread, I don't think lack of buzzing means they didn't try -- they often have to drop off more than one person's package in my building, and I never see delivery folks waiting by the door buzzing every individual's number ;-)
Yes, but it's not rude. Say no of course. It's absurd to consider that rude unless it's like your sister's wedding, then it's rude. That sort of thing.
When we make a new box, we throw it about 20 feet across the warehouse to simulate the UPS/Fedex treatment. As a manufacturer, I can assure you that they try really hard to not pay your damage claims unless it can survive that.

It would be great if someone could disrupt the duopoly of bad service.
Similarly, there were a few PlayStation games that would refuse to run if the console had a modchip, which was a pretty big footbullet when you consider that only licensed discs were likely to retain this check, meaning that it mostly stopped people who obtained the game legally.
When I ordered my bike from UK (Evans cycles is awesome), it shipped via DHL. They're pretty high on the meh scale. The box had double corregated cardboard and the bike was packed for war. I'm sure it wasn't handled gently. That seems like the expectation with shipping. Super cool this hack is! Maybe one day they'll try a picture of a glass chandailer too.

This all said, 90% of the boxes I get from Amazon via UPS are in perfect condition - it's remarkable how well they handle small packages.

There's a national geographic show called "ultimate factories" that has an episode called "ups worldport". Super fascinating. I recommend it!
Belated happy birthday man.
> Each of these needed two EC2 instances for redundancy.

Doesn't EC2 already have redundancy built in?
The author addresses this in the second and third paragraphs of the article.
No, vms can be terminated if the parent host crashes.
A Case for a OneToMany Relationship in Django (2013)
Do you have any advice for junior devs for assessing architectural decisions and crappy services?
I've been using microservices for a particular app since 2011 and it's working quite well. So in my instance, yes, please do. Maybe not for you, but for me. So, change this to: "Microservices - not for me".
If you think everyone who isn't using containers is outdated, you are living in an unrealistic bubble.
Possibly for the same reason all cars aren't pre installed with breathalyzer lockouts (and maybe should be?).
I don't think thrifty simply implies someone lives well below their means. I think thrift applies in both a relative and absolute terms, so living a multi million dollar a year lifestyle you can easily afford does not count.

I make good money as a developer and live well below my means, but I am not thrifty. I simply don't have much interest in buying most things, but I can point to 10's of thousands of dollars in wasteful spending.
Yeah, it's kind of the whole point of the article.

I think, "What are the odds that I am the guy who sees the car in the description and remembers the license plate number and calls the police and the child is saved." Then I think, "But if it were my child, I'd want every smart phone on the planet turned on." So I leave it on and endure the anxiety, and keep my eyes open, even though I'm pretty sure I'm not going to be that guy.
Where do you store your data? Would you be able to terminate all of your instances and not lose data?
The bitcoin wiki was a good starting point and did a good job at explaining the fundamentals of a distributed digital ledger. One problem I personally ran into was understanding the crypto subroutines that validate mining, transactions, and verification on the network. Reading their respective wiki pages can be a bit dense if you lack the background knowledge.
Python 4 Kids: Python for Kids: Python 3 – Project 10
This is not a very good example. These people were just doing it wrong. If they had been running something like AppEngine, Heroku, GKE, ECS, etc, they wouldn't have had to worry about maintaining VMs, replicating app instances, proper VM sizing, etc. It's not the microservice architecture that was costing them money, it was their poor technical choices.
Reasonable judgment is fine. But reasonable judgment can be applied to everything, including who is better suited for making decisions about technological adoption.

Someone who is biased towards "getting job done" and seeing technology adoption as a mere distraction, is simply too biased to be of any help during decision making. When evaluating technology adoption, you need to see the pros and cons (including adoption costs), and evaluate things seriously.
I think that's a reasonable approach you reap what you sow. To me when I hear someone say that an event would be soul crushing or something similar I'm going to go ahead and assume it's not people or a person they want to hang out with. And I was excluding things that are hurtful such as not honoring someone they cared about's celebration for them not you. Also, off the list was basic self preservation. OK, you're not likely to get fired for not attending the one yearly work event but it doesn't help with your reputation so it's not exactly good for the future. So there's a minimum to function as a human being and it's not much. Beyond that, if someone knows they won't have fun absolutely don't go. No obligation. No regrets.
Sure, the main book I had in mind is "SFML Game Development"

https://www.packtpub.com/game-development/sfml-game-developm...

SFML is a C++ library that handles window management, input, sound, etc...
For reference, a friend and I went through the book chapter by chapter a couple years ago. He was new to programming, and I'd made a few simple games and read scattered info in the past. The book had a good pace and filled in a lot of the gaps I had.

Another great book is "Game Engine Architecture"
https://www.crcpress.com/Game-Engine-Architecture-Second-Edi...

This book is a lot deeper, but I found it a great reference. I probably spent more time reading this book and going back over my engine code to refactor based on what I learned (rather than use it as a direct example implementation.

At that stage, there were a few good articles online that were focused on the ECS pattern. Here's a couple, but try to find something that matches your language, there's plenty of info out there.

http://www.dataorienteddesign.com/dodmain/node5.html

https://eliasdaler.wordpress.com/2015/08/10/using-lua-and-cp...

https://github.com/junkdog/artemis-odb/wiki/Introduction-to-...

Good luck and have fun!
Nope, if they screw up their conduct as a lawyer, that's their problem. It's the same as paying a contractor to build a building for you. You get the outcome, but if in the process the contractor gets drunk and beats up one of the construction workers, he gets in trouble, not you.

There is a wide gap between paying for a service and hiring an employee to work for the company.
In theory, somebody could publish a binary that could be downloaded and run standalone -- no need for "go get". Looks like no such binary has been published, though.
I cannot help but wonder if the over-enthusiasm for microservices these past few years is a direct result of the over-enthusiasm for "MVC" these past 10 years or so (since Rails).

MVC outlines very clearly the areas of responsibility for the framework. But many of the popular MVC frameworks take it a step further, declaring that MVC should be the primary dividing lines for your app code and business logic, with little thought given to separation along functional/domain lines. (Or in DHH's words, "The framework is the application!")

So is it any wonder that 10 years later, the industry is freaking out because our nice, clean MVC apps became business logic casseroles? Microservices can help with that, just like MVC can help with the PHP spaghetti code that came before. But none of those things can substitute for basic design principles.

I wonder how things would be different if 10 years ago, instead of app/models, app/views, and app/controllers, Rails had promoted app/auth, app/billing, app/spline_reticulation, etc. Might such a simple thing have pushed us in a better direction, leaving microservices to the 10% of apps that really need them? Or would we all have followed that pattern to illogical extremes as well?
You’ve Reached Your Monthly Tweet Limit
I don't think containers are necessary for every use case, but for the described one they definitely are.
That does not even make sense. How could it possibly be rude to not attend an event of strangers? I probably didn't catch that as I skimmed the article. I'm not that tempted to read it as there's no amount of smoke and mirrors that could convince me. That sounds to me like guilt tripping on a pretty mass scale. That's the author's issue. No need to feel guilty. And no going to events that suck your soul from your body and stomp on it will not help us resolve the our social crises, help achieve world peace, or even nurture your relationships. Just in case the author tried any of those out as proxies for you should go. Come on. Don't be an anti-social twit. You're letting all these strangers down and, well, you're letting America down.
What is Docker image?
"Your last two works have been more amusing and exciting to write than they will ever be to read." is a good zinger, and likely true in mnay cases
OpenBSD's tcpdump(1) is fork of tcpdump.org, a lot of early work went into adding security features to bpf to facilitate implementation of privilege dropping/separation in bpf programs.

In 2003, the first parts were added, bpf write filters and descriptor locking, this considerably limits the scope of access to bpf writers and byte packet parsers.

http://marc.info/?l=openbsd-cvs&m=106684834031056&w=2

By 2004, initial privilege separation support was already committed to tcpdump(1) by Can E. Acar and Otto Moerbeek.

http://marc.info/?l=openbsd-cvs&m=107531986114887&w=2

With the introduction of pledge in 2015; the privilege separation work had been further refined, with the packet parser limited to now just stdio operations, unable to read/write files or open network connections.

http://marc.info/?l=openbsd-cvs&m=144383352229927&w=2

http://marc.info/?l=openbsd-cvs&m=146908579408853&w=2

So, tcpdump is a fine network security analysis tool.. on OpenBSD today.
Wow, this is really beautiful. One thing I feel lets it down is that "text-align: justify" still isn't on par with print quality in browsers. It is getting better, but it's still a way behind pdflatex+microtype.

I'm sure there's work being done by talented people, but it's a hard problem, and maybe there's been compromise between speed and quality stuck?
This feels like support for something Bernard Ingham said, "Many journalists have fallen for the conspiracy theory of government. I do assure you that they would produce more accurate work if they adhered to the cock-up theory."

Then the paranoid part of me wonders if that's the plan. Then the skeptical part of me says, "Occam's Razor". Then I remember that I'm insignificant in relation to these issues and I have some tea.
You are expressing that you prefer talking on the phone. That is fine.
easier said than done when it's the keys for rolled out consumer premises equipment
> "I have met people that are labeled as introverted ... my son avoids parties because he gets sensory overloaded very quickly"

All through my childhood I was labeled as introverted. As an adult, having gone through a lot of self-reflection and self-evaluation, I realize that I have both strong introvert and strong extrovert tendencies -- with many of my strong introvert tendencies being sensory rather than social. I think I'm actually more of an extrovert socially, but I never got that label because of the sensory stuff.

For example: I do fairly well in group settings, as long as they're focused somehow. I like sporting events, but not clubs, because all the noise at the sporting event is focused on the action on the field/court/ice but the noise at the club is an unrelated tangled mess of conversations and music. Big lecture halls in college, churches big and small, and actual concerts are all fine. Things marketed as a "party" usually aren't. I like most people, and have friends from a lot of different segments of society. I just don't like being overwhelmed.

It seems silly to characterize me as "rude" or "selfish" because I would turn down certain types of invitations.
Hello im wondering if u could help me find things out
The US's bizarre bike culture never stops surprising me. I guess since it's so impractical, it gets treated as a lifestyle instead of a method of transportation. I bought the most expensive bike of my life last month (automatic hub-powered LED lights!) and despite having to customize the saddle pole and handlebars to fit me, it was $250 (with a 2 year insurance and maintenance plan). $800 for an entry-level road bike???
On the other hand it might just be your addiction talking.
Group chat is already there since iOS 5 in the very beginning.
I appreciate you taking the time to respond thoughtfully, even though we probably aren't going to meet in the middle.

Regarding scare quotes: your usage is exactly what is meant by the term. See https://en.wikipedia.org/wiki/Scare_quotes.

Casual time is meant to be taken literally, it's not some special jargon, just two words put together. I also clarified the meaning in my previous response.

I don't think anyone but the NYT article author is conflating poor social graces with introversion. My response to that was to unapologetically insist that it is not a matter of rudeness to find socialization burdensome, nor to decline that burden when it is not necessary.

> More generally, there's a worrying trend these days to apply labels to yourself or others to justify being a jerk. "It's ok because I'm/they're/it's an X"

I cannot relate to this worry, it's not something I experience. But in case it's not clear, that is in no way what I was saying. In this context, I would say:

- I am an introvert. That's a fact about me, can't change it, don't even want to most of the time.

- I don't think declining social events is being a jerk. Regardless of whether one is an introvert or not, or whether one is motivated to decline by said introversion.
The best example I have found is https://mycroft.ai
This makes me smile inside. Hacking at it's best.
How does the differentiation part of this work? Is it just gradient descent, or something more clever than that?

It seems like it ought to need to trace the data flows, but there doesn't seem to be the machinery to do so in the code.

Thanks! This is awesome to play with :).
Geez - Am I supposed to really believe all the hyperbole in here? It makes it sound like a move to Microservices is the main reason for a company's failure.

To me, Microservices are a pragmatic solution to build software in an age of complete chaos. Clearly it's not a silver bullet - but what ever has been?

As someone who has to manage a complicated application architecture with lots of pieces, very little time to think, a flat organization of full stack developers, and a bunch of executives who pivot every other week, it's the only scheme that works.

Would I like to go back to the old days when a team of 20 and six months would do what a team of 3 and two weeks does today? Hell yes. But, that's not reality - the world has moved on, and it's not slowing down anytime soon.

Startups these days are often about taking on as much risk as can be tolerated in a race toward dominant market share and exponentially positive revenue. And, Microservices help get us to that goal. It's often not pretty, no doubt. But, it's way easier to manage risk in that kind of environment. With proper monitoring, alerting, and automation - the risks go down a lot.

Some might say that I'm crazy to work in such an environment. Maybe they're right. Generally, this is all completely experimental. But, it's helped me scale to 25 developers and $25M revenue in 8 months. Is it sustainable? Who knows - but, I know that the alternatives certainly wouldn't have worked. In another 8 months, we will either be at $200M in revenue or will have died a horrible death - but we will have died because of the business model, not because of the software.
If introversion and being a social outcast is their own fault, the society in general and people in functional human relationship networks don't have to feel guilty about it and do anything about it.
I think for me, getting the quiet time I need is the biggest way I avoid being rude. As you say, it's like getting enough sleep. Over-drawing my sociability account now just means I'm risking being rude to somebody else later, so if I really want to respect people, I need to carefully control the amount of social time I spend and try to pick things that are less draining.

But for when I'm peopled out, I definitely have some tricks:

* Go to the bathroom and spend a couple of minutes in peace.

* Say "Hey, it's noisy/hot/chaotic in here; want to get some fresh air?"

* At work, I like doing walking meetings, which are less socially intense for me.

* Have socially acceptable reasons for leaving early. E.g., running regularly in the mornings means I can say, "Oh, gotta get up early to train for my race!"

* Minimizing other things that draw down my sociability, like noisy work environments.

* Get people talking to one another. E.g., "You mentioned X. Let me grab Jane, who's very interested in X too!"

I've also had some luck going to events with introvert buddies. If you both go get some quiet together, it doesn't look like you're being antisocial.
I worked at a distribution center for a large electronics retailer for 4+ years. It was my experience that a lot of those guys slinging boxes either didn't care, or just didn't have time to care. To the person who's been saving up for that $1200 4K TV, it's a big deal and having it come in damaged is incredibly frustrating and disappointing. To the guy loading his 3rd 58' trailer of his 10 hour shift in the middle of August - maybe not so much. You'd like to think your package is handled with the same care and pride that you would give it, but that's not the reality. Quotas, deadlines, bottom lines and the human condition just won't allow it.
Youtube Red and Google Play Music come in a package, which is actually an awesome value. Red does support the creators whose videos you watch.
Mass data is an all consuming fire. People want the fire. The fire is warm. It enables higher quality, more advanced tech. Every existing developer in the world could stop writing a single line of analytics or big data code, but the fire would still rage on. New developers would rise up. The allure is too great.

We can only hope to find a way of managing and containing the fire before it causes too much damage. Some days I'm more optimistic, other days I fear for the next 100 years. We are now a post-big-data society -- it's one of those paradigm shift technologies that can't be undone.
Where should you seat on a plane?
That's the best thing I've heard all day!
Guiding Principles for Service Providers&Telcos Delivering Cloud Services&IoT
NYC has affordable housing. Manhattan increasingly doesn't, but so what? We have plenty of transit options from the other boros to Manhattan.

NYC's biggest current problem isn't affordable housing, it is that transit capital projects are grotesquely expensive because of a combination of: diffusion of political responsibility, a broken bidding process, and very strong construction unions. What we have is great, but without the ability to undertake new projects, including rehabilitation, without spending much more time and money than any other city in the world, it will eventually be a big problem.
I was obsessed with this game when I was a teenager. The concepts for Cloud and Sephiroth being very deliberately drawn from Musashi and Kojiro was news to me: http://shmuplations.com/wp-content/uploads/2015/01/ff707.jpg
Why do you want people to have to work? A job automated is a person that doesn't need to work.
Be careful with ligatures in Web pages. They have downsides, which might not initially be apparent.

Ligatures are their own font characters. That is, an s-t font ligature is not recognized as an s and a t except visually. So, some things break:

1) search of text. "step" become a font-dependent codepoint followed by "tep"

2) accessibility for handicapped users. Readers generally cannot correctly translate ligatures.

3) browsers do not guarantee to handle your ligature correctly, especially older versions of browsers.

So, for the small increment in esthetics, you're creating a small pile of annoyances for readers and affecting the ability to find docs on your site via search engines.

For these reasons, you don't frequently find ligatures in Web pages.
Download all Google fonts: https://github.com/google/fonts
Just use seatguru.com when you pick your seats.
I got a 1080 working with VS 2015 (via the CUDA 8 beta). However, I strongly recommend using VS 2013. Frustratingly, CUDA VS 2015 support does not extend to the latest Visual Studio update level. So, to use CUDA I had to forgo the latest versions of useful extensions (e.g. Python Tools) and even forgo MS software updates (e.g. for SQL Studio, which apparently auto-installed the latest VS updates).