skysight-inc/HackerNews huggingface dataset:
I'm not too knowledgeable on the subject but I know there are a lot of groups working on persistent storage for Docker. I think most of the time this means a docker volume that lives on some network attached storage (this could be redundant across the compute cluster or on dedicated storage servers), which is then linked to a container via the network. If you remove that container or destroy the host, the volume persists and you can recreate the container on a new host and re-attach it to the associated volume (automatically).

As far as databases and horizontal scaling, this could probably be done currently within each Docker container at the database layer as you mentioned (CockroachDB also comes to mind). So let's say you add a new docker container with its own persistent+redundant storage volumes, and that container is running a cockroachDB node. You can add more containers as cockroachDB nodes, each with their own persistent+redundant storage, and you get all the DB sharding etc across nodes from cockroachDB while the redundancy+persistence are handled by Docker (plus storage solution) as far as restarting, migrating, reconnecting, etc. This probably has all sorts of problems I'm blind to but that's my rudimentary understanding.

Handling horizontal scaling, sharding etc at the storage layer directly through Docker sounds much much harder, and I don't even know what I've been talking about so far so I'll leave it at that

Here's a list of some people doing persistent Docker storage :

Flocker
Portworx https://portworx.com/
StorageOS https://storageos.com/
Rancher Longhorn https://github.com/rancher/longhorn
Quobyte https://www.quobyte.com/containers
Nexenta https://nexenta.com/solutions/containers
Infinit https://infinit.sh/docker
EMC REX-ray https://github.com/codedellemc/rexray
Ceph
Gluster
Mesos https://mesosphere.github.io/marathon/docs/external-volumes.html
Kubernetes https://kubernetes.io/docs/concepts/storage/persistent-volumes/
vSAN
Nutanix http://next.nutanix.com/t5/Nutanix-Connect-Blog/Containers-Enter-the-Acropolis-Data-Fabric/ba-p/11122
Netapp (Docker volume plugins for SolidFire+ONTAP+E-series)
AWS EBS/EFS
So if a teenager who is getting into programming has an aunt who is selling quilts on the side, he can't help her set up a custom website?

Or he can, as long as he only writes static HTML and not a line of javascript, or he can do that as long as she doesn't pay him even a nickel or a free quilt?
N.S.A. Halts Collection of Americans’ Emails About Foreign Targets
I used the term machine learning in my first sentence, but I was actually referring to data + computing power as I did in my second paragraph. Even if they just use OpenCV, that still falls into the realm of using computers to solve problems that are only recently being solved due to the computing power being recently available.

>The biggest problem is medicine and similar fields, is it's terribly conservative. It's very difficult to get new technology to market. Whereas tindr doesn't have any regulations or bureaucracy to deal with. They can just push new technology to millions of users overnight.

Looks like that's the best possible reason.
There exist research SLAM systems that use lines, planes[1] and other geometric objects as features, and thus provide non-point geometric reconstructions. Hell, there's even a demo using entire pieces of office furniture as the localization features [2].

[1] https://www.youtube.com/watch?v=KOG7yTz1iTA

[2] https://www.youtube.com/watch?v=tmrAh1CqCRo
Well, it's really tempting and financially desirable to try and get on Amazon anyway. There are lots of consumers on Amazon with both an appetite for that kind of an artisan item and the purchasing power to go for it despite the higher lead time. So the demand side is usually a given.

Don't forget that, from the manufacturer's perspective, Amazon is not only the logistical facilitator, but also a sales channel where huge numbers of potential customers are introduced to companies they wouldn't naturally be exposed to.
If you don't ask you don't get.
If you are using Webpack to build your application, you can take advantage of a fantastic loader called "responsive-loader" [0] which can automatically build smaller and smaller versions of an image which can be dumped into a srcSet automatically to give you a good amount of the benefits of responsive images without a ton of work customizing each <img> tag in your application.

Combine that with my plugin "imagemin-webpack-plugin" [1] which will ensure they are all compressed as well as you want, and you can get a fairly drop-in solution to massively reduce the size of images downloaded while keeping extremely high resolutions for user agents that want it, and without a ton of manual work on your part!

I've always wanted to look into taking this a step further and somehow determine the actual size of the image on the screen in various resolutions and then generate more accurate image sizes and fill in the `sizes` attribute. I've thought that you might be able to pull it off with some automated headless browsing of the built app with some work, but I never got around to trying it.

[0] https://github.com/herrstucki/responsive-loader

[1] https://github.com/Klathmon/imagemin-webpack-plugin
Is that even "machine" learning anymore?
OfflineIMAP: sync and backup tool for IMAP
Sorry, what are you talking about?
Elegant Coding: The Problem with Today’s Software Thought Leaders
It's a good essay, but FWIW, a few months ago in one of his link dumps (which unfortunately I can't find atm) Scott approvingly reblogged an essay arguing that atheists should go back to being like outspoken and ardently anti-theist, like in the heyday of the late-2000's/early-2010's. I didn't agree with it myself, but it did raise some good points, and I wouldn't characterize Scott as being opposed to identity politics of all sorts.
Why Jordan Peterson still believes in God:

https://www.youtube.com/watch?v=28i3lWxW5xs
Firefox gets a performance settings section
Yes. All very different from "car, house, boat".
An aircraft carrier needs resupply with avgas every three days when operating up-tempo. Warships use up resources like crazy, they're not going off on five year missions like Star Trek.
at a major legal industry firm, i had an ML project torpedoed even though it showed reasonable promise. i was fairly young at the time but now thinking back, this may have been part of it.

i was an hourly consultant and they did pay me handsomely to do that little experiment though. can't complain. the world is a complicated place.
> Right, which is a flat, or proportional, tax.

It's not a flat tax on income, since marginal spending declines with income.

Every tax can be construed as flat relative to some measure.
I used a Ninja Block (precursor to the sphere).
https://ninjablocks.com/

It's not a full proper security system but could be made into one. I had it alert me when a certain room was entered or had a high temperature or humidity.

I say used (past tense) because some support is now discontinued but I think it is a worthwhile idea.

I haven't tried the sphere and not sure of the status.
Is Ariba cXML an open standard? In my experience working with SAP stuff is incredibly complicated coming from a more traditional development background.
The Wiggles Finger Family
The secret power of “I don’t know”
Most companies don't want their IP floating around on computers that they don't control
I thought the same, and reckon many of us did. Great comment!
Crystal by Numbers: Kemal vs. Sinatra / Rails
Studying to interview with a big company definitely improved my skill and knowledge of Computer Science. Not fun, certainly, but to some degree useful outside of the interview.
Some proprietary code replacing qemu (but still using KVM). Since they still have to emulate PC devices, this just means they have a different set of security holes and fewer people reviewing the code.
It essentially gets moved around banks, at each stage the account owner is taking a cut but ultimately it requires a friendly bank to hold the majority of the funds and not give it back when requested, usually because you have set up some kind of plausible route for the funds to be in your possession.

https://en.m.wikipedia.org/wiki/Bangladesh_Bank_heist

$81m was sent to a bank in the Philippines and less than 25% was recovered. Other banks had success is recovering all the funds sent through them as part of the same heist.
Unfortunately on Ubuntu, seccomp is opt-in only. Works well when enabled though.
Olive oil that costs a fortune
For a partially DIY option with a certified, well-tested security/fire alarm option a DSC 1832 with the IT-100 serial interface board is an excellent piece of kit. Bought one off a local security company and did all the install myself, and they verified it for me.

With the base board you can run a couple of relays to trigger whatever you'd like. I use it to turn on the lights when the alarm is tripped which helps the camera system I have actually get a picture and not just a dark room. It is also nice when coming home in the dark, and for automating light schedules when out of town.

The IT-100 gives a simple serial interface to monitor/control the entire system from a computer. I used cereal on debian to follow/interact with the serial stream, and a bunch of perl/bash scripts to do things like log events to a mysql database, turn on/off the zoneminder DVR system, manipulate relays, send emails, and pretty much do whatever I wanted.

As far as B&E deterrent, I think having the monitoring company stickers is 90% of the benefit since most criminals are looking for a quick low-risk fix and will just hit your neighbour without a security system. That said, making it hard for them to hang around and really clean you out makes me feel a lot safer, since most valuable are hidden away somewhat.

I also like the cameras so I can check in while out of town. I have heard that video footage has to be REALLY cut and dried as far as identity for the police to use it, so low-res or low-light images are probably useless for prosecution.

You may find that the monitoring costs are paid for by a house-insurance discount that you get for having active fire alarm monitoring

Still, probably not as good as a vicious-sounding dog.
I see a lot of "me too" responses to this, and for the life of me, I can't figure out what systemd brings to the table. I understand the Ansible part, but what does systemd do that's notable? My understanding is that it's an alternative to init, and I can't imagine calling out init as part of my deployment/config strategy. What am I missing?
> That's a rather sweeping statement, that many in the industry do not agree with.

And some who do

https://dataorientedprogramming.wordpress.com/tag/mike-acton...

I'm not going to appeal to authority here. I'm speaking from experience. We all know how source code gets over time with hundreds of programmers working on it. A clear, consistent specification of your data model, rules, invariants, and transformations is far more valuable than the abstract-soup of trying to model your business domain in source code. I think we can all agree that the less code there is to understand then the easier it is to verify it is correct.

Verifying the requirement that "when record A is written to the database then B is appended with the delta change if such and such is True" is guaranteed at the database level along with all of the other constraints on those relations. If it's nested in one of these rings behind an abstract factory somewhere it's harder to verify.

> Am I to put that all in the DB?

That's where I would start. But I'm not you and I don't understand the problem you're trying to solve.

My original point was that abstracting out the platform if you're not really concerned about switching platforms is a form of premature pessimization and a source of errors. If you control the platform, target the platform and don't bother with the abstractions.
In your baseball example I think you could pick 100 people and then say the top 10 on some criteria are on that list. I don't think we can say the top 10 are on this list of the top 100 for programming or most other professional fields.

However, in my mind that does not mean the top 10 are not out their just that we can't rank the field that way. Which does not mean their is not actually 10 best programmers for any given task. Nor does not mean we should pick some proxy and say these people are the top paid and therefore the top 10 are on this list of 100 top paid programmers or something like that. Because, while ranking people like that might be amusing or fun it's simply not accurate which is my core problem with your line of thinking. It basically says I can't get what I want, so I am going to pretend that what I want is what I can get.
I think there is too much cruft in Qemu and a simple install can pull in hundreds of dependencies. For instance if you just want to run x86_64 VMs there is no point getting 20 different platforms.

For the standard run of the mill VM there is also rarely any need for the multitude of devices. The more stuff you put in the more surface area for exploits. The Qemu install candidate needs to be seriously redesigned and pruned down by package maintainers.

Intel Clear Linux tried running VMs without qemu altogether with Kvmtool but are now using 'Qemu lite'. But there are no packages, instructions or even a readme on what exactly they have done to make 'Qemu lite'. Kvmtool is one of those packages with zero documentation.

Libvirt is needlessly convoluted and its usage complexity has led to an inferior solution like Virtualbox gaining traction on Linux, inspite of kvm in the kernel. For those looking for a simpler way to use kvm I suggest trying something like Aqemu or even just resorting to the command line. I found it far more lightweight and reasonable than libvirt's heavy handed way of running a simple qemu-kvm command line and adding an XML mess to it.
Never hurts to ask!
How long have you been working for?

It just sounds kinda sad to say that you've never been proud of work you've done. I think if I was never proud of the work I'd done I wouldn't still be doing this job: a feeling of reward is important!
> For technical reasons, the agency ended up collecting messages sent and received domestically as a byproduct of such surveillance, the officials said.

Yeah, sure. Maybe don't do mass surveillance then?

> The agency then proposed putting the bundled messages in a special repository to which analysts, searching through intercepts to write intelligence reports, would generally not have access. The court permitted that type of collection to continue with that restriction.

But last year, officials said, the N.S.A. discovered that analysts were querying the bundled messages in a way that did not comply with those rules.

This seems to happen Every.Single.Time. I wonder what really prompted the NSA to stop this collection. Maybe they just want to act all "We're good boys now" to convince Congress that they can be trusted with FISA Amendments' renewal, later this year?
Datomic Information Model
The only scam I've ever been asked about was at an SEO conference. I was talking about how awesome selenium and browser automation was. Someone asked if I could make selenium log into gmail and click "not spam".
Ask HN: Multicore concurrency simulator
I have been teaching myself multicore programming and thus concurrent data structures in C/C++ and one problem I am facing is how best to (re)create contention situations between 2 or more cores, especially when trying to recreate read-write situations. Are there libraries/platforms/frameworks/sdks readily available that can ease or even solve this? For example, if I am trying to write a lock-free list data structure but I need to reliably create conditions under which a normal linked list data structure would be problematic to illustrate why a lock-free linked list is needed in the first place.
If this thing ever needs a G-rated name, might I propose "Chaucerizer".
I'd argue this is one of the more secure questions compared to other common questions like "Your mother's maiden name" or "The make of your first car".
Just out of curiosity, why are you singling out Poloniex? AFAIK there are exchanges with way more alt coins.
My god, programmer typography! It's like the author only just discovered font weigths. The only possible defence for using bold allcaps five times in a paragraph is if it is a name that is being typeset that way. here there is no such defence and the author deploys a further five instances of bold italics in the very first paragraph, the one small mercy being not deploying any bold all caps underline or making itrain typefaces.

I honesty felttired just looking at that text.
again, down to the reporting.

will a human being pumped with testosterone and upper body strength be violent? a human being with a Y chromosome? thats currently what culture suspects given the reported information available in crime statistics.

I'm telling you that such reductionism isn't an absolute, as there is enough evidence from marginalized people and power dynamics to warrant altering the cultural assumptions. The culture alone (and the stories written in these cultures) is what perpetuates a lack of further insight into this.
>	Wondering where do you see yourself in 5 years?

No longer in tech (34 now). Sailing around the world with my family. Semi-retired.

> What are your IT predictions for next 5 years?

Message bots will turn out to be overrated. "AI"/machine learning won't implode, but it'll continue on in the sort of discipline as data scientists. New tools built, replacing old tools, bought out or closed down, the cycle continues. Be wary of the hype train. Life is too short to burn yourself up on things that don't matter.

Facebook, Google, Amazon, Apple still around, but not taking over the world. Walmart might give Amazon a run for its money if they learn to ship to customers instead of having them come to stores (postal service JV?). There's still a lot of low hanging fruit for tech companies to scoop up, but the work won't be exciting (it'll be profitable though).

Learn history, so you don't repeat it. Tech is cyclic in nature, like most things in life. The key is to make hay when the sun is shining, and save for a rainy day. Or that day you decide, "I'm out".
I think it could be a significant issue.

1) Quite simply, software is much easier to learn than medicine, so you have a larger supply of capable software engineers than doctors. If the market for their services is being artificially suppressed, they will gravitate to wherever their services can make money.

2) There is a black market for medical services. Ever heard of a back-alley abortion?
There seem to be some clear flaws with the causal reasoning there.

For example, Cyprus is rocking that chart, but isn't a country with a particularly strong welfare system -- the reason it's on top is because it's a popular destination jurisdiction, not because it's a cradle of entrepreneurial spirit. Malta's in a similar boat.

Also, strength of social welfare system is not predictive; for example, Sweden is below the average of EU, OECD and NATO countries.

Finally, Singapore scores quite well, and while it probably has somewhat of a destination jurisdiction effect, it is hardly a welfare state.
He can't represent her in court or officially do her taxes, why should he be allowed to officially render other professional services to her?
How exactly does whether or not you are surprised make a difference in anything?
Nah, that's too soft. What you should do is assert IP rights over his side project and then sue him for infringing your rights.
Yeah, most employees read reddit or HN in between doing work tasks in order to reset their minds a bit.

If the employee is doing external coding instead of surfing reddit on their 'mental floss' time, then that's probably a good thing and its making them a better programmer.

There's issues of course if they're making competing products, or using company proprietary IP, or making money on the side.

But this may come down to the fact that the biggest issue is that you've got an open office plan, where all your employees are snooping on each other. And if this employee was doing this side-coding behind closed doors (or at home) that nobody would care as long as they were hitting their targets.

And with that I'm off to grab some coffee and get back to work...
"Second, police are too swamped to have ever reacted in time to catch the thief. To my knowledge, it has never, ever happened."

Anecdotally, I've seen Mountain View PD show up with 3 vehicles on a commercial false alarm in less than 3 minutes, and Sunnyvale PD show up in 1 minute to catch a shoplifter around Sprouts.

I think it depends a lot on where you live.
It would be really interesting to do a study of Googlers and see how much time on average they spent preparing for the interview. Would also be interesting to compare that with average preparation of people who interviewed but didn't get the job.

And finally, it would be fascinating to plot career performance at Google vs time spent interviewing. Intuitively I would expect those who got an offer without studying to do better (higher latent intelligence), but I could also see it going the other way (lots of studying correlates with willingness to work hard on boring problems, which is what most Google engineers actually have to do day-to-day).
Backslash does not have problems. It's a single character and looks like windows paths. :: is two characters and is only familiar for C++ programmers (and means something else in PHP)
Sounds like you do some embedded graphics work.

On multiple occasions, I've kicked off BitBake to run overnight. I come in to find it failing from running out of disk space. And I'm usually perplexed - does this really need over 200 GB of space!?!
>Amazon is not really an appropriate distribution platform for 6-week custom-made-to-order products. Maybe there's another well-known retail site that caters to that type of vendor but it certainly isn't Amazon (or Walmart).

But there is Amazon Handmade (which is supposed to be the Amazon Etsy):

https://services.amazon.com/handmade/handmade.html

...and Amazon Custom:

https://services.amazon.com/custom.html

..and Amazon Fine Art:

https://www.amazon.com/b/?node=6685269011

...so it looks like Amazon has their hands in other areas besides distribution of mass manufactured parts.
exactly.. The point of a startup is to utilize technologies so that they can run more efficiently than big corporations, thus giving them a competitive advantage and an economical one as well.
I agree, some years ago I prepared for a month for a Google SWE interview and still failed. I haven't prepared for interviews since, nor asked to write code. Last time I interviewed at Google for a SRE-TPM position I was asked Python trivia during the phone screen, which left quite a bad taste in my mouth.

[Shameless plug, feel free to skip] However, if you do want to prepare for a Google-style interview, I maintain a list of resources here: https://github.com/andreis/interview
My advice: start small, write something simple. Really study the language you choose and how to work with it properly. Once you understand it, you can exploit it. Then, keep studying and work on larger projects.

Also, work on something that interests you. Don't get into programming just because it seems cool. It really is, but love what you do. Life is to short not to.
If you think down this path, that craftmanship needs a very fast route to market, and it's going to be a very big industry - with the capitalistic logic, you end up with solutions like drone transport, automated machines that create custom things fast, and robots/ai to test products.

And you probably also end up with manufacturing clusters doing most of the work - and not in small towns spread around, but maybe still in the US, maybe. But designers could stay local and not necessarily near factories.

But not sure that does fit your ideal.