skysight-inc/HackerNews huggingface dataset:
If I'm understanding correctly that sounds similar to Pachyderm (http://www.pachyderm.io)
GHTRHJN BGVHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHH
HHHHHHHHH /)HHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHH
HHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHH
HHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHVJNVJNVJNVJNVJN
VJNVJNVJNVJNVJNVJNVJNVJNVJNVJNVJNVJNVJNVJNVJNVJNVJNVJNVJNVJNVJN
VJNVJNVJNVJNVJNVJNVJNVJNVJNVJNVJNVJNVJNVJNVJNVJNVJNVJNVJNVJNVJN
VJN VFVVFFGJJJJJJJJJJJJJJJJJJJJJJJJJJJVGJJVJGVNGTFGGTRFT VCVFGBVFHGZTFOC/FICCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCMM
MMMMMMMMMMMMMHJHJHJHJHJHJHJHJHJHJHJHJHJHJHJHJHJHJHJHJHJHJHJHJHJ MMMMMMMMMMMMMMMMMMMKLKLKLKLKLKLKLKLKLKLKLKLKLKLKLKLKLKLKLKLKLKL
KLKLKLKLKLKLKLKLKLKLKLKLKLKLKLKLKLKLKLKLKLKLKLKLKLKLKLKLKLKLKLK
LKLKLKLKLKLKLKLKLKLKLKLKLKLKLKLKLKLKLKLKLKLKLKLKLKLKLKLKLKLKLKL
KLKLKLKLKLKLKLKLKLKLKLKLKLKLKLKLKLKLKLKLKLKLKLKLKLKLKLKLKKKKKKK
KKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKHJLKLKLKL O O GMZHNNZVFRGJ:VC XJEXWN)))I))))))))))))))))))))))))))))))))))))))))))))))/KKKKKK
KKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKK))IHHHHHH
I disagree.

I think this article nails some of the basic issues people have with docker. That is, your app is usually not entirely self-contained. One generally needs to have a db, a cache db, some networking, something else, and dash of CI.

To run a containerized app ecosystem, you either type a load of crap in the `docker run` statement or you annotate the heck out of the compose file/dockerfile. Either way, you pray it works... I know that I have to wade into logs and docker exec bin/sh because of some kind of silly-ness a lot more than I would like.

The article is correctly, imo, pointing out there should be a better way to wire up basic containerized ecosystems.
Ask HN: Tools to evaluate scientific claims?
What statistical knowledge and training do I need to evaluate the legitimacy of scientific papers, esp. in the medical field?

Whenever I read about any scientific claims, I ignore the press and go straight to the original paper cited (if there is one, often it is misquoted). I then read the abstract and the testing methodology. If I can spot any issues in the methodology I usually stop reading, e.g. small sample size, obvious confounding variable, blatant causation/correlation errors. But if all seems well, that still doesn't tell you if the study's claims match the test results or if the threshold parameters make sense.

Given a basic stats background, how can I obtain a deeper, intuitive understanding of things like p-values (which seem to be outdated anyway) and other sample sizes. Thanks, HN.
It should be noted that the content at the submitted link is at least a year old, however what's new is DuoSkin participating in the International Symposium on Wearable Computers (ISWC), which is occurring a month from now (Sept 12-16).

ISWC 2016:

http://www.iswc.net/iswc16/

Also, here is a short technical design document (warning: PDF) prepared for the ISWC:

http://duoskin.media.mit.edu/duoskin_iswc16.pdf

And the corresponding press kit:

http://duoskin.media.mit.edu/DUOSKIN_PRESS_RELEASE_IMAGES.zi...
What did I just read? That was ... a motley rant.
I'm probably being persnickety, but I think the title here on HN is mildly misleading, as he is actually named and the actual title of the Bloomberg article calls him "Basically Anonymous" ... not actually anonymous
> everything else is stashed in one or more hstore columns.

This has the same problem as most NoSQL solutions: You don't get the benefit of a schema, and schemas are damn useful things.
This is effectively a "penny auction," which, as you point out, benefits nobody but the auctioneers.
Should You Implement AMP Pages on Your Site?
Have a look at RethinkDB, it's the best of MongoDB and MySQL with real time feeds. A relational document store.
Here comes a system that threatens to give some more power to lower income families, and the suggestion is that those systems should be abolished because it gives some parents/families more power than others. That is utterly insane. To disallow these other systems from existing is to perpetuate the idea that poor -- and usually black families -- need the state to decide what is best for them and their children. THAT is the really racist point of view.

There is this alarming trend in our politics which seems to have decided that the poorer and blacker you are, the less you ought to be trusted with your and your own family's livelihood. It's amazing for me to see all of the teachers that I know (I work in the ed. industry) speak often about trying to get into better placements in other schools and whatnot, but at the same time, when it comes to choice and mobility for lower income families, somehow then the "obvious" decision is to force them to be in the system that has systematically underserved them for decades.

If the arguments about needing to put money into public schools is real, and that the exit of certain students to charter schools serves to further undermine the quality of public education, then let's really go all out: Let's forbid charter schools from developing and let's strictly enforce the publicly-funded neighborhood school. But then, let's do the same with administrators, teachers, and staff: Let's have them all be assigned to a school, without any possibility of re-assignment.

See how well teachers/unions/NAACP like that policy...
Did you signup to HN just to make a snarky comment on my comma placement?

Not sure if I'm flattered or disturbed by this
This is a brilliant analogy. That's just what they look like to me!
Incidentally, given the directory structure above, here's a good way to calculate sha256 checksums over the files. It shells out rather than use the IRONCLAD package to calculate the checksums.

(let ((src #P"/tmp/foo/bar/")
(dst #P"/tmp/foo/baz/"))
(flet ((sha256sum (path)
"Return the SHA256 checksum of PATH as a string (which is
good enough for our purposes here)."
(first (split-sequence:split-sequence
#\Space
(uiop:run-program `("sha256sum" ,(namestring path))
:output :string)))))
(loop for src-path in (directory (uiop:merge-pathnames* "**/*.*" src))
for dst-path = (uiop:merge-pathnames* (uiop:subpathp src-path src) dst)
for file = (uiop:truename* dst-path)
if file
when (uiop:file-pathname-p file)
do (unless (string= (sha256sum src-path) (sha256sum dst-path))
(warn "~a does not match ~a" dst-path src-path))
end
else
do (warn "~a not found" dst-path))))
This article has little to do with the specific failings of MongoDB at all. The author takes offense with document databases and denormalization. I disagree with the blanket statement.

Denormalization. It's not always the answer, but sometimes making reads easy and writes more difficult isn't bad for the problem set. The funny thing is a social network at scale isbt going to be able to use a traditional SQL database without sharding it and killing joins. It will be a documebt DB with limited SQL features.

As for Mongo, it is sold as the answer to everything just like any other product. It actually fits some problems sets. I actually had great success with it,
at scale, in an Amazon division. It ain't the answer for a lot of problem sets though.

I give this blog post two of five for bringing up a mildly interesting topic HN already beat to the ground with misguided conclusions.
I like document oriented databases. It seems odd I should need to change the data structure of an item in order to persist it.

After about 5 years of the many/varied cases of Mongo losing data, I switched to rethinkdb for my current project. It's an uninteresting, surprise-less database and I like it very much.
No matter the load. A blog is only reads. Any db system should be able to hold up.

It's a different kettle of fish when there's writes; but for reads, it should be a walk through the park.
Well I don't use a Pixel but I upgraded my SSD on HP Chromebook 14 to use as my personal development laptop some years ago - still using it.

Driver support wise it takes a year plus for all the hardware to get supported in the mainline Linux kernel is what I have found. What works is to dump the distro kernel and use the latest stable mainline.
Who are these 'millenials'? Apparently these 'millennial' exist somewhere, and according to the definition I am also apparently one of them, and yet I nor the shit ton of young people around me distrust banks. We use banking everyday.
> There are (soft) solutions to this: always use GPLvX-or-later to future-proof your licensing choices, encourage others to do the same.

How is this a “solution” to disadvantaging free software developers? LibreDWG was licensed GPLv3-or-later and it didn’t help FreeCAD one bit. If Linux had been licensed GPLv2-or-later it would not have improved the ZFS situation at all. There are many existing codebases under many free licenses out there; new software under any GPL version often cannot be incorporated in those projects, but new permissively licensed software can.

> Users are not encumbered by any of the GPL requirements. … Developers are the only people who have to worry about this…

“Users,” as you call them, are certainly indirectly encumbered. When LibreDWG provides DWG file parsing, but is licensed in such a way that FreeCAD cannot use it, users cannot use it.

And I strongly dispute the distinction that you make. The Free Software Definition doesn’t divide people into groups of “users” and “developers, who are not users.” Someone who links software against a library is just as much a user of that library as someone who runs the code indirectly through LibreOffice. When complicated licenses proliferate and decrease compatibility, it prevents free software from being incorporated with free software. That certainly violates the spirit of freedoms 2 and 3.
> migration to Europe from an active war zone

What slowly turns Europe into active war zone itself...

It's not about 'political agenda I disagree', it's about actions and their results.
It means that Russians are threatening retaliation for the public discussions the US is having for their responses to the DNC and other leaks.

https://twitter.com/DAlperovitch/status/765192800367284224
The morale of the story is apparently don't get involved in ANY activists groups no matter what side of the aisle you are on.

This makes it really seem like any association with any activist group, whether you're anti-(insert subject here) or pro-(insert subject here) is going to get you into trouble regardless.

It really makes trying to get good people involved in activism (in any form) a real challenge if this is going to become the norm - more people will simply stay home and keep their heads in the sand, which is even more disturbing and problematic.

There was a time when the press was the ultimate check on government authority and overreach. These days, its clear most news outlets are in bed with said government and its really down to the citizens to keep government power in check, which makes these incidents all the more troubling.
Fire-and-forget is awesome for when you do not care at all about your data. I'm sure those types of writes are super (duper) fast. What exactly is the use case for that? Serious question.
I think you use it as a cache, but not what I would define as a database.
Donald Trump’s Poll Numbers Move Markets–in Mexico
MMOWAM: Massively Multiplayer Online Whack-A-Mole
I'd probably change Anonymous to 'Little-known'. Anonymous would suggest that nobody has any idea who is managing the money...
An Elementary Proof of Wallis’ Product Formula for Pi (2005)
I can probably load and ready an empty rifle that's in my hands faster than I can move a slung, loaded rifle from my back into my hands. That's using a proper sling and not the improvised sling shown in the picture. It's also significantly safer to have the rifle in his hands than loaded on his back. It wouldn't be that hard for the trigger to catch on something and fire a round while the rifle is still slung. Carrying an unloaded weapon, with proper trigger and muzzle discipline, is perfectly safe.
Italian lawmaker wants to make it a crime for parents to feed their kids vegan
> I have to say that I did not experience a single data loss that was a result of the database misbehaving.

How do you know? Was your data checksummed? Did you read back changes after writes to verify what was written?
That's a shame. I don't recall how I found this site, but have enjoyed visiting it. Beautiful design!
Reading through, it seems that JS is allowed, but the page needs to be functional without it. Ideally, the page would work with Lynx.
Upvoted from my sensibly balanced Craftsman home while eating crusty artisanal bread and drinking pour-over Blue Bottle coffee before I head to work in my 2012 Volvo XC90 while listening to NPR.
Jacob Appelbaum: What Has This Man Done?
Not this FUD again!
It is true that MongoDB created a lot of unexpected problems for the early adopters who did not do enough due diligence and testing. I encountered them during my POC with Mongodb but I was able to get past them easily thanks to a robust user community. I have experiences no such issues with current version with Mongodb.

Today I am fighting my enterprise bureaucracy to get MOngoDB for our enterprise applications .FUD like this allows armchair architects to quote this article to spook the management and we are stuck with stuffing json as in a RDBMS tables.
One could argue that Neo4j is much closer to a relational database than a NoSQL object store, since a relational database is effectively a graph. You could model graph data like Neo4J in a relational database by simply keeping a table of nodes, edges, and a join table for both.

The advantage of Neo4J is that its query language is explicitly optimized for the graph use case, whereas querying a relational database as a graph engine would necessitate fairly complex SQL.
Ha. I was targeted by this auction specifically. The odd thing is whoever is behind this went through the trouble of posting it to the SecureDrop instance behind BerlinLeaks.

https://heartsucker.com/blog/children-at-play
See this, from yesterday: https://news.ycombinator.com/item?id=12285545
>Keybase has a pretty good command line tool

Another example of the walled garden. You need their tool, whereas you can just use gpg with every other keyserver.
None of those places are affordable anymore, with the possible exception of parts of East Palo Alto (and even that pool is drying up fast).

The problem with your logic is that just about every city on the peninsula has decided it can be the "exclusive/upscale" neighborhood in the region. And the ones that aren't on board with that can't possibly make enough of a dent in the regional jobs/housing imbalance on their own to matter. Thus people commuting to Palo Alto from Gilroy and Tracey.
Can you give me a few examples of what it's good for? I haven't used it in production, but have researched it a fair amount, and can't find many situations where it would be suitable. Maybe analytics where it's somewhat arbitrary/changing JSON blobs and you don't care about losing individual messages?
> Many engine builders won't touch this

That depends on how popular rebuilds are. If this design proves out many engines will go to this and then a rebuilder who refuses to touch this design won't be in the business anymore.

If this design takes 1/10th of a second off lap times rebuilders will quickly not work on anything else, even if for every other application this engine is junk. (in most other applications the engine will outlast the car without a rebuild)
That's a shame it takes them weeks to read three quite comprehensible man
pages to think up two different ways of changing commit history.

How did we actually get to the point where it takes weeks of training to use
git, when I remember learning how to use it in a day or two, ten years ago
(when it was much less usable and documented), and for a (far from trivial)
use case of being a helper tool for off-line work with Subversion?
It's the new Red Scare.
Except you make those ideas sound easy to execute. How am I supposed to get a CEO's attention and trust to invest in my startup with just email?
> It sounds like you need to buy a Roomba for your hardwood floors.

Considered it, but when I asked around with other parents, reviews were universally poor. Plus so much of the stuff that ends up on the floor in the dining area is (I'm guessing) too large for a Roomba to handle without burning out the motor inside a year (think a couple handfuls worth of whole peas) so we'd end up sweeping about as much anyway.
Equality: The Evolution of an Accidental Meme
You're in tech, so an experience you have that is over 5 years is largely useless. What you need to leverage is your wisdom gained from the 15 years of experience. Wisdom is what separates you from someone with "only" 5 years of experience, but who can code almost as good as you and work for less. So no, there is no respect for experience beyond a number of years.

I've been in tech for over 25 years and I am more engaged than ever in what I am doing. I've been a programmer (front and back end), sysadmin, dba, network engineer, project manager, and product manager. Looking back, through all of that learning, I was becoming a better leader. About 3 years ago I stopped coding and became a full time leader in tech. I now optimize people and teams, not code and systems.

I'm still very much involved in architecting systems, which is where wisdom comes in. If I can't guide them in how to build something, chances are I can provide equal value in telling them how NOT to build something.

I would advise pursuing a role where you can impart your wisdom and leverage your many years of experience to help others and make an impact that way.
"A Kosher (or halal) eater will never eat nonkosher (or nonhalal) food , but a nonkosher eater isn’t banned from eating kosher."

Well no, but I would never, if given the choice, buy kosher or halal food. I would also not buy pope-approved or hare krishna-blessed food either. I'm perfectly happy with stores carrying those items for people who want them, as long as they are clearly labeled so that I know what I buy.
meh - made sense to me - "not distinctive" is a very common secondary meaning equivalent to "faceless". I think I'd need a stronger term like secret, covert, unknown etc. to suggest something different.
I live on a 50 acre farm and work (mostly) remotely.

Most of the farm is hay fields and woodlot, but on 5 of the acres we raise pigs, sheep, and chickens, have a 1,000 ft^2 greenhouse, a vineyard, a berry patch, and two 3,000 ft^2 crop gardens.

If you're going to say "hey, I've got a solution to the hard work of mowing a lawn", we need to have a long conversation.

...perhaps while we remove rocks from one of the fields and use them to build a wall? Beverages are on me.
Yeah, the post would have never even have been saved to disk in the first place :P
I was speaking of the feel of the action. The brown still has the physical bump caused by the outward swing on the guide arm much like the blue.

There isn't the extra chunk of free riding plastic that helps generate a lower sound tho. I was purely wrong the rubber wrapping, that was just me being ill-informed.
How Wikipedia manages mental illness and suicide threats among its volunteers
This is how container cloud should look like, i.e. a giant docker in the cloud.

In fact docker itself has a very nice api/cli, but obviously dockercloud does not, that's a pity.
It's not just for hardware and software companies. Service companies can be pre or post launch too.
In the long term, yes, but the labor market is quite inelastic in the short term, and without a strong and robust safety net, short term effects dominate for most workers.
This article was posted almost three years ago and went through the same love/hate cycle on Hacker News then. Why the repeat? I am sure a number of technical points could be outdated by now.
MySQL can't scale horizontally if you're using it like it's a relational database.

No joins between shards means Sarah Mei could throw away her data model if she needs sharding.

She would then need to denormalize her data to avoid joins, which is the main argument in the article.

The project they were working on was a social network, a free alternative to Facebook. So I guess it's safe to say a single box, even the biggest you can imagine, could not ensure scalability. Beyond certain limits, sharding is the only option.

Facebook has implemented exactly the denormalization despised in the article, and they're using MySQL, albeit just as a dumb key/value store ;-)
Did you get beat by others to the finish line?
To be fair, I think your comment shows why this sort of post _can_ still be useful. You're very unlikely to lose data on a modern Mongo system using default configuration (their troubles with durability have largely been solved), but there are many other good reasons not to use it, and it's enlightening to read about and understand what they are.
Apart from paranoid in one side, you seem paranoid in the other. This case is almost a complete set of emails so it's unlikely it's a hack. Most probably a whistleblower, potentially Seth Rich.

Now the question, does it matter ? If the emails are legit it is the only thing that counts.
WW3 FTAO MRS MAY UK PM and ANTI US BACKLASH
Hevia – Swift Parser Written in JavaScript
Here's one: I have an aggregation engine where 99.99something% of the data is cycled out within 3 days, and where the system can be functional again within about ~5 minutes of ingesting new data after a total data loss.

There are a lot of applications where your database is not the or even a source of truth, but effectively a big cache that you can either fully rebuild or where rebuilding isn't necessary (the data is too "fast moving" for there to be much point).

Here is another: A search engine for classifieds where the source of truth of 99%+ of listings were external feeds that'd get re-crawled at least once a day. If we lost a few million updates, who cared? If it was few enough, we'd just let the normal updates take care of it. If we had a major problem, or needed to do a major update that'd have compatibility implications, we could just do a re-crawl of all the feeds.

Here's another one:

You're scaling reads by replication, and so the vast majority of your data exists in multiple data stores. You may choose one you consider reliable for the source of truth, and the rest are basically caches, but you may want/need something more capable than a straight up key/value store for various reasons.

I believe the vast majority of data stores I've worked with have been ok to suffer a total loss of because most of them are not the source of truth, and the source of truth can be re-queries fast enough for it to not be a big deal to deal with losses in secondary copies.
Keybase makes it really easy to sign commits. By using keybase you get to manage keys and sign quickly. gpg will take hours of reading with its non-intuative cli. You're making less work for yourself.

Gpg is the flossing of encryption. It has great efficacy and terrible efficiency.
Even if its tasty? Why not?
Blogs on Mobile,Web and API Automation Testing
An Approach to Testing Your User Interface More Efficiently