skysight-inc/HackerNews huggingface dataset:
The problem with PostgreSQL clustering, and really all SQL clustering is that the DB engine is just not designed with that in mind. So what you end up having to do is add an additional layer to support the clustering (or sharding). The advantage that something like MongoDB, or CouchDB, or Elasticsearch (etc) is that they're designed with sharding in mind. This makes the sysadmin's life a lot easier! Scaling Mongo up might be a pain with their config servers, routing servers, etc but at least there's a well-documented and well-supported system for scaling out horizontally.

MySQL/PostgreSQL are fantastic database systems and exceptional at solving the problems they were designed for. But its wrong to think of it as this blanket solution for every problem, or to suggest it on HN every single time someone asks a question about MongoDB.
No, we can't, HM type inference is for nonunion, nondependent types. Python is of course going to need unions due to its dynamic nature.
Not being able to offend/hurt feelings/be disrespectful would be contrary to any semblance of free speech.
A few quick answers:

1) Yes, probably. They have some sort of a cyber military organization, and it wouldn't even have to be _that_ sophisticated to pull this off. In brief see http://www.telegraph.co.uk/news/worldnews/asia/northkorea/11...

2) They're afraid of the repercussions given the massive public reaction to the hack. This isn't a fully persuasive line of reasoning, but it seems like a possibility.

3) You can see some of the evidence explained here: http://www.fbi.gov/news/pressrel/press-releases/update-on-so...
Would you allow your parents or children to be misidentified and wrongly tortured out of the false view that torture is the most effective interrogation/investigation approach?

Note also that the CIA had to really claim some kind of permanent unknown ticking time bomb of unknown nature, but after they used that justification, held a suspect they ignored for 40 days before torturing them.

A false sense of urgency at an unknown threat is not a rational justification for torture (I'd argue that if we were rational we'd never justify it), but once you permit torture, it opens the door to all kinds of terrible, immoral, and ineffective tactics.
SFjulie1's comment is a good one, mikegioia.

Taking a look at the economics of a technology that's being used is a very sensible thing to do, especially for a business. If this analysis shows that one solution is inferior to another, it does not mean that the analyst has a "religious zeal" against the economically-inferior technology.
As a brief aside, ng-if is probably what you mean to use - it actually removes the other node. But every single one of your other points is absolutely true, and we've run far away from Angular for similar reasons. I'm having a lot of fun with React (with Backbone-based stores), and it just feels right after all of that. It feels as easy as working with Rails templates again, but everything just magically stays up to date, and the performant way to do things is the only way to do things.
U.S. Imposes Steep Tariffs on Chinese Solar Panels
Some of the SQLite utilities let you dump the tables out of the SQLite file as CSV or .sql if you want.

It would probably be easier if dB vendors just made a SQLite importer/exporter that turned any given SQLite file into a full database in their RBDM and visa-versa (or for some subset). It's not really that hard of a problem to do it and seems like a better way than shuffling around csv files or .sql files. At least then if you want to probe the files a little to see what's in them without loading them up you can just use one of the dozen or so SQLite utilities that are out there.

The hardest part might be type inference on schemas that don't define the attribute types (SQLite ignores those and so they're optional) and converting over the full-text indexing and other extensions. But it's not exactly rocket science.
I find this whole thing really weird, and I suspect sites like reddit are being manipulated by someone.

Lets the timeline right

1. North Korea makes its disapproval of The Interview public and complains to the UN in the summer of this year

2. Sony is hacked and passwords are leaked. The passwords are the focus of the story

3. A couple of days go by, no mention of North Korea or The Interview

3.5 I've gotta be missing something here

4. Theaters (not Sony directly) decide the pull The Interview because of threats from NK

5. FBI blames NK for sony hack

6. Obama gets involved (?????)

The sequence of events just makes no sense. Then there are sites like reddit that are completely consumed by the story. The number of posts about it is insane, and there is little skepticism about the bizarre sequence of events or the blaming of NK.
Why the CIA loves startups
He smelled the problem long before it started but failed to implement a simple remedy:

Creating 301 redirect to portal copy hosted in stable jurisdiction.
this religious thing works the other way, too. e.g. i, after reading a couple dozen articles about mongo across the years, most of them linked from this site, have a religious zeal against mongo.
Here's another racket: "decongestants" containing phenylephrine as the active ingredient (most U.S. over the counter decongestant products).

"Phenylephrine was not significantly different from placebo in the primary end point, mean change in nasal congestion score at more than 6 hours (P = .56), whereas pseudoephedrine was significantly more effective than both placebo (P < .01) and phenylephrine (P = .01)"

http://www.ncbi.nlm.nih.gov/pubmed/19230461
I want to get this page as HTML, instead of a Javascript script that builds the page? I can't (easily) send it to my Kindle this way.

This is a TEXT DOCUMENT, right?

(I don't want a downloadable PDF also.)
In addition to verifying you are hitting an index for all of your queries, you should verify that all of your indexes are in memory. Depending on the size of your dataset, trying to fit more (or all) of it in memory may be an option worth trying.
Aye yai yai. Ya know, your response is part of the problem here. This may be a general shift in the way this site is going, and that may be fine, but what I expect from the comments in HN posts is far greater than what SFjulie1 posted. It's incoherent, off-topic, and filled with the anti-{%database%} mentality prevalent when something about MongoDB comes up.

The comment raised an interesting way of thinking about the
problem that many developers would not consider

Fantastic! Why can we not have an actual discussion about scaling MongoDB when the post is about scaling MongoDB! You want to have a conversation about different database engine solutions to the problem, go start a post about that. But this post was about MongoDB scaling. I may have been critical of the GP here, but you fail to appreciate the need and desire to keep HN to the level it should be.
301 redirect from where? Their domain name is just deleted
I was disappointed. I hoped for a satirical view on what weird emails I get from sites but no. :-(
The USA won't intervene in a country with nuclear weapons and a few kilometers from Seoul for crime without physical damages. NK won't hacknowledge it because they want to appear as a victim in every way possible.
My entire point in this entire thread is to for once keep the conversation on topic about MongoDB without everyone going into a tangent on switching to Postgres or something else. I just want one post where we can actually talk about MongoDB scaling.
I've found vertical-oriented monitors to be just 'blah' for what I do (Windows/C# development.) Many of the Windows IDEs out there seem to realize that monitors are wider than they are tall, so various tool panels in the tool are on the right and left of the editor. Between the space used up for line numbers, breakpoints, resharper annotations, and other trim on the left, plus the solution explorer (file tree) on the right, there's only about enough room for 100-120 character lines in the editor.

My IDEs are about the only thing that I run full-screen. The other monitors have multiple windows open, sometimes docked split left-right and sometimes slightly overlapping. Windows makes this easier with left-right auto dock, where it doesn't have up-down docking.
you mean, nobody should be selling them, but ignorant buyers (== most of the market) look for 'Full HD' sticker instead of actually asking for advice.

i guess somebody should invent a 'Better than Full HD' sticker.
So the story is that a state level actor who is pissed at a company over a particular bit of video, steals a load of data and then does not check the stolen data for the video they are pissed about before publicly releasing it online themselves, while simultaneously demanding that it isn't released in any format ever?

I'm not saying that this isn't what has happened, as governments are capable of wonderfully insane levels of stupidity at times, but it does seem relatively unlikely.

This more looks like someone who is massively pissed with Sony, not a particular film, and is just running with the NK angle for comedy chaos-monkey reasons.
The Russians or NK could have secretly hired Chinese hackers to make it look like NK. Now they can embarrass the U.S. for jumping the gun like they did in Iraq and weapons of mass destruction (assuming the connection can not be proved).
Of course sites like reddit are being manipulated.

http://www.theguardian.com/uk-news/2014/jul/14/gchq-tools-ma...
If NK did hack them, a joint investigation would be great as they'd learn what techniques the US used to identify NK.
Rails used as intended can be a real pain to upgrade, I agree.

Recently I have been developing applications in the "thin-model, thin-controller, with a service layer and external API wrappers" style, as espoused by Gary Bernhardt [1] and others [2] [3] [4] [5]. I upgraded to the latest Rails this morning on one app, and apart from swapping the Money gem to use the git repository, until they have a new version out with compatible dependency, it went smoothly. All the specs and acceptance tests passing with no alteration required.

[1] https://github.com/garybernhardt/sucks-rocks
[2] http://jamesgolick.com/2010/3/14/crazy-heretical-and-awesome...
[3] http://objectsonrails.com/
[4] http://solnic.eu/2011/08/01/making-activerecord-models-thin....
[5] https://www.youtube.com/watch?v=CGN4RFkhH2M
A Poor Imitation of Alan Turing
Also Nexus 9, for quite a bit more money. The problem with these phones and tablets is they are quite unlike server hardware:

- Far too little memory (2GB vs 16/32GB+)

- Slow flash vs SATA disks

- The "zoo" of u-boot/proprietary kernel crap, instead of UEFI, ACPI and standard upstream kernels

- Nonsense like locked bootloaders (Nexus 9 disables HYP mode in the bootloader!!!)
It's kind of jarring to see screenshots of full-screened web pages.

This may betray my 90's Mac heritage (since until somewhat recently Mac OS window management hasn't even supported full-screen) I think the only things I've ever full-screened in my life are (1) videos (2) photo editing.

When I'm browsing and messing around, I have my browser surrounded by chat windows, when I'm working I have terminal windows, documentation and notes spread around.

Anyway on wide screens I can suggest putting your dock on the right side of the screen instead of the bottom to make more efficient use of space.
Before it was deleted but after first sign of trouble coming from bat'ka. That didn't happen overnight.
We've had slowness on https://Clara.io because of what we believe was excessive file system fragmentation as we were running on zfs and then later brtfs. We were on zfs and brtfs because it allowed for easy and quick backups via snapshots. But eventually writes were slowed leading to long lock times and making everything basically unworkable. A reinstall would always fix the issue for a while. We believe that the same reasons that backups were fast, the copy on write feature, is the same reason we got excessive fragmentation after a while.

I believe it was because we were not using xfs as our file system, which we have recently moved over to. So far the issue hasn't re-occured.

Other than this issue, MongoDB has been pretty good. Indices are important and formulating queries so that they are index based is also important (the same result can be obtained in multiple ways, some of which likely do not use the indices, while other formulations will use them.)

We use Redis as a cache in front to reduce the unnecessary repetitive load on MongoDB for common operations.

We have MongoDB cluster setup and it has saved us a number of times. Also it is really just a live backup system -- we've had a few hardware failures and we still have never had to restore for an archive backup, we just resync from one of the failover servers. But using that is likely a no-brainer, and you are likely already doing it.
Heck, I have a SQLite dB I'm working with right now that has ~30 million rows across a few dozen tables. Queries against the indexed fields are returning in 130ms on my rMBP.
I don't think script kiddies could do this size of a hack, especially considering the amount of data involved and stay under the radar this long. If this is what a script kiddie is capable of... then what is a real hacker capable of?
I remember a pic of John Carmarck coding on a huge rotated monitor, but my google-fu powers are failing me and can't find the pic.
3.5 The Senate Intelligence Committee releases the CIA torture report.
On the other hand, group 2 are the ones who you need to really convince. Group 1 is already convinced. So if you spam group 2, you might lose them completely and group 1 you don't really need to spam.
About 1. it was the subject of the following Phrack's publication: http://phrack.org/issues/68/19.html#article
NK does have the ability.

Few things to remember:
1. The instruments of dictatorship is working well. They are not bunch of idiots. They outlasted the Soviets!
2. NK launched a medium range ballistic missile. It was a rather crud one (basically bolted together from parts from multiple missiles). NK may be poor and a backward country but they did build and launch the rocket(although it broke up in mid flight). How many nations have actually launched rockets as NK did?
3. We all know 'hacking' isn't some rocket science. It can be done by any reasonably intelligent person with a lot of time on their hands. And NK obviously has reasonably intelligent people who have the aptitude for programming/coding/hacking with a lot of time on their hands.

NK's only internet connection is via link through China. But I can also see NK posting hacker-soldiers in China too.
--> 3.5 Sony executives are so scared about the information contained in the stolen documents that they pull out the lobbying canons and demand the government/fbi/obama create a smoke-screen FAST and focus public opinion on a different shiny object for awhile...thus The Interview nonsense.
Ubuntu's control panel (gnome-settings) has never failed me for this (12.04+) and if you're into kinky CLI commands, xrandr is your friend. It is a sane wrapper that helps you configure your displays in an almost natural language:

xrandr --output eDP1 --mode 1024x768 --rotate 180 \
--output VGA1 --mode 640x480 --right-of eDP1

(From memory, dont paste this to the bank)
Or, if you're a programmer, this:

==============================================
| |
| --------------------- |
| | | |
| | | |
| | | |
| | | |
| | (webpage) | |
| | | |
| | | |
| | | |
| | | |
| --------------------- |
| |
==============================================

becomes this:

==============================================
| |
| -------------------- -------------------- |
| | | | | |
| | | | | |
| | | | | |
| | | | | |
| | (webpage) | | (code) | |
| | | | | |
| | | | | |
| | | | | |
| | | | | |
| -------------------- -------------------- |
| |
==============================================
It appears to be political chess - it's mostly of relevance to nation states. I don't believe that there is much for us to grok right now except for us to follow the news that comes out.
Definitely take a look at Mongo's recommendations:
http://docs.mongodb.org/manual/administration/monitoring/#di...
This has gotten much better since I last used mongo heavily. I ended up using the slow query log, but it looks like the tooling has improved significantly and now there is a list of common problems
We have thought about this. We are interfacing via Mongoose to MongoDB. Is there an easy way to still use Mongoose while transitioning to PostgreSQL?
Maybe i should check closer, but i never got the impression that NK was behind the threats that made theaters pull The Interview.

As best i understand they were "just" online threats, but came in the wake of similar threats to Sony employees and their families.

At this point in time i think there is a subset of internet trolls that get their "lulz" from finding some high profile controversial topic and throwing random threats at whoever is involved.
Literally every day now I run across something mentioning "Sony hack", but haven't understood yet why it's so significant topic. It seems to gather way more attention than I imagine something like this should. Every now and then somebody gets "hacked", sometimes it's somebody pretty big, it's not that uncommon that some really important data gets leaked, but it never goes further than mentioning it on HN or something, no jokes about it on 9gag, no North Koreas joining investigation. What's the matter?

Maybe it's because I missed original news. Can somebody provide link or explanation why the heck it's so important that even completely non-technical people buzz about it all the time?
> "... the concept appears every day in business."

Umm, no. It does not. Maybe in finance or procurement but it is certainly not a term in general use.
"While some computer experts still express doubts whether the North was actually behind the attack, American officials said it was similar to what was believed to be a North Korean cyberattack last year on South Korean banks and broadcasters. One key similarity was the fact that the hackers erased data from the computers, something many cyberthieves do not do."

I won't pretend to be an expert on information security but surely this isn't anywhere close to being unique enough to point blame at North Korea?
This is also known in Italian as sprezzatura: it's the practiced skill of making everything you do appear effortless or natural.

http://en.m.wikipedia.org/wiki/Sprezzatura
This comparison is interesting in that it compares the performance of plain or type-annotated Python code, but to get the full performance benefit of Cython you would replace lists with C arrays, objects with C structs, etc.
Fine, so lots of the websites I read are broken. I still need to read them though.
it seems like a excuse for starting the war... maybe that's why NK is cowardly saying "not me, not me, seriously guys!"
In my opinion, it's mostly about the scope of the hack, and the studio's reaction.

The amount of data compromised is unparalleled in any other previously reported hack, and the response by Sony (canceling the distribution of a movie) is also unprecedented.
All narratives about enlightenment contain a form of letting go. Zazen, Koan. Siddartha and his quest etc. I read a book years ago from a French guy who suggested that this could be reached by writing meaningless sentences, which he made a long winding point is more difficult than it seems. I guess one can look at Azimov's A guy like that too.
What it says, apparently, is that there is a reality behind all this. The human mind does have the ability to make qualitative jumps.
We just need to get rid of the travail first...
Somebody came here asking for help with a real world problem.

It would be doing this person a disservice to not mention alternative technologies that have solved very similar problems that have affected many other people/organizations.

It is total absurdity to avoid bringing up these solutions to the problem merely in order to maintain some vague purity of the discussion, or to otherwise keep the discussion unnecessarily and unhelpfully focused.
Because free speech is a constitutional right now being impugned by a bunch of hackers or a tiny country. The U.S. looks completely powerless in the face of it.
The Tale of Studio Ghibli
I see your point but if 99%+ of developers are rubbish at security what are you going to do about it?

a) Hope they suddenly improve, which is probably not going to happen

b) Accept they have limits and encourage them to use systems and frameworks that are hard to screw up on, written people who are good at security?

I note in the Sony hack the only computers that survived basically intact were Macs, not I guess because their owners understood security but because they were well designed and idiot friendly.
While that would be interesting, I don't see it as the responsibility of the author of a conference poster that has already been presented. It would make more sense for the authors of the various Python implementations to take this up as a benchmark.
Though if you open a book, you actually have a landscape view of two pages, side-by-side.
This isn't a good enough excuse to intervene.

North Korea routinely provides much better reasons to intervene.
Yes, you have been using your monitor wrong. Try a tilling wm and you'll never go back.
The free speech angle always seemed like a stretch. Isn't Sony free to release or not release movies as they see fit?
i don't watch tv so i don't know what you are talking about.
That isnt what I or parent was saying.
After 10+ Years, NetworkManager Reaches v1.0
It looks like we're on the verge of getting a vertical alignment property in CSS, not "just got".
Of course they have the capability. The North Korean government has billions of dollars to throw at any project they come up with. The breakin at Sony, sourced commercially in the US, might have cost mid-six-figures.
Also, mailing list announcement:

https://mail.gnome.org/archives/networkmanager-list/2014-Dec...
I agree that the U.S looks weak during this whole thing but how is this an issue of freedom of speech? A company chose to pull its product due to a threat, the government didn't force them to pull it or anything, it's their own choice. If you publish a controversial book and get threatened because of it and choose to pull it, it's not a freedom of speech issue because you are pulling your own book (or not pulling it).
My understanding is that the code for the module that securely deletes files is unusual and nearly identical.

But I share some of your skepticism.
One thing to consider is that it is entirely possible that whoever did the hack is scratching their heads right now and wondering who threatened the cinemas.
US isn't powerless, it's just a matter of the will to act. If everyone agreed that NK should be destroyed (such would be the case if they were stupid enough to launch a nuclear attack against someone, for example), it would be. Hacking Sony doesn't reach that level of retaliation.
You heard it here first folks. Mike_hearn has scoured the earth and cannot find one person using hidden services for non-criminal purposes.
The state has targeted lots of private conpanies for decades, offering the advice to American companies as a competitive advantage.

This is different from states trying to explicitly destroy another company, but the bottom line is the same: you need to include state actors in your list of potentially hostile attackers, same as any black hat.
The comment was not 'incoherent', to say so suggests that the actual points made no sense. Rather, the comment was simply written in poor English.

I think your comment only needed to be a polite "can we keep the conversation on the topic of MongoDB scaling" rather than a quite personal attack on the author.

Also, personally, I thought the main point raised about viewing the database choice from a business rather than development point of view was interesting and well worth discussion.