skysight-inc/HackerNews huggingface dataset:
A lot depends on what kind of cleanup you need to do. If each cleanup step can be done in the context of a single XML file, then your simplest approach is probably to skip databases completely, just process one file at a time in your favorite language.

If you need set-oriented operations, it's hard to imagine you can do better than use SQL, although that presumes that you have normalized the XML into SQL, which may or may not be trivial. Depends on the structure of your XML docs.

After the cleanup: hard to say what's best, but it depends on the structure of the data, what you want to do with it, and how much of it there is. To me, SQL is the tool of choice nearly always, unless you have requirements for data volume or data structuring that are incompatible. On the latter point (data structuring), since you have XML, I would guess that it would not be difficult to define a SQL schema. I.e., the schemaless aspect of NoSQL systems might not be important for you.
$1B lawsuit filed against Getty Images for selling public domain photos
I know how many those people killed. I don't know why you think I don't.

The absolute numbers may well favor the atheists. But there's only one reason for that: those are who the genocidal maniacs happened to be in the 20th century. The next genocidal maniac will probably blow all of those away, regardless of religious beliefs, simply because of the number of people available to kill, and the technology available with which to kill them.

The world population at the time of the Great Leap Forward was 2.4x larger than at the time of the Taiping Rebellion. It was about 6x larger than at the time of the French Wars of Religion and the early phases of the conquest of the Americas, 10x larger than when the Crusades got started, and 15x larger than when the An Lushan Rebellion killed perhaps 5% of all humans on the planet.

It would have been difficult to kill 100 million people during the conquest of the Americas, because that probably would have required millions of immigrants just to bring the population back up to zero afterwards.

In terms of languages lost, cultures destroyed, peoples wiped out, land permanently lost to conquerers, and duration, the Americas "win" by a huge margin.

By the way, do you know why the Atlantic slave trade got started? It's not because Africans made such good slaves. It's because the conquerers of the Americas kept working their native slaves to death and began to run out of natives.

China's population recovered to the level prior to the Great Leap Forward in a few years. I'm not sure of the USSR's population ever significantly dropped, as it was a sort of slow burn that population growth kept up with. Europe's population recovered to pre-WWII levels in a few years. How long did it take the Native American population to recover to pre-contact levels? It's hard to tell, because the pre-contact civilizations were so devastated that there's no good idea of how many people there were, but it's likely that they still haven't recovered, and may never do so.
Guess what caused a serious outage of a system at a customer that I know, with an estimated impact on his bottom line in the seven-digit area? Yeah, right: naive copying of some XML out of IE into the configuration of said system. Including those '+' characters, which resulted in it not exactly being XML anymore.
I'm not exactly recommending this, but there are communities in Berlin whose main language is English, Turkish, Polish, Russian, whatever. It will probably hurt you in the long run, but you could always "live" in one of these.
Much of the discussion in this thread is in regards to life in Berlin. In this context, the OP does not seem irrelevant at all.
A lot of individuals just don't feel comfortable speaking a language before they know it well enough. I definitely have a lot of respect for people that can just pick up a few basics and manage to always get their point across. But I just couldn't do it. I'm the kind of person that rehearses what they'll say in the most mundane situations. I'm uncomfortable when the plan doesn't work out.

Recently I even got complimented by a McD employee for telling them my rather lengthy order flawlessly without any need for interruption, made my day ;-D
Note: I believe this is a reference to http://thedailywtf.com/articles/the-inner-json-effect
> Making mistakes with them is extremely easy and taking all cases into account is hard.

He states why right there. He doesn't say anywhere whether templates can or cannot generate well-formed xml.
Just because I was curious, here's the actual breakdown:

Highest level of play by current NFL head coaches

NFL: 10

Division I: 7

FCS: 6

Division II: 2

Division III: 4

High School: 3

This is pretty generous bucketing, i.e. the NFL bucket includes people like Sean Payton (played 3 games as a replacement during a strike) and Gruden (practice squad player).

The DI/II/III breakdown is also based on the school's current NCAA status (not when the coach played), which is probably inaccurate in some instances as well.
All right, I'll bite:

>JSON doesn't have namespaces, making integration of different data-sources quite hard.

Yeah, and how often do you merge two data formats like that into one data format in a way that doesn't require massive transformations anyway?

>XML allows me to do versioning within documents

Well, that's fantastic. Because XML is designed for DOCUMENTS. But JSON is designed as a wire protocol, and a data exchange format, which is very different. You shouldn't use JSON for documents, and I very much doubt that's what OP was talking about.

>An extremely large corpus of well-tested libraries are available.

For your language. But XML is fairly complex, and there are a lot of environments with no support, and JSON parsing is so simple and easy that the complete grammar, as well as the semantics, are on the front page of the website, and it's unlikely your language doesn't have support for it already.

>As opposed to JSON, XML and accompanying standards (XSLT, XML Schema, XPath, XQuery) are extremely well documented.

The grammar and semantics are on the front page of the site. And JSON is simple enough there's little more to it than that.

>XML validation, parsing and processing can happen at the same time, allowing streaming solutions. Using the XML schema, a parser can be created which is optimized for a specific stream of data.

Really? That's actually kinda cool. :-)
XPath expressions are actually pretty cool (and I say this as not a great fan of XML in general). The ability to search and select elements is something we use all the time. For many examples, search for "xpath_" in https://github.com/libguestfs/libguestfs/blob/master/v2v/inp...
A lot of people around here would do well just to read the official rules carefully and follow them.
"Hester Harriet Marsden-Smedley" Wow. Just wow. And apparently it isn't never lupus.

Gladwell has a knack for making me want to know more about his topics. Not by reading Gladwell, of course; that would be pointless.

He makes the assertion in this article that intelligence services in general, and British intelligence in the early decades of the cold war specifically, are useless. Based on a few examples, he thinks that having MI5 and 6 riddled with spies had no consequences---either the intelligence wasn't believed or it was, it was acted on, and people died, but that didn't change the outcome. Further, he says the later, paranoid period was bad, although other than a couple quotes from politicians, he gives no evidence.

And yet, the period between 1945 and 1965 was the high point of the Soviet Union. Taking over neighbors. Stealing secrets. Influence. Striking terror in the hearts of free world politicos. And then, after the golden age of Philby, not so much, realistically.
If you like Agricola, I recommend Caverna. Sort of a spiritual sequel to the game, and done better in my opinion, which is saying a lot because Agricola was one of my favorites.
> I strongly dislike dubbing and simply cannot enjoy a dubbed drama or film.

The problem is that often the original screenplay contains cultural references that are not known in the audience that the dubbing is made for. So you have to replace the cultural references by ones that are understood by them. The same holds for puns, word plays, songs etc. These have to be rewritten.

In this sense a dubbing (at least in Germany) is much more than a rough translation of the original spoken text, but often a reinterpretation. Thus I wrote that there are even people who say that the German dubbing of some American movies is yet better than the English original, since the translators are even more creative in the wordings than the original screenplay writers.

To give one example: In Finding Nemo, the German names of the two sharks (besides Bruce) are Hammer (hammer) and Hart (hard) (in the English original they are "Anchor" and "Chum"). Now you have to know that in German "Ich bin voll der Hammer" ("I am full the hammer") is a very plebby way of saying "I'm the greatest". If you now keep in mind that Hammer and Art were dubbed by some German comedians which have a very turkish-plebby image you will understand why the German dubbing of these scenes is much more funny in German than in the English original.
What do you think JAVA stands for? It's not an abbreviation. It's the name of an island and it's just 'Java'.
'It's also worth checking out existing neural net code-bases to see what tricks they have. The fine details usually aren't in papers, and they're not all in the text-books either.'

Given that you are a person who is highly-qualified to answer, I am genuinely curious why do you think that is? Reimplementing algorithms from scratch is an efficient way to learn, understand the underlying concepts and attempt improvements in a research context.
Zen of Assembly Language: Volume I, Knowledge
Definitely. Even as a consumer, I am able to order food from UberEats, and the total costs less than the cost of the food on the menu at the restaurant because of Uber's promotions.
The biggest problem with XML is that it's a node labeled tree that makes the schema choice between leaf node and attribute for scalar data almost arbitrary, whereas JSON is an edge labeled tree without the same choice. Most programming languages use edge labeled graphs for in memory data structures, so the semantic distance is lower with JSON.
My family plays a lot of board games. Most recently we've been playing:

- Concordia https://boardgamegeek.com/boardgame/124361/concordia

- Istanbul
https://boardgamegeek.com/boardgame/148949/istanbul

- Lanterns
https://boardgamegeek.com/boardgame/160851/lanterns-harvest-...

- Codenames
https://boardgamegeek.com/boardgame/178900/codenames
(this last one is more of a lighthearted party game, but still great fun)
Uber is a investment fueled churn machine right now. Supply and demand(even as overly simplistic that model is) has yet to come into the equation. We will not have any idea the validity of the business model until the never before seen massive expenditures in driver acquisition subsides. Which probably won't be for several years or more.
Perhaps because it's an old challenge, which automation has always won?

The Luddites and others challenged the automation of the Industrial Revolution. Now we use their name to demean people who argue against increase automation.

John Henry (a "steel-driving man"), won a Pyrrhic over the steam-powered hammer.

Phil Och's "Automation Song" from the 1960s goes:

Now you've got new machines for to take my place

And you tell me it's not mine to share.
Though I laid down your factories and laid down your fields,

With my feet on the ground and my back to your wheels.
And now the smoke is rising, the steel is all a-glow,
I'm walking down a jobless road and where am I to go.

The solution since at least the early 1900s has been the hope that there would be more free time, for people to be humans instead of wage slaves. Not quite the "work-free utopia" mentioned at the end of this article.

But that would be "socialism". sigh
Reminds me of a maneuver performed by Mehmed the Conqueror during the Siege of Constantinople:

"On 22 April, Mehmed transported his lighter warships overland, around the Genoese colony of Galata, and into the Golden Horn's northern shore; eighty galleys were transported from the Bosphorus after paving a route, little over one mile, with wood. Thus the Byzantines stretched their troops over a longer portion of the walls." [1]

[1]: https://en.wikipedia.org/wiki/Mehmed_the_Conqueror
Income tax including the compulsory health insurance, pension payments etc. is around 42%-45% for income of 50k-60k.
The title is a bit misleading - it's basically about how babies/kids learn by observation and that we should give them more opportunity to observe/experiment rather than tell them how the world works
The Big Internet Brands of the '90s – Where Are They Now?
"It’s a strange thing to keep a creature you have no hope of developing a relationship with."

I keep tropical fish because I find it super relaxing to watch them flit around. We're not bros or buddies.

My grandparents put out feeder and nectar for hummingbirds because hummingbirds are totally awesome, not because they enjoyed a deep personal relationship with those little sugar fiends.

Its a strange theme for a reptile show story in that most stories are a variation on pointing out the unusually high percentage of white trash followed by the usual preaching to the choir social signalling about how awesome we are because we aren't them.

I also noted the lack of sense of wonder or beauty. Perhaps another symptom of excessive projection about human relationships is refusal to admit some animals are part of our lives for shallow reasons because of fear of judgment about the depth of human relationships. Maybe something to do with age; I'm confident enough in my long marriage to buy a tropical fish based solely on how it looks (aside from blindingly obvious higher priority engineering constraints like compatibility and biochemistry, within those constraints, pick something based on looks) Or the opposite, Mexican Mole Lizard totally not happening any time soon.
LWN: https://lwn.net/ . Best source for FOSS news; next best thing to reading all of the Linux Kernel mailing list and many other first-hand sources, as well as reports from numerous conferences.
Top games:

1) Cosmic Encounter. Plays 3-8 (best with 4-6), about 90 minutes. It's a negotiation game where each person has an asymmetric way they alone can break the rules. Cosmic is a strange game where the entire game takes place off the table, but you use the table to keep track of what's happening in the game. The first one or two times you play, you probably won't understand how deep and subtle the game is, but stick with it. (https://boardgamegeek.com/boardgame/39463/cosmic-encounter)

2) Memoir '44. 2 Player, as written plays in about 30 minutes, but typically we switch sides between rounds, so 60 minutes. Light WWII war game. Lots of expansions (Russians, Japanese, British armies), and lots of ways to play (expansions allow up to 8 players). This game is just so much fun if you dig the WWII theme. (https://boardgamegeek.com/boardgame/10630/memoir-44)

3) Kemet. 3-5 players, about 90-120 minutes (depending on player count). "Dudes on a map" war game with excellent fighting mechanics. Very well balanced, with every player being able to attack all other players. Fun little monsters you can buy in the game. (https://boardgamegeek.com/boardgame/127023/kemet)

4) Railways of the World. 2-6 players (depending on the map), 60-120 minutes (depending on the map). Nice railway game. Simple rules (about 10 minutes to explain), but just a great game. (https://boardgamegeek.com/boardgame/17133/railways-world)

5) Star Wars Rebellion. 2 players, 90 minutes to 270. Thematic Star Wars game. Imperial player tries to find the rebel base, while the rebels just need to last long enough to have their cause take hold in the galaxy. Incredibly well balanced, despite the asymmetry between the players. (https://boardgamegeek.com/boardgame/187645/star-wars-rebelli...)

6) Party games: Love Letter, Codenames, Wits & Wagers, Can't Stop. All are great games. One game, For Sale, deserves special mention because it explains so fast, but has such depth.

7) Eclipse. 2-9 players (best with 3-5), takes about 45-60 min/player. 4X game where you explore the galaxy and try to accumulate the most points through science, research, economy, battles, negotiations, and exploration. You should buy the Rise of the Ancients expansion to fix a subtly broken part of the game dealing with missiles.

That's just off the top of my head. Last night I played Patchwork and Quadropolis. Patchwork might be a great game -- too early to tell, and Quadropolis is fun, and likely worth the money, but I don't think has the staying power of some others.
Here is a quick shortlist of some type inference issues (some bugs, some enhancements, and some fundamental limitations of the language design) that I run into pretty much daily:

1. (Search for "asInstanceOf"): http://typelevel.org/cats/tut/freemonad.html

2. (Finally fixed and will hopefully be released soon - yay!): https://issues.scala-lang.org/browse/SI-2712

3. https://twitter.com/extempore2/status/430456002392391681

4. http://pchiusano.blogspot.com/2011/05/making-most-of-scalas-...

5. (Anecdotal): Various pattern matching peculiarities.

Compiler bugs: As long as I write code on the happy path and steer clear of scalaz/shapeless/cats, the compiler is pretty well-behaved and I can go months without getting a compiler crash. However, when I add those in and start writing pure functional code with complicated types that hits the intersections of various features (e.g., GADTs, package objects, implicits), I get a few crashes per week related to known bugs.

It works pretty well, and I am not trying to complain too much about all the mileage I get out of Scala and the excellent tooling! Just trying to get the most out of it.
Duolingo is good, but I'm not sure it's a great measure of understanding the language. I've been teaching myself German over the last 5 years using Duolingo (and LingQ) and I've completed all the German lessons (Level 23) - and while I can read German reasonably well now, I would still struggle to write or speak fluently in German. Thinking of what you want to say quickly is a skill that Duolingo doesn't really teach - but maybe that's where iTalki or LingQ Skype classes come in. [Native English speaker here, for what it's worth.]
Can the UK do something like that i.e. get the best terms possible from the EU and then put that to a vote?

That was already supposed to be the case.

David Cameron, as then-Prime Minister, went to the EU with as strong a mandate to seek substantial change as any British leader was ever likely to receive. Because of the imminent referendum, he also had as strong a negotiating position as any British leader was ever likely to have.

The deal he came back with was regarded as underwhelming by a large part of the population, with nothing fundamental really changing much in the long term. That probably convinced quite a few moderates that their first preference, reforming a less than ideal EU from within, was never going to happen, and we know the rest of the story.
I used to enjoy Dominion, but it can become very mechanical. For any given set of 10 cards, you usually want to ignore all but a few of them.
That increase the creepy factor. Perhaps this person friended the business or a coworker???
I didn't interpret that for dishonesty; he's just trying to illustrate how it works, in my opinion, by showing a scenario where the screen is too dark for the content on it, and another scenario where the screen is too bright for the content on it.
Working in a statically typed language, and using schemas to ensure that the generated messages are correct, because we can generated classes that map onto the required data structures.

So far as I know JSON doesn't allow for that.
Half of China population is under 30 and only known the good times of plenty. The original revolution, the cultural revolution,,etc are as about remote as the US revolutionary war and civil war to US citizens.
> And that's exacerbated by volatility, both in demand but especially in supply

This is usually dealt within the framework of commodity markets and the purchase of futures, but you won't be able to buy water there. We have abused water as a resource and created water rights for millenia.

At least we're moving in the right direction now:

http://fortune.com/2014/06/25/water-futures-markets/
The European Common Agricultural Policy Easily Explained
Didn't countrywide have such rampant forgery they called their loan department "Arts and Crafts"? Also, wasn't there a foreclosure crisis brought on by robo-signing and mass forgery?

Here's Judge Jed Rakoff, a senior judge in lower New York and one of the leading securities experts in the American court system today:
""One possibility, already mentioned, is that no fraud was committed. This possibility should not be discounted. Every case is different, and I, for one, have no opinion about whether criminal fraud was committed in any given instance.

But the stated opinion of those government entities asked to examine the financial crisis overall is not that no fraud was committed. Quite the contrary. For example, the Financial Crisis Inquiry Commission, in its final report, uses variants of the word “fraud” no fewer than 157 times in describing what led to the crisis, concluding that there was a “systemic breakdown,” not just in accountability, but also in ethical behavior.""

For what it's worth, he chalks up the failures to prosecute as 'discretion' on the part of the justice department. Personally, I'm convinced that a man like too-big-to-fail Eric Holder is too morally corrupt to find fault in such blatant fraud. If he can sign off on the banks financing terrorism and drug cartels, he's probably okay with the suicides resulting from the mortgage crisis.

http://www.nybooks.com/articles/2014/01/09/financial-crisis-...
I think patterns of developmental and good tooling make it scale up at least in utility to larger projects. Worse case use the workbench analogy like the clojurescript oriented devcards project where you check in playground style simple environments that are designed to make it interactively developing sub systems and components easy.
This is basically a workaround for a problem that I've noticed has affected laptops for many years --- the ability to set brightness and contrast independently, despite the fact that desktop monitors have retained both controls (and more).

One big problem with this setup is that my laptop’s backlight is either so dim that I can’t read the text in my terminal or so bright that I’m blinded by looking at websites. The problem is especially bad at night.

That suggests the contrast is insufficient. On a monitor with both controls, this means turning up the contrast while keeping brightness the same or slightly reduced.
Discussion: https://news.ycombinator.com/item?id=12180039

Other submissions of the same story:

https://news.ycombinator.com/item?id=12179689

https://news.ycombinator.com/item?id=12179302

https://news.ycombinator.com/item?id=12177409

https://news.ycombinator.com/item?id=12177230 (1 comment)

https://news.ycombinator.com/item?id=12173826
> Did you make a ton of money betting against the housing market? If not, why not? Or if you were too young/poor, then do you know anyone who did?

Considering there was no product to bet against the housing market, your options are:

(1) Be a hedge fund manager of a large enough hedge fund to enter a custom derivative contract with a bank, to create the product (which is what those funds that made a ton of money betting against the housing market did)

(2) Have a few million for the minimum to investment in one the said hedge funds

So I'd say the answer for most people is "were too poor".
If you don't mind me asking, which IDE do you use?
Microsoft sued over Windows 10 update campaign