skysight-inc/HackerNews huggingface dataset:
The author seems to have a very narrow view of "data science". In the comments he criticizes all of machine learning as simply unprincipled revival of nonparametric curve estimation. While there's much truth to the "unprincipled revival" accusation, some aspects of machine learning arose for good practicality-beats-purity software engineering rather than simple ignorance.

My interpretation of the term "data science" is much more in line with practicality of engineering rather than the purity of traditional statistics. To that end, Python is leagues ahead.
Yes, the "philosophical principle" Carlyle was rejecting is economic efficiency. Slavery is not efficient because the world might contain a more productive employment opportunity for a slave, which the slave would freely choose if given the opportunity.

I have absolutely no idea why you wish to portray slavery as economically efficient. Is it truly your belief that welfare is maximized with some people enslaved? (I suppose this is not a particularly uncommon left wing view, but it's very rarely stated so explicitly.)
Bart gets its operating and capital improvement money only from fares. A lot of the value that Bart creates by increasing property value around its stations is captured only by landlords, if it were able to capture some of that value it would be able to expand much quicker.
That sounds political, more than anything else.
and the Newton had a db / query API on top of an object store (soup)
Hmm, that was sort of what I figured, but that seems to me as though calling it a "permanent" web is a bit of a misnomer. There is still a place for projects like the Internet Archive.
But not using the language's idioms is not a fair comparison.

In modern times, vector based thinking like that that's present in R or numpy is the only sane way to program. Because these are not "library calls," they are the primitives of modern architectures.
I don't know, I would think users would add those events when they saw them, not copy the information from one app to the other.

I doubt Google itself copied them, but I have no problem seeing Wazes pulling all the information in while it was a tiny company, and then their DB being dumped into Google.
is stealing email becoming legal? no matter who they belong to
ISP Offers BitTorrent Caching
Adobe InCopy CS6 Serial Number Keygen Full (32 Bit 64 Bit)
R seems to have taken Perl's "there's more than one way to do it" as a credo, all of the official documentation I've seen seems to be an exercise in trying to say as little as possible with as many words as can be managed, all of the syntax seems to be deliberately designed to make no sense whatsoever and I can give it a task that JMP (no speed demon it) can finish in under an hour and not get results back after letting it churn for nearly a day. Everything about R makes me wonder what I've done with my life to end up using it.
> Certainly. And we change those laws over time to reflect changing circumstances.

Which would be quite different from the article's positioning that acts entitled to that money in the first place. But at that point, it would be reasonable to ask why such a change should target non-profit educational institutions in particular, rather than non-profits in general. (Obvious answer: because that would be wildly unpopular, and would threaten some of the primary organizations that non-profit laws were created for, which have enormous lobbying power.)

> That blanket statement is as true as the statement that companies have no problem spending more money than they have.

And those companies doing so typically go out of business, which is strong encouragement not to do that. Government departments have no such controls or requirements in place to enforce fiscal responsibility; when they spend more than they have, they still get more to spend in the future. And lo and behold, they often demonstrate extreme fiscal irresponsibility.

> I mentioned Cooper Union as an example of how non-profit universities are also not immune.

And they very nearly went under due to (as far as I can tell) epic mismanagement, yes. Mismanagement occurs in many places. It's worse when it happens with other people's voluntarily donated money, and even worse when it happens with taxes.

> Who am I likely to believe more, you or Piketty?

I'm hardly the first or only person to argue against what is commonly euphemized "wealth redistribution" on moral/ethical grounds. Whether you're inclined to believe those arguments depends rather heavily on your political beliefs and morals, as it's a question not solely decidable based on economics. Sounds like you've already made up your mind that "wealth redistribution" is acceptable to you, which is a political viewpoint, not solely an economic one.
These days I use both R and Python regularly. I don't have a strong opinion about one being better than the other, and I feel pretty good about that.
If you are religious, then you either think that religion is a valid alternative to science for certain problems, or that testable predictions are not important in some domains.

Which is to say, either you think that scientific reasoning isn't always a good way to understand our world, or you don't think understanding how our world works is really so important. All else being equal, good scientists will possess neither of these qualities.
Washington DC saw a drop in rents with substantial new supply - http://dc.urbanturf.com/articles/blog/dc_area_rents_drop_3_a....
I think you're looking for a set of roughly-orthogonal concepts that together make up a "database", right? Basically, you're trying to understand the different dimensions under which database products might make different trade-offs, defining the design space? If so, take a look at these concepts:

Schema. This defines how the raw bytes of a data record are mapped into semantically-relevant pieces of data for your program. The relational model (behind SQL) is the most commonly used schema for commercial database products, but also check out things like XML databases, JSON data-stores, serialization formats like Protobuf or Thrift, etc.

https://en.wikipedia.org/wiki/Data_model

Indexing. This defines what data structures are used to quickly find records on disk. Almost all the major products use B-trees, but these are not the only options: you can also have hash indexes, sorted string tables, bitmaps, bloom filters, etc.

https://en.wikipedia.org/wiki/Database_index

Concurrency control. This defines how the database deals with multiple clients trying to modify the same piece of data at once. Options include row-level locks, table-level locks, MVCC, STM, CRDTs, etc.

https://en.wikipedia.org/wiki/Concurrency_control

The memory hierarchy. This defines where the data is stored, physically. Is it on disk, like most data-warehousing stores or distributed filesystems? Is it in memory, like memcached or Redis? Is it on Flash memory? Is there some sort of caching scheme where parts of the data are in memory and parts on disk?

https://en.wikipedia.org/wiki/Memory_hierarchy

Distribution. How is data split across multiple machines, and then how are failures in the network handled?

https://en.wikipedia.org/wiki/CAP_theorem

Hope this helps. Most data-management solutions (even ones that often aren't considered "databases", like memcached or Redis or flat CSV files or MapReduce or the Google Search indexes) can be mapped onto this space.
I was the original programmer for that project...while I didn't enjoy spending part of my late 20s learning about PDF to text conversions...I wouldn't necessarily attribute their use of PDF to devious motives. It's easy to forget sometimes that much of the world still operates on paper...and electronic documents that translate directly to paper have some value. These financial records were disclosed as part of legal settlements, and they were also used by hospital compliance officers...While obviously just sending out CSVs or Excel sheets would be great, it adds a possible breakage point between the company and its audience...i.e. hospital officers complaining that the spreadsheet looks funky on their version of Excel or whatever the hell they're using. The thing that makes PDFs so frustrating to parse is what makes them so "secure" and stable to end-users. That's why I advise my students to not just send URLs and web-clips to potential employers, but to have PDF versions of their resumes and work because inevitably, the "boss" wants a printout on his desk...and you don't want his office's shitty printer (and/or whatever IE browser rendered the HTML) to leave a bad first impression.

And let's face it, if you are an end-user who is not a programmer, a PDF is very convenient. You can even do Ctrl-F to look for things...and if you aren't a programmer, that's all the search-power you need to do your compliance work. After the investigation was published, I fielded a lot of questions from auditors who were convinced I had built some amazing proprietary search algorithm...such people just don't know the gap between doing Ctrl-F versus "SELECT * FROM doctors where LAST_NAME like ..." :)

There were a couple of companies who arguably went out of their way to obfuscate their records. They had built websites that consisted of Flash widgets designed to look and act like a (crappy) HTML table...except with Flash, you can prevent the user from select/copy/etc. Unfortunately, the developers of those widgets never told the companies that their Flash containers operated by making XHR requests to external XML/JSON files...so these companies ended up being the easiest to gather the data from.
Not sure how good it would be but maybe someday if I ragequit I'll post it.
As I understand it, that still involves importing the whole file, rather than just the part you need. If that is an issue, lodash is parted out by method, so you can do this instead:

import clone from 'lodash/lang/clone'
According to the article, the claims are based on fake data points, which are common among publishers to catch copying.
What a sad moment in US history. "What do you mean? Wipe it with a cloth?" Translation, I have nothing but contempt for the American people. Any one of us would have been in serious legal trouble for much less.

Nice code, BTW. How is pdftotext when compared to PyPDF2?
Have you looked at ATS? http://www.ats-lang.org/
007 Spectre: la chanson originale interprétée par Sam Smith?
If it can happen for cars it could happen for electronics.
http://www.autonews.com/article/20140125/RETAIL05/301279936/...

I applaud dell for making their repair manuals available online. All companies should be following in their footsteps. Apple give all sorts of information to techs but not to consumers. No repair manuals and Even the support tools are different.
True, he seems to be displaying the same characteristics he criticizes religious folks for by assuming the values and beliefs he derives from his culture are self-evident.
I don't see it happening. There's no way people are going to be strapping things to their faces for social interaction.
MMA likes to tout itself as the closest thing to a pure fight, but it's scarcely less restrictive than boxing. Fish-hooking, biting, eye-gouging, rabbit-punching, breaking and dislocating fingers and toes... those were never allowed. Even UFC 1 didn't come close to actual "anything goes" fights. And much of MMA's popularity is owed to the fact that public outrage has significantly tamed it. Many effective (but permanently damaging) moves are now banned. Fighters wear gloves to prevent broken hands and ugly faces. Refs err on the side of stopping the fight early, rather than letting a fighter suffer significant injury. Ethics-wise, I place MMA in the same bin as boxing. Speaking of which...

It's hard to say whether I find boxing more repugnant than football. If I could wave a magic wand and eliminate one, I'd pick football due to its popularity. The number of people put through that meat grinder is much higher than the number of boxers. That said, I do find boxing abhorrent. Watching a boxing match, I get the same emotions as watching a disaster. Horrifying, yet fascinating. Some part of me is compelled to keep watching. I think most people are similarly affected.
Can you offer up some examples where religious "reasoning" directly improved our understanding of the world?
Mass transit projects in the bay end up being highly disruptive and costing billions a piece. I'd like to see more subways in terms of getting around, but there is plenty of logic in arguing for BRT over trains. I think most cities have that same problem right now, particularly when federal funds for such projects are hard to get or non-existent.
Also, unlike those three countries, Abkhazia is a region of Georgia currently occupied by Russia.
> For the benefit of any who are not sure what you are talking about, could you please elaborate on what some of these "better ways to handle that" are?

While I am not certain what the GP specifically references, I can say that about 40 years ago the Actor model[1] was officially documented. The literature documenting benefits of an Actor model over a callback approach are easily found. For understanding the pain which callback-based systems often produce, a person can familiarize themselves with the Win32 API (disclaimer: this is a masochistic exercise not recommended for anyone).

1 - https://www.cypherpunks.to/erights/history/actors/AIM-410.pd...
I've always wondered why Julia went this route too. They more or less said "because matlab does it"
I know. I'm assuming users saw the alert in one app, and copied it into another.

It's not always easy to actually see the cameras, I can easily imagine users just believing the other app.

Did the at least put the fake cameras in places like the middle of the ocean where it would not actually every alert anyone?
> This vectorized R code turned out to be much faster than the Julia code–more than 1000 times faster, in fact, in the case of simulation 1000000 steps. For 100000000 steps, Julia actually is much faster than R, but the point is that the claims made about Julia’s speed advantage are really overblown.

What are we supposed to glean from this paragraph?
* Make a list of website rss feeds

* Retrieve the rss feeds from the websites

* Parse the rss feeds into a displayable format
How is it not easier to programmatically find/replace specific names/emails and replace with (redacted).

In this day and age it takes a lot more work to print, manually redact and scan than it does to digitally redact permanently. Your story about redacting PDFs is interesting these were not originally PDFs, they were emails.

I can't see any other reason for delivering documents as printed/scanned PDF than to make it more difficult to analyse considering they were originally not paper or PDF. Occams Razor applies here.
If there are any Adroll folks on this thread, really curious to know about Adroll's use of the D programming language, how it has worked out, anecdotes, stories etc. That you use already makes it an attractive place :)
Where do you think the people that would live in new luxury condos go if there are no new luxury condos? Any chance they may buy up existing rental properties and evict long-time residents?
Hey, off topic but are you based in Manilla? I'm headed there soon, would love to chat! (no contact info in your hn profile)
Not all of it is. Only small parts of it.
Blue in one direction, red in the other.
Thanks for sharing your knowledge.
What betrays the rejection of science even more, is making blanket statements or taking strong standpoints, especially on controversial topics. It betrays a propensity for scientists to ignore evidence, or to frame conclusions and experiments to fit their preconceived notions. I would include strong support of religious viewpoints, athiesm and even global warming under this rule.

Once politics or agendas get involved, then science takes a back seat to convincing others that you are right.
The problem is that you may have to stray outside that vectorized bubble, and at that point you enter into a two-language situation if you are using R (e.g. RCpp) or Python (Cython?) - which was one of the motivations for the whole Julia language, to avoid needing to do that.
There's no particularly good reason for police officers to live in Manhattan. Since we have good public transportation you can live in any of the boros and work in Manhattan (not to mention LI, Westchester, Hoboken, Jersey City, etc.)

Since the Bay Area has both crappy public transportation and not enough density it is doubly screwed. But incumbent homeowner NIMBYites and rent are happy, so great I guess?
Anti-Virus Software Maker John McAfee Is Running for President
Think of it as the Petreus doctrine ...
Handling PDFs and OCR is always troublesome.

But in this case, if I understand you correctly, the original source documents were PDF? That they were distributed as PDF for all the reasons you state?

That doesn't apply in this case - the original documents were not PDF, and had no reason to be PDF except to make it more difficult.
OT:

"Why do we always refer to female public figures by their first name, and male ones by their last?"

I heard/read that question somewhere, and it stuck with me, can't stop seeing it. And this is a fine example of that.

Google results:

"Clinton email scandal" 41M results.

"Hillary email scandal" 48M results.

Yes, I do realize hers is a special case, and it's necessary to use her first name to disambiguate wrt to Bill. But the phenomenon exists. Just some thing to keep in mind.

[Edit:

"In the tennis commentary, women athletes were called by only their first names 52.7% of the time, while men were referred to by only their first names 7.8% of the time."

http://www.la84.org/gender-stereotyping-in-televised-sports/

]
It's funny coz in mainland Europe and even in the UK we have had lightning fast internet way before 2011. Should we expect some 'american freedom' soon?
Go 1.5.1
Meanwhile, in Tokyo:

http://www.jreast.co.jp/e/info/map_a4ol.pdf

http://www.tokyometro.jp/en/subwaymap/pdf/routemap_en.pdf
Im a full stackoverflow developer ;)
I'm pretty sure the 6809 is still considered a 8-bit processor. You could treat 2 of the 8-bit registers as a 16-bit, but it was still 8-bit registers.
Because CO kills surprisingly quickly -- unless your commute is in the order of a couple of minutes you'd be too late. Also you don't send a person into a house with a CO leak so asking you neighbour to retrieve your cat would be placing them in danger.

My point is that the smoke alarm and the CO alarm should be exactly what they are simple alarms that allow occupants to escape in an emergency. Adding IOT capabilities doesn't add to the alarm functionality in sensible ways. However, it does risk introducing vulnerabilities. I don't want my smoke alarm to start sending spam emails (this really happened with a smart fridge a couple of years ago).
As much as the rise in "sensory issues" may be real, it could also be occupational therapists trying to generate more business for themselves.

It's happened in South Africa's[1] for-profit private healthcare sector, where wealthy areas with high concentrations of occupational therapists just happen to have enormous rates of diagnosed sensory issues in normal children, to the extent that medical schemes (insurers) have had to ration these treatments (with the tacit approval of parents, who know it's often a scam, but are forced by schools to undertake OT treatments).

Especially as formerly good South African schools have been forced to cut back, and the overall quality of education has deteriorated, OTs have become the "real" teachers in affluent areas, teaching handwriting and other motor skills, often to every child in some schools. And, anecdotally, bright young women who want to work with children aspire to become OTs, rather than teachers nowadays, exacerbating the problem.

Wikipedia has the citations on this issue. https://en.wikipedia.org/wiki/Occupational_therapy#Children_...

If I was an parent of a young child in the U.S., my spidey sense would be very tingley when I read articles like this.

[1] yes South Africa is a third-world country, but there are aspects that are very "First World"
Source? One of the best arguments, that is personally relevant to the work I do, is that indexing in math often starts at 1 (e.g. the indexing of rows and columns of a matrix). Translating this to code results in a mental overhead of mapping the math-index to the code-index, a cost I don't pay in Julia.
mongodb and redis are two compiled modules and we didn't have problems with those. Honestly, there may be others, I don't even know!

We try hard to keep our dependencies up to date to limit the risks of an upgrade. We progressively apply dependencies updates to dev->staging->sandbox->production environments.

Was I worried when node.js forked? sure! but the situation is much better now. I think node.js can move forward smoothly now.
> How is it not easier to programmatically find/replace specific names/emails and replace with (redacted).

Because this isn't possible. How are you going to account for any possible misspellings, accidental spacing or other unknown unknowns? You can't. To properly disseminate things the documents have to run through actual people. Sure, people fuck up things too but they can be much more precise when it comes to processing real, human language than any computer right now.

This is the process the government takes. Convert to PDF, redact, release.

> I can't see any other reason for delivering documents as printed/scanned PDF than to make it more difficult to analyse considering they were originally not paper or PDF. Occams Razor applies here.

You are misusing the meaning of occam's razor. This is actually the easiest, most correct way to disseminate possibly sensitive information from the government that they have available. It sucks. If you can write something better then do it; you can make a ton of money and save the government a whole lot of time. But it better be really, really accurate.
Also the quotes are from my roommates :)
> where a new major version number indicates backwards-compatible changes

lucio was probably referring to this part, where "incompatible" is indeed correct.
Could you elaborate on its differences from the kernel trick. It seems to me @xtacy is exactly right on that modeling point. Training the model using scale appropriate optimization is an orthogonal concern, if that is what you were getting at, i.e. an off the shelf kernelization would not be sufficient to run this at scale.
To be fair, there was another famous Clinton that could make this confusing. I've never heard of Condoleezza Rice, Sarah Palin or Angela Merkel being called by just their first name, although I admit that I don't often hear them being called by just their last name either (maybe except Merkel).
What do you mean by "bliss states"?
Because in general, women are less common, so we can use their common name without people wondering which person we're referring to?

I realize that's a weak justification, but it does make some difference... And 41M vs. 48M does not require a very strong justification.

Of course sometimes the issue is that people use first names in order to intentionally avoid showing respect, but that happens to "dubya" and "jeb" and many other public men as well.
It could just be a matter of overdiagnosis of problems from medical professionals in a for-profit healthcare system.
> I didn't know what bad documentation was until I used Ruby.

Really? I mean, you probably could have made any other point and have it hold even the slightest amount of water.

OK, let's help you out on finding some good documentation on Ruby:

http://ruby-doc.com/docs/ProgrammingRuby/

http://ruby-doc.org/

https://en.wikibooks.org/wiki/Ruby_Programming

http://mislav.uniqpath.com/poignant-guide/book/chapter-1.htm...

http://rubylearning.com/satishtalim/tutorial.html
I thought this was going to be about why an OS needs a database for its own data, instead of a collection of flat files without locking or atomic updates.
'populace' not 'populous'