skysight-inc/HackerNews huggingface dataset:
I think it may be this "widget" (I don't know the WP ecosystem, but this seems reasonable):
http://wordpress.org/extend/plugins/recent-comments-widget-w...

I only see one query in there:
$comments = $wpdb->get_results("SELECT $wpdb->comments.* FROM $wpdb->comments JOIN $wpdb->posts ON $wpdb->posts.ID = $wpdb->comments.comment_post_ID WHERE comment_approved = '1' AND post_status = 'publish' ORDER BY comment_date_gmt DESC LIMIT 150");

I'm not sure why they are fetching 150 (why would you use that many?) but this query could be slow if you have many posts and many comments. Also, the goofy thing is that they are wiping out the cache every time and regenerating it instead of (say) incrementally adding to it.

I'd re-write it with an exists, which may help performance instead of a join (I've seen MySQL be pretty dumb with joins when you basically want an exists):

SELECT whatever
FROM comments
WHERE EXISTS( SELECT * FROM posts WHERE ... )
AND comment_approved = 1
ORDER BY
LIMIT xx

In this case, MySQL may be having a problem where it can't read a multi-column index on post_id and comment_date_gmt DESC (I'm not sure if you can specify ordering in MySQL indexes, been a while), thus it's basically doing an in-memory sort of every approved comment (on a published post, which is likely all of them) in the system, which in his case was about ~200K. This could definitely take several seconds if there isn't enough memory to do it all at once (lots of swapping).

Personally, I'd try and modify the logic to be more conducive to indexing - do you really care if a comment was on a post that you made 10 years ago? MySQL also (IIRC) doesn't have bitmap indexes, so that "comment_approved" thing may or may not invalidate an index usage unless you add it to the index.

I'd probably do something like: the "n" (where n is < 150) most recent comments to a post made within the last n number of days, so you can really cut down on the number of rows you need to sort.
Not all anarchists are teenage rioters who just want to make trouble and listen to punk music. Hell, many (most?) are not even interested in an active (let alone violent...) overthrow, and are no more politically active than any other person of more mainstream political ideologies.

What you are proposing is that the government spy on anyone who falls within a broad category of political classification. I think the issue with that should be self-evident.
Scraping with Node
Here's how I do it:

$ pip install dotcloud
$ echo 'frontend: {"type": "nodejs"}' >> dotcloud.yml
$ echo 'db: {"type": "mongodb"}' >> dotcloud.yml
$ dotcloud push $MYAPP
$ dotloud scale $MYAPP frontend=3 db=3

This will deploy my nodejs app across 3 AZs and setup load-balancing to them, deploy a Mongo replicaset across 3 AZs, setup authentication, and inject connection strings into the app's environment. It's also way cheaper than AWS.

The only difference with OP's setup is that the Mongo ports are publicly accessible. This means authentication is the only thing standing between you and an attacker (and maybe the need to find your particular tcp port among a couple million others in dotCloud's pool).

(disclaimer, I work at dotCloud)
Did you have a point to make? Shitty software being popular doesn't make the authors of that shitty software any less biased when discussing that shitty software.
It might be BS, it might not be:
http://en.wikipedia.org/wiki/Radiation_hormesis
Tweetdeck Feature Requests from Journalists
How can the government serve the people if it can't sustain itself?
RT - Question more (as long as it is against the USA, not Russia)

It's funny that Russia Today always points out the flaws in the USA while having a not really well functioning democracy at home.

Let's release some FSB information for a change?

I am not thinking RT is the root of all evil though. It's definitely a valuable source for information, if you take it with a grain of salt.

[Funny also that they are one of the big media outlets for Assange or Wikileaks/Whistleblowers in general, that are with their information indirectly targeting mostly American Intelligence] - one of the reasons btw why Assange is a hypocrite
UI looks great, except the default scroll-bar on the "Highlight Changes" section.
Dell wants to tune big data apps for ARM servers
Mozillians do the AMA
I'm curious why you think they should be out of business.
So basically, pay for and outsource the tasks that you don't like or find mundane. This is cost prohibitive and a way around or optimising them would be better. I just need to get busy enough to feel forced to.
Speaking as a (at one time) fellow game developer: maybe you shouldn't go ahead and use the niftiest new features instead of being conservative in your choices.

I don't really feel any sympathy here--for the C99 part, okay, but otherwise, none whatsoever.
Facebook up nearly 20%, Zuck makes over $2B
Now View Twitter Conversations with Ease, on your mobile device
You are mostly referring to epistemology and ontology, two rather theoretic branches of philosophy that probably aren't that relevant to software.
The philosophy of free software (even your URL contains the P-Word ;)) makes use of ethical arguments and political philosophy, for examples the ideals of enlightenment.
The age of enlightenment was kickstarted by philosophers, some of whom went to prison for clearly voicing thoughts that seem quite common to us today.

I want to argue that, while modern academic philosophy may be a bit of an ivory tower, philosophy in general isn't synonymous with "detached from practical concerns".
Yes, but what you call the "remnant" still takes too much time. Laundry requires me to sort clothes, put them in a bag, carry them to my building's laundry room, load up and configure the machines, then set a timer so that I don't forget to go back and pick them up. I then need to fold the clothes and put them in their corresponding drawers or hang them in the closet. The worst part in all this is that even though I am not doing the actual task of washing the clothes, I still need to block off a time period, meaning I can't actually be in another location doing other things while laundry is getting done.

Similarly, doing the dishes and commuting can still be annoying despite the automation. Loading and unloading dishes takes a fair amount of time. Commuting requires having to schedule one's time around bus and train schedules.
I would kill for an MacBook ARM. How much power and cycles remain wasted on x86 legacy cruft?

Only Apple could make this kind of huge transition as they've worked for years to be able to put an OSX-derived OS on a tiny iPod form factor (and thus creating the iPhone and iPod touch).

Bringing that back to the laptop world would be truly awesome. They have the ecosystem, toolchain, and numerous successful similar transitions from 68000->PPC->Intel already.
Life Hackers' Anonymous
The problem is that the Nexus 7 doesn't seem to have any "killer app" that really show cases that extra umph in the power dept that wouldn't be possible on an iPad.
...how about Intel's C++ compiler on Windows? (it integrated in Visual Studio and one could even have one compiler on all platforms by using Intel's solution on all supported platforms)
why the downvotes? I was surprised that swipe isn't in other places, asked where he was located, and then said where I'm located. What's the problem with that?
Recommended biographies of self-made businessmen/entrepreneurs?
Do you have any recommendations? What did you find well-written, informative, entertaining, etc?

Cheers
Diagnose iOS Push Problems w/ APNS Script
July of 1868 is a little jacked up, shows up more than once.
Sounds like this is something that's worth addressing on an architectural level.
If they're stockpiling bombs or something and actively working towards criminal activity, sure. I think monitoring of some anti-government groups who rise to that level, such as some groups within the American militia movement, or groups such as Revolutionary Struggle in Greece, is legitimate.

But I don't think that, in a free country, the government should be monitoring people solely for their political views or what kind of books they read, without some actual evidence that they're a danger to anyone. Sure, maybe someone who buys an Ayn Rand book will eventually work to eliminate government, but I'm not sure owning The Fountainhead should land you on a watchlist; and the same should go for reading Proudhon or Kropotkin.

It's also really easy to run into false positives. In the '80s/'90s, for example, the police/media liked to paint a bunch of generally harmless BBSing kids as "dangerous anarchists" because they had an ASCII file of The Anarchist Cookbook—which is violent anarchist literature, after all.
Reverse brain drain: Economic shifts lure migrants home
A previous HN comment about RT as a source, with back-and-forth follow-up comments below:

http://news.ycombinator.com/item?id=4247829
If price is your biggest concern, then by all means, continue using free products. We charge money because the money - and having a sustainable business - allows us to develop the very best product and allows us to provide excellent support.

It is not a secret which features are and aren't available in Enterprise. The documentation and the website are very clear on this.
OK, I get that DangerousMinds posts a ridiculous amount and would definitely be deleted from my account and probably should have to pay for advertising on an ad platform, but what about other use cases:

I run a nonprofit alumni association here in Boston and I use FB as a way to update alumni of changes in events so that we can limit the numbers of emails we send. We were using Facebook as sort of an information platform and don't profit or make any money in any way.

I am very careful to not post too much, even entering in to specific agreements with the national alumni association so that they do not to post ads on our page for their merchandise etc.

What am I supposed to do now? Should I pay out of my pocket to reach users who definitely want to be reached already?

Facebook provides a great service, and they should be compensated, but I will now have to look at other options to potentially reach our group.

---
And the flip side of this is that I would like to see posts from everyone I am friends with that I haven't explicitly blocked from my feed, going through all those names to re-add them seems like an amazing amount of trouble for me.

---
The OP is hard to sympathize with, but he/she has a good point.
https://www.facebook.com/business/power-of-advertising this claims facebook gets 3.2 bn likes everyday. http://www.digitaltrends.com/social-media/facebook-now-has-9... this says facebook has 500+ mn daily users.

I going to describe my own hypothesis called "Dilution of your likes":

The above two numbers mean, one user is doing 6 likes on an average. And that fellow is doing the samething everyday. He is of course going through more brands & websites. No. of likes in a year is 6365=2190. Your site has garnered 50000 likes so far. Lets assume all are from different users. And you had been in business for 2 yrs (I think you mentioned it above). Over NEXT (assuming the same stats for facebook and your like growth) two years,
your existing 50000 unique fans have also liked 219050000=109,500,000 (100 mn likes). And you are expected to have another 50000 to 100,000 likes with a similar growth.
A single like on your website is valued at 1 in 1 mn + (1 to 2 mn) = 2 to 3 mn. taking account of your new likes also.

Everybody is talking about the number of likes in their website and thats what facebook is showing. EdgeRank (IMHO) looks at the ratio between your likes and their all other likes - let me tell you why - in order to compare yourself to others and decide which post is relavent to him. And I am also making an educated guess that EdgeRank also looks at the timestamp of the like they gave you.

I liked you yesterday. Today I like Coke. That could be interpreted as Coke is my new Dangerousminds (to some degree atleast). And tomorrow Pepsi is my new Coke. Just speculating here... And I request someone who understands EdgeRank can correct my guess please. And your frequency of writing 12 posts a day could also be made known if I am facebook, I will see the latest like on your site and for 24 hrs / 12 = 2 hrs you are not updating your content and maybe facebook wants to take its users to new posts that they will like in those two hours. And Coke is not your competition because don't forget he has liked 1 mn other things which even if 1 % of them is creating a new post only once 1 day, your post is competing with 10,000 posts within those 2 hours. And Even if the user is refreshing for new posts every second of the two hours, 7200 times, you have more than 1 competition.

Every post on facebook must be given a number using some logic. You can compare only two numbers and decide. And EdgeRank assigns a number to all fed posts.

And they cant compare your post with all other posts to decide. One obvious way is to cluster the ones according to the user and decide as quickly as possible (within one sec max). How much computation can EdgeRank do for one user by the way? Cloud computing for 1 user? You might need the whole sky.

All are seeing the number of likes. Thats the numerator. But the total number of likes by the users in facebook is the denominator. And that is growing. Diluting the value of your post each time your own fan who liked you is liking something else.

Please comment. Thank you.
Preparing food is one of the most rewarding activities in my life, and the same is true for many of my friends.

Maybe it's an attitude thing?
Facebook's data doesn't tell them how close you actually are to people, only how often you like/share/respond to their content -- and how many other people like their stuff.

The guy who spams 30 lame political memes per day, who I might argue with a couple times a week, gets treated like my best friend. My mom, who posts maybe once a month and has a limited friends list, gets hidden away in the deep recesses of the system.
The issue is not that of government is trying to preserve itself. This is a desirable outcome, if all else were equal. The issue is that, in this case preservation was given priority above other goals, among them preserving the right of people to freely associate.
I'd be shocked to learn they didn't at least have prototype MacBooks running ARM processors in the lab for the last couple years, as they did with x86 once upon a time. Very compelling case from both a product and business perspective. Longer battery life, higher hardware margins.
Broken on Purpose: Why Getting It Wrong Pays More Than Getting It Right
Yes, my point is that Hydroponics use very little water while traditional agriculture uses a large amount. If water were actually as expensive as it's scarcity, Hydroponics would be more competitive.
Eh? That comment looked like a troll?
Government is sustained (or abolished) by the people who employ it. Government that can self-sustain seems dangerously close to a government that doesn't need the people it serves.
I'm always conflicted about interesting comments which link to something I read and learn from, but which are needlessly insulting. The grandparent linked to FightingAging.com and I read the article and clicked on some of the links and found it informative, though not convincing. But I cringe when he says, "Nonsense about antioxidants in the diet is exactly that: nonsense."

So do I upvote because I learned something from his comment, or downvote because his tone degrades the quality of discourse on Hacker News? Clearly pg says "downvote", and I often do, but I'm always on the fence about it.
Wikipedia mobile gets a new look
More than one event happened in July 1868.

For onlookers who would like a wall map that shows many of these territorial changes, the United States Geological Survey map UNITED STATES OF AMERICA PUBLIC LAND SURVEYS,

https://store.usgs.gov/yimages/PDF/101208.pdf

http://store.usgs.gov/b2c_usgs/catalog/query/(xcm=r3standard...

may be of interest. The usability of the federal government online map store leaves a LOT to be desired, but I have successfully ordered a copy of this map just a few months ago, and it looks gorgeous on a sufficiently large wall. (I first saw this in person at a map store in DC, back in the 1980s, and my previous copy of the map was tattered, so I ordered a fresh copy this year.)
If you get a new 13" Retina MBP, you'll have the best of all worlds. If you need a lower res, you got it. If you need a higher res, you got it.

I hadn't anticipated this but since every resolution looks excellent on a retina display, I'm switching quite often for different tasks.
Why should the government preemptively keep tabs on anyone? Should the EPA and HUD be able to place sleeper agents in right wing community organizations to monitor them? Should pro-secessionist historians have their phones bugged and be trailed because they don't believe in the legitimacy of the federal state?

Aside from that general principle, there's also the reality of how its implemented. Most of the time sleeper agents are used to get evidence for trumped up, meaningless charges like "interstate travel with intent to riot." That's the best case scenario. At worst, these agents, on not finding something of even minor note, will attempt to incite violence to prove that "those anarchists have really been violent all along." See, for instance, Brandon Darby.

Edited to add: I do, for the record, think that if there's actual evidence that someone's trying to blow up a bridge, monitoring is appropriate (though I don't see why simply arresting them wouldn't usually be sufficient if that were the case). But usually these things are more fishing expeditions than anything, against people whose ideology the State finds distasteful.
Please. While I'm sure people just talk about their own opinions in many cases, it also happens all the time that people criticize the specs or other attributes of a new product precisely because they think it won't appeal to the masses.
Given the patent-trolling that NetApp was waging against Sun for ZFS, perhaps Apple was wise to stay away (let's leave aside how depressing that is).
Salesforce.com lays off Radian6 employees
It's a popular word in Boston.
A government, if it is to serve the people, should only exist as long as the people will it.

If the people present a democratic threat to the government, the government should fade from existence peacefully. If people present a non-democratic threat to the government, then the government should act to protect itself.

Anarchists do not, categorically, present (or seek to present) a non-democratic threat to the democracy.

Do you want to keep tabs on violent* anarchists? Knock yourself out. I have no particular issue with that.
Or worse, street view on the PCT requires a paid "premium" subscription.
Or g++ / Clang under Cygwin. They are ubiquitous compilers because they work pretty much everywhere, in some way, somehow.
This seems ridiculously nice to me, but I haven't heard much buzz around this in the community. Any thoughts on why there's comparatively less noise about dotCloud's offering? It seems far nicer in many ways than others.

From what I remember when trying to get the copy/paste instructions written for Kandan so others could deploy to dotCloud to get started with it, there was a steeper learning curve for dotCloud than for other services (with the possible exception of CloudFoundry, which was a sunk cost for us at that point anyway...). Maybe the on-boarding is a bit tough for new users? Where do you see the most significant drop-off in your funnel? If you don't mind sharing, of course.
Simple Wave Simulation with Numba and PyGame
Show HN: Safely run multiple applications on the page using Web Workers
The #1 UX Failure of New Products
> Instead, the evidence required is data points on the side of "no publicity -> no resolution".

Which by definition we don't hear about. In fact, that's why - if Amazon are rational - they'd give special treatment to issues that get publicity, so it seems like they handle customer issues better. There is essentially no downside for them in doing this; it's not like they'll be hurt by the publicity backlash from incidents that went unresolved because they got no publicity.
on a group whose professed ideology is the elimination of government

Hmmm - yes, why not: http://www.gop.com/2012-republican-platform_Reforming/#Item4
Can you actually get similar results to paying for promotion just by having really engaging, viral content?

My understanding was that this doesn't work so well anymore. I think paid promotion should be a way of boosting the visibility of content, but definitely not at the expense of content that would have spread virally if it wasn't artificially limited.
Small video that shows how it works: http://www.youtube.com/watch?v=vAMTomxQV80&feature=plcp
If you cursorily examine the history of anarchism, there are those who seek to achieve a violent revolution, and there are those who seek to achieve a peaceful revolution.

It's of course reasonable to keep an eye on seditious groups: these almost by definition imperil life, liberty, property, etc. It is another thing altogether to keep an eye on someone who wants to peacefully change government via peaceful and lawful means.
intelcc is great, with error messages significantly more clear than gcc or msvc (not as good as clang), and solid performance. But it is more expensive than msvc and I don't believe there is a free version like visual studio express.
I'm surprised Charleston doesn't already have these - I live in a mid-sized city nowhere near NYC or SF and we have versions of these. You should check around for alternates.
Rand was a minarchist, not an anarchist; in any case.
This is great news for the broader community, even if you do not have a use for Druid per se.

Database engines designed for real-time analytics have a significantly different internal structure than either traditional OLTP or popular analytical systems like Hadoop. Most people just try to (badly) fit real-time analytic workloads into a database engine not designed for it. Druid is the first open source example I am aware of that has internals designed for these types of workloads.

Few software engineers know what the inside of a real-time analytical database looks like. This will provide a great starting point. (The only major missing component is the non-trivial, custom I/O scheduling engine required to back these engines to disk instead of in-memory.)
> the government is created by the people to serve the people.

Be careful, this is only true in certain countries. Sometimes governments are created by someone who is the best warlord & administrator, c.f., Charlemagne.
I suspect Russian media bias is not so fundamentally different from American media bias. The two complement each other neatly I think; reading both side by side is enlightening. Al Jazeera is another good one to throw into the mix (and their international reporting of "non-partisan" things is superb).
And is (peacefully) working to eliminate gov't illegal in and of it's self? Could congress vote to dissolve, or amend the constitution to massively reduce the size and scope of the gov't?
Get notified when somebody mentions you on IRC
Let's completely ignore the fact that most compromises of password databases are of live systems, not extraneous backups. What the hell is the point of the backup? You didn't back up the salts, so restoring the backup leaves you with a broken, useless password database.
I think it is interesting that the writing advice I see promoted each year around the YC application cycle is more or less identical to the advice that I received when applying to graduate research fellowships. Have you seen any over representation of former fellowships winners in the "well written applications" stack in the past?
Here in the UK, a group of Hungarian dentists did this with inflatable surgeries (and could offer Eastern European rates too): http://www.dailymail.co.uk/health/article-1051660/Deflated-c...