skysight-inc/HackerNews huggingface dataset:
I'm rather older than the average HNer, and it's hard to express how profound the worldview shift was when I read in 1983 that India was sending food to relieve the Ethiopian famine.

I grew up in the period when parents trying to get their children to finish a meal said "Think of the starving children in India." The meme was pervasive because it was true.
Obama is not solely responsible for everything that goes on in the USG, but in this case he bears enough responsibility that he can and should be held accountable.

It doesn't matter where the pressure came from to make Obama go down this road. The bottom line is that Obama chose to go down this road.

Some people are saying, "Well, maybe he wasn't in the loop." If that is the case, and Obama was mislead as to the scope and nature of what the NSA was doing, he should've come down on the NSA HARD. The fact that he got up on TV and stammered on about balancing security and privacy and "welcoming the debate" means he was not alarmed by what was revealed and he had not intention of stopping it. He has done nothing to rein this program in.

Make no mistake, Obama knew enough to know what was going on was wrong. The fact that he chose to go down the wrong path means he is responsible and he should be impeached.
I can't figure out a point to this conversation other than the pure link-bait and troll value.
Let me try to answer: Slow - as in average Top loads (on CentOS) staying between 1 and 2 pretty much throughout the day; closer to 2 rather than to 1, peaking ALL the way up to 10 and even beyond several times a day, for periods as long as 15 to 30 minutes.

Storage engine: MyISAM
The thing about these articles that I hate is that they all try to play to the letter of the law as if we're playing word games. But in real life, in the courts( of public opinion and the judicial ones), where this stuff matters, its almost always been about the spirit of the law.

People do get thrown into jail for technicality (minimum sentencing laws are moronic), but this is one of those cases where circumstance and plain common sense would prevail.
Option 4) would be to hire an expert in these matters.

100M rows is not a lot of data nowadays.
Lego robot that strips DRM off Kindle books
"Close enough" doesn't count :)
All in all, drawing comparisons between something like a domain and real world objects are disingenuous at best. I'm not going to detail how apple.com is different from your Ford Pinto.

You do not own a domain. That is false right off the bat. And no, you cannot do with it as you please. For example, buying a trademarked name and then trying to extort money out of the owner of said trademark is not allowed.

If you are renting a domain with the sole intent to deprive someone else the ability to use it unless they pay an extortionist fee, that is wrong. It goes against the free spirit that the internet was built on. The fee charged is at least in part to prevent a massive "land grab" of domains that are to be sold off at absurd prices.
Bogleheads.org is an incredible resource. It's like "HN for investments", IMHO.
Hey, thanks :) We are actually considering this, but it skipped my mind while making the post.
Or worse, removing the fiber during the juicing process.
http://www.imdb.com/title/tt0071360/

This movie is boring, BTW.
Indeed, the scale of the issue extends to the very young. The worst cases of smoking-related cancer are the result of starting smoking at a very young age, not unlike how obesity and type 1 diabetes are especially destructive when encountered at very young ages.
"I searched for "escrow.com" reviews and found some negative ones. So there's one reason why someone might not use it."

With all due respect (as they say) does this really add anything helpful to a discussion? It's like "I've searched online and people say that wordpress has security issues..."

First of all, as pointed out by others in this thread, that is not the case with escrow.com who I have personally used over the years (and seen used) for numerous transactions. And it is who people use for these transactions, is a specialist licensed in all 50 states (no small feat). Additionally the process is as close to bullet proof in terms of protecting both buyer and seller. And they aren't so large (ala ebay) that if you have a problem you can't get someone on the phone to rectify. Lastly, the President (Brandon Abbey) replies to emails (and in fact adopted a suggestion that I had into escrow.com service).

"Another reason would be that as a general escrow service they may not understand the domain escrow process as well as a company that only does DNS escrow."

Let me assure you that they know that process very well and the industry has responded to that. They are used by buyers, sellers, attorneys, everyone. I get the point you are making which in a general sense can be a valid one. But not applicable here.
A tale of two parsers
AT&T's site wasn't an unlocked house, it was an unlocked corporation.

If your personal site gets breached, it's akin to someone having walked into an unlocked house. You have a right to keep your house unlocked because the only one that's going to be hurt by your negligence is you and possibly your family.

A business owner that stores massive amounts of private information is not allowed to keep his doors unlocked, because it amounts to gross negligence. It wouldn't be right for someone to walk right in and steal everything, but the business should be held accountable, because they don't have the right not to secure their customers private information.
Qemu(KVM) works as well.
You are presuming that your users would not write down the password they choose for themselves as well, perhaps on the same sheet of paper.

I'll leave this final thought--how many other websites have implemented a double password system like the one you're proposing? I don't know of any.

Is that because you have come up with a more secure solution that no one else has thought of? Or that your approach does not confer the security advantages that you think it does? Which is the more likely explanation?
Why geeks are becoming more influential
What exactly is getting slow? Inserts? Updates? Queries? Which ones? Have you looked at the slow query log? Have you checked the plans for the slow queries?

Are these MyISAM tables or InnoDB?

150GB and 100M records is not huge, not even close. You are looking for a quick fix and there isn't one. You need to start with (2).
Let's say the President was not in the loop, and all of this stuff was a surprise to him. Why has he not taken any decisive action to fix the problem?

He asked for the resignation of the head of the IRS after the political targeting scandal. He asked for the resignation of General McChrystal after he talked trash about Obama in a Rolling Stone article. But in this brazen assault by the NSA on the very foundations of our government Obama has barely responded at all. Director Clapper flat out lied to Congress and Obama hasn't even lifted a finger.

That to me indicates that Obama is absolutely supportive of what the NSA is doing.
Please let me know what more info would be helpful and I'll be happy to provide the same.
I think there is a misunderstanding of my point. I'm trying to say that at the point that you list your domain that you intended to use but do not for a crazy sum, that is when you become a squatter. Simply holding onto a site with the intent to use it for a few years isn't. It's all about the spirit and intention.
You are grossly oversimplifying a complicated process of digesting food and its interaction with the overal metabolism of the body. Yes, calories play a factor, but also in what form you ingest them. Then there's genetic factors, gut bacteria, physical exercise and probably a whole slew of other things that interact with each other.
Some countries take an extreme stance on driving-related offenses. A few countries are actually so worried about speeding that they have banned the sale of racing-related video-games.

Hell, in Virginia a few years back they implemented insanely high fines for all sorts of minor moving violations. Some of the offenses cost several thousand dollars.
Do you have some other measurements? slow_log, queries without indexes, low key cache usage? Load is just one metric and can be very deceiving. Do you have any backup system which hits the disks at the same time, batch jobs, or something similar? Depending on your workload, "load" can vary - it just means the writes are being queued up.

It's definitely not a good sign, but try to get more specific. I've seen servers doing heavy network I/O with "normal" load over 5 times the number of cores.

Also, unless you're doing loads of selects and very few modifications, you could gain a lot by switching to InnoDB, or XtraDB, rather than MyISAM.
The last correction is a little tricky. Out of the seven occurrences of the string "James'" only two are incorrect. In the other cases "James'" shows ownership, although there's some debate on if it should be "James's" instead.

Sorry for nitpicking, but my name is James, so I've dealt with this a lot over the years. :)
I'm a psychiatrist, and I disagree with much of your post. I see below you mentioned going to a psychiatry conference many times, but if it was with the same docs why did you expect a higher level of scientific discourse? It's true that there are crummy psychiatrists, but please don't throw the rest of us under a bus. At our patient conferences, not being to cite articles to back up your treatment plan would be considered an embarrassment.

I think this article puts psychiatry's dilemma into some good perspective:
http://www.sciencebasedmedicine.org/dsm-5-and-the-fight-for-...

I do think that it's interesting how people conceive of psychiatry. We cannot really objectively measure or test pain. There's no blood test or scan that confirms it. But as everyone has experienced it, nobody doubts it exists. There's migraine headaches, which are, like psychiatric illness, diagnosed based on history and symptoms. It's pretty uncontroversial. Yet, as everyone believes themselves to be an expert in behavior, if they have not experienced or known someone with mental illness, it's suddenly all invented.
There are Clojure versions of the examples from the book by Stuart Halloway [1] and Michael Fogus [2]

[1] http://thinkrelevance.com/blog/2008/12/12/on-lisp-clojure

[2] http://blog.fogus.me/tag/onlisp/
It does for all the irritated people that can't use their new domains on the tens of thousands of systems with rigid regex like this. Even if it's not breaking anything today, it's certain it will in the future.
stackoverflow -> this way
> He walked into an unlocked house,

He sent an HTTP GET request, and the server responded. This isn't walking into an unlocked house. It's more like walking into an unlocked storefront during business hours, asking permission to view a certain item behind the counter, and being granted said permission by the clerk, who hands it to you.

> Just because he didn't use a crowbar doesn't make it any less intentionally criminal.

If those documents were not supposed to be viewable, the server should reject the request. Making a request is not a crime. You are literally asking, "Can I please see the document stored at $LOCATION?" If the answer is no, the server has a means to do that: send an HTTP 403 response.

The "unlocked house" analogy might hold if he tried to ssh into their server as the root user, but in this case, AT&T should have been held responsible for gross negligence for allowing people browsing[0] their open "storefront" (their website) access to personal customer information.

To use another analogy, if you submitted a FOIA request for classified documents, can the government satisfy your request (by sending you the documents) and then charge you with a felony for requesting those documents? I wager that most people would say that the fault lies with the government for failing to deny your request.

Publishing the documents later on is a separate matter, but the crux of weev's case focused on the fact that he obtained them, not the fact that he published them, which is maddening, because that logic would break the entire model of the web by breaking HTTP.

[0] Not to get too hung up on terminology, but notice that we use the term "browsing" the web to refer to HTTP requests, but we don't talk about "browsing" an ssh login.
C2: The Third Manifesto
>Bradley will spend rest of his life in jail.

Are you sure about that? Jeffrey Carney, an American who worked for the US Air Force and spied for the DDR, was sentenced to 38 years in prison, but only ended up serving 11 years.
netflix thinks i will give it 4.6 stars...did you like The Lives of Others?

http://www.imdb.com/title/tt0405094/
I'm somewhat confused, exit nodes are not used when connecting to tor services, right? Only when you use tor to connect to the regular web.
The domains I added seem to be on my profile but have been removed from the browsing list.

Any idea why?
Creating a new account with a fake name directly interacts with the company's server. Looking at a roadside sign requires no activity on the part of the sign.
For one thing, that will use much more memory and take more time to compute.
Yes, however there is a coordinated effort on a global scale to cause people to be addicted to a substance to the detriment of their health. That is the key difference.
Yes, we enable slow query logs from time to time, look at those and try to optimize for those. MyISAM tables.

We've been cycling frequently (and painfully) through (2) (and less frequently through (1)) for the best part of three years now, so please don't accuse us at least of looking for a quick fix :)
I have a little bit of experience dealing with large datasets and MySQL. This is going to be a little counter-intuitive to standard startup culture advice, but generally, the engineering effort to optimize databases past the initial live flow is not worth throwing money at the problem. You have to weigh the fixed cost of the optimization and the variable cost of the upkeep of the system against simply patching the system for now.

If you are willing to throw money at the problem, which you seem like you're wavering on, here are some options on how to throw money at the problem:

1. If you are willing to be hands on and maintain your MySQL cluster yourselves, you should move away from EC2 (I am presuming) and to a local collo where you can install super fatty SSD computers with massive RAID setups that will greatly improve your performance per server (on the magnitude of up to 10x)

2. You can do a hybrid solution with your existing infrastructure. It sounds like a lot of the data is not necessarily going to be used that much (tracking all events probably, from what I am assuming, or something big data intensive like that), you can throw that into a separate database infrastructure.

If my assumption is correct, I am presuming you are using a large portion for the database for stat tracking, and not user information, then the "proper" way to throw it somewhere is to put it into S3 as fat logs that you can later use something like map reduce to process. Other options for more efficient storage are Redis and MongoDB.

3. We have taken this to the extreme and actually moved all of our live data to DynamoDB. It is a NoSql database storage system operated by Amazon. This has let us concentrate on features and the user experience. The cost is our database is probably 5-10 times more expensive than a self rolled Redis SSD backed equivalent hosted at our local collo.

------

Just some other general database scaling advice for MySQL. The steps to scaling your MySQL database for live use are as follows:

1. Do not use any relational calls on your data. Relational calls are useful for databases that aren't used to manage live web transactions as it can seriously back up your system.

2. Put indexes on all of your heavily used columns for finding data.

3. Look at the slow queries and optimize those queries out.

4. Call up Percona and ask for a full consultation to make sure your configs and systems are set up properly for MySQL.

http://www.percona.com/products/mysql-consulting/overview

5. Email me if you have more questions charlesju gmail
The problem with this analogy is that trespassing on a physical property and altering the user agent when making a query to a public server are totally incomparable.

It's more like you're handing out personal documents on the street to everyone with a mustache and some guy comes up with a fake one and you get tricked.
A billboard is bad metaphor for a website. With a billboard, you can get the information while standing in public or private space not owned or controlled by the advertiser. So a billboard is more like banner ad than a website. A website as a public store seems to be the better metaphor.

That could mean that creating a new account after your old account was banned could be a crime. That's like putting on dark sunglasses and a beard and walking back into the store after you've been kicked out. It's trespassing which is a crime. The difference is in the real world, simple trespass does not result in a life-altering felony conviction with a jail sentence.
Blending speeds up digestion and reduces satiety versus eating whole fruit, but (unlike juicing) I haven't seen any evidence that it destroys fiber. Do you have a reference?
We need a social-shift that treats sugary drinks more like we treat alcohol. I'm not saying let's only sell Coca-Cola to 21-year-olds, but rather that the social stigma should be different.

A sugary beverage should be a celebratory drink, reserved for special occasions, like beer or wine, not a staple of our diet.
You could easily write at length on the efficacy of water in putting out fires:

You can put out a campfire with water, but adding
water to a grease fire does the opposite. So obviously
the use of water to put out fires is nothing but hokum!
good call. there's a lot of free resources / open source projects with tools for optimization and locating pain points/bottle necks. i'd check those out first. see the types of queries that are slowing you down. then optimize.
> What about less strict and more used languages like C or Java?

there already exists a system for verifying C, Astree (http://www.absint.com/astree/index.htm). Airbus, volkswagen, and similar companies use astree (they are, as I understand it, required to by EU law) to verify safety-critical software in their airplanes and cars. though astree has some large limitations on the C code it can verify, for example, no dynamically allocated memory or recursion.

investigating why it has these limitations is a good way to begin investigating what our current limitations are when formally reasoning about computer programs, and why C is so terrible to assure...
To my knowledge, Facebook has never set a limit on your photos, presumably for essentially the same reason: there's a network effect benefit from me posting my stuff on Facebook, or on Flickr. Me posting my photos will help recruit my grandmother. Me backing up more of my data on Dropbox will help recruit no one.

If I'm adding "content", it makes sense to let me add as much as possible, for free.
Should you build it if nobody comes?
This looks very interesting. a game I can play without feeling like I am wasting my time
Without doing an analysis, which is really warranted, here are some coarse grain recommendations:

1) Get off VPS if you can. If you can't check out linode.com; they offer better price/performance than most cloud services.

2) Take a look at the Percona build of MySQL - it is faster, especially with more cores.

3) Use in memory tables if possible

4) Switch to InnoDB or XtraDB (in the case of Percona) tables... MyISAM implements table level locking, whereas InnoDB and XtraDB implement only row level locking.
There is no silver bullet.

1) Analyze your indexes on all tables. Start with the high volume insert/read tables.

2) Look at your slow query log. Pick the slowest three queries. Optimize them. Setup a recurring meeting with your team to do this every week.

3) Start looking at what data can be flattened and is less important and could be stuck in a key value datastore.

4) Consider loading a replica slave server. Off load some of high volume read queries to the replica. Also serves as redundancy.

5) Consider where it may make sense to move tables to InnoDB. Table-level locking can be extremely time consuming when traffic is high. Row-level locking can help here.

6) Figure out what your hardware upgrade path looks like. You will have to do this eventually. Identify when you might hit a hardware ceiling with your hosting provider and get a plan in place. Coordinate with your marketing/sales team and upgrade before you hit a traffic peak, not during.
I have been told that this is only the case in America (and I guess Asia). in Europe, there are laws that require the use of safety-validation tools and worst-case execution time tools on code that will be used in safety critical applications, for example, flight control, process control, etc.
I didn't watch The Lives of Others (will do, thanks for suggestion).

The Conversation's IMDB rating is 8.0, which is why I watched it, and while the movie was not bad, it was boring :)
Anyone who ends a tenuous argument with "anyone who argues against this is (insert any insult here)" is being ridiculous.
Neat! Thanks for the instructions - that's definitely the easiest way to play around with Plan9 that I've come across (but I guess I haven't been looking too hard...)
Thanks - 4) has been on the cards, I just forgot to mention it.
The smart people like Schneier tend to think that the mathematics of modern encryption is solid. It seems much more likely that a backdoor in an algorithm is detected by academia than a backdoor in some hardware module or in the implementation of some proprietary software.
ECDSA verification on P-256 is slower than RSA verification with 1024-bit or 2048-bit modulus, but they are thought to achieve such vastly different security levels that comparing them at all for performance is wrong.
The scenario is that a US foreigner mentioned we use jello for jam. We use the word jam.

Don't reply to this comment.
This proposal is too aggressive at deprecating ciphers that are the only option for some browsers (e.g., IE8). It would be useful to add an icon to the address bar that indicates the security level of the crypto used (PFS or not, etc.)
Futuristic touch-free writing
Apparently the lowered glycemic index for foods
of a smaller particle size is only for starchy
foods (smaller particles hydrolyze easier,
making them higher GI). So while my statement
may have held true for starches, it wouldn't for
fruits. I have no idea about smoothies! It's out
of the scope of the paper, though, so all we can
say is that the study suggests that juicing
increases diabetic risk and whole fruits lower
it.

Source: http://www.reddit.com/r/veg/comments/1le10o/eating_fruit_cut...
A truly horrifying story!
Cant people just eat actual fruit? Is that really so inconvenient these days? All that energy wasted to process, package, transport, etc. Just eat a damn fruit.

I'd love to know how much of this pointlessly processed food contributes to environmental problems compared to cars, for example.