skysight-inc/HackerNews huggingface dataset:
I don't see such a sharp divergence as a computer science major working in a top statistics department. Statistics does not magically work well in hard sciences and machine learning has worked very well in many fields. I don't know if you consider biology hard science but biostatistics has many pitfalls many sciences fall into, and highly regarded statisticians can come to opposite conclusions on same data.

Statistical theory is actually applied probability, often called mathematical statistics. Math majors would feel right at home. In fact math majors look down on statistics major for lack of rigor and they have a point. Two years of classes in a five years phd program isn't enough to perfect knowledge of measure theory. But the more important problem is that stats training leave out computing enough that it impacts works coming out of stats department.

This gets back to difference between machine learning and statistics. Machine learning research embraces all fields of engineering, approximation and estimation, numerical analysis, optimization, plus statistics. Since so much of scientific advances can be attributed to computational improvements, it is natural that the more computational oriented fields are ahead of less computational fields. LASSO has been all the rage in statistics recently when it largely relied on works in convex programming. And signaling processing community in EE and CS are leagues ahead of statisticians in the sophistication and scales of problems they can tackle. Computational statistics is an attempt to remedy computational shortcoming of traditional statistics, but we have yet to see visible impact in term of high-impact work from statistics departments.

Having said all that, computer science departments do have the problem of not fully understanding the statistical foundation of machine learning methods. But this is not the case for CS in prestigious schools such as Berkeley and Stanford and MIT. Work coming out of these places are theoretically sound yet application oriented. One needs to just look at NIPs papers to appreciate the breadth and depth of expertise available in machine community.

For a good reading on bridging statistics and machine learning, read paper by an inventor of random forest, Leo Breiman, "Statistical Modeling: The Two Cultures." It is a well regarded paper by a renown probabilist and statistician who cares about utility of statistics as used in the real world.
I've modelled a society with 1.0 birth rate and everyone died. And it's not like died in a million years; no, the last "person" was born something like 150 years from the start.

Having said that, why would anyone live in the remote countryside? In a rural town? We can't bring modern standards of entertainment and culture to the countryside. Museums, clubs with modern live music, theatres, circuses - you can't have that and that's what make you a modern person.

I guess most people will be living in fifty kilometer radius from a million plus population hub. That's what we should have.
Hypothetically, if you were hiring a front end developer, would you see his stand up comedy hobby as a detriment? Asking for a friend.
Protip frozenport: Don't take HN too seriously.
Do you want to take your hand out of the fire? Why?

Maybe because it hurts like hell? Just guessing...
It does if everything is made in highly automated factories and you have a lot of unemployed.
>> you have to actively manage your career

I completely agree with this statement. Nowhere in school are you prepared or told that you will have to manage your career, and no one will do it for you. I think that's the biggest thing left off of this list. Schooling is 12+ years of following steps and getting to the next one is an easy, clear, and direct path that's been laid out for you. The real world has no such thing, often the are not clear paths to get up to the next step, you have to figure this out yourself.

I think another big change from school to working life is that it is easy to get stuck in a "rut", in the sense that life is sometimes the same, day in and out, for months or even years. Yes, in school you are busy and frequently work hard, and often don't have all the time you like. But no matter what, in 4 months, everything is going to be different. Different classes with different people in different buildings. You will meet new people and make new friends and do different work. If you're in a social group in college, some people graduate and leave and new people come every year. It keeps things interesting. The real world doesn't change things up that often, and sometimes that sucks. A lot. I think variety is the spice of life, and I thrive on new and evolving friendships and intellectual problems. Being in a static state can be a drag, but is very very common for most workplaces, and that can spread out to the other activities in your life as well.

So I guess the two items I'd add to the list are:

* nobody is going to tell you how to advance, it's up to you to manage your career/future

*Things such as friendships and workloads can/will become more static, learn how to cope with this, or learn how to mitigate it.
No, I mean which way is the photon traveling - left or right? (Relative to a line pointing "down".)

The photon is traveling radially outward; that means it is traveling in a direction opposite to a line pointing "down". At least, that's the way it's traveling spatially. In spacetime, a photon at the horizon is traveling along a curve of constant radial coordinate r (and constant angular coordinates theta, phi if you include them). A photon inside the horizon is traveling along a curve of decreasing radial coordinate r; inside the horizon even outgoing null curves (the worldlines of outgoing light beams) have decreasing r.

Emit a photon from just inside the event horizon, traveling directly away from "down".
What does the photon do?

According to an observer that is falling inward just inside the event horizon, the photon moves radially outward at the speed of light.

Does it go into orbit?

No. As you say, it has no angular momentum, but that's not the primary reason; the primary reason is that there are no "orbits" inside the horizon. In fact, there are no "orbits" inside a radius of 3/2 the horizon radius; at that radius, a photon can orbit the hole in a circular orbit.

Does it hit the black hole?

Eventually, yes.

(How did it turn around without ever curving?)

It didn't. The spacetime itself is curved inside the horizon to such an extent that even a photon traveling radially outward ends up hitting the singularity.

Once again, your intuitions about how "space" works and how things "travel in space" break down inside the horizon. You are thinking of a point with radius r < 2M, i.e., just inside the horizon, as a "place in space". It isn't. It's more correct to think of it as a "moment of time". The horizon itself is also not a place in space; it's more correct to think of it as an outgoing light beam.

Does it just travel forever thinking it's moving away from the black hole, but not actually going anywhere?

This is one way (but probably not the best way) to visualize what a photon exactly at the horizon does; it is moving radially outward at the speed of light, but because of the curvature of spacetime at the horizon it stays at the horizon.

(i.e. redshift into nothingness, since it's constantly fighting gravity)

"Redshift" is relative; you have to specify what observer is receiving the photon and measuring its frequency.

Tell me what it does from the POV of the photon, not the black hole.

There is no such thing as "the POV of the photon"; photons don't have "rest frames" in the usual sense of that term. I said above what the photon does from the POV of an observer falling into the hole.
NY Times jumps into mini digital book market
I learned Visual Basic .NET in high school. It honestly wasn't nearly as bad as its reputation. It's more like a watered down C#. It's pretty decent once you get past the syntax. There's still no reason to pick it over C# though. One thing I can say I prefer in VB.NET is the handles syntax - private sub blah blah .. handles object.event. A bit more elegant than C#'s making the event function and adding it to the object with +=.
My heart really goes out to you. Can you imagine replacing "autism" with "type 1 diabetes" in your story and any health insurance company acting that way? Unthinkable. I hope our culture gets to the point where it stops regarding some illnesses as unworthy of care.
Creating barcodes in java web applications
I would say it depends on enough factors that pinning down an answer here is going to be difficult. I would recommend however, that if this is a web and SQL type data focused site, that you split those services if at all possible.

You can get a single beefy box and run apache/nginx/lighttpd(what???), mysql, memcached and anything else all on one system and there are certainly people that make it work... but given the number of times I have been called in to fix these kinds of scenarios and make them work properly, I can say from experience that if you expect any amount of traffic you invest in the ability to abstract these various services away from a single machine with ease (or just have them separate to start with).

Perhaps if you do not have a lot of operating capital to begin with, virtualization/cloud options would be a good place to start. You can have with virtualization that single beefy machine and still separate out the various pieces of the infrastructure and then allow to add additional virtualization hosts to the cluster usually with a click or two.

I am happy to answer other questions to scaling (within reason) if you post in response or mail me. I'd rather you start things in a good direction and give away free advice than see a company fail because of architecture decisions which hobble expansion in the future!
Japan is overpopulated as it is. I fail to see anything wrong with population levels dropping, to some lower, sustainable levels.

The low birthrate is caused by overpopulation: there's too little resources to give to babies, so it's impossible to have children. I would actually say, there's so little to go around, people can't form families (get a partner, be a couple - maybe because the courting ritual is too elaborate now), so less people are even able to have a go at having a child.
stop taking the pills for one.
Google's porn filter in the UK scrapped after public rejection
Without knowing what's actually going on internally that's just a snap judgement. If the engineers are actually being pressured to achieve it in too short a time then sure, however it's quite likely that "mad at [him]" means in a friendly way, and he's going "would love it if you can prove me right, otherwise don't worry, I'm already telling the press that I was an idiot who spoke without checking with you, so if we're late then it's not a problem".
blekko needed 700 servers at launch for our web-scale search engine. We figured an index of a few billion webpages was the minimum needed to give reasonable results.

This is definitely not a one-size-fits-all sort of question!
"The Tor design doesn't try to protect against an attacker who can see or measure both traffic going into the Tor network and also traffic coming out of the Tor network. That's because if you can see both flows, some simple statistics let you decide whether they match up."

We now know, that entire nations' & worldwide traffic is being intercepted and logged.

One would probably see I2P as an overkill without knowing the downfalls of its predecessor. Tor was once a wonderful multi-proxy used for hiding IP addresses and bouncing off servers all over the world. At one time, it was even trusted by most governments for strong anonymity. All of that seemed to change after an article was posted in 2600 Hacker Quarterly. One author exposed how becoming an exit node for Tor allowed all the traffic on the Tor network to pass right through your machine. Becoming an exit node was the same as performing a Man-In-The-Middle attack. All one had to do was open up a packet sniffer and see all the traffic going through encrypted. Tor is still used by people trying to protect their privacy. But at the same time it has become a playground for hackers and governments monitoring what they consider suspicious. I2P has secured this problem while adding more functionality.

Proper German engineering: http://www.i2p2.de/index.html
While I appreciate the sentiment, some of the supporting facts are dead wrong.

> If we didn't do this, the city where I live, New York, would have a freeway running down the middle of it.

That's not really the reason that Robert Moses's LOMEX project failed.

> There would be no Central Park.

Again, 'national landmarks' are not the reason Central Park was created, nor are they the reason it still exists

> The East Village would only have NYU dorms.

That's kind of the way Greenwich Village is heading as it is. National landmarks haven't stopped NYU from taking over the neighborhood.
AWS autoscale problems and Terminators are morons.
If I can see the floor, then light from the floor is passing the horizon and entering my eye.

No, it isn't. Consider a ray of light emitted by the floor just below the horizon, and suppose that your eye is just above the horizon when it is emitted. By the time that ray of light reaches your eye, your eye will have fallen below the horizon. So your eye will see the ray of light just fine.
The author clearly fears for her safety and her other children's safety due to her 13-year-old's violent behavior. Her story isn't making blanket claims about all mental illnesses, only about her son's particular violent condition.
Shortage of daycare centers may sort it self out before the economy gets completely screwed up, but soon after the declining production (due to less workers) will mean less taxincome for the government, which always means that school, daycare, the elderly and hospitals will be cut.

Workers might have been able to command a much higher salary a century or two ago, but in global world there is only so high the salary of an individual can go before the entire thing comes crashing down into a gigantic economic disaster.

Regarding gigantic economical disasters, consider what will happen when the current generations retire. Unless the government has put enough aside to pay for the retirement of all these people (very doubtful), then it must get whatever it can from the citizens who are working -- and with a very small amount of people working, that means that each worker will have to pay a lot more in taxes, which is not likely to lead to either economic prosperity or reelection of the politicians (even though their hands will be completely tied down).
Udacity uses GAE.
Ask HN: What unknown technical blogs or sites do you read?
You don't think it is at all possible that the kid from the story, while also having a serious mental illness, could also be cured of 'being an asshole', just like the commentator here?
> The whole of the EU has such laws. I think most people within the EU would regard this as just a part of living in the civilised west.

The US is not all that different. You'd get a court order for the record to be expunged. Although each state has its own laws
A few friends and I were discussing at work how nice it would be to be able to make your own custom laptop or smart phone. Something pluggable where more than just RAM and HDD were swappable. One thing that came up, however, was what to do about "evolving" wireless standards. Well, what if you could get a completely open source software defined radio? Might be bloody expensive for the miniaturization, and it would have certain physical limits (due to antenna sizes mostly), but it might go a long way to solving the whole problem of having to "upgrade" your phone or laptop just to get higher connection speeds, or have NFC/Bluetooth 3/etc.

(the above are ramblings of a code monkey who dabbles in simulating RF; negative mutterings about how unrealistic or stupid the above ideas are will be politely ignored).
This seems to be at odds with your reply to the sibling comment. If Newtonian physics is incomplete, then the statements it makes about reality are, strictly speaking, wrong. Yet to flatly reject Newtonian physics would be silly, since it clearly has some aspect of truth to it, having been useful not only in practical tasks, but as a platform for building more complete accounts of physics.
Analogously, modern physics may have contradictions and is clearly "wrong" at some level, yet it is remarkably good at explaining lots of empirical phenomenon, and we would probably be much worse off if we scrapped the whole enterprise and started over from first principles rather than building on what we have until the next breakthrough. Your litmus test may be right, but that's no way to do science. Lastly, since you aren't a fan of Kuhn, do you prefer any one else's account of philosophy of science?
I agree. Any adviser that judges your capabilities based on how long you spend in the lab is a fool.

But I think that in cases similar to the original author's, the student incorrectly perceives the pressure on him to be to spend more time in the lab and less on other things, whereas it is actually to be more productive and focused. Being dedicated and having outside interests are not mutually exclusive.
Design for 20x capacity, Implement for 3x capacity, Deploy for ~1.5x capacity
So, does this exist yet or is it just an executive summary and some renderings?
I remember when I was in 7th grade and realized that the working world would be like being in one class for 8 hours and it was somewhat of a panic moment.

Well, it's more accurate to say that the classes aren't defined. You have to create the structure by deciding what's important to you, and you may face opposition from managers who think they know better than you do when it comes to what you should be doing.

If I were running a company, the default assumption would be that employees are autonomous and the manager's role would be advisory, as in, "If you don't know what to work on yet, <X> would be a good place to start. I'll introduce you to the team."
Many problems have two solutions, the solution for "one" and the solution for "two or more". If you really want to be ready to scale I would be a lot more confident with two servers than one. On the other hand, if you are coming out with a true MVP and don't expect the world to come rushing in, then one seems like the right answer if it saves time.
Twitter moved on from having a single table of tweets a long long time ago. I imagine archived tweets (which aren't necessarily that old) are spread out in multiple archive databases and perhaps not even in traditional db formats. And I imagine that, as a rule, no user facing code is allowed to touch any of the databases, but rather goes through services with heavy caching. So that a seemingly simple feature is an engineering challenge really isn't that surprising. Twitter is optimized for very recent content.
It depends hugely on what you are doing. At Kickfolio, we needed to think about dev ops and infrastructure right from the start. Kickfolio launched with 13 servers in place (10 Mac Mini's, EC2 load balancers, Heroku front end).

Having been featured on a few large sites, it was enough. We spun up 3 dynos on Heroku for the front end, and in the first week of launch we had gone through a few hundred GBs on bandwidth (not including static assets hosted on Cloudfront).
> From the start, the article equates "concentration" and "mindfulness", with no backing for that assertion.

The author is a PhD candidate in psychology. You were expecting science?
One Amazon EC2 'micro' instance when I launched http://www.nepaladz.com That too was running on a free server (for the first year). And it was delivering around 200k requests per day at around 40% server load. It is however configured to auto scale as per the load.
What do you mean you can't find anyone good on dribble?
I actually find it physically difficult to hand write more then a few words these days. It's pretty sad.
When will there be an option to upload the archive to App.net?
Right... I agree that psych problems could be based in genetics, its just not my field. But these things can also be environmental, developmental, epigenetic. They can also be mixtures of all of them. I was just saying that we're probably not going to have a genetic test for psych conditions and be able to eliminate them. Sure, maybe one or two combinations of mutations could be screened for, but never most, no matter how far genetics research goes.
One thing I am learning about is regulating my sleep pattern and eating consistent meals. This is tough with a startup, but it really helps.

Another nice thing hat I've started to do is collect things that make me happy. When I get down I look in the box.

Like others have said, try a new therapist.
Frases de reflexion
Our New Startup: Listnerd - Tripadvisor for Everything
The per-capita productivity growth rate in Japan the last twenty years has been around 1%/year (down from the 4-5% of the 1970-1990 era). At that rate, the average worker in Japan will be 2.4 times as productive in 2100 than today.

In the long run, productivity growth and technological changes will dwarf demographics. I'm not talking huge Mr. Fusion-style breakthroughs, just small improvements that we all see every day. The Radio Shack catalog from 1982 that was posted here a few days ago is a great example. The improvements since then happened so gradually that we don't even notice them until we look back 30 years.
I've never worked for a company where executives and/or salespeople didn't promise features that don't exist without first consulting engineering.
Just wanted to say thanks and keep up the good work!
Considering how unreliable their servers and links are. And how their support responses are catastrophicly slow ... I wouldn't put anything citical on Hetzner.
Oops. I wasn't thinking about macro when I disagreed with your earlier claim. Your explanation sounds consistent with my distant recollection of the field (though I'd also take your word for it.)

I shouldn't have disagreed so strongly in the first place.
My thoughts on Tragedy
How many poorly-disguised sockpuppet accounts do you have, JohnLatter/LatterJohn/RettalnhoJ? Really clever on that last one, Count Alucard.
I got the impression he was looking for anecdotes to get a broad impression of what it "usually" takes, instead of advice specific to his situation.
There has been a number of mass extinction events in world history, the most well known being the extinction of the dinosaurs. That much impact on an ecosystem all at once had massive, unpredictable effects.

At current rates, we are currently experiencing a mass extinction event worse than the one that killed the dinosaurs. I am not fond of making large, random changes to complex systems that affect us.
Virtually impossible?

Hardly. One generation where the average is 10 children per woman will boost the economy and permanently change the demographics; it may sound completely unrealistic, but it was the norm only a few generations ago.

And no, it didn't end when a lot of the children stopped dying in childbirth, as my grandfather had something like 8 brothers, and all of them made it into adulthood just fine.
At the moment we have 5 small Linode VPSes (1.5/1/1/768/768) for app/db/solr/redis/async-jobs and paying around $200/month.

I've been looking for alternatives, preferably hybrid dedicated/cloud with good RAM/IO for app/cache/db and cloud based storage. Rackspace seems to offer something like this, but at a higher price. Any other suggestions?
Funds for 1 petabyte raised, 3 to go (please help)
You may be right on this one, but I like to believe that, in aggregate terms, we're more introspective and enlightened than the general population.

Exceptions exist. Give $100 million dollars to any of the idiots on the Bravo "Silicon Valley" show and you'd have a dead crack whore. [0]

[0]: I have no sexist intent in using "crack whore". This assertion applies with equal strength to the men.