skysight-inc/HackerNews huggingface dataset:
Awesome! Now if we can just get HBase to update it's prereqs and bump it's version, I can have some symmetry in my life!

On a more serious note - is anyone using HDFS for something like the WebHDFS stuff was designed? We're currently looking at HDFS right now for an Event Store mechanism, but it appears to me to be pretty large file / stream oriented, and I'm wondering how it will stack up if we want to do something that involves files much smaller than say, 64MB.
[author here]

Nope. It doesn't mean "reaches the most people". It means "has the most impact on the world". I think that Android will be the technology that allows people in poorer places of the world to have the internet - and thus, knowledge, and thus, power - in their pocket. That is going to change the world in a significant way.

Even something as simple as this: the internet may have information on the best way to treat sick cattle, or how to best treat certain crops. Heck, in more developed areas, it may cut the reaction time of aid services drastically.

(you already see this happening in Kenya, as linked in the article: http://singularityhub.com/2011/08/16/80-android-phone-sells-... ).
You are right.

My thinking is that, especially for beginners, it's too easy to get into a tight write-compile-debug loop without thinking in broader terms about the problem. It's just an exercise in thinking about the structure of your code.

Also, you can do, or not do, whatever you want :)
For some strange reason, when I see MMX, I am reminded of Sega's old "with blast processing" commercials.
The number one reason is your second point (without the CG). The problem is that it's total crap. There's lack of content, bullshit scenarios, nothing entertaining. It's not the overuse of CG, but that it's the only thing they're selling anymore.
can we please stop responding to MG Seigler? I don't read his blog so i don't know if he actually does post intelligent thought sometimes, but every single thing the blogs have picked up from him is pure fanboy trollbait.
All he is trying to say is that being a hard boiled cynic more often than not hampers your productivity.

I totally agree with that.
Create your own online survey with WordPress and Gravity Forms
Lunch with Luca: The Man Who Really Made Ferrari Famous
They do this in China. IMHO, it is a pretty mixed bag. Mostly they teach kids how to take tests.
We've been hearing that economy is bad, but this indicator of movie business is a proof that economy is really bad. So that's one reason why revenues are down. Logically, with the outpouring of 3D movies and additional cost, the revenue should be up, but obviously the 3D has not helped. I think people are also realizing that 3D is only a gimmick. Besides few forced scenes, typically a 3D is hardly a 3D. Hugo this year obviously made a difference but I wonder if others are going to follow?
Agreed, I find that the independent movie theaters cater to a crowd that actually cares about film. They also show a mix of old and new films so you can catch the classics on the big screen. The Harvard Film Archive just had a great retrospective on Clouzot and the experience of the theater is really impressive.
S3's 1st Complaint Against Apple Dismissed Entirely
What it's largely done is allowed people who are nothing to do with Google to produce devices with the OS on them, and made it possible for things like CyanogenMod to exist.
Compare:

http://www.hnsearch.com/search#request/comments&q=by%3Ae...

to:

http://www.hnsearch.com/search#request/comments&q=by%3Af...

A superficial cheap shot would be to note that you have to go nine pages into Ed's results to find a comment scored as low as 'funkah's top-scored comment. Less superficial observations follow readily from actually reading the two sets of comments.

Veteran status readily accounts for the spectacularly high amount of karma Ed has here. That and name recognition surely biases the score on any given recent Ed comment upwards. But the difference in tone, effort, and craft between Ed's comments and 'funkah's is hard to miss; put more succinctly, the reason Ed has an average comment score of 27 (27!) and 'funkah has an average of 2 is that Ed doesn't write things like "This comment is shitty and cynical and you should feel bad about it." He's more likely to draw an ASCII art picture.

I point this out mostly because 15 minutes spent reading the best of Ed on HN is time well spent, and so there you have it: a convenient link off this stupid thread.
Yet, like with cars, there exists a sizable community of people who want to put on bigger wheels/tires, a new turbo, a new stereo system, taller suspension, etc. A locked bootloader is the same as having a hood that can only be opened with the dealer's key.
I agree that the future is bright for the technology. I absolutely love the idea of powdered metal 3D printed molds for injection molding. If you can drop down the cost of making a mold by an order of magnitude inject molding of smaller lot sizes becomes economical. I think that really shakes up the consumer product industry because suddenly you can make a new product for 1/10th of the cost as before.
Back while I was in undergrad, I interned for the VPs of engineering, manufacturing and sourcing at a US consumer products company. (None of them ever had an intern so I convinced them to reduce risk by sharing me.) Anyways, the company I worked for relied heavily on contract manufacturing in China. I was able to help encourage getting more prototypes printed here in the US for evaluation instead of waiting for the factories to tool prototypes and saved the company a bundle. The company lost a bunch of time and money shipping prototypes back and forth before they could even get to the production sampling stage.

I don't think that 3d printing is going to revolutionize manufacturing in the US. If 3d printing revolutionized anything it will be product design. Empowering designers to experiment and try new things without the fear of having to retool the factory is going to produce some cool stuff in the future.
Ask PG: Can we have collapsable comment threads, please?
As HN has grown, so too has the average length of comment threads. For the most part, these threads have remained interesting and insightful, but after I've read a very long deep thread once it is a hassle to have to scroll past it to find new threads further down. A simple link that could collapse all child comments would be much appreciated!
But the reason people identify so strongly for or against is because of the branding.
It applies to everyone equally.
The Prince Charles Cinema in London, UK [1] is also doing this kind of thing and is about the only place I can be bothered to go see a film these days.

[1] http://www.princecharlescinema.com/
Open Source tools for education
I timed it recently, and it was almost 16 minutes of straight ads (not trailers for unreleased films mind you, ads for movies coming out on bluray, newspapers, an anti-piracy PSA, etc.). This is in addition to having to sit through countless still ads for dentists, car washes, advertisements to advertise at the theater, etc. etc, before the scheduled start time.

The movies should be an escape from every day life. The theatrical experience should be a sort of sacrament, otherwise there's far less incentive to leave the house and pay 10 times as much to watch a film a few months earlier. Luckily there are still a lot of theaters in my town that are not so aggressively trying to capitalize on their captive audiences. Mark Cuban gets this, but I'm sure whoever he sells Landmark to won't. I'm done with going to see movies at the megaplexes though.
> In 2011, NASA began developing a heavy-lift rocket for the human exploration of deep space

...which is sort of stupid, given that there are multiple private firms eager to deliver this service, and deliver it at a price point lower than NASA is remotely capable of achieving.

This silliness is explained by the fact that NASA employees want to work on this project, even if it's going to cost more and deliver less than other teams working on it.

As with regulatory capture http://en.wikipedia.org/wiki/Regulatory_capture and the principal agent problem http://en.wikipedia.org/wiki/Principle_agent_problem, the key insight here is that NASA is not run for the benefit of the people who cut the checks (the taxpayers) but for the people on the NASA payroll.

A wasteful rocket development program is not a COST ... it's a BENEFIT.
Why The iPad Camera Matters
Sequels, remakes, remakes of sequels, remakes of remakes.

No need to go any further.
> Their treatment of farmers that choose not to use their seeds is an abomination.

And so's their treatment of farmers who do choose to use their seeds, and their treatment of populations close to farming communities, as well as their treatment of... well pretty much everybody once you get down to it[0].

[0] example: http://www.vanityfair.com/politics/features/2008/05/monsanto...
Good heavens, that's a complete rewrite of history. It certainly wasn't the case that Microsoft created this incredibly accessible OS. What they did was make a crude and far less accessible copy of the Apple OS. What they did well, was allow it to run on generic hardware (what we used to call "IBM clones"). It was simply a strategic marketing decision that made it affordable and therefore brought it to the masses.
If anything it's that we haven't found an appropriate metric for measuring teacher performance.

Modern VAM (Value Added Modelling) methods tend to work well. This is basically building a statistical predictor of student performance, and then measuring whether individual teachers students meet this predictor.

The teachers unions fight tooth and nail against using them, but they work well.
I don't see the problem. The only people who really care about software updates (in the absence of show-stopping bugs) are those that are willing to install custom ROMs. We have a healthy compromise here that keeps both the carriers and the nerds happy.

I think we need to temper our expectations with respect to the mobile device industry. We might see smartphones as mini-computers, but the companies that make them do not, and neither does the vast majority of their target audience.
^-Same here. However that is not going to happen due to the fact that Hollywood is devoted to protecting their brick and mortar distribution network, a.k.a, the theater.
Microsoft Security Bulletin MS11-100 - Critical
You might like this: http://trailers.apple.com/trailers/

They even provide an RSS feed of new trailers.
Top ten movies for 2011-

1.	Harry Potter and the Deathly Hallows Part 2

2.	Transformers: Dark of the Moon

3.	The Twilight Saga: Breaking Dawn Part 1

4.	The Hangover Part II

5.	Pirates of the Caribbean: On Stranger Tides

6.	Fast Five

7.	Cars 2

8.	Thor

9.	Rise of the Planet of the Apes

10.	Captain America: The First Avenger

Yes, every single one is a comic book or a sequel. That's why they get made, they're what people pay to see. Everyone complains about it, everyone sees 'em.

If you want different movies to be made, go see different movies.
This bulletin fixes the "Hash Collision Attack Vulnerability" that came into the spotlight on Thursday: http://www.securityweek.com/hash-table-collision-attacks-cou...
I have often wondered at the lack of apprenticeship programs in our industry. We use unpaid interns at my day job and they basically sit on the other side of the building do whatever odd jobs management can come up for them to work on, instead of actually learning the specifics of what we do. The one intern that we ended up hiring full time has slowly started working towards picking up development skills, but it's definitely secondary to his other duties, even though it would benefit the agency considerably if we could get him up to speed.

I understand companies don't want to invest in people if they are just going to leave, but on the other hand they spend so much money trying to find good talent. I suppose you would have to take steps once they are up to speed to make sure you're paying them enough to keep them around. If I knew that a company had really invested in me and gotten me to where I am, I would be more willing to stick around, certainly more so than for a company who hasn't really invested in me (conferences, bootcamps, books, etc).
Beyond that, there's the problem of creating items to be printed, or even of modifying existing items. For the most part, the proliferation of laser printers and inkjet printers into homes has led to the creation of a lot of disastrous-looking fliers with horrible fonts and banded,posterized, poorly color-controlled photographs that quickly fade to blue.

Think for a minute about the photo-finishing industry. In theory, almost every home with a computer and digital camera also has an inkjet printer capable of producing photos. In practice, by the time you get the printer set up and properly calibrated, buy the right paper from the store, and finish color-correcting your images, it STILL COSTS MORE to print a snapshot at home than it does to get it made by the local Target or Wal-Mart. The exception is for pro or semi-pro artists who are printing canvas wraps or large-scale enlargements, in which case the investment on a large-format inkjet becomes pretty substantial.

The problem with the "maker proliferation" theory of society is that not everyone wants to be a maker -- in fact, I'd argue that not even 10% of people want to be makers. This is what the One Laptop Per Child project ultimately found out -- even most curious children don't really want to hack their computers, or build their own word processor.

If we end up with 3D printers in every home, I can guarantee that for the most part, we'll end up with a lot of crappy, expensive Christmas ornaments and paperweights.
There are only 3 things, which aren't surprising to anyone who has done much js.

1). a list of expressions eg (foo,bar,baz) evaluates to the last one.
2). Array(4) creates an empty array of 4 elements
2). Array(4).toString() = ",,,"
I've run clusters with and without Cloudera and I'd never go back to without it. It just works which when setting up a new cluster is often something you can't say.
I disagree about film dying, we still have traditional theater, we'll always have film.
Apps: Establishment. Features. Elegance.
I Need a New Startup Idea
More like they tried to make him throw all of his money in the garbage rather than infringe on their IP.
Email someone there and offer to include their logo and a link in exchange for a higher limit. API limits are almost always negotiable.
This piece totally avoids the basic fact that both liberalism and atheism are a trend among intellectuals, so to be accepted into those circles many times one is A) inundated with a liberal and Atheist culture and B) must accept it to be considered valid among their peers. To not deal with this in the paper is a gross oversight due to the fact that the trend of the two has been strong since Marx and Nietzsche. The fact that liberalism and atheism exist in intellectual society can be as easily explained by cultural trend issues as it can be explained by the fact that intelligent people believe in it. To negate and absolutely leave out that their is a cultural trend at work invalidates the entire piece because it is a huge motivating factor in human influence and it is not cared for. The fact of the matter is there is group think at all levels of society, intellectuals may think they are not affected by it and some may not be, but the reality is their are trends among all groups and liberalism and atheism are trends among intellectual circles. This is junk and most likely self validating junk.
I think that just goes back to quality. When I go see a movie in a theater the screen better be right and the sound better be right. If the screen is so dark it is unwatchable and the sound is so loud it hurts, I am better off just watching it at home. And if the movie or sound cuts out, that is a big problem.

I think I only saw 1 movie in theaters this year, and I saw about 5 or 6 last year. A large part of that for me is that the quality of the actual screen & sound sucks at the local theaters by me.
If you really want to go all out, check out The Elements of Computing Systems (here: http://www1.idc.ac.il/tecs/). The book walks you through defining basic gates in an HDL up to having created your own "fully featured" processor, programming language, and runtime.
Interactive entertainment is a markedly different form of entertainment from movies. You're comparing apples to oranges I'm afraid.
to me it's simpler - big budget, well-made TV series are flat out better than movies.

id rather spend the same money as two theater tickets a month for HBO / Showtime and watch Homeland, Game of Thrones, 24/7 etc.

Example: Girl with a Dragon tattoo would be an unreal premium TV series. A 2hr 40min movie seems rushed and messy whereas a 12-18 episode TV season could do this and other amazing books justice.
Official Facebook Messenger Leaks For Windows [Download Now]
Show HN - Generate, store and track custom QR codes
Flagged for cnet.com submission...we can't be giving those slimy bastards any traffic.
I'm a big fan of Alamo Drafthouse as well. I think their model really brings back a sort of "event" feeling to going to the movies which helps differentiate away from going to an ordinary theater or watching at home.
Over 10,500 Domain Names Transfered to Namecheap So Far Today
For example, one of the best films of the year -- Margin Call -- was released on a variety of streaming services the same day it was available in theaters

I agree. Sometimes I feel I could pay $3-$5 if I could watch the movie from home on opening day.
Man's changes are abrupt and discrete. We are not outside of nature but we rock the boat pretty hard.
Internet Download Manager 6.07 Build 15/IDM 6.08 Beta Build 5 Full Free
It's not a free market due to regulations and licensing and the AMA. The supply of doctors is artificially constrained to keep their pay high.
4shared Mobile untuk Android di pasar china
There are two parts: 1) what is an appropriate statistical model for A/B testing and 2) how should we make decisions based on our current beliefs (the Bayesian posterior).

A sensible starting point for the first is a hierarchical beta-binomial model. For instance:

http://www.stat.cmu.edu/~brian/724/week06/lec15-mcmc2.pdf

Translating that example, the binomial variable represents the number of conversions given the total number of exposures. So if you show a red button 100 times and 10 people convert, then, using the notation in that PDF, n_i = 100 and y_i=10. We are interested in p(\theta_i|y_i, n_i), the posterior distribution of the conversion rate for experiment variation i (red, blue, green) given our data.

The hierarchical part of the model is what's Bayesian. Here we use a Beta prior, since \theta_i is between 0 and 1. This prior shrinks each estimate towards to overall conversion rate based on how much variation there is between experiments -- the \alpha and \beta parameters. You can think of \alpha and \beta as pseudo-observations -- the number of conversions and failures you've "seen" apriori. Given that we have multiple experiments, you actually have a sense for the distribution of \theta_i, and we can therefore estimate \alpha and \beta by adding a third layer p(\alpha, \beta).

There are many ways to make a richer model, but if you haven't seen Bayesian modeling before that's probably enough.

The beauty of the Bayesian approach is the posterior is what you want -- your belief about conversion given the data you observe, the model you assume, and your prior beliefs. As you add data, your posterior beliefs update, but at every point in time it always represents your best guess.

It solves the multiple comparison problem via shrinkage rather than by adjusting p-values. This is intuitive. If you see an outlier and you don't have much data yet, then it's probably just a random fluctuation and your prior shrinks your best guess towards what you think conversion rates should be overall. For instance, if you believe conversion rates are typically .05 and never .2, then if you see something like .2 after just a few observations, you'll probably guess the true \theta_i is more like .08.

The second part of the problem, optimal sequential decision-making is more tricky. It's a bandit problem, where there's a tradeoff between exploration and exploitation. As far as I'm aware, this is still considered a very tricky problem to solve optimally in all put the most simple cases. Practically you could probably get close to the optimal answer via forward simulation. There's a lot written on Bayesian bandit problems.

An approximate solution to a very similar problem is proposed here:

http://www.mit.edu/~hauser/Papers/Hauser_Urban_Liberali_Brau...

Once you see the logic of this approach, it's really shocking that A/B testing companies have not implemented it. It's really the only way to think about optimal decision making under uncertainty.
If iPhones hacked into Android phones on the same network and installed iOS, would Apple have any case against the folks who subsequently used that iOS installation on their Android devices?
thanks to @raghus @KenCochrane and @SePP for sharing their experiences with sendgrid.
just wanted to chime in and point out 2 things: we offer an inbound Parse API for receiving email into your app (http://bit.ly/oA2GA7) and offer pay-as-you-go pricing similar to SES and a free plan that allows 200 email/day (http://send.gd/o1fNtT).
for what it's worth, based on my discussions with developers around the world, postmark and mailgun are solid solutions that would likely fit the needs described in the original post here.

thanks,

tim
The problem is movies have become too expensive to make. When a movie cost 100-200 million dollars to make, studios believe that to be successful they must make, or more typical take, a brand and develop a movie around that brand. Studios need a brand that ideally people already know that they can franchise into a cartoon, plush dolls, a theme park ride, and 3 sequels in hopes to try and get the 150 million back. This why we end up with Land with the Lost and a baker's dozen of Charlie's Angels movies.

I wish I could say the studios were wrong and that people vastly prefer a movie with just a great story rather that 3D explosions, but sadly I'm not sure that is the case for most movie-goers in America.

edit: Down voted already, eh? Do you disagree or am I way off base here?
I'll tell you the two major reasons I don't go. 1: Nothing worth seeing and 2: When it IS worth seeing, it's not worth the price of the movie and concessions. I can get a 12 pack of soda for what they charge for a "small". No thanks. I'll wait for the DVD. I can buy the DVD for the price of getting into the movie anyway.
Cineplex here in Canada is getting much better. They've started opening VIP theatres, which because of the drinking age here in Ontario means absolutely no-one under 19. People paying the extra couple bucks don't use their cellphones and don't talk during the movies.

In their main theatres they now have stroller screenings where the volume is reduced and the lights stay on low. They've done the sing-alongs. They also let you rent out the theatre to have xbox gaming with Halo or whatever you want to play.

Sadly the general theatres aren't great at policing the cellphones or no talking. Although I've heard several times that they're interested in the cellphone jamming, but it's illegal to jam 911. I have heard, and noticed, that in a lot of the newer theatres you get really poor reception in the general theatres. It could just be coincidence from them being out of the way and all the steel, but I do appreciate it nonetheless.