skysight-inc/HackerNews huggingface dataset:
On the other hand, perhaps the CEO shouldn't be so disingenuous to believe that his company is the end-all, be-all for engineers. To some extent, it's on him to prove to engineers that it's worth staying at Zenefits over a Google. I think he could have rightly admonished the guy, without withdrawing the offer.
Motorola pioneered six-sigma, i guess Zappos wants to pioneer a brand of management style (sans management).
Tested it briefly, the start and stop dates don't extend nearly far enough. Interesting idea though. It could be looked down upon because maybe some employers will think you didn't put as much thought into your résumé and just used a template
In Brazil, such experience was just terrible.

Although public universities are the best in the country, secondary education is terrible and most of their students don't go to college.

As most public universities are very selective, most of their students went to private schools and are richer than average.
Oh, good. They've been so successful with the Ubuntu software center. NM the fucking thing barely works.
On the other hand, it could just mean that definitions of "the right tool" are more arbitrary than not.
Resurrecting a dead comment:

"the amount of engineering at this scale is just insane. kudos to facebook engineering." - emocakes
My guess is this is what Google and Amazon are also doing for Nearline and Glacier.

When will SSD drives catch up in storage capacity and price to traditional spinning platters? A SSD consumes very little power so this type of setup will not be as necessary.

Also what about the life cycle of drives that get powered on and off repeatedly? On one hand you have backblaze running consumer off the shelf drives 24/7. On the other you have FB/Google/Amazon powering on and off these drives.
I'm already cringing about people in this thread talking about "language detection" and "stemming" as if there are good, easy solutions to them.

Take your favorite language detector, like cld2. Apply it to some real-world language, like random posts on Twitter. Did it detect the languages correctly? Welp, there goes that idea.

(Tweets are too short, you say? Tough. Search queries are shorter. You probably aren't lucky enough for your domain's text to be complete articles from the Wall Street Journal, which is what the typical NLP algorithm was trained on.)

Stemming will always be difficult and subtle. It's useful but it isn't even linguistically well-defined, so you'll have to tweak it a lot. If stemming seems easy, you haven't looked at where it goes wrong for your use case.
Good question. I'm not sure. You might want to seek to the end and move back. You probably shouldn't do it byte-by-byte directly from the file since that's very inefficient. As you can tell, this is already starting to get complicated! Maybe you could try mmaping the file so you could treat it as a []byte.
Most of the systemd people arguing about the unix philosophy have no idea what that philosophy is[1]. A common argument is to insist that breaking up systemd into a separate binaries made "not monolithic", while ignoring that the design is still totally interdependent.

Linux has become a victim of it's own success. It's popularity has brought in a new generation of people that learned about computers from Microsoft and Apple and they are bringing the "design" ideas of that world with them because they usually have never learned the basics of what unix is and why so many people use it.

Don't get me wrong - if they want to make a community-developed OS in the windows-style, they should! If that solves their problems better than a unix, then I wish them well and hope the project succeeds. The problem I have is that instead of starting/forking their own project, they are trying to trying to redirect Linux at the expense of those of us that have been here since the kernel 1.2.13 days[2] because it was a unix. Instead of being a separate project, we get to deal with misinformation and bad design, while being labeled a "hater" for wanting to use a working unix instead of the systemd vision of the future[3].

/Sigh/

"Those who do not understand Unix are condemned to reinvent it, poorly." (Henry Spencer)

[1] http://www.catb.org/esr/writings/taoup/html/ch01s06.html

[2] Slackware was already on version 3.0!

[3] http://0pointer.de/public/gnomeasia2014.pdf
Yes!! Another soon to be half finished project from Ubuntu that breaks compatability with everyone else. They don't seem to have the devs to finish the projects they have, and they keep removing the Debian and ubuntu community in favor of in house development. They are half finished writing a full new userland, but most of the time it's just broken shot that never quite works and never quite gets finished.
I think I need to sleep.
So instead you propose to punish those more fortunate? How's this any different from what you are arguing against.
> I hear sommeliers can't do so for wine, often failing to do well even at identifying red versus white.

This is a tremendous misreading of a study of dubious quality.

I have a few friends who have studied to be sommeliers. The training is intense and the exams arduous. There are several hundreds of different flavor profiles that have to be understood and picked out in real wines (and they map with objective chemical profiles). There is character in the wine that comes from specific characteristics of the regions and seasonality. And the tests to be a sommelier require months of study and are based on objective criteria.
There is that guy growing sheets of diamond, if he isn't off'd by the diamond cartels. I suppose diamond semiconductors will supplant GaN some day. I'm read a few years ago about cold cathod parts, but I guess it never panned out.
A new visualization of the electromagnetic spectrum
The first news article ever written about Apple
But factor in the value of 3 months.
http://www.investopedia.com/terms/t/timevalueofmoney.asp
It is the same in Stockholm, or worse even. Because of rent control, nobody builds rental apartments because it isn't profitable. Most rental apartments have been sold due to unprofitability and have been turned into owners apartments. The few rental apartments that still exist are rent controlled and you pay with a different type of capital to get those -- social capital. Or you can spend 15 years of your life in the housing queue. There literally is no rental market, rental agencies don't exist.

As a result, Sweden has the world's largest housing bubble and by some measures the highest private debt of any country.

You can not find a more segregated, class-based society in the developed world.
Actually the issues are fairly interrelated.

San Francisco is currently getting the overflow from massively constricted housing market of San Jose and the Peninsula. Build high rises in East Palo Alto and you satisfy the demands of the "anti-gentrifiers" and make the labor more elastic.
"Education is a human right"

No, no it isn't. Internet isn't a human right. Human Rights to not require any transaction or service. Human Rights are inherent in personhood, they are observed and respected not provided for.

I have the Human Right to speak my mind, it costs you nothing.

I have the Human Right to defend myself, it costs you nothing.

I have the Human Right to own property, it costs you nothing.

http://www.un.org/en/documents/udhr/
>Societies much better than USA are mixing them well with great effect.

For example...?
Education quality is generally better in public colleges. A huge part of the population start college, either public or private, but very few finish because it is very hard to complete a career, often taking 8 or 10 years for an engineering degree.
I recently moved to SF from a large Midwestern city. I don't know what things used to be like here, but I would say number of job opportunities here compared to where I moved from are somewhere between 20x and 50x. Maybe that's confounded by the access to capital.

Not to mention living here is nice for many other reasons.
In all honesty, people who want a working Unix would have went to a BSD or Solaris variant a while ago.

GNU/Linux, although historically mostly abiding by Unix principles, has always had syncretic aspects as early as the desktop environments experimenting with various fat RPC protocols over 15 years ago, and likely other precedents earlier.

The introduction of the various storage abstraction layers like devfs and HAL, plus all the other monolithic subsystem daemons in the form of the *kits that emerged early on, foreshadowed what would come today, even if they were mostly manageable back then.
Impossible? What if I find 1 or 2 HN threads (among the tens of thousands that exist) that are a counter-example to your sweeping, extraordinary claim?
I would categorize that as humour, actually.
There's "Perl Power Tools: Unix Reconstruction Project" [0], which doesn't seem to have activity since 2004. I remember something older than 2004, I think, back from when perl was first available on Windows, to bring UNIX command line utilities to Windows through perl.

It's great that they all have inline POD documentation too.

[0] http://search.cpan.org/dist/ppt/
You're misrepresenting what that stat means. ~86% of Americans are functionally literate.

It's ridiculous these kinds of claims even make it to HN comments.

Proficient on the survey that derives from, is the highest possible ranking. Proficient on that survey does not equate to functional; anything at or above basic is functional.

About half the 14% of people that fall below functional, do so because of language barrier problems related to not speaking English as a first language.

https://nces.ed.gov/naal/kf_demographics.asp
The number for SF is definitely not right if you're looking at SF city proper.

According to Wikipedia, based on the 2014 estimate of ~850k people, the per square kilometer density figure for SF proper is 7,000.

Is there room for growth in SF? Definitely. You'll get no argument from me on that. And I agree with you that Parisian style density is a fantastic thing. It also goes to show you that skyscrapers aren't essential for high density urban living.

By the same token, I do think people tend to underestimate the density of 3-story tracts in SF. The zip code I'm living in in SF, for instance which is dotted with 2-4 story buildings for the most part boasts a respectable 31,000 people per sq mile (and this is on the west side of the city). Many observers, without actually looking at the actual population statistics, would probably say this is a low density neighborhood when the reality is that it is anything but.

If we can achieve those densities with a mere 3 stories, imagine how many more people we could house if we upzoned to 6.

Btw, you can find neighborhood density figures for the 2010 US census by zip code here: http://projects.nytimes.com/census/2010/map (look under the "more maps" drop down)

EDIT: Looks like you corrected the SF numbers.
Had this same thought, there's a lot of things named unison, including some really popular ones.
I recall running into a pensioner at Akkurat on my last visit. He was complaining about his 350 euro rent controlled apartment in Gamla Stan. I just shook my head - one the low rent; two he was drinking and eating at Akkurat which isn't the cheapest place.
Indeed -- I updated the number before you finished posting this. :)
Reminds me of this comic, which I've always thought had something positive to say to engineers: http://wondermark.com/666/
This seemed counter to pg's advice about corp dev (http://paulgraham.com/corpdev.html) until I read the last paragraph.
It looks like every four days Facebook gets a Flickr worth of photos.
So not too different then from another major Linux software vendor that cannot be named, except significantly more honest about catering to its own specific direction, and thus less popular and less adopted by the broader developer community.
You're wrong about the 45% illiteracy rate.

There are four scoring levels: below basic, basic, intermediate, proficient.

14% of Americans fall below basic, which is the line for functionally literate.

https://nces.ed.gov/naal/kf_demographics.asp
That's what I am wondering. There was a mention of RF, but don't go into detail. If they can use this advancement in the CPU / GPU area, I think a new "golden era" might happen. New CPUs and GPUs each year would be nice. =)
Would be interesting to see stats on how often they had to resort to cold storage? Also, how do they go about thoroughly testing such a service? This is a main advantage of having 3 replicas, you can test HA in your statement in a straight-forward way. How does that work with the Reed-Solomon system? Also, kudos to Facebook for publishing articles to this to the public. A lot of companies keep this stuff secret.
My response came from a windows desktop with a fairly nice monitor. I just checked on my macbook (retina, 15"), first on osx, and then on Ubuntu. You're right, it looks much better! I still think that loading the ubuntu font from google fonts would be better (and then using arial/tmr as a fallback) but to each their own.

As far as the general design, I don't want to be too harsh but the website looks a little 2005 to me, if you judge by this (obviously unofficial) scale: http://i.imgur.com/7f24Qfs.jpg. This reddit thread is a great place to find good websites (http://www.reddit.com/r/web_design/comments/2zpk4u/best_site...) but a few quick suggestions would be to toss the plain white background, make the main search box a little more pleasing, making the logo and text a little bigger, and try a more modern design for the actual job list (I would look into something like what hckrnews.com does or one of these http://www.freshdesignweb.com/free-css-tables.html).

Also, and I hate myself for saying this, but you may want to look into using bootstrap (http://getbootstrap.com/). I was originally against it since it makes websites look similar and I generally like to write my own code, it does make it easy to modernize projects.
I have no idea what world the author comes from, but it doesn't remind me of my day to day development efforts using Python.
Sounds like it's time to change your environment.

The reason some people are mopes is as I mentioned in the last post - they just are. They're stuck. Don't get stuck wasting your time being 'positive' to them.

Be positive to yourself by not spending time around people who make you feel like shit and spending time around people you can learn from instead.

Easier said than done of course, one step at a time :)
I find the up-front focus on microformats off-putting. The general vibe of microformats is "Hey look! You can do a lot of work to explain things very patiently to a computer program that nobody you know is running, and in return, you get nothing!"

What's the selling point there?

I like the idea of the IndieWeb, but can you tell people how to get started without such nitty-gritty details?
The new Swarm killer: Radius
Slack emoji vuln
Is North direction good for Stairs?
Running Kubernetes at Scale with Mesos and the Mesosphere DCOS
This is absolutely correct, but the underlying assumption is that the player can play the game perfectly.

This just isn't possible in a world of infinite variability. Human-controlled centralized management cannot outperform a decentralized, non-planned, ad-hoc market in these cases.
seems FB will be bigger then google, once they launch the video service.
That's lame. I logged special just to downvote you.
> Because of rent control, nobody builds rental apartments because it isn't profitable.

I'd like to understand this better.

I live in a city of a quarter-million people in a US state that no one in tech cares about. There's no rent control here. I pay $400 plus utilities for a 1000-square-foot apartment in a decent location. Clearly my landlord is making a profit off of this and similar apartments at $400 a month. But I'm often told that, if my apartment was in New York, he'd be taking a loss even at $2000 a month. Why is that?

The only difference that has occurred to me so far is the initial cost of the land in a dense city, which could potentially be enough to tie up many years of profits. But that's still just a one-time cost. What am I missing?
>does anyone even use Tornado anymore?

We do for as many apps as possible. The async / callback structure is far easier for our developers to understand over Javascript/Node. Tornado is significantly different from other Python frameworks like Django and Flask, but IMHO it is under appreciated.
That same insanely fast DHCP client library now powers systemd-networkd[1]. We have been using it as the default on CoreOS for quite a number of releases now.

[1] https://coreos.com/blog/intro-to-systemd-networkd/
Sure I worked for a law firm for four and a half years. I received pay raises and promotions and had a very good salary. I worked in a team, and debugged Visual BASIC code and ASP VBScript code. Problem was I was picked on and bullied by some members of management and some coworkers and I didn't know why. The work kept piling on, more programs to debug.

It used to take months to debug a program to get it right with quality and security checks. Management suddenly wanted it done in weeks instead of months. Most programs were written in spaghetti code, with no comments, no documentation, and I had to fix all of that. I was moved into a new position called legacy software and any program that was messed up became legacy software.

I worked extra long hours, I took some work home to try and make the deadlines. I was under a lot of stress and I even had dreams about the code. I had problems sleeping, and had to go to work while I was sleepy. On June 2001 I experienced my first delusion. I thought I heard two airliners crash into our office tower one after the other. I freaked out and had a panic attack. Went to a mental hospital after others didn't hear the plane crashes. I was diagnosed with schizoaffective disorder and placed on short-term disability. I was told that the stress at work had triggered a stroke and caused some damage and I developed this mental illness that is rare (Less than 0.5% of the population has it). On September 11, 2001 while I was recovering at home on short-term disability I saw the two planes crash into the WTC and it sounded just like my delusion. I was scared, and the people at my work must have been scared that I heard two planes crash into our building, and then 911 happens a few months later.

I return to work in November 2001, my cubical is gone, they move me to this open space near a bookshelf and give me even more work. I had another panic attack and was told by my boss to "Snap out of it or you are fired!" and I couldn't snap out of it so security escorted me out of the building and I was fired.

After that it has been hard finding work, when I apply I am 'overqualified' even if the company makes a public statement that they can't find qualified people and have to hire H1B Visa workers to fill jobs. If I did get hired, they keep me on only to debug their programs and get them to the next level and then fire me.

I don't understand why I was treated that way, and I've always been nice to people and helping them out.

But I ended up on disability in 2003 because I am unemployable, can't find a job that would be willing to work with me through my mental illness and keep me on.
This tool is awesome. It would be better if you add a search feature in the selector UI. I know that we could do that in the command itself but it would if helpful in case we forgot previously or need further filtering

Also, it is failing to select the entire file if there are spaces in it
Yes, in some parts of NYC (Manhattan, cool parts of Brooklyn) prices are indeed very high, but there are plenty of parts of NYC where you can find fairly affordable housing while still being in public transit range of the things that make NYC a major "World City". My friend is paying <1500/mo for a 1 bedroom in a good part of Astoria that's about 35 mins by foot + subway from times square. He only moved there a few years ago so it's not like he's taking advantage of some crazy rent control either.

You'd never find something equivalent in the bay area, so overall I think the "density argument" has some validity. Even more so if there would be willingness to expand the public transit infrastructure.
I get the impression, e.g. from Ubuntu's "new package format", that NIH aside (always a big factor with Ubuntu), that many of these efforts are mostly targeting "simple apps", i.e. standalone applications that don't require any kind of complicated wiring into the system. It looks like they'll still need a "real" package format to actually do things like update the system, install kernels, libraries, and dev stuff, etc.
That's not serialization.
I really appreciate your honesty.

this discussion start to feel like "Microsoft should use WebKit".

I'm not asking you to use Tox, but to look at what they are doing and to talk to them. Microsoft is for sure looking at what WebKit is doing.

Yes, competition is a good thing. But you should also learn from your competition, right?

Thank you.
Have you looked into whether that 1-2M threshold still applies if the tables are partitioned? Such as a multi-tenant application where a search might be constrained to a single user_id. I wonder if that would provide, at least temporarily, a way to get past that constraint.
Yearly property taxes.
I've used Rally and don't care for it. It wouldn't surprise me at all if you've come up with something that's actually better. I'll take a look at AgileZen... though now that Rally owns it, I don't know that I'd use it because I'd be concerned they would screw it up.
Read the actual paper[1], not the Bloomberg article, to see the tortured method by which they compute this. The authors claim that the problem is that excessive wages in these key cities are holding down GDP, and if the cities had more people, wages would drop and GDP would go up.

They write: "This output effect is driven to a large extent
by three cities -- New York, San Francisco and
San Jose – which experienced some of the strongest growth in labor demand over the last four decades, thanks to growth of human capital intensive industries like high tech and finance (Moretti, 2012). But most of the labor demand increase was manifested as higher nominal wages instead of higher employment. The resulting increase in overall wage dispersion negatively impacted aggregate growth. In contrast, Southern cities also experienced rapid output growth, but much of this growth showed up as employment growth and only a small amount as an increase in the nominal wage."

It's a "trickle down" paper. Wages are seen as a problem, not as the output.

[1] http://eml.berkeley.edu//~moretti/growth.pdf
Why don't we build more housing in all those places?
Apps to Watch: Makr, Union, Fotograf and Others
I wish they had a pickup-my-friend feature. When my friends are drunk I end up calling Ubers or Lyfts for them, on my account. But the problem is: I can only do that for one friend at a time (because Uber thinks I'm in the car that just picked up friend #1). I wish they would let me specify who needs to be picked up, and give some basic stats like Name, Phone #, etc... and I wish they would let me do that for multiple people in parallel, and let the rides happen concurrently.
PHP makes writing and supporting webapps easy. More than that, it is easy to train and hire for roles, deploying and setting up servers is simple. And it can be more efficient than ruby and python, although that depends on the skill of the developers

Advanced data analysis, machine learning, networking software, mobile/embedded are good things to implement in a different language.
I don't see what any of this has to do with trickle-down economics, which was about reducing tax rates for the rich on the premise that they'd throw nice parties and maybe hire you to serve cocktails.