skysight-inc/HackerNews huggingface dataset:
The problem is that this guy has no clue.

- A naive Bayes classifier is not a Bayesian method. It's just using Bayes rule, while Bayesian methods marginalize out the parameters.

- Regression and classification are different things. And, ironically, logistic regression is a classifier.

- Neither Linear Discriminant Analysis nor radial basis functions are kernel methods.

- EM is not a clustering method, it is an optimization algorithm for probabilistic models of a specific structure.

- Learning vector quantization is not a neural net.

- ...
>A tendency to apply high value to symbols, instead of substance is a property I've noticed in less sophisticated people.

This is a wonderful sentence. I recently got married, and I wouldn't trade my wedding ring for ten times the gold value in cash, because I cherish it as a symbol of my commitment to my wife, and a symbol of our love for each other. Does that make me "less sophisticated" than somebody who looks at their wedding ring and says "Gold prices are up from when we got married; let's cash this sucker in and make some profit"?

Am I stupid for not doing that? Is it silly that I cherish my wedding ring more than somebody on the street, because to me it's a symbol of my marriage and to them it's just my ring?

It's fine if you want to adopt an utterly robotic and value-driven outlook on life, but it's silly to expect everybody else to do the same, and it's ridiculous to say that people who refuse to be similarly robotic are somehow "less sophisticated" than your utterly logical and enlightened self.

edit: you keep on pointing out how you do X, like how you've shortened your name, or you were named for your grandfather, and I guess I don't understand why because it doesn't matter. What you choose to do doesn't have that much of a bearing on what other people choose to do, and just because you're willing to change your name doesn't mean other people should have to.
He has been posting some of the monthly shipments in his blog: http://randomshopper.tumblr.com/
I used to just use text files. Now I stick everything in Evernote. Text files are good enough though.

Organization is pretty simple. Just need a decently named file with the relevant information. E.g. I would have an sql.txt file containing sql database operations that I don't use often enough to remember, but use often enough to be annoyed by having to search the web on how to do them.

Another example might be a centos5.txt file, giving me a quick rundown of the various setup options I've wanted in the past, and the location of various configuration files.

For programming languages, there's many that I use maybe once every 3 or 4 months. So ruby.txt might contain a quick rundown of how to do basic things: how to define a function, a class, perform loops, instantiate an object, access command line arguments, etc. I find it much better than having to hunt down a tutorial which will also be more wordy than needed.

I also have some for more computer science related things, such as tables of graph and search algorithms, along with their tradeoffs.

Checklists are another good thing. I have checklists for processes I've messed up.

E.g. committing new code. If I don't use my checklist, I always seem forget to forget to update a sample file. Or add a file.

Another big checklist is for giving estimates. For example, one of our legacy products is translated into 5 languages. This checklist reminds me to think of translations, because they have been a huge bottleneck in the past.

Hope that helps some.
> They really just don't care about optimizing their workflow at all

Sure they do -- they don't care about optimizing your workflow.

> they already have a profitable monopoly and a captive audience, so why rock the boat?

Even without a monopoly, deliberately driving away the section of the customer base that has the highest support cost is one way of maximizing profits, especially when you can't conveniently establish a pricing structure that effectively segments pricing so that those people pay more (because otherwise you have to subsidize their support costs out of the general pricing level.) There've been many articles over many years discussing strategies firms in many markets (some very competitive, some less so) take to do this.
I'd similarly be curious about letters that have multiple ways of forming them: for example, capital G's and the "serif"
Nice to see another NASA-related astronomer here. I work on Fermi Gamma-Ray space telescope project, although I'm deep into the data processing and data management side of things.

I also have been helping out with a ton of LSST camera related things.
Do you believe in "public good?" I'm just curious.

For example, is there any value to society in allowing a licensed individual to drive to some part of a city and park for a modest fee collected by the municipality so that the driver and any passengers can patronize a business that is not within walking distance of wherever their origin was? Or perhaps visit friends or family that reside further than walking allows?
"Freedom" has two different meanings: http://en.wikipedia.org/wiki/Two_Concepts_of_Liberty
I know this contributes nothing, but...

So meta.
There's an issue in the 1.1 milestone for adding the event that an external monitor was added/removed. Once you have that, I don't see what's stopping you from creating this feature :)
Oddly, I posted it and it got turned into a dead link. :( I'm not even sure what that means. I'm assuming I messed up the posting.
The one that blows my mind is when Comcast installers have to call in to what seems like the normal help desk.
http://people.bethel.edu/~steken/death%20and%20despair/holze...
>Because anyone trying to keep anything private or secure must be hiding something bad...

No, that's not the reasoning. People that do bad things try to hide them. Therefore, a good first filter to catch bad people is to target those who hide things. They can narrow the search field afterwards.
I think that it's generally a good assumption, anywhere in business (and most places in life), that whoever you're talking to is self-interested. Not evil, not even necessarily selfish, but it's a good bet that their world revolves around them.

And once you've got this principle ingrained in your mind, navigating the big scary world of business, or VC, or Google, or health insurance, or any other industry becomes much easier. Because you start to look for what people's incentives are, and don't ask them to do things that are against their own incentives. People are much more inclined to cooperate with you when it doesn't hurt their own interests.

People who actually "disrupt" industries, rather than just talk about it, do so by finding loopholes in other folks' incentive structures. They figure out other ways of doing things that incentivize everybody involved to cooperate with them, and that's how they revolutionize things.
This is cool. I often find myself combing through the New section looking for interesting Show HN posts that get lost in the ether. Nice one.
Worst I've got was "Avery" (instead of Andrei).
Ask HN: Career advice for someone starting out
Hi HN!,

I'm a recent college grad with 1 year professional work experience (BA/MS information systems). I work at a great, well known company but it's not really the industry I see myself in. I work in the IT dept. as an analyst but I'm a little concerned about my career path.

Currently I'm -ok- with what I'm doing (although I wish I had more technical work) but I'm just not sure where to go from here. There is not really a formal position for me to advance to and I'd need to change job functions to get a promotion which would probably mean even less technical work. I can see how growing what I'm responsible for could make my job more technical (I can do more custom software development, data analysis, etc...) but again, there's no formal job title for a more senior role in my area.

On the plus side, I'm getting great experience in a large office setting, learning about how to deal with corporate politics, developing my soft skills, getting exposure to large projects, access to expensive trainings and all that good stuff I probably wouldn't get at a smaller company.

I'm pretty happy for now where I am but I feel like this can get complacent and I'm not sure if this will be bad down the road if I try to seek other opportunities.

My question is, should I just be patient and get some more experience with soft skills or seek other opportunities? If I stay here for say another 2-3 years will this make it harder to get a job in a company whose core product is more technical? Should I look to advance faster?

PS. I have a few friends with similar backgrounds who have changed jobs every few months until they found something they liked and received better titles and more money with each change.

Thanks and sorry for the long post!
whow! this is the coolest thing i've seen this whole year!
It's what the law requires. GitHub, YouTube, etc... don't have a choice in the matter. They are required to take down the content until they receive a formal counter-notice from the recevier of the takedown.
It's a little sad to see things the way they are. Nintendo has a load of beloved IP, and a generation of developers who would likely love to build for a Nintendo platform. But they've failed to capitalize on either.
That's it exactly. There are some brilliant people working at the NSA and our country would be better off if they were working improve the security of utilities, local governments, and critical businesses.
Google's collection of Wi-Fi data during the collection of Street View data:

http://epic.org/amicus/google-street-view/
I'll be posting a follow up about the machine learning bit in the near future. It uses not just words, but also phrases. For the meme / buzzfeed posts, more weight is given to content you write vs. links / articles you post (and we only take into account what you say if you do share a link, not the content the buzzfeed post itself).

It doesn't really try to distinguish sarcasm. Depending on the sample size (ours used 75k people with ~750m words / phrases), it could conceivably detect sarcasm. Yeah, totally. /s (Maybe, but probably not)

The study itself is published at http://www.ncbi.nlm.nih.gov/pmc/articles/PMC3783449/
I think you're overestimating the difficulty of the problem. The difficult part is access to the channels of information. After that, it's a matter of applying well-known algorithms while filtering and processing streams.

The only reason that I suspect that the government is still terrible at this is because they have to rely on government contractors to implement it. If they're intentionally funding startups that happen to be developing tools in the spaces they need, though, it's only a matter of a (short) time until the systems they have are settled and dependable, and they can concentrate on innovation.

>it's the NSA that is behaving out of line. So they should change, not you.

This is also silly. That's like people who walk into speeding traffic because they have the right-of-way. You won't get to hear about how the trial turns out from your grave.
finally! I always like looking at the Show HN posts and have often wished feature existed, great :)
The success and failure of Nintendo was always based on trying things that the market didn't believe in.

Sometimes they succeed (Wii) sometimes they flop (Wii u)

The main reason I like Nintendo is their willingness to go All-in on something controversial or new.
Nope, but I would venture to guess that most software would be improved by sticking to that.
It has always struck me as little more than a fraud when employees are hired with promises of equity and then additional rounds or other trickery simply dilute their share and contributions to approaching zero and they walk away having put their work, effort, and innovation into making the parasites of our society wealthy just for investing.
and the top key-word on their watch list is de-fund
Make Things and Show Them
How do you maintain your bearing? It's certainly possible to walk two contractible paths on a torus each of whose intersections are orthogonal. You can know that you've failed to keep your bearing if there are two distinct points of intersection between your paths, but I don't see how to guarantee that you succeed.
Like another poster mentioned walking for 20 minutes in high heat and high humidity (like 100 deg F - 38 deg C - and 80% humidity, not uncommon at all in the South) can be a pretty unpleasant and sweaty affair, especially in dress clothes.

Some people are limited mobility as well (like the elderly), and/or especially vulnerable to heat and inclement weather.

It's a little offensive to generalize about "Americans" as a whole, especially based on the comments of exactly 1 person, so please don't. 300+ million people live here, with often very different customs and practices, of different social classes, ethnicities, beliefs and worldviews, and living in many different geographies. It's not as diverse as all of Europe, but not even close to homogenous and easily generalized either.
Np, I didn't mean to be snarky. I wanted to make a point both the opportunity cost of starting something creative and the pride that entrepreneurs have for their "initiative and originality" yet are beholden and exploited by the investors who invest in them and who'll ultimately reap in their success.

Also that trading can be an creative act (expressing your belief about yourself, in risk-taking in buying a leveraged option call or a conservative index fund with stop loss; your personal conflict resolution and problem solving when the market moves against you) and a simple decision to invest in an index fund is not trivial but can be just as nuanced in making any complex decisions. But in the West, we put so much credence in "hustlin'" that we become penny-wise and pound-foolish.
Neat! I'm curious as to what percent of posts made to HN are Show vs. Other.
"The perfect is the enemy of the good."

Just authorize. If you have perfect-forward secrecy, as long as you aren't being man-in-the-middled right now, you're safe.

It's better to have all people doing everything encrypted by default than not.

The goal isn't for one individual to be safe against a targeted NSA attack. That's insane--if the NSA wants you, specifically you are screwed; it simply has far too many resources to bring to bear.

The goal is to make it expensive for the big agencies to do pervasive surveillance. If everybody is encrypting all the time, random peon at Three Letter Agency has to get up from his chair and actually authorize a wiretap, get a warrant, etc. At that point, it's not going to happen unless you've actually done something very wrong.
so hacker news is splitting into subreddits. cool. (although subreddits is not the right term... )

what other future subreddits are planned?
Free legal docs for startup founders and investors
Like every industry, "finance" spans a wide gamut of jobs both low and high paying.
Yes! I've been wanting this for a while. Thank you.
Wow. Yay. Hacker News just got incredibly more hackery. Thank you so so much. Just looking at all the work people here are doing is awesome!
Jeremy Ashkenas got a byline in the NYTimes
I could click this link forever, it's just that great... also it leads to itself so there's that too.
> You won't get to hear about how the trial turns out from your grave.

Well, in contrast to you, I plan to enjoy my life instead of wasting it by worrying about some possible bad actor spying on me, which is what I'm must read is how you spend your life.

Sure, fight the NSA by engaging a little bit politically, and buying the right things. But apart from that, don't worry so much, man.
Really nice guidelines, as someone always fearful of looking spammish almost made me want to submit my stuff, but it still needs some work.
"I know you're not being serious about the bank thing, but I just want to say, if you're a programmer and you love what you do, and you're good enough to be choosy, don't work for anyone (especially banks!) whose main job is not software. "

I'd disagree with that. Some of the most entertaining bits of work I've ever done were for companies whose main job wasn't software.

The problem isn't companies who aren't focussed on software. The problem is companies that don't value the great things that software-oriented folk can produce. Unfortunately there are plenty of the latter in the software-focused end of the spectrum too.

Don't work anywhere that treats you badly. Sure. Don't work anywhere that doesn't value you. Sure. Don't work anywhere you don't enjoy yourself. Sure.

But I know some folk who are having excellent fun at banks. Solving stupidly hard problems that fascinate 'em, fostered by great management, and being compensated very well for their trouble.. I know others who have worked at large tech focussed companies that have had bloody awful stories of management idiocy. Hell — I've got more than enough horror stories from smaller tech-focused organisations.
Fantastic addition to HN! I'll be visiting this daily.

Edit: Clicking on the YC logo from the guidelines brings up a 404.
I'd imagine that "Ask HN" would be another major sub-heading.
Sort of fuzzy in some countries. In Australia categorising data is something not protected by copyright, say a phone books listings of numbers, because there's only one way to do that and there's no creative process involved. Some code could probably be argued to fit into that as well.
Great work! I love when organic user behaviors are recognized and made first class features.

Allow me to emphasize something from the Show HN Guidelines[1]:

> Be respectful. Anyone sharing creative work is making a contribution, however modest.

> Ask questions out of curiosity. Don't cross-examine.

> Instead of "you're doing it wrong", suggest alternatives. When someone is learning, help them learn more.

> When something isn't good, you needn't pretend that it is. But in that case, consider saying nothing.

The comments section of Show HN posts are not an invitation for you to tear someone apart for your own self-aggrandizing glory. If you want to be helpful, be constructive. If you don't want to be helpful, don't bother.

[1]: https://news.ycombinator.com/showhn.html
This could just mean most people suck at practice. There appear to be very specific ways to practice different skills. Practicing wrong means engraining bad habits and effectively creating an artificial plateau.
We had a FIOS installer call and be on hold for two hours just to get our fiber setup. He just sat on the carpet and started to snooze.
Umm... It already is.

https://news.ycombinator.com/ask
Glad to see this implemented...now on to the feature creep!

Sometimes the submitters use a text post, which I imagine they do because they want to give some context to the project that may not be ideal to present prominently on a landing page, but which likely cuts down on click-throughs (because of the slight inconvenience of users having to find the link to click through to in the text post).

Maybe it's worth having a post-type...for submitters only...in which the submitter gets first say and a click-through title? And those who use it for non-Show-HN submissions are mercilessly flagged to oblivion? Sometimes the submitter's first-comments are buried depending on the type of discussions that occur.
> Possession is 9 points of the law was the original quote - it's just been bastardized over the years.

Its not that much of a bastardization, as a modernization -- the original seems to have been "possession is 11 points in the law (and they say there are but 12)", which was decimalized from 11 and 12 to 9 and 10, sometimes used with the "9" alone and the last part omitted, and later simplified to 9/10. The original sense of the statement is preserved, which is why I wouldn't call it a "bastardization".
I have to have a set of bloods 5-6 tests every 6-8 weeks plus 4 quarterly ones for the royal free as a result of my condition - god only knows what that would cost in the USA as people say bless the NHS
Anyone can easily buy raw milk here and so far no diseases happened. That being said, raw milk manufacturing and transportation are heavily regulated and checked by inspectors. They are also regularly tested for possible infections.
Close. Kshee-teej, where the 't' is a soft 't' sound, almost like in the word 'thumb'. Hard to explain since English doesn't make distinctions between how consonants can sound.
Wii U was definitely an initial failure but they've been clawing it back in the last few months. Since the release of Mario Kart 8 and the free game thing, Wii Us have quite literally been out of stock at quite a few places (since the demand spike was quite unexpected from the retailers).

It remains to be seen if the Wii U will be a long term success or failure, but we might yet see it do well. The Wii didn't really hit the big time until its price came down and it had software like Wii Fit. Maybe the Wii U will have a Wii Fit equivalent and will hit the right price point?
Using the data from a previous HN analysis of all posts until Feb 2014 [1], I've found that 1.45% of all submissions are Show HN submissions. (but that only found 18,000 submissions. If you use the given 24,000 submissions and the current number of articles [1.3m], the percentage is 1.75%)

I have the data loaded if you have any other Show HN questions.

[1] http://minimaxir.com/2014/02/hacking-hacker-news/
I'd like to see "metrics" replaced with "measurements" – metrics is the theory of measurement, not the measurements themselves.
Awesome, thanks for this nice feature :)
Strathclyde MUFC Twitter Data Set
After reading all 17 questions and answers from the 74th Annual General Meeting of Shareholders, I only see one question which might be interpreted as "Under fire from furious share holders", and the shareholder starts by saying: I do not understand video games and I even feel angry because, at Nintendo’s shareholders’ meetings, the shareholders always discuss things relating to video games or such childish topics as “what the future of video games should be.”

http://www.nintendo.co.jp/ir/en/stock/meeting/140627qa/index...
Experiment (YC W13) started off as a Show HN, but back then we were called Microryza. It was a very modest thing, and after somehow getting near the top of the front page, we were flooded with traffic [http://i.imgur.com/miMyx7x.png]. That traffic spike is what convinced us to quit our jobs and go all out. Show HN is definitely my favorite part of hacker news.

https://news.ycombinator.com/item?id=3833393
Thanks for answering and for accepting this comment - I needed the validation, since I lost two karma points on the comment.

Ironic, no?

:->
well use something like the UK model where dr's can have both a NHS contract plus private patients.
Note that this is a filter on Show HN titles.

For the newest Show HN submissions, you must go to https://news.ycombinator.com/shownew
Along with the !! function you can reference the last call of a specific command like so:

!<cmd>

e.g. sometimes I forget the "ln -s" order of arguments (to which it gives me an error), so I follow it up with:

ln -s !ln:3 !ln:2