skysight-inc/HackerNews huggingface dataset:
Thanks for the feedback, Peter! We're thrilled you enjoy it!
Is this a zero sum game? Are there only 1000 jobs ever in the world and men are worried for their positions?
As I've surely alluded to on HN in the past, I have too much experience with Government work.

I generally consider most of the list of positives as negatives.

1. Huge sense of purpose.

Makes it even more frustrating when work which would serve the people is dashed due to petty internal politics and vanity projects.

2. Stability / 3. Pension

Widespread complacency about performance from entrenched employees and extreme defensiveness born from the knowledge that they can't hope to go anywhere else and reap the same wage/benefits.

When a place is full of people whose primary goal is to last long enough to retire with a pension or simply collect a stable check any perceived threat to the status quo, much less real change is out of the question.

4. Time off

Scheduling becomes a nightmare as someone or other is always off. Absolutely nothing gets done from the second week of November to the third week of January.

Most senior employees are gone at least 5 weeks a year.

When someone does finally retire, the position might be held up a year or more as they burn off accrued leave.

5. Big fish, small pond. Government tends to promote from within for most positions.

This compounds number 2 and 3 as the complacent culture of caring only for the next check and retirement exists from the top down.

Towers of management are created as moving up becomes the only/most effective way to increase salary at longevity.
teng, I'm curious what direction you are immediately headed with this funding round. A deeper technical team, salespeople, bizdev, or other. HN is an open community used to sharing ideas, and I'm curious if you have anything interesting to share here. I'm hoping to, one day, get to where you are now.
See: http://www.lfiplaw.com/articles/trademark_parody.htm
MultiMarkdown [1] is an adaptation of Markdown that claims to solve the sticky bits and adds additional goodies. The latest version is forked from peg-markdown.

[1] https://github.com/fletcher/peg-multimarkdown
1) It's pronounced like a native English speaker would guess. SHIH buh leth.

2) IPA is tough, but in Wikipedia's case, if you mouse-over each IPA symbol, it'll give you a "/ʃ/ 'sh' in 'shy'" and so on.
I think github's missing the point. To encourage a group to do open source we provide them with private repositories?

I get how this group may feel hesitant to post something in the open source world, but so was I, and I'm a guy.

Here's an analogy that maybe fits: Consider you meet someone that's afraid of flying. Do you say "come with me, I'll show you its safe" or do you say "here's a bunch of train and bus passes"
Although I am no fan of the company, in this case you're wrong and they're right. This is a very successful brand campaign that started in 1995.

http://www.chick-fil-a.com/Cows/Campaign-History
Despite courtship amherst decides to shy away MIT edX
Companies make demands on all employees which have nothing to do with their business all the time but they care about it a lot.

One obvious one is a suit and tie policy. I'm curious what happens to people who "disobey" norms like this.
As a side note if you want an "industrial-strength" applied version, at the cost of losing the small/elegant implementation, there's been considerable work in the past years on building robust Markov-language-modeling packages. I mention it here mostly because I didn't realize until recently myself that there was much to gain on top of the vanilla versions that are fairly straightforward to DIY.

One active area of research is smoothing the models, so they capture regularities without just memorizing the input text. The vanilla approach chooses a fixed order of Markov chain (e.g. 2-grams or 3-grams), where you choose n either ad-hoc, or (ideally) to balance underfitting (miss context you could use) against overfitting (end up memorizing verbatim text strings due to insufficient data). But the right "n" to choose can vary based on context as well, since different words show up more often in the training data, and are more or less variable in what kinds of words follow them. So there are a number of approaches to choose n adaptively and/or to smooth the counts ("Katz's backoff model", "Kneser-Ney smoothing", etc.).

From a more engineering point of view, there's also considerable work on pruning the models and representing them efficiently, if you want to work with things of the size of, say, the Google Books ngram dataset.

A few free-software packages that implement a good portion of the recent work:

http://kheafield.com/code/kenlm/

http://code.google.com/p/berkeleylm/
I'm doing deep belief networks with dropout, and don't have access to GPU's with good double precision performance. I used to write graphics device drivers, so GPU computing has a special place in my heart and definitely agree with you there performance wise. It is funny though that my little laptop is hitting training times similar to some papers where people are using low end GPU's though, its amazing what you can do when you pay attention to performance.

I suspect my tuned C++ code will work quite well on a Intel MIC, and that is probably where I'm going to go when I have more resources to throw at the problem. I do know that Theano does use Alex's C++ CUDA code under the covers and I have done lots of reading of some of theano's code looking at implementation details to help developing my code. I just am not a big python (or most scripting languages actually) fan, perhaps I'm just too old school and written C, C++, C# and Java too long. If it doesn't smell or feel like C, I feel like Scotty in Star Trek 4 when he was making the transparent aluminum on the mac.
I don't consider req a long variable name. What I'm trying to communicate is that req is better than request, and res better than response, since they communicate the same thing and are easier to read and write. When it makes sense, i.e. when it can't lead to confusion, the variables have one-letter names--oftentimes this is e.g. i, j for loop variables or n for a number, and so on. Also, it is very common for a method on a type Bar to bind the Bar to a variable b, i.e. func (b Bar) Foo() { ... }

This is how the entire Go stdlib is written, and how most packages are written.
Poor parenting -- including overprotection -- increases bullying risk
Not similar at all, maybe in sentence structure, not in logical structure
I'm sorry, but if people don't get your Star Wars humour, that does not make them stupid. May be they just didn't like Star Wars. And may be somehow they thought that being "in marketing or law or something" is just as worthy an occupation as writing spam filters for google.

I guess the reason they form a community in the short time of an IT event, and "the nerds" are always on the fringe is this same dismissive attitude of superiority that makes people fiercely unattractive and isolated. Men or women.
I don't personally believe this discrimination exists on the scale that it is touted. I think it starts much earlier. As far back as college, women were more interested in Nursing, Acting, Business, English, Philosophy, etc., but rarely would I sit at the advisement panel and hear "Well, I really do like computers!" from a young woman.

That's not every woman, but a very big chunk that I witnessed.

Our school began participating with various groups to secure funds to help encourage women to come into the CS, MIS, or SE programs. I can count on my hands how many additional women joined. Nowhere near enough to call the effort a success. More women chose the classical major choices instead of the various computer fields, even if they didn't show a lowered cost of attendance. Why?

Through it all, I'd have to blame the culture. You don't fix the problem by throwing money at it. You fix it by showing that Penny is just as comfortable around computers as Sheldon is to Theoretical Physics. A field doesn't have to be stylish, and a playing with a computer doesn't have to make you a nerd.

I assure you there's no concerted force working to eschew women from the sciences. If the culture fits and is likened by its followers, I'm sure the numbers will grow to equal measure of the men. If you start from the root, you can fix many of the problems we see today.
This is absolutely right. We are drowning in an tidal wave of books/articles to read, videos to watch, podcasts to listen to etc. Trying to keep up is a fools' errand we must admit to sooner or later. The best we can do is give in and hope to drink a few sips from this ocean.
LivingSocial messed up a meal order of mine so badly one time, I had to pay for the meal twice and they still didn't refund my payment. Worst company I've ever dealt with, and I'm really not surprised to see they have a security breach considering the awful experience I had with them and how it seemed that they just didn't know what was going on.
Here's a different approach: http://www.keyframesandcode.com/resources/javascript/deconst...
Meta, but codewalk looks pretty cool.
Yes, but such trademarks are necessarily harder to defend because you have to show that consumers associate the term with a specific brand, not just the meaning of the words. This case is pretty easy, though, because nobody would use "Eat More Kale" as a marketing slogan unless it was an intentional play on Chick-fil-A's popular and widespread "Eat Mor Chikin" campaign.
Yeah, but how long will it last ?
ITunes Store at 10: how Apple built a digital media juggernaut
Poll: What DNS server/provider are you using for internal needs
I'm building a DNS management tool targeted at the ops/admin market. The idea is to have a central place to manage all the internal and external DNS records for your servers, including DC-awareness and flexible naming scheme. What I wanted to know is what services to integrate with first. Please vote for all the services you use for both internal and external DNS.
BIND9
Rackspace DNS
DNS Made Easy
easyDNS
ClouDNS
dns.com
Zerigo
Other (please leave a comment)
are you actually empathetic if someone has to tell you to be empathetic?
I'm not sure about how the decision making process went when deciding who to give an early preview of glass, but I'd imagine the people responsible knew who Saurik was and what his intentions were.
I think what dwild is after is that online identities don't always have a gender attached to them, whether it be intentional or not.

If the gender is not apparent, then there's no real way to discriminate is there?

This especially goes for HN. I have no idea who is man and who isn't, as most use some sort of username/alias instead of their real name.
If $20 is worth more to you than the hassle of creating a new account and having to re-enter all your data every single month till the end of time, you are probably not somebody the provider should be optimizing their sales process for.
And as a Debian user you know and use dh-make-perl when you need to, right? And it does the job with no troubles usually, right? And this is possible exactly because CPAN is the CPAN, not an half-baked bunch of packages that called "it like a CPAN for <language name>" too often.
Marco Arment talking about the Instapaper acquisition with Dan Benjamin (live)
... And gives it to what? My prefrontal cortex volunteers, but it's always so pushy.
I mean bind9 duh, not an external provider named BIND if that exists...
Akamai DNS
"You must do what you think is right, of course"--Obi-Wan Kenobi

But we should confuse how you or I feel with the aggregate behaviour of HN in toto. My observation is that as a herd, HN approves of the legality, morality, and sanity of businesses, especially tech startups, making unconstrained choices that may appear "discriminatory" to others.
That's a fair response...now what's a reasonable amount of time for that to take place knowing that customers are learning about it from third parties?
Exactly. Show me the code. Doesn't matter if you're black, white, yellow, brown, male, female, genetically-engineered dolphin.

If the code's good and you can advocate for it - great.

If it sucks - it won't be used.
He has to rethink it, because the typical dealership support of "go to the dealer a half hour drive away" isn't workable for their sparse dealer network.
Ask HN: Franchise vs. Start Up
Does anyone have something to say about a franchise vs. a start up or even franchising a start up? I always found franchises almost vulgar sounding, but considering how they provide a proven solution to a proven problem and systems to back it up, it doesn't seem so bad. I know the exit isn't the same, but the reality is these gazillion dollar exits happen to so few people. Could a franchise bring good experience running a business? Discuss...
There generally on the bottom stage so they don't reach Anything close to orbit. But what there really useful for is dampening rotations which is hard to fix with a thrust vectoring system.
ADHD & Guardian Angel - Helping day-to-day lives of those with ADHD
Live tweeting that you're getting fired seems like a terrible idea to me.
We're definitely looking to bring great technical talent to our team - that's our highest priority after funding. There are always more things to build and work on! As we grow, we want to keep up a strong development pace.
Wine-types are always much easier to deal with after your second glass.
Cubesats are in general some of the safest / least junky spacecraft in orbit.

There are several factors that influence how much space debris a spacecraft will generate:

1. Surface area vs. density - If a spacecraft is large and has lots of floppy solar panels and things hanging off of it, it's much more likely to be involved in a collision, and if it is involved in a collision, it's more likely that it will generate secondary debris dangerous to other spacecraft.

2. Orbital lifetime - If a spacecraft is in orbit for longer, it's more likely to be involved in a collision.

Cubesats are usually very dense, with few or no deployable components. Cubesats are also typically deployed in a low orbit that has a short lifespan - less than 2 years or so.

There are of course exceptions to both of these rules, but the phonesats are not.
How did your first paycheck from your business affect you?
I have a dumb question about this. It was a smart question when someone asked me it the other day, but it's a dumb question now because I feel like I should know the answer and I don't. Why can't you get away with using some trivial but obscure modification of one of the standard fast hashing algorithms? It will be just as vulnerable as the standard algorithm, of course, once you know what it is. But now the attacker has to figure out which algorithm you modified and how you modified it. How do they do that?

I get that this is a bad idea that won't work, blah blah security by obscurity and so on. But when I was asked why it doesn't work, I was unable to give a very satisfying answer.
WinAMP is a great product by the standards of 1998.
> the only people in there were super-nerds playing video games for hours

I know! It was really annoying. I just wanted to get stuck into computerized maths, CAD and plotting when I was 14 but it was uncomfortable being the only girl in the lab during lunch hours. If there had been another boy or girl I respected as a friend there I might have joined in, not to be sociable but just knowing there was someone else there who wasn't geeking out on gaming.
Yes, but you have to work at it. If I apply for a trademark on the phrase 'what's going on' I'll get nowhere. But supposing I have a website or magazine that provides listings of interesting local events (ie 'what's going on' in your area) and I work hard at developing that brand and building an association with my service, then my chances are much better.
Why? Are they in danger of being fired for it?
The Tesla Model S’ Battery Is Now Covered By A Nearly Unconditional Warranty
My theory is that before going to sleep different parts of the brain shut down not in one single moment, but at different moments. Therefore before sleep some parts of the brain is already sleeping. That would explain why so often ideas that seem good before sleep look silly when you wake up. As in this case, maybe before sleep parts of the brain that produce depression shut down sooner and "temporarily cures" the depression.
Is it time yet that someone builds a cross-platform account management appliance? Currently, we seem to be stuck between things like Kerberos which are complex, and your framework's built-in account framework which often uses SHA-1/MD5 + salt and has no mechanism for upgrading to better alternatives.

While things like Persona are awesome, for those who insist on using passwords, why not have a standard "thing" that handles them? It should be able to switch passwords schemes on the fly (via re-encryption or double encryption), store data separately from your main DB, and be all kinds of paranoid.
Hiring Software Product Generalists
Greetings from Facebook!

We are looking for innovative developers who will come up with the next great idea for Facebook to help us connect the world. By design we run very small teams, and on average there is about 1 engineer for every 1.25 million Facebook users. We encourage our engineers to try to break things and be innovative. The company is growing rapidly and this position will offer explosive growth opportunities.

I urge you to have an open mind and check if Facebook would be a better opportunity for your career growth. Appreciate if you could let me know when would be a good time for an exploratory talk to know more about your interests. Thank you in advance for your time.

Best Regards,

Raj Vemuri
Facebook Recruiting
rajv@fb.com
Wow. I've been searching for my next language and this could be perfect. I loved Haskell and really miss static typing, type inference, etc, but got tired of living in mondads. I've been looking at Clojure a lot anyways, but really dislike dynamic typing. If I could have Clojure with static types, I'd be done searching.

Though BODOL mentions static typing, I didn't see any examples... What did I miss?
Reminds me of Mike Rowe's Dirty Jobs. It's not a show about "getting dirty", really--it's a show about being willing to learn from people who we don't traditionally think of as having much to teach.
I'm not sure HN has ever agreed on anything enough to be described collectively as defending it. I suspect the members of the HN community that defended that viewpoint may be college freshman who just discovered "Atlas Shrugged". I don't see much ground to say, "People on HN sometimes say this, so isn't that the ethos now?"
Any MBA program worth it's salt doesn't let people in unless they have work experience.
Avoiding pissing people off is a basic ethical concern, which is at least as important as making money. Obviously it can't be totally avoided, but you try anyway. If you can't make more money without pissing a bunch of people off, you should consider changing your business.
I know there's a bunch of quotes out there that all basically the same thing:

The more you repeat something, the more you believe something to be true, the more you will cause it to be true or real.

I suggest men, women, and everyone stop making this a bigger deal than it is (however big it currently is, it can be made bigger), and let's start focusing on real problems. Whoever has complaints about disrespect, belittling, or whatever, should just self-study and create something AWESOME, and then prove to the world by action, instead of blabbering off and causing pointless havoc that won't get us anywhere, let alone possibly make us take steps backward.
How a bicycle is made video (1945)
Upon a password reset submit, check if the hash(email_submit) exists, if so, email the password reset instructions to the email_submit address :)
How is it clearly an attempt to play off that slogan?

I hadn't heard of the slogan, and 'Eat More Kale' just sounded like it was playing off the pro-Kale zeitgeist of our times.

Both vegetarian and paleo diet eaters love Kale (to use two opposite diets as examples), and it's all the rage in trendy urban areas.
I agree with the first part of your comment, but am confused by your conclusion.

As a woman in technology (yes, one who codes, not a marketer or lawyer), I have my own views on this. I am a nerd when it comes to technology. I have a passion for it and could talk about it all day. I don't however, have a significant interest in sci-fi or fantasy films. From first glance, I appear to be stereotypically female: I'd rather talk about make-up than Tolkien--but that has no bearing on my interest in technology.

I can understand why someone might think being interested in science fiction would be correlated with an interest in technology. But technology has become an important part of an individual's world. With women being huge consumers of modern technology, it's not difficult to see how some would be interested in the creation of it too.

I don't have the issue this article discusses--feeling alienated from other women. I don't feel alienated from most men either. It comes from people who believe these interests to be important qualifiers for being a "nerd." I think the article is somewhat interesting, but it's difficult for me to see how her fellow women not being interested in her "geeky" activities is a barrier from entering engineering. In fact, it seems as if she is drawn there because she feels she'll be more accepted, and that her issue is with too many marketers at an IT event. Perhaps some of those women would actually be interested on the side of creating technology, but felt there would be more acceptance of their interests in marketing? It appears to me that these associations (that engineers and programmers love Star Wars) may be its own barrier.
I was thinking more of Xbox360, Playstation3, iOS, etc. - none support user-replacable files. I don't even think any even support dynamic linking...
)
Unfortunately, we don't have much experience with industry sized datasets - simply because we don't have them. I know that our SVMs are among the fastest of the world. At least we beat Libsvm and Liblinear(and there certainly on very big datasets!). But we lack support for hadoop/mpi, even though we would like to change that in the future.

Right now I would say that the main focus of shark is research oriented. That is we want to be fast but also modular so that we can still easily exchange different aspects of the algorithms with our own work. As these goals sometime clash, it is hard to claim that we are the fastest, simply because there is for nearly every algorithm some way to improve when you know exactly which combination of model, loss function and training algorithm you use. But we are (hopefully) reasonably fast and certainly want to improve.
What's so preposterous to me is that Chick-Fil-A's entire "cows doing things poorly" advertising campaign is basically a rip-off of Gary Larson. Not in any legal sense, of course, but in an intellectual honesty sense.
The Truth About Entrepreneurs: Twice As Many Are Over 50 As Are Under 25
Fair point. I will write up a proper description.

The main site is about dividing up goods. Lawyers do it and might pay for it.

This app is about dividing up bads (tasks). It was meant to be a toy but something about the problem is sticking in my craw as something more serious.