skysight-inc/HackerNews huggingface dataset:
> scratching your arm has become the basis for a mental illness diagnosis?

In the same way as sleeping is the basis for a diagnosis of illness (narcolepsy), washing your hands is the basis for a diagnosis of mental illness (OCD), etc. No one is going to diagnose you as mentally ill because you scratch your arm, but if you repeatedly scratch your arm enough to cause tissue damage and seek psychiatric help with stopping, there's a label they can put on it. Just as sleeping is normal but falling asleep uncontrollably in the middle of the day might be narcolepsy, hand-washing is normal but washing your hands 100 times in a row might be OCD, being tired is normal but being tired all the time might be CFS, having your cells grow and multiply is normal but if they do it out of control it might be cancer, etc., etc., etc.

Lots of things are normal in small quantities and pathological in large quantities.
This is a very fair criticism, and I believe lenses are the solution to this problem, although I'm not advanced enough in Haskell to provide a round counterargument.
The free version has advertisement. Advertisement can be removed by in-app purchase.
Tricky catch 22. You want the kind of employees that are interested in what they do enough to want to learn new skills and try new exciting technologies. But, you want them to actually use something boring.
Very good initiative. I hope to see more and more success for these free software improvement projects.
When I see some crowdfunding success story, I think people enjoy more and more to play the game of "donating" to projects who fit to their needs and hope it could definitly be a viable economic model to free software side of existings dual licencing and service support.
"Sadly now that it is here few can see it."

Well, the smart money will see it first. And entrepreneurs. The rest will eventually follow the herd, well after the money is off the table.
I usually see Data.Map to imported as M, Text.ByteString as BS, etc. If you need more than a couple of these, I'd say it is a red flag and that the code needs to be split up.
Or any number of dangerous mammals. ;)
There's nothing boring about pandas
Was this man's computer use being charged by the key stroke? I mean I understand using a few abbreviations here and there, but i.c ? At least name your files descriptively.

I would avoid using this for realzies if only for the fact that if something broke trying to fix it in that code base would be prohibitive
don't even understand what value I will get out of it. No examples, no explanation?

Ok e-commerce... and? what's different with http://www.drupalcommerce.org/ or http://www.shopify.com/ or ...

How does it differentiate?
> but because Starlite is so lightweight - 1 mm thick

Just what about a substance determines how thick it is? How thick is concrete, then? Glass?

Is there a reason Starlite can't be manufactured 75 mm thick, and would it then not be even more amazingly effective? Or alternatively, what's the thickness value for concrete? Glass? What's the Q-value of 75mm of paper tissue?
HL3 will be a timed Linux-exclusive for Valve's official Steambox. Calling it now.
I wish that I had spent more time crafting my initial response. How would you have written my post, so these concepts are clear:

rgbrgb, I agree that it's superficial, but in direct contrast to your praise of the superficial style of the documentation, I was unfortunately distracted by the superficial mistakes in grammar and spelling. I wish someone would take the time to help the author of this code, Dmitry Simonenko, to improve the documentation. To that point, here are my hopefully constructive criticisms specifically of the language used in the documentation. I have performed no audit of the library itself, and cannot speak to its quality.

Does this still come off to you as poor form?
Periodic Table of the Operators
Lawyers are a "racket." They show up when you have just enough money.
Agreed, but I'm not optimistic that the view will become wide-spread.

There was a phrase I learned long ago: "if it fits into cache it's not a supercomputing problem."

This essay promotes the related view: "If it fits on a desktop, it's not Big Data."

BTW, you might like Greg Wilson's 2008 essay "HPC Considered Harmful". I can't find the slides anymore, but there's a lovely interview with him about this at http://itc.conversationsnetwork.org/shows/detail3682.html .
I'd love to understood how the Hadoop hype and marketing team generated so much unwarranted interest in Hadoop.

I'm witnessing a feeding frenzy for Hadoop talent in situations where there's absolutely no need for Hadoop, and I can't recall anything like this for any other software.
Fiercely quick front-end boilerplate and workflows, HTML5, Grunt, Sass
Holy shit, really? This is your argument? Talk about not getting it.

The average income in the US in 2013 is $52k.

The "haves" are not the arbitrary top 1% which starts at $380k, no, the "haves" are the people with millions or BILLIONS of dollars. It's not about yearly income, it's about net worth.

The difference between someone making $52k a year and someone with BILLIONS of dollars to their name is far more than 1:1000. Assuming just $1 billion to $52k the difference is about 19,230:1.

And that's assuming the people with $52k income "have" $52k. But they don't really, they're probably in debt.
British ex-pats are famous for it for some reason.

I don't think it's all of them (I'd say us but I returned to the motherland a while back), just the ones you notice.
Their logic is that the meat will be cooked killing all bacteria and denaturing and DNA remnants. What spillover discusses is referred to as zoonosis, and that's when the animal is alive (or carries a vector that is).
The Ontology of the Web
Disclaimer: I've worked with and submitted a few odd patches to Hive. I have not worked with Pig directly.

I think you ought to consider what you mean by inferior here carefully. If you mean 'Hive QL can capture many of the common semantics of SQL' then sure.

If you mean just about anything else, you're wrong. The performance and reliability considerations of Hive/Hadoop are vastly different and very easily inferior to a mysql or postgres setup for small to mid-size datasets.

(That doesn't even get into ease-of-usage. Anyone who's ever dealt with Hive's dreaded 'error: return code: -9' can attest to how maddening Hive can be to use).
You are living out a dream/fantasy held by many of us and obtained by few. Please do keep us informed on the awesomeness that is to come on Tynan's Island.

Also, definitely look into the permaculture thing. The Zombies Are Coming! and you gotta be prepared. =)
Yes, Java is a far superior language than C++ for writing Java code.
Why would that be obvious?

A straight up "no collisions" theorem would require proving limits on the behavior of other objects in and around the road and also that certain mechanical components never fail.
"We don't have big data" or "our data is rather small" -- said no dev team ever.

"Big data" is like "cloud" it is a cool label everyone applying to their system. Just like OO was in its time. Well once they applied the label they feel they need to live up to it so well "we gotta use what big data companies use" and they pick Hadoop. I've heard hadoop used when MySQL, SQLite or even flat files would have worked.
Ubuntu Linux please :) (why not make it cross platform).

Just bought the Android version :)
Why do you think that is?

(Reason for asking: writing a book about SaaS. Writing a chapter on "why SaaS?" right now :))
That's not the only reason no-one uses phage therapy - there's also a strong cultural resistance in the west. I've worked on phage targeting various Salmonella serovars, and while you do require cocktails for the most effective treatment, but phage evolve along with the pathogen. There's no inherent limit on the availability of phage like there is with our current suite of antibiotics.

With extensive sequencing-based environmental monitoring, as we're starting to see in many western countries, we can detect the evolution of new bacterial and phage strains in near real-time and isolate the phage to treat the pathogens. We can keep up with pathogen evolution. There's no equivalent system for generating new antibiotics. I reckon this kind of tech is only a few years away - all the pieces are coming into place.
Don't be. The fundamental observation that monad's usability is tied closely to Haskell's features is important, and still hasn't been taken on board elsewhere. There's always someone trying to do monads in Clojure...
Could you please make it available for my country - Georgia. Thanks
It's even more exciting mixing pandas with the IPython notebook.
More than 5TB doesn't mean you need Hadoop either, it means you need a better storage system like tokudb/tokumx or leveldb. These technologies can index the data so that you can run selective queries instead of reading all the data for every query like Hadoop would, and they can compress it so that you can keep everything on one disk a while longer.
You are inviting trouble if you do not use big data. Play it safe.

http://fakevalley.com/tech-executive-fired-for-not-using-big...
In play store, I selected all countries. I am not sure, why this is not available in your country. If Google allows me to do that, I will surely do that.

EDIT: I cant see your country in list provided by play store. That means Google does not allow. I will be publishing the same app to Amazon app store. Check if you can download apps from Amazon app store
You would probably want some RAID + Backups, (and a very generous amount of RAM there) but this is ok.

In fact, I wouldn't doubt that for several "big data" users even SQLite would be enough.
Game Key Hacks
I think in this "post-Snowden" era, you now need to consider not just the people on the internal network, but whether any of the gear on that network might be betraying you to the NSA.

I'm sitting here in my loungeroom looking at my printer, the PlayStation, the Media Server, a bunch of laptops, a few phones, a couple of iPads, a Mac Mini, the linux box, a RaspberryPi, the cheapo chinese adsl/wifi box, and the old NetGear ethernet switch – and wondering if any of them are taking advantage of the privileged access my home IP address has on a bunch of other internet connected networks?
Is there a way to customize foot speed for Google Maps Transit directions?
Well, after writing my comment, I went online looking for some quick introduction to the language. I'll admit that there are certainly very interesting facets to that language.

What I can say however is that there's a difference between conciseness in writing and productivity in reading.

For instance,

(!R)@&{&/x!/:2_!x}'!R

It's very concise but very hard to grasp quickly. The equivalent, in even 10 lines of code, might be way easier /and/ faster to read and understand.

That being said, I really like the functional aspect of it where most of common operations on list were shortened. (I.e. map, reduce, etc.)

Personally, I think the Arc language strikes a really fine balance of verbose versus concise. It's just unfortunate that there's not a more active community and that it lacks the battery to be productive with it.
Did you look at SockJS? It is far more mature than Socket.IO imo. Follows the websocket spec, does not resort to flash for fallback, supports more fallback methods, and later when websockets are fully supported native you just replace "SockJS" with "Websocket" in your code and drop the library.
Are you serious? Facebook and Twitter are huge forces worldwide. There's a reason countries like Iran and China have blocked them. (And this just in: Iran has unblocked FB and Twitter as of this week.)

And for SV companies other than those, there's no lack of big names: Apple, Oracle, Salesforce, HP, Intel, Symantec...
How about http://github.com/Tokutek/ft-index? It's embeddable (BDB-like API), has compression built in, and is a similar data structure to this but with more mature features like transactions.
hmm, rereading that suggests the following would help :

;-)
Top 50 Internet of Things Applications - Ranking | Libelium
There is no problem with CV-driven development.
In a sense, this proves one thing: convenience wins, again. And that's definitely a great sign for Steam, since many Linux users are probably feeling the same way we do.

If convenience wins, doesn't that mean the vast majority of people will just stick with Windows for gaming?
What happens when Voice becomes the next big thing in digital?
Aquaservice
aquaservice
Oh man, another coffee out of nose moment. Touché sir.
Rowing past dozens of cemeteries to get to a haunted island...

Is this the beginning of a horror movie or a comedy?

Seriously though, owning an island is awesome. Have fun and be safe. :)
Strange. Did you also make available for all the devices? (Mine is nook hd+).

EDIT:

Right. Since you use in-application payments, the app won't show up in countries where payment is not allowed, including Georgia.

Unfortunately, Amazon app store is not supported for Nook devices, but at least I'll get it for the phone.
What Type Of Back Links Are Good For SEO?
Do you use standard off-the-shelf consumer hard drives at those prices?

Most companies I've worked for have shelled out quite a bit more for "enterprise" class hard drives. I've always struggled to understand what these bring to the table, and my understanding is that it's some combination of greater reliability and a service agreement.

It's always seemed to me, in my software-centric naivete, that it would be more cost-effective to get off-the-shelf drives, RAID them for redundancy to increase uptime, and make regular backups to increase data longevity.
Also http://www.kamaelia.org/Home.html developed by BBC R&D using Python. It seems to have been quiet for a while now though.
Google should learn from the SO duplicate questions finder. I have often been surprised at how good it works. In contrast to that, Google doesn't have anything like this on Google Code bug trackers (most importantly for their own products) or its support forums. The amount of unnoticed duplicate Chrome bug reports is huge.
>That's a little too blatantly useless to be interesting though. But note how ugly CL's multiple namespaces make liftmaybe and its uses.

Oh yeah, incredibly ugly \s

OP, you may be interested in checking out LiL, the Lisp interface Library.

https://github.com/fare/lisp-interface-library
I have made it available for all devices with Android version 2.3.3+
Scala has plenty of monads and they work fine.
I'm a C# dev and I totally agree with this.

I've done a limited amount of C++ many many years ago before I even knew what garbage collection was and I keep thinking of revisiting it, but honestly in my line of work ("Enterprise") I don't need the mental overhead of dealing with things such as pointers and memory allocation.

Perhaps, my view is outdated, but I get the impression that everything in C/C++ is just a little thorny when compared to other slightly more high-level languages, such as namespaces, package management, list comprehensions, library compatibilities, type strictness etc.

I would like to be wrong about that though... I wish I had a little more motivation to spend some real time with C++ (or perhaps even C).
My understanding of the idea behind most APL style languages is that it's an expert language, in that you need to take the time to invest in it just like a musician would musical notation.

Once you've done that, the theory is that it is actually quicker and easier to grasp than reading "verbose" lines of code.

That said, I've never taken the time to invest in an APL style language, so I can't speak to whether it is actually true or not.
Incidentally, I am just reading through All About Monads (http://www.haskell.org/haskellwiki/All_About_Monads) and his point 3 ("Allow polymorphism on return types") is what confused me in this example:

getAny :: (Random a) => State StdGen a
getAny = do g <- get
(x,g') <- return $ random g
put g'
return x

I was like.. how on Earth Haskell knows which function "get" should it call? I think this is a point which should be more stressed in the tutorials (I read Learn yourself a Haskell and glanced at couple of others..)
I don't know how this is possible after my very hard childhood but I just don't get sick anymore.

Sounds like whatever your doctors did worked miracles. No serious illness for 20 years? If this experiment could be repeated at scale, and proved to apply to others, everyone should receive the same antibiotics treatment you had!
I take it someone's mad that their "blog" was banned or ridiculed?
Is the problem really hospitals, or is it industrial animal farming? Because I suspect it is mostly the latter. It is of course more convenient to rant against sick people than to give up the daily junk food burger.
Why would Hadoop automatically be the right tool for the job in this case? In fact, when is any tool automatically the right tool for the job?

I understand the desire not to do unnecessary work and to plan ahead. However, something like Hadoop is very heavy weight and requires a significant change to the way you write your software. It isn't something easy to undo if Hadoop turns out to be the wrong direction. Thus, if you start there you are more likely to stay there, even if "there" is not appropriate. On the other hand, starting with a much simpler system and adapting it as your needs change may add a little more work over the course of the project, but saves a buttload of necessary technical debt.
[project author here] The idea here was to actually sort of extend redis. People often ask "can redis do X" and get the answer that their use case is not broad enough, or it can be done with Lua, or simply no. then they ask what about plugins, and antirez is not inclined to add them anytime, probably rightfully so.

The aim here is to allow adding commands or creating custom subsets of the redis protocol - and allow easy extending of existing clients to support them; and having replication and persistence - the "boilerplate" of the database, already taken care of. Adding custom commands to the redis python client for example is trivial to the point where the client actually has handling for unknown commands.

BTW replication is also written as a plugin here and can be replaced by a more robust way, for example using RAFT as replication and failover method.

So this project started as scratching a personal itch for me - which makes me a 1 person niche at leat - and as a learning experience for Go. I don't know if the world needs it or not, nor do I care if it doesn't.
NeuroPod: Podcasts from Nature Neuroscience
No but it's the main reason. If I had a nickel every time someone told me we can do real-time sequencing I'd be rich. You're greatly overestimating our technical capabilities and underestimating the costs and challenges that would be involved. Theoretically we can identify a new phage a week after resistance is detected, factor in all of the other costs and time involved and it's even worse. The major downside of phage therapy is that there is no readily available phage if resistance develops as there is with antibiotics (the manufacturing process for a new phage is not that short). If you find a methicillin resistant infection you can give a tetracycline or cephalosporins.

Additionally, don't forget that phages are not all lytic and not all are effective (i.e. look at C. difficile) and that phages won't affect intracellular pathogens (i.e. Salmonella, to my knowledges phages don't work but please share as you say you have experience with this).

So while phages can be useful (I never said they weren't) their use is limited and has it's own drawbacks.
A lab without test tubes, but with Stinkyboards
Back in college in '97 or so, in our databases class on the first day, the professor asked, "Who's worked with databases before?" A bunch of hands went up. "Oh, sorry, let me rephrase, who's worked with databases larger than a few dozen gigs?" Only one or two hands remained up. "If it's smaller than that, just save yourself the effort and use a flat-file instead."

15 years later and it's the same thing, plus a few orders of magnitude.
It wasn't ment that way.
The vaccination conspiracy theorists are the opposite evil here. They are even worse.

I didn't want to say that I would not give my kid antibiotics. This is bullshit. But I will change the doctor if his only solution is antibiotics. I had that situation already with my girlfriend. She is ill pretty often. She works in a kindergarden and parents tent to get rid of their sick kids by sending them there. She had to change her doctor because it just did not work out and sometimes the solution is simply to stay home for a few days and drink some warm tea.

There is no easy solution here. You can't say that you refuse all kinds of medication but you have to find out which doctor is really trying to help you out here and this can be only done through experience.

I for myself am just lucky. I can't say how but it works.
If I ever get really sick and the 3 days on tea won't help, I will go to the doctor I trust and get some medication to cure it.
Amen! Finally someone talking sense. Apart from being a hype, Hadoop is also a wet dream for VCs that want to have "exposure" to "big data".

Hadoop is a solution for cases where you have multiple petabytes of data, with query's that need to touch a significant portion of your data. Roughly speaking in this case your execution time will scale with the number of nodes in your cluster. Classic example is creating the inverted word list for a search engine.

For most other use cases, including all cases where you can index your data, you do not need Hadoop.
Dunbar's number is interesting. His methods were not particularly scientific but his language was. It was a fairly formative paper for me when i was studying history of science.

I do think there is something in the number, but where it comes from is unclear.
I think that's disingenuous. CV-driven development leads to really messy nightmares, in my experience, for the same reason that a machete is a poor tool for heart surgery.
Not a single time is the acronym, or whatever the hell it is, defined.
I heartily agree. I had a similar experience when researching client-side frameworks within the scope of minimal viable products.

http://minimul.com/should-i-build-an-MVP-using-a-client-side...
I downloaded the app with a bit of bit regurd but I was really really please with how it worked on my nexus 4! can't wait to try it on the nexus 7! Well done!
Where there any challenges for your kids or any advice you can give to other families trying this? My initial feeling is that uprooting kids is not a good thing, but it clearly works for your family.
Interesting. I have an opposite view - for me it was easier to find answers before SO. One good example is when you need to get a library recommendation (which is quite a useful thing for a programmer). "SO is Q&A site and doesn't do library recommendations" (literal quote from someone who has closed such a question). The problem is that most of the programmers nowadays hang on SO, so other sites (where such questions would be allowed) have much less audience than they did pre-SO. Sure, I can disguise the question and hope that I will get library recommendations nevertheless, but that's an (ugly) hack.

There are countless other examples where well-researched, popular and in some way contributing questions were shot down because they are unfit for SO.

And as others have pointed out, most karma comes from answers to popular questions, which rewards generic questions which probably have tons of similar answers across the Internet. Domain specific answers however are less awarding.

I cope with that in my way. I ask the questions and treat fairly all who answer / comment, but I hold myself back when I see a question I know the answer to. Why would I answer and help SO? I really hope some alternative arises so I can share my knowledge there, but until then I will just try to survive with SO. And what "if all did that"? Well, I guess the alternative would come much sooner. I wouldn't be unhappy about it, far from it.