skysight-inc/HackerNews huggingface dataset:
Thanks!
Any particular points I should be aware of in this setup?

I've deployed many small websites using flask+uwsgi+nginx before, but for a high-volume API, there seem to be a number of "fragile" aspects to this, e.g. processes and threads settings, since WSGI is synchronous.

If I may ask, what's usually the weakest link in this setup, and what's the best way to monitor for problems and scale appropriately and intelligently as users grow? For example, let's say I set processes = 16, it hits the limit, but it turns out that I still have plenty of CPU and RAM to spare and I want it to dynamically make use of that?
I work on GoLearn as a side project. It's a general-purpose machine learning library written in Go.

https://github.com/sjwhitworth/golearn

I started it because I wanted to revise some data mining algorithms, I've since moved on to an unrelated career, but I'm still truly addicted to contributing...
I'm not against local variables for counting called i and j.

I'm against a big list of forward declarations, with tens of different variables, each with a very short name, and a comment explaining what this is an abbreviation for. Just replace the names with the comments, with underscores for spaces, using find and replace. two minute job for the whole code base, much more readable code almost everywhere.

I agree that functional languages may be a counter case; but codebases in C and python (in my experience), benefit greatly from well named variables.
I haven't got any friends :(
I am really interested in idea of online quizzes. Do you need any help? If yes, how would i contact you?
This is fucking cool as shit. Thank you so much for posting it--will definitely be trying to use it in the future.
This is a terrible idea. I barely can schedule time when I'm job hunting (while still employed) to do the marathon 5-8 hour interview blocks that many companies demand. There's only so many PTO hours I can burn, and I'm certainly skeptical of working several (!) possibly unpaid days just for the chance of being offered a position. The hell with that.
I've wanted to get back into drawing web comics for a while. I also love DMing (Leading D&D games) so I decided to combine the two into a crowdsourced adventure comic with Reddit-style voting.

http://omnomzom.com
It's a LAM(PHP) stack on DigitalOcean, nothing fancy. I specifically kept it simple so that I could get it out the door. Even though the tech behind it isn't anything amazing or useful I'm having a lot of fun drawing comics and seeing what people come up with!

The site (and my drawing skills) are still very in beta - only 21 users so far, mostly my friends & family.
Sid is a toy story character :P
I would think a truly serious candidate would be willing to invest some of his PTO for this type of scenario.
Huh. From the title I would have guessed this was a Wired article.
I don't distrust the American voter in particular, don't worry. Maybe you could say the problem is simply entrenchment.

Voters don't go and seek out candidates with the most money, it's the other way around. Somebody with small funds simply can't reach as many voters as somebody with a huge war chest.

A capitalism where money is the outmost metric doesn't work, just like communism with absolute centralization and discounting all ownership doesn't work. Sidestepping the need for social responsibility, a very important factor, that people tend to ignore, about free market theory is that it's based on the premise that all information is available to you when you make an economic transaction. In that case, the market can be self-regulating. But in reality, this is by a large stretch not the case. Especially in politics.

So there you have a democratic system where money is power to to spew your viewpoint to as many people as possible. The voter doesn't have to be particularly ignorant for this to work, as this subverts the usual social channels. You always have incomplete information about the world, even without the help of politics. Money is an undeniable influence factor. A free market can only work if both sides to a transaction disclose all relevant information, be it money or politics.

My problem with "The System" is that the influence of money (and other hidden factors) is hushed under the table, and thus, in the vein of the previously mentioned free market principles, self-regulation ceases to work, and you have entrenchment.

So that is the dichotomy perpetrated by "pure" capitalism with regards to democracy. If you want money to win, there you have it. Those in power rescued the banks, themselves, effectively, to keep their money and their power, at the cost of the people at the lower rungs being disenfranchised. This has nothing to do with socialist principles.

Coming back to the beginning, the two-party system is already biased towards entrenchment, effectively barring small upstarts from entering politics. The mechanics of how this comes about are subtle and evolutionary enough that nobody notices it until its too late. The system is already too broken (maybe only almost...) to allow reform from within, eg. by the regular mechanism of voting and elections. There is also a huge amount of technical debt from the before the information age, that needs to be shed, as well as legal debt from at least two centuries of evolutionary lawmaking.

TL;DR: reform is needed, but the system is too encubered to let it happen.
The owner of the car is and should stay the owner of the data. He should also be able to decide what and where to put his data, at any time.
Anyone here been through Y Combinator or know someone who has?
I'm new to this scene, just looking for some advice.

If you have just a couple minutes I'd love to ask a few questions of someone who has been through the program.

Any and all help is appreciated. Thanks!
Here's a list of the Top 10: https://hn-follow.desh.es/?user=hn-top-10
I've been developing the stack for The ContentMine (http://contentmine.org). In the next month or so, we will start scraping the entire scientific literature as it is published each day, and processing it through our 'fact extraction' pipeline.

Done so far:

- I've defined a JSON format for declarative web scrapers (ScraperJSON: https://github.com/ContentMine/scraperJSON)

- made a Node library for web scraping with ScraperJSON scrapers (thresher: https://github.com/ContentMine/thresher)

- as well as a command-line client (quickscrape: https://github.com/ContentMine/quickscrape)

- and a small library of ScraperJSON scrapers for scientific publishers that is about to start expanding rapidly (https://github.com/ContentMine/journal-scrapers).

Next step is to build the web interface that will let people compose data mining pipelines. Imagine something like:

- "give me a feed of all the articles in journals with 'Cancer' in the title that use HeLa cells in their methods"

- "alert me when a new paper comes out that mentions species X alongside a geographical reference"

- "find all the papers that mention my software in the methods but don't cite me"
you can try to use Core Bluetooth devices as tags: http://bdp.linkstore.ru
I was one of the people championing a Pathetically Eclectic Rubbish Language back in 2000, and I was definitely not alone. But you win points for making a "No True Scotsman" Fallacy[1].

1. http://en.wikipedia.org/wiki/No_true_Scotsman
>There is this common misconception that basic income will make everyone stay home and do nothing useful.

Rather than answering supposedly common misconceptions that nobody on this thread actually had - answer me this instead:

What is so wrong with giving the unemployed a JOB rather than just money? They need money, but they also want to work. During the last depression the PWA built tons of useful stuff, much of which we still use today. Why would Basic Income be better than doing that again?
Thanks bnb! It's much appreciated :) Shoot me an email if you want to chat with me about it: matt@mattkremer.com
is this the release where systemd expands its control to debian ?
This sounds very interesting and I've been wanting to do something similar in Haskell.
Fair enough, but can you do that until you're 80? And what happens when you have a serious knee problem or a pregnancy?

I suspect it's exceptional that someone can do physical labor for 40 hours a week for 45 weeks a year for 60 years.

The common response is, "Well, yeah, but you should retire at some point." And that's a fair response, but farm workers are severely under-charging if they expect to work for 30 years (to make up a number) and then be retired for 25+ years.
Startup idea: create a CAPTCHA that humans recognize as one word, but OCR recognizes as a different word.
I think the service is a cool idea, but you have people running cURL requests in a crontab? Heaven forbid something is wonky with the DNS, or your service gets compromised, or any number of things and that machine is basically 100% owned! Convenience or not, I don't think I could ever bring myself to commit that crime.
This may be roughly equivalent to saying, “I would rather have a programming language that describes what I want in plain english, so I can program myself without hiring a programmer to do it for me.“

Even the first ten amendments, "simple" as they are, have mountains of debate and legalese surrounding them.
I think its good having this kind of thread at some period of time. People build things everytime, its nice to see and share them.
Public Artfound: The single largest collection of geotagged graffiti/street art

http://publicart.io

- Rails backend API and iOS app frontend

- Nearly 500k images added monthly

- This is the current iteration for a 16 week research project of graffiti/street art related software projects
Tox doesn't even have an official release. It's still in alpha stage development.
Facebook Provides Developers New Ads API Access Levels
I just realized that Jetbrains changed their student plans! If you're a student, you can now automatically get a license for all their software for free! I think I had to pay $99 for a student license of IDEA 13, so this is great news!

Link: https://www.jetbrains.com/student/
Slow Symbol Loading in Microsoft’s Profiler, Take Two
Understanding category theory and its practical applications
Writing expressions concisely is an interesting problem, but in order to do, for example, tensor algebra in C you basically must use macros to define a DSL. It is not a goal which can always be achieved, but structures higher than variable names are what allow one to achieve it (usually.)

I didn't say that "verbose" variable names were mandatory everywhere - i and j have their place - but names which are at least pronounceable words are essential, especially if they appear in more places than a five line function.

This project is a special case, certainly, but toy compilers are nothing if not to learn from.
If you want a demo, any site running CodeMirror is a good start as that's the basis for the editor.

Otherwise, why not just download it and give it a try?
Exactly - I've come to peace with it that I'm being paid to be available for my 37 hours a week. As others have touched on, "knowledge economy" jobs aren't all-out work, so whilst my brain is foggy (especially after lunch) and I'm not accomplishing much, it's easy to think, for me, I'd be better screwing off outta here and doing something else.

However, for a lot of it I'm asked for help or input where my brain's called into action for a few minutes a time every now and again by other staff. We know this isn't productive for us, but if it provides value to the organisation as a whole (usually by solving something relatively minor, which is best expressed IRL than through the screen), then that's what they need of me.
12 Hurdles Hampering the Internet of Things
To Paul Krugman: Thou Art the Man
A quick and easy way to send files from the command line.

https://wsend.net

Tech Used: Bash, Node

Statistics: 612 users, 7 paying customers

History: I started working on this in Jan 2013, I wanted a quick way to send files from the command line and get a URL. I later found after building this backend, I, or anyone could expand upon it in many ways

https://github.com/abemassry/wsend

https://github.com/abemassry/wsend-gpg

https://github.com/abemassry/wsend-twitter-card

A little more about how it was built is in this post

http://abemassry.com/blog/2014/02/14/building-wsend/

I have some more ideas as well, if anyone has any ideas or wants to work on this with me I would definitely be down for it.
Getting Started with Hadoop MapReduce
Show HN: Debt Ceiling – Tech Debt Quantification/visibility/CI Tool
Bullshit jobs don't exist in a vacuum, they are consumers of goods and services produced by other industries. For instance, I'd wager that most of the print industry serves advertising. All those magazines, leaflets and billboards use horrible amounts of paper, paint, metal and electricity (and all of this is ephemeral, often thrown away without even delivering its message). And of course you need to design it, manage it, transport it, etc.

I think there would be much less need for products from more useful industries if we could cut down on some pointless zero-sum things we're doing. I don't have any numbers in front of me though. It would be interesting to see how much % of resources we actually waste like that.
Is Joomla still relevant? Is it on a downward spiral, or still have potential?
It's a good question. Would be nice if the page could've details what makes the criteria for being featured.
It seems you need to reinstall Scala plugin in Intellij 14 even if it's installed in your previous version of Intellij.
Full agree on the C# support. VS+ReSharper is nice but it's become a bloated blob of triple keyboard shortcut assignments and sloppy performance. It really needs some healthy competition.

MonoDevelop is surprisingly good, but IDEA is simply an order of magnitude better. With Roslyn out there, it should be strictly less work to make an IDEA for C# than it is for, say, Python, right?
The Internet is getting slower really fast and we're doing nil about it
That's fine, because sid is basically always the firehose of new packages. sid is always equivalent to unstable, so neither matters.

But "testing" is dynamic. Before the release it's lenny, after the release it'll surprise-upgrade itself to whatever sid was at the branching point.
The best way to learn a new language or framework is to do something you enjoy doing in my opinion. It'll make everything much more fun for you and even then, you never know if it could evolve into a bigger project even if it started from something that was just for fun.
Odd, I've never noticed this behavior before. I just installed the new version and it didn't take over any file types for me. I'm currently using it on Windows, maybe it's a Mac thing?
I suppose it depends heavily on your field, but I can't see this working well for a job that has a lengthy ramp-up time (where it might take months of training to start doing anything useful).
A curl protip is to specify a timeout with -m. An important detail, to be sure.
Storytime – Content-focused Rails 4+ CMS and blogging engine
If that is the case, it would create a market inefficiency which some other market participant could come along and exploit (anticipate the TAs moves and act preemptively). Your statement is basically saying there is no one out there smart enough to do this.
This looks like a really cool setup. My only constructive thought: It'd be really nice to have an option for text messages that was lower-powered than $10/month for 100 of them. I could never come up with three reminders per day, every day, that I'd want to get texted about, but if there were some option for ~10 a month – say, for birthdays and when a bunch of my bills are due – I'd be all over it. I just couldn't pay the same amount I pay Dropbox for 1 TB of storage in exchange for 90 text messages I'd never use.
very cool idea.
I recently switched to IDEA after 10+ years of Eclipse use. All in all, I'm rather happy but I still have to fire up Eclipse from time to time.

The main PITA is that multithreaded debugging in IDEA is awful: it is not possible to suspend all threads and resume only one thread.

In spite of the "Improved debugger" it seems that this problem is not fixed in v14: https://youtrack.jetbrains.com/issue/IDEA-43728

:(
'tptacek maintains a "must read" list in his profile. I'd add kasey_junk to it.

https://news.ycombinator.com/user?id=tptacek
If you do real work for another company you should be always paid for that.
Anyone else experience some issues opening a project in the new version? My $USER_HOME$ seems to have changed from one directory in another. I can still open the project in 13.1.5 but 14.0 can't find any of the files, since it looks in a different location. I can't define a new USER_HOME in the path variables to fix the problem, either (says it's already defined).

I can fix the project files manually with a find and replace (probably) but mostly posting this in case the folks at JetBrains are watching.
Correct me if I'm wrong here, but that just seems like reinventing crypto with a large key, and requires you to implement a counterparty-provided algorithm, which could be malicious.
Aside from my startup (which fills most of my evenings), my side projects never pan out. They're never completed, or end up being too difficult to complete. I consider them learning opportunities more than marketable projects.

Currently, I'm way out of my comfort zone: I'm on the way to build a proof of concept for an optical computer. No simulations, real hardware. My hope is that I can build a few passive logic gates, and go from there. Without a shadow of a doubt, I'll fail. There are a million factors I didn't consider or underestimate, and my knowledge of things like laser physics and optics is marginal at best. But I'm learning a lot from it, which is the main goal. I also just want to see if it can't be done. From what I could gather, there is far too little serious research being done into the whole field. If all else fails, at least I'll know why that is.

And hey, any side project where you get to play with lasers on your kitchen table has got to be a good one, right?
Follow you enemies too !
we use exchange + dropbox, so this will be a nice feature
How I would love to see IntellijIdea support Mono. It would make my life so much easier.
DC legalizing- Christmas came early for Late Night show writers and hosts.
All Things Pivotal Episode #5: Interview W Ailey Crow at the Strata+Hadoop Conf
The Verticals Hardest to Find Complimentary Cofounders
They should just include the Scala plugin by default. It's the most popular plugin by a very wide margin.
Also, depending on local and regional laws, asking people to work for free can be illegal.
I'm working on a new model of how online discussion is done by developing a new monetizing strategy which shares ad revenue with users who bring original and quality content to the board. In essence, insightful comments which spark meaningful discussion are rewarded with real money (or an option to gift that money to a charity or another user).

https://whoaverse.com

Built mostly on .NET stack.
The student license is valid for only one year.. but its a great opportunity for students like us to use these tools for free..
I think many people in comments to your post not understand that "can" is not equal to "will". The rights they require are mostly for avoiding issues with some countries, testing, avoiding responsibility during hack attacks, removing duplicates and editing some files that could be browser open.

If anyone thinks that Google, multi billion company would take your photo and publish it to make money out of it - you are creating issues to yourself.

Its Google, they are all about your data, statistics, behaviours and keywords. Not about stealing things and using your photos/artwork for marketing purposes.

Cloud = trust. No matter if its Dropbox or Skydrive or Box. On the end of the day you either trust company or not. No matter what's in TOS.
This is focused on tech jobs. What is for you, a "job that has a lengthy ramp-up time"?
What always surprises me about articles like this, and the discussions they produce, is how so many engineers and builders-of-things discard the evidence of their years of experience and see the world through the eyes of people who've never built a complex system.

For instance, a couple of years ago I inherited a convoluted, needlessly ornate and grotesque application that could clearly be rewritten and even extended in one-fifth the LOC it currently occupied. When I finally got greenlit to perform the surgery the usual thing happened, which is that I realized, after much painful effort, that the system had become grotesque little by little, in much the same way that good people turn bad: by taking steps that seem appropriate at the time to what the situation demands. My solution, in the end, was somewhat less grotesque than the original, and certainly more capable, and yet it was not the glittering jewel that I had imagined beforehand, and the path to it was littered with bodies. I assume many people on this site have had a similar experience.

So with regard to repugnant systems (giant commerical banks) and jobs (middle management) or jobs and systems that are repugnant due to the types and numbers of people who seem to be filling them (lawyers, politicians) and wrt established habits and customs and traditions -- to all of it I now perceive that these jobs and systems are the survivors of a mighty selection pressure, and the whole creaky affair so vastly outperformed the alternatives that it has taken over the world to the extent that now it seems as if nothing else is possible.

Something else is possible, of course; but the costs of these theoretically more benign and humane alternatives are impossible to envision. And I'm positive that the whole thing could not be redone, elegantly, in one-fifth the code.
I'm confused, because the best are working for someone already or for themselves. How can they come in for 2-3 days?
From my POV, working 40 hours a week instead of 15 is a conscious choice. I could probably start my own company or source of income and get away with working 15 hours or even less a week, but I'm not going to.

One, working for a boss is secure - I know what I'm gonna earn by the end of the month, no stress there.

Two... I honestly wouldn't know what to do with the remaining time. I'm not an artsy hipster that spends all that free time being creative, I'd probably spend the extra time playing video games and growing fat. I for one need the structure in my life.
I'm quite confused on the accuracy of this article because of GRR. The article was written in 1994, but according to the GRR history page (http://www.grr.org/History.php#5), the airport did not change its name until 1999. I believe the GRR is for GRand Rapids, and question if this was actually written as is in 1994.

Edit: I see that the article is updated online. Still think that GRR is for Grand Rapids though.

Edit2: Source Found! A NTSB report froma crash in December of 1998 cites a weather reading from " Kent County International Airport (GRR)" (Source: http://www.ntsb.gov/aviationquery/brief2.aspx?ev_id=20001211...). I move that this shows that the airport code was GRR prior to being re-named Gerald R. Ford, and that GRR stands for Grand Rapids.

Edit3: Further a US DoT doc from April 1998, lists Kent County International as GRR in Appendix D: http://onlinepubs.trb.org/onlinepubs/sr/sr255/apndx.pdf
A summary of the new features:
http://www.jetbrains.com/idea/whatsnew/
For those stating this would cause candidates to work for free:

"During this time, all Wonoloers would be considered as independent contractors and get paid for the job performed. Wonolo would take care of payroll as well as other administrative HR burdens involved."

This could also clear the air of expected compensation from the start.

Regardless, I do think the idea behind this approach has merit, but it could also use some realistic iteration itself.
Dude - this is sweet. Like codeshare...but better. Thanks for sharing with us!
Social Advertising Benchmark Report, Facebook Results