skysight-inc/HackerNews huggingface dataset:
You can get raw data from the NYSE TAQ database, as well as various resellers:

http://www.nyxdata.com/Data-Products/Daily-TAQ

However, doing things like producing a histogram or tracking the individual numbers for a given fund require that you be able to identify individual traders, which is generally not possible. Funds will route their orders through brokers specifically to anonymize them, often slicing a given order up into many sub-orders so that it can be spread across multiple brokers. The golden rule of the financial industry is to never ever let your competition know what you're doing; if it gets out that, say, Goldman Sachs is buying a whole lot of Google stock, you can bet that the price of Google will rise and it'll cost Goldman a whole lot more.

When I was still tangentially involved in financial software, there was a lot of interest in algorithms that could heuristically identify possible actors based on patterns in the data, much like how Google identifies webspam or PayPal identifies fraud. I'm not sure how far this got, though, and obviously if some company succeeded in it, they wouldn't tell anyone. Actually, I kinda wonder if this is the sort of stuff Palantir is doing.
The anti-fluoride folks remind me a lot of the anti-vax crowd.

As someone who hangs out on an anti-vax list, I think there is probably a lot of overlap between the two groups. (I don't say that as a put-down. I stopped getting my annual flu vaccine some years ago.)
I propose using the term debuggist for a human operating a debugger, as in typist and typewriter.
The article mentioned at least twice that "mainstream" porn companies are making videos that look like amateur porn because that is what the market wants.
I have a large number of books that aren't available on Amazon, especially foreign-language books. If this can produce good-quality images, suitable for OCR/PDF, then it becomes a lot easier than building my own scanning machine.
I've advocated this for depression, too .. if you think you are truly depressed, then get the hell out of your environment, and go somewhere else, completely and utterly different, immediately. It works.
this article holds especially true for non-technical entrepreneurs deciding which language to choose. while the supply of developers may be lower for languages such as ruby or python, you find a much more enthusiastic crowd of developers who in general seem to already have graduated from another language such as php. thus, from a business non-technical background, by choosing an enthusiast type language such as ruby it made it easier to narrow down quality developers with the right mentality as a technical co-founder than say a language with a large supply of developers such as php.
I could see using this to take old Moleskine notebooks and digitizing them for long-term reference so I can junk the physical notebook. That kind of info might be invaluable.

For everything else shelling out $10 for a kindle book seems like a better use of time and money.
RiderOfGiraffes scripted a bot that would do that automatically, but others here thought it was some cheap novelty trick he was pulling.
If something is "inherently hard", not just "hard", it seems that it should be hard for everyone, which is clearly not the case with programming for some geniuses out there. There are people who don't blink an eye at mastering any data structure or algorithm, don't sweat when it comes to actually coding, and they're human just like you. Plus what if programming became really simple for some AI to do? You ask it "Make me a triple-A style video game I might enjoy" and it does so after a short while. I believe Eliezer is pointing out that programming being inherently hard is a mind-projection fallacy.
"Goldman will be creating a “special purpose vehicle” to sell the stock to its wealthy clients and then will charge them a 4 percent initial fee plus 5 percent of any profits."

Heads we win, tails you lose. I'm just waiting until they start dividing up the stock into tranches.

(from http://news.ycombinator.com/item?id=2071267 )
Yeah I remember. Freaking good idea and well executed, destroyed by a small but vocal bunch of whiners.
Using MTurk to spam upvotes for Quora
This piece is commentary on the article discussed recently here: http://news.ycombinator.com/item?id=2076785

I will add: Myth Busters has shown that quite a few scenes in block-buster movies defy the laws of physics and couldn't really happen that way. Movies are frequently escapist fantasies, basically. I don't see why porn should be held to some higher standard of "authenticity" or some such than any other movie genre.
The story link is scrogged. Here is a working link: http://online.wsj.com/article/SB1000142405274870472310457606...
No real opinion, but I will note that your question (in the title) isn't really an accurate representation of the situation: They are offering you stock and also jobs, with a pay raise.

I am noting that because the way you worded your question implies that you may be mentally framing the question that way. A more accurate assessment of what is really going on may help you think more clearly about this decision.

Good luck with this.
I joke that I have sold my soul to google because of my Droid. Then they went and gave me a Chronos. It concerns me that they know more about me than any other person in the world.
This is why you bought an iPad
Generally its because people who run/operate companies are terrible at allocating capital. Operating a business and effectively allocating capital are two very different skills, but smart operators seem to believe their intelligence carries over to capital allocation.

The fact is that most companies destroy shareholder value when they buy other companies. A recent example is the whole yahoo/delicious debacle but anyone reading this can think of a handful of other equally terrible examples off the top of their head. A far more difficult exercise would be to name the acquisitions that actually added long-term value. For example, Apple is generally great at only buying companies that add real value. They are an exception.

The fact that operators are terrible at capital allocation is great for founders and VCs. Its terrible for shareholders of the acquiring company!
I don't post comments disagreeing with people but I'll make an exception here. This is possibly the most shortsighted idea I've ever heard. Suicidal people need a venue to discuss their issues without stress or judgement, not to be relocated to a warzone. Suicide is a real problem and as someone who has been through the darkness of those thoughts let me say this idea is completely wrong and should be relegated to trolling or satire.
That's exactly what I (business guy) did. I learned Python myself also though, which made a difference. Reading threads on sites such as this had already convinced me of the power of Python (over PHP) and I put together a couple of demo apps to be developed in Python. Some of our guys have moved to it, some have been more resistant, but the guys who have seem much more focused on what they need to do.
Way more dynamic objects (vehicles, destructible environments) with a much larger playable area (more room for more objects). Usually objects further from the player are updated less frequently (to deal with the sheer volume of objects) but may still be visible to the player, client-side prediction comes in handy here.

Also the need for more detailed positional/vector data for much more complex physics simulation, which also requires both a higher resolution of updates to function realistically. Additionally, fast moving vehicles with more delicate control/handling, such as fighter aircraft, also a require higher resolution of updates so that you can actually fly them without crashing due to the feedback loop of perceiving jerky/delayed movement and input response. Prediction can help to smooth this out.

Additionally modern games use things like physically simulated projectiles (think bullet drop[1]) with collisions calculated using mesh-based collisions instead of simple hitboxes, over much longer distances, so there is a need for prediction as timing is more of a factor. Quake 1, 2 and 3[2] use the 'hitscan' method[3] of calculating whether a bullet hits its target, which is instant and calculates a linear trajectory, which has the side effect of making it easier for players to adjust to lag (basically any difference between the player firing and the hit registering is network lag, and should be more or less consistent).

Finally, two slightly different issues that have become apparent in recent years are automatic match-making and local servers (ie, the game running on one player's console). Auto matchmaking is often fairly shitty, meaning that (on average) players end up playing on servers to which they have a higher ping time than if they had chosen the server from a server browser (something that is sadly becoming rare in today's games). The phenomena of local servers, on the other hand, puts pressure on the total available throughput, rather than ping time, as the player that is hosting likely has more limited outgoing bandwidth than a dedicated server might.

[1]http://en.wikipedia.org/wiki/External_ballistics#Bullet_drop

[2] only for some weapons, a rare exception for the time

[3]http://en.wikipedia.org/wiki/Hitscan
There are many venues for suicidal people to discuss their issues, and people are still committing suicide everyday. This is not to replace anything existing, it's just to reduce the number and address those who are currently not being helped by the systems you talk of.
There isn't much point criticising possibly the least used part of an otherwise well designed site. Quora are certainly aware of the page but have probably prioritised their efforts elsewhere.

Instead, let's be constructive. What things do you like about Quora's design or how would you redesign things that you don't?
i think you would have more success with this product with the android crowd than ios.
There are two cases that we're addressing:

1. A developer writes an end-user application, but doesn't want to free their software. Clearly, this person isn't going to use GPL libraries.

2. A developer modifies an end-user application licensed under the GPL. If a developer makes a modification and then distributes that modification, then clearly it was of use to someone outside of that developer. The GPL guarantees that every person who uses that modified software gets the source.

But why is it good for an infrastructure product to be free, where it's bad for the end-user product?

Or, is this as simple as the fact that most free infrastructural products don't require the end-user product to be free. So, it's "appropriate and beneficial" for them to be free. But, most free libraries do require the end-user product to be free, so it's bad for the developer who may or may not want to make their product free. If I've accurately summarized, then at what point where does that "appropriate and beneficial" aspect disappear?
I work a little different than most, as in I don't plan a set schedule in advance or according to a fixed routine. I look to reduce low-efficient workflow and seek to maximize optimal workflow taking intuitive, up to date cues from how I'm feeling & doing. Examples:

My approach involves compartmentalizing blocks of time through out the day and devoting blocks to separate projects. When I'm working on one project I don't worry about other projects because they have their own blocks. It helps to avoid nagging thoughts that are related to other projects/commitments while one is trying to tend to another.
Those nagging thoughts are a major point of stress/distraction/lack of productivity so I make it a point to prevent and counteract them. Each dedicated block is like giving permission to tend to one area and one area only. This works as long as I am concrete/clear about it.

In between blocks I take advantage of mental reboots/refreshers by resting, exercising, eating, socializing etc. Nothing original about that, but it works. Especially if you stop working when you hit a roadblock, or find you're getting tired, switching to rest or to a different project helps is most likely much more efficient than struggling along. If I'm frustrated I know I'm not working optimally and that's a cue to either switch to resting or a different project.

I give way to flow, or being in a zone, because it's like to be the most rapid and effective way to get things realized. Whatever is psychologically easy/pleasant to do is probably going to be more effective use of time. Note that that has nothing to do with intellectual difficulty (working on a really hard problem can be fun etc). Of course this doesn't work all day everyday and for everything, but as a general guideline it makes a big difference - at least for me.

It's a bit like sailing, I know generally where I want to head, but I work with the wind and weather. It works nice if you have a lot of flexibility and freedom about how you manage your time.
Mindset-wise certainly. But on what tablet?
I need some of the 0.3.x features :)
Can you give me an example of Python readability trumping Ruby?
Particle Video (flash)
Droid VNC server
Nah, too expensive if done correctly. In STTNG, people always give their pads away.
I'll have to disagree.

When I open up any substantial Lua project, I am flooded with local local local and local. It drives me nuts coming from a Python background. Not only is there that, but they decided to use "end" which is more cluttered and longer than using brackets.

Lua also has no standard oop system which means you have to guess which half-baked version the project is using. I'm sure there are other problems I forgot to mention here.
I'd be happy if they applied their own interface standards to the App store and let me change the language. Just because I am in a German-speaking country, does not mean I want my computer to speak German. I've got the rest of my system language preferences set up just fine - why can't they use those standards, instead of having a whole different setting for the App store? Pathetic.

Plus, where are the preferences for the App store? Shouldn't there be a syspref?

I have a feeling that there are a lot of loose ends in the Apple development process for apps like App store .. and maybe they're leaving these ends open for future releases so everything can be "revolutionary" again. But for the most part, I feel like the App store app is, itself, pretty weak for a company supposedly as powerful as Apple is..
9 Disadvantages (or Cons or I Hate about) of Spring Framework
The strange thing about python is it is almost TOO easy. I have worked with developers who preferred python because basically they were not great developers. The ease of development and attractiveness of the speed of development was a lure.

The only problem is the overall systems they wrote were bulky, not efficient and generally over-engineered. Very not hacker like. For example using threads in python, a very big no no that can and does cause many performance issues. Designing python middleware that had no reason to exist other than to be a cool project to build.

And so on and so forth. Painful.
The beep is plain awesome.
Facebook has exactly the same interface (http://i.imgur.com/EwrHR.png) only much longer (~60 checkboxes not including one for each external app).

Horrible.

If that's not a middle finger to all users (is is that hard to implement a simple "Select All/Deselect All"?) I don't know what is.
That sound you hear is the furious typing of counsel at Paramount drafting a nasty cease and desist order.
Hah, it's crazy how the things we saw in science fiction are becoming a reality!

Interestingly enough, the (unattributed) background music in the video was played/recorded by Adrian Holovaty, one of the original creators of Django: http://www.holovaty.com/writing/mario-gypsy-jazz/
People have been suggesting this design is some sort of mistake. I don't think so:

1. Email notifications have a very high value for Quora - they drive users back to the site.
2. A fair number of users unsubscribe by clicking the "unsubscribe" link at the footer of emails
3. This design ensures users clicking this link will only ever unsubscribe from a subset of email notifications.

This way, users end up with an inbox that looks like this:

http://www.contrast.ie/blog/getting-your-users-on-board/

If a user wants to unsubscribe from everything, they have to have the presence of mind to visit this page, and then untick every single checkbox. This is effortful. Geni.com were criticised for using this exact dark pattern and ended up adding a single-click "Unsubscribe me from all Geni emails" feature:

http://wiki.darkpatterns.org/Roach_Motel#Example:_geni.com

The real question is whether Quora should be criticised for using this design pattern, or is it an acceptable practice?
What's the point of map reduce if data can be held in memory ?
why do you think it's better than MongoDB for stats?
The Need for Urban reforms
It's simple, If I don't indent properly - I don't get to run my code in python.

Yes, I know I can make my code look cleaner in Ruby, but I'm lazy. Call me shallow, but sometimes not having to type in blocks and "end" is kind of nice because of the inherent indentation constraint. And that indentation makes it easier to find lexical scope hierarchy easily too (at least for me). YMMV :-)
It was certainly novel, and probably cheap. In most other discussions on HN, that combination would be regarded as a good thing.
Sorry about that, link fail on my part.
I don't want to be coerced into vising a site just because it's hitting my inbox, I have enough incoming mail as it is.

If a site respects me by allowing me to easily remove all email notifications, I'll be much more inclined to respect it back by giving it my business.
As long as they have sensible default settings (which I think they do), having detailed control of the types of notifications you want to receive is perfectly fine. If they decide to change default settings to something less desirable, then I think this would be more of a problem.
What's "between 5 and 10" as a percentage of the volume of attempts to send you email?

If there were 20 attempts (spam and non-spam) a day, that's a problem, if 2000000, less so.
An Inspector Calls Essays: Do’s and Don’ts
English literature students will be assigned the writing of the An Inspector Calls essay. There are elements which need to be considered when writing essays of this nature. Having a good understanding of these elements will enable students to write effective essays.
Of course you can also hack your own: http://www.diybookscanner.org/
+1 for the music.
It's estimated that fewer than 400 people make a living off of fiction

Wow, can you point me to a reference for this statement? I find it remarkable.
> If a site respects me by allowing me to easily remove all email notifications, I'll be much more inclined to respect it back by giving it my business.

In the unlikely case that this is actually true for you, not just the way that you like to imagine yourself to behave, it certainly is not true for most users.
SMS of Death, Mematikan Ponsel Melalui SMS
It's probably gonna be coffee script on top of node.js
It was figured out much earlier than 1996 - CAML first appeared around mid 80ies, and the theory behind type inference is more than 30 years old. I strongly suspect someone of Richard Gabriel caliber to be aware of this in 1996.

Maybe the real difference is that computers became powerful enough to do this kind of compilation in near real time not so long ago ?
> Doctors don't sell medicine, plumbers don't sell pipe, why should developers sell copies of binaries rather than hours of work?

Because selling copies is far more scalable and profitable?
Failure Sucks but Instructs
If you'll read the New Testament, you'll see nobody was more tolerant and respectful than Jesus.

And I don't know what' the fuck these extremist Christians are smoking, but they sure as hell haven't read their own bible.
Oh, didn't know that. Thanks!
OWC launching SandForce-based SSDs for latest MacBook Air
Quite a misleading headline: SFU/SUA doesn't allow one to run native Linux binaries on Windows, which would require emulating Linux's syscall interface, libc, dynamic linker, etc. It allows one to port (i.e. recompile) POSIX-compliant applications. Linux (as the term is popularly used) is a significantly-larger superset of the interfaces and utilities specified by POSIX.
The python paradox is not true anymore - since it is taught in so many schools these days. Unlike in 2004 when the article was written.

However the main thesis holds true still... just replace python with haskell, erlang, clojure, or some other esoteric language.
I still do not get the point of an Arduino though. Its just an avr board with supporting circuitry. If you know C, picking up on avr-gcc is a day or twos job. Where was the need to have the new language? Where did all the hype came from?
That article is full of it. It essentially wants to agitate a lynch mob against the messenger, implying a conspiracy by Rémi and his current employer, without a clue about FSF's role in the incident, while disregarding any responsibility of Apple to provide its paying customers access to the software they want, by the terms they can get it.

The copyright infringement notice is not targeted to the group that created the iOS version of VLC, and their project is not being shut down. There is nothing that prevents those people developing that application and distributing it via any channel they choose, as far as that distribution channel complies with terms of GPL.

Why is it so hard to see that it is Apple which prevents having such distribution channels?

I am amazed how these people assume all the liability, support and freedom from the FOSS developers, who work without compensation, while happily accepting all the restrictions from their vendor, who they pay dearly.

How is it that I see talk about "how much I hate GPL" and "how GPL is bad for businesses/community/users/whatsoever", when an alternative of having these pieces of software distributed with GPL license is to not have them at all? The author of the software chose the license for a purpose. Without the license, choosing of which the creator has no obligations from the users whatsoever, the users will not have the software at their disposal at all.

Instead of groups of whiny self-entitled users and lynch mobs, we need people who are willing to work against restrictions imposed by businesses, and users who see themselves as members of a community and not just as consumers of others' free work.

That said, I think non-copyleft licenses like BSD are just fine. But at the end, it is the authors' privilege to choose whichever license they find suitable.
Startups and The Problem Of Premature Scalaculation
Will cloud computing be adopted massively in 2011? 
See PArt 1 and Part 2 Companies discussed: Amazon, RackSpace, CloudSigma,Gartner, Joyent, Cloudera, Eucalyptus
Please do not use sensationalist headlines. "LCARS Internet Media Reader [Star Trek]" or something like that would have been appropiate. Thanks!

For Android there is a fun sensor and statistics viewer called Transcoder that has the same interface.
No it isn't. Next. :)
What happens if you do this and a lot of users click the "report spam" button?
If I were Quora, I would include a 'daily/weekly summary' option.
That way, people will get one notification with all details.
Also, be sure to click the "flag" button.
JSLint just got a major update
Ergonomic Keyboard for Pirates
It's a quote from the page, the last bullet in the list of features.
I'm an avid nodejs lover and coffee irritates me for some reason, but I agree with you. It's combining some of the up points of python and ruby, and hopefully it begins to get more traction.