skysight-inc/HackerNews huggingface dataset:
Right, and now you can use "git show --pretty=raw" to see the commit
header:

$ git show --pretty=raw 313378458f8c4fb53c808f4b0bae5bf71ba5e23b | head -n 10
commit 313378458f8c4fb53c808f4b0bae5bf71ba5e23b
tree 7e93df01bfc9c187d58a0b96e756dd8ac0031c82
parent e4eef26d985177e4bdd32bf58b6ae40e7ae67289
author Spencer Creasey <screasey@monetate.com> 1396872901 -0400
committer Spencer Creasey <screasey@monetate.com> 1396872901 -0400
lulz 843475

1337 Test Commit

http://lists-archives.com/git/756394-choosing-the-sha1-prefix-of-your-commits.html

There's replies in that thread where the naïve technique I was using
was improved a lot.
Trading is the only industry on earth where we even debate whether Joe Schmoe off the street should have a chance at competing with huge institutions, and oddly enough it's probably one of the most purely competitive things in the world. Most guys who play ball at the local park can't be Lebron James. A guy sitting at home has no shot at market-making liquid stocks, and low latency is only the tip of the iceberg as to why.

In any case it is not expensive to start a firm like this relative to most things in finance or even other physical market-making businesses like running a retail store. You could do it with a few million dollars and a dozen technologists/researchers. That's why this debate is so stupid. Banks who are mostly the ones complaining about having trouble executing could easily hire up a team to build better routers and execution algos for them. Most of them have, even, which has cut HFT profitability considerably. The laggards prefer to go on CNBC rather than invest in technology to keep up.
For a gentle introduction to functional programming and Scheme/Racket, check out https://class.coursera.org/programdesign-002 and the How to Design Programs book http://htdp.org/

These can be good precursors before starting on SICP. I have to say, though, that I have never felt comfortable with LISP's syntax. The parentheses and the prefix notation are convenient for the parser, not the programmer. Pyret http://www.pyret.org/index.html might be a step in the right direction.
I was a free-rider of their free tier for a while, but I totally understand and respect their decision. My main problem is not that I do not want to pay 20-30$ a year for a dynamic DNS, my problem is that it is either one of their domains or I have to bring domain services to them.

I own a VPS, I own a domain and I was wondering if I could do something myself. Does anyone have any recommendations how to set up DIY dynamic DNS? I would like home.mydomainexample.com or even home.homelan.mydomainexample.com to point to my home dynamic IP.
When I first read the title/url I got excited. I remember on the thoughbot podcast, Ben Orenstein spoke about going to Cape Cod with some people to go through SICP in a nice but isolated setting. I thought something like that was being organized on a larger scale...

Still a very good article, with great arguments for why the book is a must-read. Great links too. I would also include something easy like Realm of Racket (or Land of Lisp) as a good first-date before shacking up with SICP.

Hacker Retreat does look great though. Wish I had the free time to give it a try.
I didn't mean to imply there were only two possibilities. I merely wanted to ask what "not rigged" means to you? As the current article shows, there are real technical details necessary to figure out and the CAP theorem limits what can be done. It isn't a simple question to answer, and I personally lean towards "the SEC did a generally good job".

I don't know why you feel I was "uncivil" - I merely asked a question. However, please accept my apologies.

If you want to see assorted defenses of specific aspects of HFT, I have quite a few on my blog. I just posted a new one today. If you look way back, you'll also find a tutorial explaining the basic mechanics of HFT. I'm planning to publish an explanation of "quote stuffing" (aka screwups in your algorithm) shortly, as well as a takedown of Mark Cuban's idiotic article on the topic.

http://www.chrisstucchio.com/blog/tags/high%20frequency%20tr...
It's an interesting thought exercise, but as many of the commenters point out, the article's premise is a little ridiculous. With modern technology you don't need to send the entire population. The vast majority of the genetic diversity could be in the form of frozen sperm and eggs.
In my opinion there is just no good use for Comic Sans, except for speech bubbles in a comic (and even for that there are better fonts).

Important memo or note at a pediatric ward of a hospital? Well, you are still communicating with adults, so you don't need to use a "childish" font. Funeral? Nope. Childs Birthday? Nope.
Is Singly having problems?
I've been trying to login to https://singly.com/ using Github for the last two days and that doesn't seem to be working. Today I noticed that https://www.singly.com/docs/ is also unavailable
Banned for Life: The hidden danger when developing for Android
A medium city in north Italy.
There are significant differences in terms of salary and HUGE differences in term of jobs availability and cost of living.

Some planning is needed if you want to a nice living.
I can understand MongoDB and MySQL - but what features were missing from Postgres?
Once they forked Webkit into Blink they took the bad path.
Hi, I haven't had much of a close look at the site. I quite like the initial design, but one thing I think it would really benefit from is a simple search interface on the home page.
Exactly why is it better when there's "an app for that"?
Plenty. Read LinuxGizmos http://linuxgizmos.com (nee LinuxDevices) to keep abreast of them.
No, no one has the right to be CEO of Mozilla. Its not a right to start with.
Mammography and the acute discomfort of change
You could have a look at http://www.erp5.com/ .
Dyn started warning about this a year ago already [1]. This is not an overnight announcement.

[1] Text-content of email in my archive dated May 10th 2013. http://pastebin.com/r6JQxU8i
TED All Stars return for more talks
While the answer to the question is quite good, the rant at the end really considers any kind of skepticism towards medicine "mumbo-jumbo". The key point is the accuracy of the medical prediction from the measurements. If you indeed have a tumor of the kind Jobs had, then it is certain that you will have problems. However, if you have mild hypertension or high cholesterol, you might have a problem, or then you might not. Treatment itself can cause problems of similar magnitude, and therefore being skeptical can be well founded.
Sitting in a small room, with 6 others, building the next big SaaS product felt very much like it did 15 years ago on EFnet
Yes, but you shouldn't hardcode the known end point, you should cache it after a walk. At some point in the future, it may 404 or 410 on you, in which case you rewalk the API from the entry point, following the link relations that got you to the thing you are after. Then you cache it again.
Hundreds, depending on the packages used by the customer. The good news is that the names never changed, so you could write a third-party add-on to it and it would always work. I know of a company that wrote a plug-and-play data warehouse for only JDE customers.
Michael Lewis Is Wrong About the Stock Market
HN discussion under a direct link to their blog (without link tracking): https://news.ycombinator.com/item?id=7546300
Any particular ideas about what's wrong with it?
what about the people who did not do a math major. Is this a book they can get through?
I tried once and saw that I had to read two other books before I could even read chapter one. one for discrete mathematics and the other for calculus. do you have any tips for the people in my situation?
a link to github / behance is a must in the description
Unfortunately for your system, if there's a network hiccup, you won't know why your jobs failed and the job will hang on the HTTP call. Also, you're paying for it instead of just sending e-mail alerts to yourself.

Critically importantly for this use case, if you are doing something critical for your business (say, backups or your daily billing run or sending reminders to thousands of people or what have you) and something goes wrong with your network and makes you unable to curl, you get told about that. If you instead do self-hosted email, and your network fails, you don't get told about that.

It's fail-open vs. fail-close. That's literally so core to the product it is alluded to in the name. A Dead Man's Switch doesn't go off if anything goes wrong, it goes off if everything doesn't go right.
I think if anything it's more like the 80s, but with more cash. You have to watch your ass more now, but there's more monetary incentive on top of the thrill of scoring some ingenious root. Of course anonymous has had a big influence; they're the biggest cyber-griefing collective in history. But to me it seems like you can still do whatever you want and not worry as long as you don't hit any .govs or extort/embarrass big corporations.

Remember that historically almost all of the people who get caught get ratted out by their friends. If you work by yourself, or at least just don't tell your friends too many details and don't be an arrogant loud-mouth to strangers, there's very little the feds can do. The sheer waterfall of data they have to sift through just to find your weird custom backdoor makes it impossible to investigate every attack. As long as it doesn't effect their bottom line, who cares?

(Also, seriously, the NSA? They have nothing to do with domestic hackers. They'd maybe use you as a pawn to draw out foreign islamic hackers or something, but then throw you to the FBI to get Mitnick'd in prison)
yeah, pretty bad.
Oh, I remember using dyndns back in the day. It was remarkably convenient to run Apache on my desktop computer, I could just drop files to my www directory and have link ready to be pasted on IRC. Of course that was way before Dropbox et al came to be.
Right, so, playing around.

(In my experience, "learning about how to manage distributed systems..." and etcetera isn't much fun and is something you can do fairly well emulating as many systems as you'd like in software.)
Roughly 5,000, as I recall (JDE was only tangentially related to my world). I think about 1,500 of those map to specific system objects.

There's also various naming conventions for other objects; user-defined value lists have terse names like "UDC 98/SY" (which is, I think, the value list of value lists, or some such), batch routines have names like "R09430," and so on. It's all horribly brain-deadening, and the cognitive barrier to entry is extremely high. Evidently ORCL likes it that way.
On all the encryption tutorials I found they always assume 2 and only 2 people trying to talk privately.

I wonder how would one encrypt a conversation between say 15 people.
It's not "tin foil hat", it is circumspection based on public reports about what the NSA, etc., does. But I am with you. There is shit we used to do in the 80's that I would never even dream about doing today.
Kissing....How to Kiss
Depression increases heart failure risk by 40 percent
Experiments on Seismic Metamaterials: Molding Surface Waves
Felix Language
But there are plenty of SODIMM-sized ARM embedded modules with much more compute power than the Pi already.
It's a pity they went that way, because there's a different framing that is still an interesting question: How far could humanity fall and still be able to recover? It's essentially the same problem, and it's a lot easier to imagine that we're talking about a situation in which there's no longer any technology. We consider the people geographically co-located, but it's not hard to imagine a pocket of survivors of whatever $DISASTER, either.
Awesome stuff. Although this has already been shown off here before: https://hn.algolia.com/?q=superhero.js#!/story/forever/0/sup...
PyCon Apac 2014 Infographic
Why could they not do that with any of the existing SODIMM-based ARM boards?
Are you sure it's ignoring them? mansr said the kerning table is incomplete. Could it be that you were just lucky on everything you tested on?
Correction: They built a trailer and mooch off the girls parents. Not really all that commendable.
How would they get the GPG key securely?
Can't say Berlin is an isolated setting, nor does it feel/look like Cape Cod, but it is nice - if you like cities, it's got something of everything. :) And the summer here is fantastic.

SICP is always "on" at Hacker Retreat - I've always got SICP buffers open. If you're able to work remotely from Berlin, consider coming to Batch-02 this summer.
> Essentially, an ERP and set of buzzword-bingo cards in the same box.

Isn't that redundant? ERPs always come with buzzword-bingo sets, its like a defining feature of the product class.
I also don't understand why any of this (OP's problems with REST) is the fault of REST or a database. To me this is 100% architecture woes. Lets of people use REST successfully.
This is great - it hits major topics that should be part of this debate. It's long, and it's a bit complicated... but so is the issue.

Some things you should be thinking about after reading this:

* What exactly constitutes front running? Does trading based on public data (albeit in expensive feeds) constitute front running?

* Large trades are almost all traded through algos. Are those algos better than proprietary "market making" algos? Why?

* What is adverse selection? How do dark pools contribute? Who benefits and who suffers?

Read more articles like this. Be suspicious of "simplified" discussions.
Author here, happy to follow up. We wrote the Meerkat manifesto after our experience Hacker Retreat batch 01. The meerkat method should be more effective than the (few) alternatives we tried. If you hear from people having success doing something similar systematically (pair up; mentor picks a project, gives it to learner, only simplifies if learner is really stuck)... let me know. General lore says that people who pair up more improve faster. The twist here is to pair up with a person who is far more advanced and is invested in getting you up to speed.
Allowing a trader to make large trades makes price discovery happen faster and more accurately. I've written a more detailed explanation on my blog - read HFT apology 1 and 2.

http://www.chrisstucchio.com/blog/tags/high%20frequency%20tr...

As for the downvotes, I lead a small cult of traders, rationalists and scala programmers - tptacek is my #2 sycophant.
I have been a happy, non-paying customer of ZoneEdit.com for years. I am looking for current information on their free offering and coming up empty, but if the pricing page is complete, your two zones would cost you $12/year each there.

I think that the offering when I signed up was two free zones. Now it looks like you can get one for free, unless I'm just grandfathered in.
What's wrong with STEM education?
It's a lazy question, but what mechanism is the regulator using to score the effort of the exchange?

A related topic would be how often they take enforcement actions.
I don't know about greatest, but game theory has set off some pretty good epiphanies. I watched this Yale class on game theory and it really opened my mind:
http://oyc.yale.edu/economics/econ-159
What's the point of monitoring your infra if the report never reaches the party who cares?
Other than something like blue box, what would be one such thing? If anything things are away too tame now. I think of is something like CarShark that isn't publicly released.
It's not really a DIY solution, but Hurricane Electric offers support for dynamic DNS subdomains with their free DNS service. It's super easy to throw in a cronjob with curl and have work. https://dns.he.net/
12 people feels quite a crowd. From my experience talks in crowds of that size stay typically very shallow. Any ideas on how to keep that more focused?
Charge Your Phone in 30 Seconds? An Israeli Firm Says It Can
I don't understand the emotional baggage that comes with Comic Sans. Its a font, not a statement. The message is in how the letters are arranged. I'm not even sure I can recognize Comic Sans if I saw it.

Moral? SO there are people like me, who don't give a leap what font you use. Its fine to communicate with us with Comic Sans or Dingbats or whatever. Ignore the people with their banners crusading for better communications through clever framing of the ink.
https://www.youtube.com/watch?feature=player_embedded&v=9DhJ...
Wow, this is like the best case scenario of what I had in mind! Have you used it yet?
Not sure without knowing more of your background - provisional answer is "maybe." Some parts of Ch.1 are certainly math-heavy. The video lectures are quite accessible. Did you study, say, ~1 year of calculus?
Emails and forums are definitely not the same thing; some people prefer one over the other, and are very vocal about it.

I know that solutions such as discourse are trying to make forums sexy again, but I still find that mailing lists are the way to go for decent discussion, and searching. (I keep thinking there should be a forum which uses NNTP as a back-end, or even a view on a shared IMAP folder.)

For hosting mailing lists I abhor mailman's monthly reminder-day, but there are a few good simple list managers out there. Enemies of Carlotta, etc, personally I use a small plugin to qpsmtpd which gives me decent control and it's otherwise hands-free.
I have setup my own DDNS server, in two Digital Ocean boxes.

- You have to run your own DNS service.

- And setup a PHP page on the server, which when called will update the zone file.

But the next problem is elsewhere. All routers seem to have hardcoded DDNS server names. Therefore even if you install your own service, there is no way you can call it from a router.

It would have been better if routers had accepted a "DDNS protocol" + "a server IP" instead.

I have my home linux server. But I can't share this solution with my friends that don't run home servers.
Skype Delivers a New Solution for Broadcasters
There are people who think that there's elegance in R's design. Remember that is as old as C (if not more!), but it still feels like a modern language (warts and all). You don't compare C to say clojure for language features, they show the advances in language design over the years.

R says: 'everything is a vector, and vectors can have missing values'. This is profound. It was only recently that other matrix-oriented language extensions (say panda) got missing values, even though they are meat-and-potatoes for data analysis.
This is true about incentives, but it's also how pretty much all bad stuff in the real world actually happens, rather than black hatted evil-doers twirling their mustaches (though there's a bit of that too).

Some consider "incentives matter" to be a good two word summary of economics, it would be great if people bore that in mind when dealing with corporations, rather than treating them like local sports teams.

Though I think in this case, Firefox and Google actually have their incentives pretty well aligned, with each other and the general public (generally "make web video better"), it's just a matter of timing.
Yes, here in Hamilton, Ontario our local start-up hacker community is pretty involved in the local urbanist scene. It's a sharp contrast from the usual software geek reputation for being callous libertarians.

The new push for open data is a big example - local hackers demanding that governments open up their datasets (especially transit-related ones) so that the hacker community can develop software for local users.
You really see these being sold in Radio Shack?

With Pis, all the average person needed was a regular keyboard, mouse & monitor to plug in. That's why it worked. That's all been thrown out here.
I like to play around with WebGL for prototyping ideas, but it be the second coming of VRML if it doesn't improve.

Every time I see a WebGL site, my NVIDIA card jumps to full usage, followed by increase of CPU usage across all cores.

For real OpenGL stuff, native is the way to go.
Location is not usually discriminatory though, pointing out someone's gender usually is.
Is it a licensing issue or that they need a whole bunch of machines to install various components?
In your example both NY and Chi would be "crossing" the market (bid above offer) which is not generally allowed. The displayed quote on both exchanges is "protected" and another exchange can't lock or cross the market without first dealing with the protected quotes (usually by routing orders to fill against it, see #2 below).

What would have really happened in your scenario would have been on of the following:

1. The orders would have been partially filled and the balance would be cancelled (order were Immediate Or Cancel)

2. The orders would be partially filled and the balance routed to other exchanges which are displaying the same price (Orders were routable)

3. The orders would be partially filled and remain active (but undisplayed) at the exchanges (this is dependent on what order type is used and at what exchange).

> how can non-HFT traders arrange to capture the surplus currently claimed by HFT?

By posting their order and waiting to be filled. In a two sided market your options are to pay up and be filled immediately or to get in line with everyone else that wants to keep that extra $.01 and wait for someone more impatient (or informed) to come along and sell to you. By providing liquidity you take time and price risk (you don't know when you will get filled, if ever, and the market may move away from you requiring you to have to pay more later) and by taking it you don't (but you pay the liquidity provider for the privilege).

"Someone will always be faster." That will always be true no matter what new trading format is being considered. There will always be a way for someone to get relevant information more efficiently and act on it. Always. Slowing down markets or obscuring/delaying quotation hurts price discovery and increases uncertainty. This increases volatility, widens spreads, and in all likelyhood actually tilts the playing field in the favor of high-speed computerized trading rather than away from it.
Not an ad hominem.
It's funny, Notedock[1], one of the things I'm currently working on is kinda like what you've described. The original vision at least.

It's currently being offered as something like a self-hosted wiki or similar as you say, but has some hidden, unadvertised "social" features.

Like sharing pages to other sites in the Notedock system.
And pages can also be public (you can choose to set individual pages as public or private).
Here's an example of my "public" site: https://jb.notedock.com/public
Members of that site, and the members of sites each page is shared to can add to the Comments section. But for public pages, there's also a Disqus[2] option at the end (which I've turned off for my public site).

The original vision also included being able to "follow Notedocks" instead of "follow users" like you've described.
What I didn't have in mind was the Medium type comments and "forking".
So it's leading me to think that we probably have/had the same inspiration, but different ways of implementing this.

[1] https://notedock.com

[2] http://disqus.com/
So again the trader not the market/society.

Whats the benefit outside the stock market to society in general? I.e. how is HFT a net profit to other than those involved in HFT?

You are asking people to be specific, can you you?
Being a hater douchebag is not ok. Even if you're smart at your thing. Get over it. Try not to be that douchebag
HAM Radio folks always freaked me out, but the ability to legally do something on the airwaves is valued.