skysight-inc/HackerNews huggingface dataset:
(See also my response to gaius.)

As you noted, the x86_64 sorted out some of the mess.

Personally, I think a big issue is the whole backwards-compatibility thing. It causes all sorts of nastiness, and a complete overhaul of the architecture is impossible because everything depends on it! (Which is one of the reasons the IA-64 never really became a hit.)

I vote we design our own processors, and write a new kernel to boot. ;)
When Will The Social Sharing Button Madness Stop
So it's an alternative to BGP for internal networks?
Anti-competitive behavior would be literally cheating at golf.

Right, and "cheating" in the real world is defined by fraud and physical violence and their myriad manifestations, not mututal trade to mutual benefit (as on a proprietary exchange, for example). Or offering the best product at the lowest price.

But, that's not at all the meaning of "anti-competitive" as people use it.
They should naturally be just dumb pipes.

Does the fact that someone isn't wildly successful doing this indicate a market failure?
My argument does not rely upon it, it was an example of one of several reasons running map reduce jobs on the AWS cloud have nothing to do with the amount input data you are moving around. I am not going to go off into even more detail about specific jobs I run daily that generate a large amount of itermediate data because unless I paste the source code in this thread and write a paper on it I assume you won't believe me that there is in fact in the space of "all map reduce jobs" jobs that can generate more data than they input.

If you write a trivial map reduce job using cascading that has 10 reducers and each reduce step shuffles the data on a different grouping key you will find that Hadoop alone is generating more data than you input. But again, this isn't the point. The point is the author is calling anyone using AWS for map reduce a "cargo cult" based upon an academic argument that the sole purpose of map reduce is to move computation to your data, hence if you copy your data you are missing the point. In practice, the cost of uploading your data to s3 is a footnote compared to the computational flexibility and use cases that become possible once you are able to run arbitrary tranformations on that data via EMR. You keep ignoring my main point and are focused on my simplistic examples, reading way more into them than was intended.
Why won't it accept my prior distribution? Sheesh.
For sure, HFTs don't have crystal balls. They certainly are able to leverage their market access to give them an advantage, though.

I feel like I need to reiterate that I don't think HFT is evil. I'm just not sure that HFTs really add that much liquidity to the market, and there is evidence that they contribute to volatility (such as the flash crash).
I once complained on a message board that sales tax should be included in the sticker price, so that I know ahead of time what I'm going to pay.

I still feel that way, but someone pointed out that it would further hide from consumers the fact that the government takes money out of every transaction. Now I contend that every sticker should tell me both the price with taxes, and the price without. This would make it very clear how much I would have to pay without government intrusion, and how much extra they get from me.

I'm getting the same vibe here with income taxes. Taxes used to be a much more contentious issue before it was taken out of every paycheck prior to the worker seeing the money. Now the single pain point in paying taxes is an hour's worth of paperwork once a year. Eliminate that friction, and the government becomes an invisible siphon, sucking money right out of the economy, with hardly anyone noticing.

By all means, make paying taxes easier, but don't obscure the fact that someone is taking your money, all the time, without giving you a choice in the matter.
Release of 'iPad mini' from Apple viewed as 'question of when, not if'
Dell Inspiron 15" dual-core 2.3GHz, 2GB RAM, 250GB HD. Purchased from Best Buy for $399 on Black Friday in 2010
Show HN: Hooking up Twitter with Angellist
Tutorial from PyData Workshop: scikit-learn - Machine Learning in Python
In case you missed Java applets circa 1997.
You may or may not be following their blog, so just in case (from http://www.raspberrypi.org/archives/913)

We’d like to apologise to all customers who placed
orders with Newark element14 and have seen their
acknowledged delivery date suddenly change on our
website’s order backlog to August 2012.
...
At present, as already communicated by Raspberry Pi,
all deliveries are on hold awaiting the outcome of the
compliance testing currently taking place.
...
Apologies again for any confusion this action has
caused. We firmly believe delivery will be much sooner
than August.
Is there an opportunity here? Even unsophisticated users know there's something wrong with crapware.
New blocks are created in a lottery process (mining) that could take seconds to hours for someone to win. We are using unconfirmed transactions but are willing to take some risk while developing strategies to mitigate that risk. Orphan blocks don't concern us so long as the transactions we are honoring make it into the greatest-height chain.
Assuming our tax law remains insane, I actually prefer having private tax preparers. The IRS's incentive is clearly to make me pay much tax as possible, whereas for private tax preparers it's to make me pay as little tax as possible.

If our tax law were simple there wouldn't be much difference between the two, but in its current state there is. Thus I think the tension between the two groups is healthy.
Regardless, if it wasn't for facebook it would be happening on flickr or instagram or any other sharing site.

The problem is a legal one, not something that facebook can simply add as a feature. (Though they do have a way to report a photo in addition to untagging it. And then you explain why that photo violates privacy laws. https://www.facebook.com/help/?faq=217091804975136#How-do-I-...)
With an income tax? Rather than a use tax?
Overcoming Artificial Stupidity
>In Japanese (at least from what I've gotten from my 4-years in University

Studying Japanese literature or something similar for your degree, or just taking some class? Because the second implies an order or magnitude less insight on the language...
Huh, I'm glad this was posted!

1) Didn't realize when I read this it was by yummyfajitas, whose comments I always respect.

2) Do I understand correctly that the order book is public (albeit anonymized)? That surprised me -- it seems like this would lead to meta-games and jockeying for position and such, as opposed to different parties just submitting into a black box what some security is worth to them.

3) Are there any good papers/articles modeling different market set-ups? For instance my black box one above. Or one where orders are matched randomly rather than chronologically. Or one where trades happen in one batch once per day. I can't say I'm opposed to HFT, it just seems to sap a very large amount of engineering brainpower for not that much societal marginal benefit anymore. If I could snap my fingers and give up a bit of the liquidity and get all those engineers back I probably would.

4) I once worked in a sell-side equity research shop which traded stocks the old fashioned way (based on fundamentals) and had a non high-frequency trading desk, etc. That type of company is getting hurt by the lower spreads offered by HFT. But I never did quite comprehend why it made sense to pay for our product (research) with trading commissions. Seemed to cross two unrelated services, although that kind of business model seemed deeply entrenched in the market.
E(compensation in a start up) > E(compensation running a HFT strategy)

I also would like to hear more about this calculation. More the right side than the left, since I know far less about the right side than the left. But I imagine this might be getting into the author's personal details quite a bit.
That's nice for people who qualify for 1040EZ.
No. I do sometimes, but I do take the train and bus (which incidentally costs a fortune) because I'd pass out at the wheel. This has never happened but its always in my mind.

Besides there's (typically) nowhere to park. I've decided to leave in the next few weeks. Life's too precious for this sorta shit.
OpenFlow is really the coolest thing to happen to internet infrastructure in a long time. Just look at this video from Stanford where they route a wireless video stream simultaneously over WiFi and WiMAX. http://www.youtube.com/watch?v=ov1DZYINg3Y
This technology is really imperative if wireless networks want to cope with the increased traffic from all mobile devices. How cool will it be when, having a video call, your iPhone naturally switches from the cellular network to your home WiFi when you get home. Or event better splits the traffic over both networks.
The best form of defence is attack, is the language really air tight enough for companies to not use them in attack?
The cost of entering the market is truly staggering. I'd be ready to make the case that last-mile ISPs (which the carriers really are, they just operate with wireless) should be utilities, with all the baggage that entails, for exactly the same reason water and electricity are utilities.
Act 2 of The Microsoft Accelerator (Azure)
That's the point. People keep their data on Google products, using (or not) Windows machines. Windows machines are pipes to your data.

Unless you depend on Office, which doesn't run on the phone anyway. And they already have Xboxes - they don't need matching phones.
The Elopalypse continues...
'The company will not use the patents in offensive litigation without the permission of the inventors.'

Honestly how hard is it to go up to someone and say "Let us troll with this patent and we will cut you in on 20% of the profit". I know quite a few people who would do that deal just to pay for their kids college in the future. I don't see this changing anything except for inventors now getting a cut of the deal.
>The old fringe player Apple could - the new $trillion corporate Apple might "think different".

I seriously doubt it. Especially since they became the "$trillion corporate Apple" by not caring about those things --so why change a winning strategy?
At the point of IPO the capital for a company has already typically been allocated. The financial markets allow the owners of a company to sell their shares to the public and realize profits on their prior investments. After that markets are about betting whether the price of the company will go up or down and people trade accordingly.

The need to trade instantly is very important for risk mitigation. If unexpected news comes out today that a company is the target of an adverse event like a DOJ lawsuit many market participants will want to react as fast as possible to the news. Say it takes 30 seconds for the price to fall by $10. If you could trade at the 15 second mark you would only lose $5. To an investment firm (non Market Maker or other HFT) this can be crucially important and many firms have automated systems of their own to trade.

A key point of the article that most people miss is that someone has always fulfilled the role that HFTs currently occupy. In the old days floor traders occupied this role as pointed out by the article. Floor trading was a club where you had to buy a seat to be allowed in. Depending on the market the cost of the seat might be hundreds of thousands of dollars. The traders controlled access to the markets and for some markets like Oil the only way to trade was through these floor traders. Now these floor traders took full advantage of this and kept the spreads on the instruments they traded much wider than they are today. In the early 90s you could easily pay $.20 per share to the market maker to get a fill on a liquid stock.

The realization (as pointed out by the article) that computers could do this better and faster is just like any other industry. The people most hurt by this development were the floor traders themselves. There is a movie called The Pit that explores the effect that computerized trading had on floor traders in Chicago. Today if I want to trade MSFT the spread on BATS's BZX exchange was just $0.01. To me, another market participant I consider it to be much better to pay a penny to Getco rather than $.20 to a floor trader.

The colocation business as it has evolved has made market access more equal, not less. Today anyone can pay to colocate a server at NASDAQ, NYSE, BATS, etc... I know longer have to buy a floor seat to be able to trade there. Now there are real market barriers to entry but they are not structural. Just as you can't go build a Google competitor given that you don't have all the historical search traffic data and the infrastructure to compete with them, HFT firms have made significant investments in infrastructure of their own. If you had sufficient capital for technology development you could compete with any other HFT firm.

Yes there are people hurt by HFT, just like anything else when new players with greater efficiency emerge. However the average investor who is not competing with these firms is not harmed. The floor traders were, just like telephone operators before them.
Twitter is quickly becoming OSS's best role model - imitators take note.
The "Flash Crash" was caused by a single, manually-initiated large block trade:

At 2:32 p.m., against this backdrop of unusually high volatility and thinning liquidity, a large fundamental trader (a mutual fund complex) initiated a sell program to sell a total of 75,000 EMini contracts (valued at approximately $4.1 billion) as a hedge to an existing equity position.

(From the SEC link Chris posted earlier).

I don't know whether I believe Chris that HFTs caused the market to correct much faster, but it seems clear that HFT didn't cause the crash.
You can no longer make a supercomputer the old Cray way, by having Seymour Cray design the fastest, most optimized CPU he possibly can and sticking it in a box. Now you take thousands of processors (with an increasing trend toward low-power low-heat processors rather than just the most powerful ones) and glue them together--and the interconnect becomes one of the most important parts!

Huge companies like IBM can afford to make their own custom chips for their supercomputers (see Blue Gene L, P, and Q), but Cray isn't in that category. They do create a lot of software for using their systems, and the hardware is very well integrated, which is probably why they still do pretty good selling to national labs.

We're realizing that now while you can buy a bunch of computers and a 10 GbE switch, it can be worth it to get a nice fully-integrated supercomputer shipped to your door. It's ready to go, the software is installed, the cables are the right length (and neatly arranged!), and when a node burns out you just mail it back to Cray for a replacement.
it's not a selling point. a selling point is something that a salesperson can take advantage of to make a sale, and "my employer hasn't fucked this phone up as much as they have those other ones" isn't something a salesperson can tell a customer.

lack of carrier crap is a feature, but it's not an advertisable one. even microsoft can't advertise it, because they have relationships with carriers to maintain.
That's true. My post assumed a software-centric view of the world, where costs are very low and all that matters is a great product.

In most other businesses, it would be very important to know how many widgets you need to sell at what price to float the loan payments for production or to know all your overhead costs before taking on a consulting/service contract. Neither of those require long range planning, though, which I think are still guesses. The immediate budget and plan, however, is important.
StackOverflow uses a Redis + MSSQL combo.

http://meta.stackoverflow.com/questions/69164/does-stack-ove...
The bigger question is why am I still doing taxes once a year?
Presumably you could use lambdas or SONET or MPLS circuits or something (at Google-scale that would cost more, but it may be cheaper for smaller networks); it doesn't have to be private fiber per se.
I love how the comments just shit all over the author, but I guess that's true of every article on the web. It was just funny seeing how many were correcting him about the Star Wars reference, it was like a 20 comic-book guys getting sand in their vaginas.
NYC: David Lee of SV Angel speaking April 23rd at NYU
No it's not a routing protocol, but it makes the router so configurable that you're able to switch the protocols out easily. You could even invent your own for your internal network. I guess this is what Google has done because they have so much knowledge about their traffic and infrastructure.
It's not only about routing protocols though. It also allows you to do traffic shaping and all kinds of cool stuff as well. Just imagine a software router which is just as high speed as one which implements the logic in hardware.
aka iPhone?
The good thing is that Instapaper's extraction process can be modified by anyone who has an account:

http://www.instapaper.com/bodytext (Login required)

So if something is not working properly you can improve Instapaper on a site by site basis.
Yes, very basic realtime billing/CDR storage. With traditional DBs, I have to resort to batching balance: Read N messages from queue, compute overall balance updates, then apply at once. With VoltDB, I can just fire off records as they come in.
That would violate the terms of the agreement:

"If Assignee needs to assert any of the Patent claims against any entity for other than a Defensive Purpose, Assignees must obtain prior written permission from all of the Inventors without additional consideration or threat."

At which point whoever twitter was suing could claim that they had violated their own agreement so they don't have grounds to sue.
I'm sure part of the improvement in relevance is users learning what not to ask. They can't take all the credit ...
Also, this post was originally titled "CoinDL enables Bitcoin purchases in seconds (link to eBook example)" so your post was more on-topic than it seemed. Today I learned, titles can be renamed by somebody else on Hacker News.
> 2(b) against an Entity that has filed, maintained, or voluntarily participated in a patent infringement lawsuit against another in the past ten years, so long as the Entity has not instituted the patent infringement lawsuit defensively in response to a patent litigation threat against the Entity

So it counts as a defensive purpose if they're suing anyone who's filed a patent infringement case in the last decade? That's pretty friggin' broad.
I can't speak for why this hasn't happened yet. This idea, though, was a small thing that was very appealing about Obama back in 2008:

> Simplify Tax Filings for Middle Class Americans: Obama will dramatically simplify tax filings so that millions of Americans will be able to do their taxes in less than five minutes. Obama will ensure that the IRS
uses the information it already gets from banks and employers to give taxpayers the option of pre-filled tax
forms to verify, sign and return. Experts estimate that the Obama proposal will save Americans up to 200
million total hours of work and aggravation and up to $2 billion in tax preparer fees.

From http://web.archive.org/web/20080716203213/http://www.baracko... (I can't seem to find a more recent copy of this).
I think I might have taken that exchange too literally. :)
The first H1 tag in the computerworlduk article says "Blogs", the second has the title.
Just an opinion - none of us will be able to push Locomotive in an enterprise setting (which is precisely where CMS makes a lot of sense) without it supporting a relational DB.

Dont get me wrong - I get the value proposition of mongo - but in this case, it is taking away a lot and not giving me anything in return.
How to decide the membership model?
Free vs Paid?

If it is free;
-give it away totally for free and try to make money from ads
or
-give it away for a limited time/limited extension and force them to be paid or leave

If it is paid, how to adjust pricing?
- make the entry level very low so that we can gain as many members as we can and then try to make the current ones higher paid members.
or
- adjust member levels accordingly so that there is no easy entrance but when they become member they will worth something

All ideas are appreciated.

Thanks.
Google wants to make switching hardware a commodity product. Right now most switching software does not interoperate, at least not on a level Google wants.

Because of this if you want the latest and greatest features from Cisco you have to run all Cisco. Or Juniper. You can't just buy 10 Cisco switches and 10 Juniper switches and all run the same operating system. Compare this to PC hardware where I could buy any combination and install any OS I want.
We've come a long way in lake-reflecting technology, to be sure. Just think, you don't even need a plugin!
So the idea that Jurassic Park would have hired a Chaotician to do systems analysis was completely realistic. Except, in this real world example turbulence is introduced to maintain stability. Fascinating.
Doctors do know the available drugs. . . but the current system is set up such that the primary channel for learning about them is direct-to-physician marketing by drug companies.

Which is hardly the most effective channel. In fact, studies have shown an inverse correlation between how much time a physician spends being "educated" by drug reps, and patient outcomes. Of course, while the patients' quality of care goes down the cost of care goes up, because they're paying out the nose for expensive new drugs instead of equivalent (or, as is often the case, superior) generics.
Now I want a Groklaw app for my iPad.
It's interesting that this is now the insurgent, because in some sense, this looks like networking done the old way, the telco way: centralised provisioning, aiming for 100% utilisation, etc. The kind of thing that cisco et all were originally the small rebels against.
The patents I find offensive are the ones held by companies that aren't producing any products, much less a product similar to what's described in a given patent.
The rebuttal at ritholtz.com is largely propaganda as well. It was penned by the brokerage firm Themis Trading who has been on a crusade against private exchanges, HFT, reg NMS, and pretty much any change in market structure that could negatively impact their business model. Not only that but the post simply lists properties of the equities markets and implies they are bad. For example:

"-the IOI’s that dark pools send to each other"

If IOI's are bad, why exactly are they bad? The post fails to explain the "why" for any counter argument it presents.

One additional rational not previously mentioned for multiple exchanges is redundancy. Reg NMS allows trading venues to match orders of listed securities from other markets. Because these markets compete as liquidity centers it behooves large market participants to have direct connections to all of them. If the NYSE has technical problems (this happens more often than you may realize, to all the exchanges) trading in NYSE listed securities continues unabated on the other platforms.
I had no idea you could do that! That's cooler than the other side of the pillow!
Agile teams are 5-7 people.

Perhaps you mean how many people in total? I've seen lightweight systems like this scale out to 150+ developers. (Insert discussion here about Agile Program Management)

You really don't need a lot. Most enterprise project management systems are over-engineered by a couple orders of magnitude. (And they hurt much more than they help)
Semicolon: A language of semicolons
So now we need a European localized version called the 601 Developer Manifesto.
I'd like an "Express View" like that too, to get more on the screen. Maybe smaller text in each too.
Alice isn't screwed in the second case. She just gets lucky in the first case.
Really struggling to think how the creator of this feels it would have a use
What makes a great tweet?