skysight-inc/HackerNews huggingface dataset:
I'm just thinking like Amazon/Google/Facebook big and whether that would become an issue.

Yeah, why solve problems that you actually have when you can fantasize about solving problems you don't have instead?
Can India's economy overtake China?
That may be the intention [2], but it isn't the effect.

Prioritizing EBS as was suggested above is prioritizing by server. But let's say that there was some reasonable way to priority-queue EBS-like traffic regardless of the provider (there really isn't [1]). The DDOS attacker would then certainly use this priority channel, which would magnify the effect of their attack ten fold.

[1] Let me explain this in greater detail:

The best way to do QoS is to have end-devices tag their own IP traffic with the appropriate DSCP bits. After all, only the end devices can be really certain about the class of some packet. In your network, you then establish policies for how the various classes of packets should be prioritized and limited.

This works great inside a private network (like AWS, or an ISP). For one thing, you can establish clear standards on how different types of packets should be marked, and you can order them appropriately. You can trust the classifications to the same degree you trust your own systems and (potentially) your customers (depending on checks you do at your service edge). Also, your network gear can prioritize efficiently because only one bit field needs to be checked to determine priority.

Once you step outside of a private network, this all breaks down. First off, most carriers strip DSCP bits at the network edge, so these don't propagate end to end on the internet. Even if you receive a DSCP tag from the outside though, why should you trust it, and how could you trust that it is tagged according to your policies? If Youtube sets all their traffic network control priority, and you trust it, your network would grind to a halt under load. More problematically, though, how can you meaningfully (and generically) differentiate Youtube packets from DDOS packets?

I don't expect you to have answers to these questions; they are hard problems that the best internet engineers in the world haven't solved yet. But this is the background on why an enforced government Net Neutrality mandate is going to throw all QoS policies into question.

[2] And trust me, I've very sympathetic to that intention. On net, Net Neutrality would be a win for my business. But it is still bad policy. What makes people so sure we should give politicians like GWB or Pelosi final say about network engineering [3]...

[3] Once the interest groups realize that centralized national network engineering policy is up for grabs in Washington every 2 years, have you thought about all the unpleasant directions this could go?
I'm just stating a fact :/

It's a simple message passing service. It's pretty much as complex as a router that supports multicast UDP. eg not very.
It depends what you mean by the terms "solve" and "IT problems". The things you mention address at best 5% of some of the IT research problems of a decade ago[1] and even if you mean IT problems in the more mundane
sense then the answer is still no since a) most of those are really organizational problems and b) new IT problems will appear as soon as your older ones are resolved.

However if the question you're really asking is "can those technologies help me reduce my effort or cost by 80% ?" then thanks to advances in hardware, services and open source in many cases the answer is yes.

1- http://research.microsoft.com/en-us/um/people/gray/talks/gra...
Well, it's more like an alpha than a beta at the moment, but I like where it's going. I think the key benefit here is that it's not something compiled from a static .pdf like an NYT visualization, but something based on feeds which aims to provide a dynamic window into what's going on. Considering how opaque government spending and budgeting is for most people, this constitutes significant progress in transparency and timely reporting, even though as presented it's rather clunky. Personally, I'd be happy if this met the goals of being comprehensive and responsive by the end of the administration's term. I note too that they've got feeds for everything so if you had better ideas for visualization the data sources are being made available.

BTW you want to 'elicit' user feedback; 'illicit' would be spending the project funds on tickets to Disneyland instead of building out the website.
I think of this kind of tool wank as "Guitar Center development" - the conviction that choosing the perfect combination of web framework, revision control system, programming language, data store, templating engine and web server is a prerequisite to building an awesome app.

It's exactly analagous to the idea that you can't truly shred until you've assembled the right set of effects pedals, preamps, niobium-plated strings, vintage depleted-uranium core wound pickups and ocelot-tooth guitar pick.

Just play the damn thing.
Not a well-titled argue. It's claiming implicitly that doing good things negates doing bad things. I'm not saying I think Google's evil, but if I did, this wouldn't convince me otherwise.
US Navy awards funds for Polywell Fusion reactor experiment
It would be really interesting to hear 1) how you measure - what data do you track, and what tools do you use to do so and 2) how you analyzed (simple Excel, something more sophisticated?). I imagine it's not simply RescueTime.

I think many, many people would love to have this to take to their employer and also for themselves.
SQL is not a data storage scheme, it's a query language. If you mean "relational database", say "relational database".
They charged $20 for their pdf for a while, though, before they made it free. And it was never even a "real book" that you could buy in stores, with its very own ISBN, and all that.
I'm amazed to see how just how many in the community had a personal interaction with Dan. I doubt that anyone else here has reached out to so many different people.

Dan friended me on Facebook one day. I later saw him comment in a thread about the lack of profile pictures here, saying that if you wanted to see what a poster here looked like, you could just add them on Facebook. Later, I had the privilege of learning the secrets of "ticket hustling" directly from Dan.

The world misses you, Dan.
I'm not familiar with the Australian school system, but I bet there is a lot more national control over curriculum and teaching standards. The convoluted admissions process is the price Americans pay for having a decentralized educational system. If universities went on the basis of marks alone, I can't imagine how many schools would spring up where every senior mysteriously graduates with a perfect 4.0.
Let's not be too hasty to play armchair sysadmin. Someone who claimed to be involved said the traffic never reached their servers.

http://news.ycombinator.com/item?id=859941
Working harder IS a good business strategy, but only if you've correctly worked out what's worth working on. Once you've identified what tasks produce the highest value, it makes sense to work on those tasks as much you can (i.e. as many hours as you can put in without inducing burnout). Good business strategies are not always good life strategies of course...

Nothing in the article contradicts that, even if the article title implies it does. It was a really great article and I particularly loved the idea about assigning monetary value to your tasks. Unfortunately it's difficult for me to do at the moment since so many of my current tasks are based on all-or-nothing gambles.
...but if you don't like the format or style...

It's not a matter of liking it or not. It's just that your style overwhelmed your message so much that I had trouble discerning what it actually was.

For anyone who didn't know about GeeksOnAPlane (me), it looked like you were reaching back for something to pick on. Two weeks here is like two years anywhere else.

I often use your suggestion of cutting and pasting difficult to read blogs (mainly because of color or resolution), but I was having so much fun with yours, I didn't even think of it.

I'll run your content through my parser and de-fucker and read it again. It won't be as much fun, but maybe I'll learn something :-)
Is that possible? How could they be the only ones affected then?
This is not the sort of "hacking" that the site's title refers to. What's it doing here?
Not to defend this particular programming idiom, but the third result for [perl underscore] is "About Special Underscore Filehandle" http://www.perlmonks.org/index.pl?node_id=613621 so it's rather easy to Google.
While alarmism is always fun, it's worth taking a step back and comparing the risk of dying from a hamburger to the risk of dying from, say, a shark attack, or a bee sting, or being struck by lightning, or whatever your favourite unlikely cause of death may be.
Wow, sorry to hear. Can't really think of what to say.
Anything's possible. What if there was enough traffic targeted at just BitBucket that one of the 'last hops' to BitBucket's machines, which may just be a virtual hop in Amazon's own infrastructure, was the only one saturated? I suppose it's even possible that the affected machines could only see high-packet loss (and EBS sluggishness), not the arriving packets themselves.
>> "that is known to be extremely verbose"

It's not in my opinion, and yes, I do want to do it by hand. That's why my code is NOT extremely verbose.
Going on nothing other than my overactive imagination, I speculate that somebody hosted exploit code on BitBucket that somebody else didn't want made public. There seems to be a growing trend of black hat security types who are very much against disclosure of exploits and holes.
How to access iPhone/iPod Touch from Ubuntu
> are there managers who really wouldn't listen to the state of things and plan accordingly?

Listening to something someone says, and having your own perceptions, are completely different. I think you are being too rational. People are not rational. Programmers are always too optimistic about how much work there is to do and how much has been done, and managers always thing that what they see is all there is.

I agree with the article, and I think simply talking about it doesn't solve the problem. You're right that communication is the key. What the article is proposing is to wrap that communication into the prototypes and demonstrations.

Glossy, pixel-perfect demonstrations are, in their own way, lies.
Unfortunately the reality is that some poor coders will be lumbered with whatever the CIO read about in a Forrester report. The article itself counts as "research".
Getting caught trying to cover up a big mistake is usually a resume changing event. As trite as it may sound, the cover up is usually worse than the crime.
You're right -- actually the curricula and the final exams are all done on a statewide rather than national level, but it is certainly more centralized than it is in the US.
Google Search's Singhal. Google algorythm changes on average every 20 hours.
Challenge for November: No Google Software.

That's where I'd have trouble.
No offense but a million hits/day doesn't have much to do with scalability. That comes down to 11 hits/sec - a single midrange server will deal that without breaking a sweat.

Add one or two orders of magnitude, then you're talking about scalability.
but where do you end up selling ur used books? I have a few used textbooks that i don't need and the university bookstore is giving me nothing for them.. :( and selling it privately means i need to put up posters all across campus..
no such thing as a free lunch
Ok, now I can think of something to say. Compared to Dan and Tom, I'm kinda old. And yet, I went out to a hockey game and a baseball game, and beers with the two of them, and Dan made me feel comfortable, and I felt that he was my friend. I've just moved to Boston, and was looking forward to going out with them again, and drinking too much, and laughing, something I don't do enough of these days. It really sucks. I, personally, will miss him. And hope that Tom can keep going with ticketstumbler on his own, and have lots of good things in his future. And at least I'll be able to have beers with him.
Everyone should use ticketstumbler for their next purchase, just as a vote of confidence for Tom, or a memorial for Dan, or both. I'm going to do that tonight.
The video starts about a minute too late, so you miss one of the best PG quotes: "Everybody, stop using the Internet!"

It turned out he didn't mean it that way -- he was just asking the audience to stop using the wireless network so he could access his presentation -- but it was still pretty funny.
If your company has an incredibly high valuation, it might make sense to take all the money people will give you at that valuation and figure it out later.
Cocaine, hell of a drug, etc.
If it doesn't fit, flag it.
Darn. I have a wedding the Saturday prior in PA, but unfortunately won't be on the east coast during this event.
I do. But since I have plenty of useless karma to burn, I figure I might as well try and use it to do my small part to keep the site from turning into another reddit. And one thing that will keep that from happening is staying rigorously on topic. It's important to encourage people to do so.
Having now sold a company (albeit for nothing like the scale of Mint) the value of simply having the stripe is immeasurable.

People get confused between what the right thing is for a company's customers or the "ecosystem" and what the right thing is for the entrepreneur (even taking account of the other two).

As a Mint user I'm really sorry Mint sold to Intuit. I also think it is a bit of a waste for the ecosystem as Mint was positioned to do something pretty amazing that probably won't happen now.

However, the decision was very sensible indeed for the founder. Mint may never have sold, he could have been ousted as CEO. Now he's a great bet for future investors and employees and he is cash independent (both as an individual and an investor).

Knowing when to stick and when to twist is invaluable. I am interested though why the VC's cash him out $20M and keep in the game as Matt Mullenweg's did. That way he would have hedged his risk and everyone swings for the fences.
second that. Microsoft only during compatibility testing.

Google search, I'd hate to count how many times every day.

Other than that, analytics and adsense.
Hey!! Thanks to whoever brought these back to life - I was unable to access the SS08 videos at Omnisio for many months (basically, ever since the sale).
To be honest, I'm not actually sure what QOS even has to do with the initial post in this thread; wouldn't a dedicated private ethernet network between the ECC machines and the EBS machines (assuming it's possible within Amazon's network structure) have worked, assuming that their switches are configured to only allow communication between ECC and EBS (forbid ECC - ECC traffic)? Your commentary about how this would deprioritize other traffic wouldn't then be quite right; it would be a dedicated network, with no cost to any external sites. It would obviously give EBS an "unfair" advantage over anybody who wants to provide an ECC block storage solution to compete with EBS, but honestly, is that a concern? Nobody's demanding that all internet hosts (end-user included) have the same bandwidth to all other hosts. It's just artificial crippling of services that are bad, not some things having advantages over others.

QoS on the general web doesn't seem likely, as you point out. Prioritization based on which services can afford to pay off all the nation's ISPs seems like a really bad idea though. As a service provider, I don't want to have to pay kickbacks to every ISP in the country (world?) to ensure that no unfortunate accidents befall my traffic. Much more personally, though, as a human, I'm sick of being sold as a product. I don't watch commercial TV because I'm not a product to be sold to advertisers. Similarly, I'm not a product for Comcast to sell to google; that's how they see me, but it's not how I see myself. And, I get pissed off when people see me that way :)
Computer keyboard
I'm talking about inside Drupal itself. Locking strategy is another one: it's impossible to optimize for one database without sucking on another. Lots of developers with experience only on one don't even know they're doing it, they think this is just how databases work.

Being database agnostic makes as much sense as trying to write code that compiles in both C and Java.
You say that you approve of RSA because if someone is using it, its inevitable that they learned of it from RSA. I don't think you'd have to go that far to say what's worth patenting. I think that's the purpose of patents -- to make people disclose worthwhile discoveries so that others can benefit from them at a fee -- but they can't be structured that way legally, because unlike copyright, it's very hard to show the origin of ideas.

What makes a patent a bad patent is usually that it's on the idea of what's a good idea to do from a business perspective, and once you've realized that, hey, online auctions are a great idea, the mechanics of writing the code is pretty straightforward, as you say.

I'm not clear how things are de facto in European law, but from reading http://en.wikipedia.org/wiki/T_258/03 it looks like at least some people are on the right track -- you can patent something involving software, but only if you innovation is technical in nature, not a business innovation that involves a lot of technical details to implement.
Correct. Our machines don't allow UDP, even. Either the physical machine our VM runs on, or the segment was flooded, which means we couldn't talk outside it.
I want to develop a Web application - a really good Web app. The kind of Web app that will make me so rich that I can buy an $9.4 million co-op over looking Central Park, a Yacht registered in Monaco, and hire an architect to build my dream-house west of Boston that is a combo of Buckminster Fuller, FLW, and MTV cribs. Throw in a vintage sweet ride like Don Draper's Cadillac and lifetime membership to the Boston Sports Club. I'm set.

I had to re-read the article (and the above paragraph) several times, and check other articles on the site to make sure I wasn't reading a parody site.
Using the Omnisio site makes me wonder what ever happened to that tech. I'm guessing it was just a talent acquisition after all.
[2] and [3], I think may have been written after I posted, or maybe I'm just blind. Either way...

I'm definitely uncertain about what bad politicians would do with control over the net's structure. I do know exactly what the CEOs of major ISPs will do though: they will maximize short-term profit. I've seen a lot of short-term profit maximization in my (rather short) life, and I haven't seen any of it turn out well. We used to have companies that had long-term goals, fundamental research divisions, the ability to see past next quarter's profits. I'm not sure where those companies are now, but if they're gone, it seems that the government is the only entity left that can have a long-term goal. Of course, long-term for our (US) government tends to be the election cycle, which is 2, 4, or 6 years. Not good, but perhaps not as bad as it could be. It's also easier to change the government than it is to change a huge company, although neither of those things is an easy thing to do.

I'm not sure that net neutrality is quite as sweeping as you see it either. If congress is getting into peering agreements, protocol design, things like that, then we're definitely all doomed. If they're just slapping down anti-competitive measures like charging companies for access to ISP subscribers, then I can definitely get behind that. It's a matter of degrees, I guess.
wouldn't a dedicated private ethernet network

With appropriate capacity, a VLAN/QoS configuration is functionally identical to having physically separated networks. On an abstract level, if you object to provider prioritization, you should probably object to them running separate physical networks for their own services.

As to your point about feeling screwed by the (mostly theoretical) possibility of intentional service degradation, I sympathize. I'll point out though that 1) I'm quite certain this isn't terribly prevalent in the US, 2) in most cases where people think this is happening it is the result of simple under-capacity or generally bad network design or management, and 3) the correct answer to this general issue is to enable provider competition, not to impose ham-handed mandates.
I'm confused -- what was the old definition of "slave" which was so different from "person forced to work and prevented by force from leaving"?

I'm not convinced that there are indeed 27 million people fitting that definition at the moment, but I can't see how someone fitting that description is anything other than a slave. (Hmm, though I suppose legitimate prisoners can be forced to do work without being "slaves" so perhaps the definition does require tinkering around the edges.)
That's kindof like trying to quit smoking cold turkey. It's killing you, and you know it, but you still have to make the transition gradually.
Wheel of Stars: A music box made from 118,218 stars
the CEOs of major ISPs will...maximize short-term profit

I think you may be unfairly maligning a bunch of folks who do actually care about their customers, but in any case, the correct answer is to enable competition, not to add regulation.

As for how sweeping it is, knowledgeable people in the industry feel like this is going to impair their ability to make reasonable network design choices, and in some cases force them to lay physically separate networks to do an identical job. Once it is established that Washington has that level of control (effectively making a public resource out of private networks), it seems reasonable judging from historical precedence that they will expand their jurisdiction (the special interests will smell blood).

(On a meta-note, I wrote 2&3 before seeing your response. We were likely writing in parallel.)
I can't reply to tc's reply to me (I think that "feature" should probably be disabled, btw; it tends to lead to broken threads like this one, and inhibits discussion), so I'm replying to myself, like a monster.

Service provider competition is definitely the answer. Where I live, we finally have a competitor to Comcast (Qwest), and t-mobile is also gearing up for a bit of wireless service. I've heard that some municipalities assert ownership of their power grids, phone lines, pretty much everything that's built on public land, and they force open competition for providing services over those infrastructure pieces. That would definitely be preferable to net neutrality, but it seems that wresting ownership of infrastructure from the ISPs is even more offensive than the creation of neutrality provisions. At least new communities can learn from existing ones and have sane starting points for competition, I guess.
AdSense is a toughie.

Yahoo has a competitive analytics package (http://web.analytics.yahoo.com/), and really, Bing results are generally just fine. Sure, it'd be harder, but that's the point of the experiment.
We have the First Game Play Concepts and our First Game Build
In theory and on average, a million hits per day will come down to 11 hits per second. What you're more likely to see in practice though is huge peaks and troughs in load. The average might be 11 hits per second. But the peak load could be 100 hits per second around lunch and the minimum load could be 2 hits per second at 4 AM.

Moreover, a hit is a rather arbitrary unit of measure. 11 hits per second to the Twitter API is a lot different than 11 hits per second to a static site like example.com.
Banking: Where transparency is the best policy
Ask HN: what's up with New Mogul?
http://www.newmogul.com/ (nickb's business version of Hacker news) has been down the last few days. Anyone know why?