skysight-inc/HackerNews huggingface dataset:
Ask HN: Help me find older hacker news post
I need help with finding one of the posts that was recently here on hacker news. Unfortunately I haven't saved it on time and now I need it for one of my projects.

It's a post about an archive of entire internet crawled and available for download. It's also offered as AWS image package. I just glanced through post initially and wanted to save it for later inspection but now I can't find it in any of my bookmarks.

I tried searching like crazy but it's possible that I am trying wrong keywords since I just barely looked at it at the time.

Can someone help me with this?
you should write more about Japan.
Unfortunately, we're always on our nerves. So pre-occupied dealing with petty things, and on top of that add the troubles of a third world nation (poverty, unemployment, corruption, not so great healthcare). It's only when we get out of that environment do we truly realize our potential.
Oh, interesting. I assumed that since they had a specific date and time they went on sale..... that's when you could start claiming them. Kind of doesn't make sense to me. I'm no domain mogul though, I just think they're fun to have.
An excellent test. If a VPN makes something faster, despite the fact that it adds overhead to the process, that seems like proof that it's being throttled.
Maybe everyone who died is still alive in some universe or other. That's a sobering thought.
More than you can shake a stick at.

For graphing:
Munin, Cacti, Graphite, and ganglia are the normal options. Graphite is the most powerful of these. It doesn't do any actual monitoring though. Munin is the simplest to implement.

For general monitoring and alerting:
Nagios (and its clones: Shinken, Icinga, and Naemon) is the standard. There's also newer projects like reconnoiter (which suffers from awful documentation, but looks like it could be really nice), and Sensu (who's got quite a bit more documentation than reconnoiter, and looks like it could be quite good). A reasonable number of people use Zabbix as well - the main benefit of this seems to be a nice GUI for management (but I've never used it, so take my comment with a pinch of salt). Graphs (and almost anything you want) can generally be added to nagios and clones if you're willing to do a little work. Reconnoiter seems to have graphs out of the box. I don't know about zabbix or sensu.

There's more tools that you can use for log monitoring - I think that's a whole separate area, but if you're interested, ping me and I can point you in the direction of the right tools :-)
Enterprise don't have their stuff in the cloud.
You speak of singularity as if it is something that can be achieved, while in fact it is just a hypothesis, or a sci-fi thought experiment, that imagines one possible outcome of developing smarter-than-human AI. In particular, singularity proposes that such a discovery would cause a complete qualitative phase-shift in technology and human existence in general, but for this outcome the hypothesis relies on many speculations. As many have pointed out, smarter-than-human AI might not bring about singularity (or is even unlikely to do so).

At our current technological era, speaking of singularity is no different from speaking of other science-fiction ideas like warp drive or even time travel.

Would you say that a very old civilization would have surely developed warp-drive or time travel by now? Same with singularity. We don't know it's possible. We don't even know it exists. We're not even sure what it is.
Solution: don't serve Netflix to Verizon customers.
Punchbowl CEO: It's All About Phones and Tablets, Not "Mobile"
Budget Smartphones To Buy in 2014 That Gives Great Value For Low Price Point
Transferring brain to a computer is just brain transplant.
If you accept organ transplant you should hardly have any
problem with this at all.

Your "uploaded" brain probably won't have any problem with this, but your original physical instance brain probably won't be too happy to have the lights turned off.

John Weldon's "To Be" (https://www.youtube.com/watch?v=pdxucpPq6Lc) kind of touches on this. It focuses on teleportation, but I think a brain upload is pretty much the same idea at heart.
Oh, and the even more galling part... when watching Hulu on regular Comcast (without the VPN), the shows average around 500-900kbps. When it flips over to displaying the commercials, it jumps to 8Mbps or more!
By that logic, every startup or small business is already dead.
ITT: People post anecdotes about Vaio products without commenting on the actual article.
Google disallowed servers initially as a non-insignificant number of people thought of the service as an easy entry into mass virtual hosting as soon as they got it. That started to affect throughput[1]. As mentioned numerous times elsewhere, their ultimate goal is to embarrass ISPs into providing better service. That seems to be working in Texas ATM. The hobbyists that complained got an exemption in their TOS for non-commercial use[2].

Of course, Google is collecting information about me. As is every other ISP (Verizon and Comcast hijack domain misspellings to redirect to their search pages), which is why VPNs and Tor are so popular right now.

[1] http://arstechnica.com/information-technology/2013/07/google...

[2] https://support.google.com/fiber/answer/2659981
> The talent and know-how

Actually, they state that any sale or spinoff of the de-emphasized products would not include employees.
I think you're missing the point about changes to the labor market.

The unemployment rate you cite is correct, but it's just as you said - a rate, not an absolute total.

What the report states is that the total number of jobs will decrease. Together with the fact that we know that hours per job is not going to increase (and may actually be decreasing, thanks to other PPACA regulations), simple algebra tells us that there will be fewer hours worked overall.

Barring an external development that causes productivity per hour to increase, we can expect lower total production. Bottom line, then, is lower GDP as a result of this. That is the opposite of a good thing for the economy.
You can't really compare a small densely populated country such as the Netherlands to a huge country with large rural areas such as the United States. If you live in an urban area here (such as the Bay Area) you get excellent speeds as well.
They're predicting a smaller labor force (non-institutionalized population of working age working or actively seeking work) resulting from the reduced health insecurity from the ACA, not fewer jobs.

According to the CBO, the difference between actual and potential GDP will decline to 0.5% by 2017. At that point (and possibly before) a reduced labor force is reduced jobs and (more importantly) reduced production.

It could result in reduced jobs/production even before that if workers who choose to reduce output are not interchangeable with unemployed [1] workers willing to take those jobs at the same wage.

We're not in a recession. We're in an expansion in which both wages and employment rates have recovered slower than normal

Either we need fiscal/monetary stimulus or not. If we need stimulus, increasing wages is a bad idea according to all mainstream economic theories (Keynesian, Monetarist, Structuralist). Which is it?

Here is the report, btw: https://www.cbo.gov/sites/default/files/cbofiles/attachments...

[1] Including discouraged, at least if employers can find the discouraged workers.
I just spun up an EC2 instance (US-East) and threw a bunch of 100MB-1GB test files on it.

I'm on Verizon FiOS here at home, residential service, and they all downloaded at ~20Mb/s, which is the line speed I'm paying for.

Anecdotally, I watch Netflix every night and haven't noticed a buffering/quality issue. I'll have to try the download test again later.
Comparing IIT/IIM entrance exams to caste system is a very cheap shot. IITs are no more exclusionists than Harvard or MIT. Its the country's premier place for education, so everyone is going to want to study there.
I wouldn't be surprised to see Detroit & co rise again, if only because of the dirt cheap price of housing.
Can you name other government programs -- particularly any of this scope and complexity -- that have had unintended positive consequences?
To the people saying that you shouldn't trust some tech support guy, I counter with this: He is acting as representative on behalf of Verizon. Verizon trained them and Verizon gave them the scripts to read so that this tech will properly represent Verizon.
Let's wait and see. So far it has been below expectations.
There are some sports that reflect culture more, e.g. football (soccer). In those scenarios, you could argue that fans are taking pride somewhat due to their attachment to the culture.
The author said this was happening specifically after 4pm.
Interesting I have been watching Netflix more than ever but I havent had any problem. I'm also using Comcast in Atlanta I wonder if its based on region?
This inspired me to check whether 69signals exists. Yes, it does, and amazingly it's not a porn site.
Eve Online gets a real life monument
Just FYI - I'm only seeing the slowdowns in the evening.
The economy is a measurement of the productivity of the workers. By cutting 2 million man/hours, or whatever metric they use, you are cutting the economic productivity that much. So, it will hurt the economy no matter how you spin it.

Further, it is not like they are getting health care due to an efficiency in the system. The government is taking resources from the productive (taxes) and giving it to the unproductive (subsidies) in order to purchase insurance. This will further erode economic productivity.
One could argue that survival is the meaning of life, just as one could argue that eating cake is the meaning of life. Just because we have a massive instinctual desire to survive doesn't necessarily mean that it is the default meaning of life.
The ringworld has a radius approximately that of the radius of the orbit of earth. A quite large sun could fit easily through such a 'toroidal planet.'
Switch to t-mobile. Screw verizon
I see this effect in all areas of achievement. I call it the difference between intellectual understanding and actual understanding and look for it whenever I'm attempting to learn something new.

One example is programming. (Most) Everyone knows that TDD is good practice. But every time TDD comes up in an HN thread, it's overloaded with people saying the exact same thing. They know they should TDD but they don't.

It took careful and frequent watching of Gary Bernhardt's videos before I could finally TDD. I would watch videos at night, then go to work the next day and try to apply what I learned. I kept running into snags, and I'd have to go back and watch the videos again to get a feel for the technique.

The techniques looked simple, easy even. But actual practice made a giant liar out of the appearance. Proper testing is a tough, complex, pain in the ass to learn. Every time you learn a new programming paradigm, you have to figure out how it's tested. And you have to keep doing this for as long as you grow as a programmer.

It's complexity of a sort that makes it very difficult to properly articulate. When you do, the advice looks simple, boring. Yet the simple, boring advice gets thrown out whenever you try to put it into actual practice, leaving you with cowboy code.

The reason you see so few people who actually TDD is because very few people end up putting their foot down, and digging deep into the "simple" advice to make real progress on the goal of actually TDDing their software.

Entrepreneurship seems awfully similar.
As a totally blind developer I have to disagree. Maybe it's a bit easier for me since I don't need to worry about font sizes but I'd say 95% or more of the web is accessible if you are good with screen reading software.
I'd say this has more to do with an existential crisis - the landscape for project management collaboration tools is very crowded with competitors, and some are vastly superior in many ways to Basecamp. I stopped using Basecamp years ago and groan every time a client makes me log into it. The early adopters have mostly given up on their core product.

PM collab tools are becoming a commodity product in business, and 37 Signals got distracted and missed out on making sure that their brand was front and foremost in customers' minds. They could have doubled down on the brand and become the "Kleenex" of PM tools. But they waited too late and are now scrambling to re-affirm their dominance in the space. Thats how I see this.
Flash is evil (1999)
Seconded. Nationalism is just outdated tribalism that requires you to put your societal overlords' agendas above your own. When they call for you to go to war and kill your brothers and sisters from different places, you do it. When they ask you to give them the fruits of your labor so they can fund their war games and send your children to die in trenches while shifting wealth from the poor to the already wealthy, you do it. They feed you intellectual manure and try to appeal to your monkey brain to accept them as your tribal leaders and unconditionally pledge your allegiance to them and their purposes. And if you're big enough a fool, you do it (most people are).

Nationalism needs to go. There is absolutely nothing honorable in it. It just creates an artificial divide between the peoples of this planet. It all stems from a time when tribalism was needed to survive, and as it happens, evolution optimizes for local problems on the evolutionary curve and some of these features never go away.

Don't get me wrong, I am not saying we shouldn't cherish our cultural differences. On the contrary, I believe diversity is a wonderful thing and I find it fascinating that nearly every group of people out there has devised their own ways of communication, worship etc. Just don't let that devolve into "we are better than them", as it usually happens.
I'd thought this subthread was discussing semantics.
Was really hoping for "I switched to emacs".

Interesting the effects of unapproved "copies" on the OSS community though.
Which means the profit margin is shrinking. It's not all about whether you're in the red or in the black, it's about how much profit you're making.
If you consider the "infinite" of space and, especially, time, I believe that the probability of the existence of (at least) one "inteligent" species capable of reaching any given place of the universe is 100%.

The question of why they don't contact us is simple: Prime Directive (http://en.wikipedia.org/wiki/Prime_Directive)

Disclaimer: I'm not a particular fan of Star Trek and bumped into this interesting principle, which I believe makes perfect sense.
From my experience android accessibility is about where iOS was in iOS 3.1. Usable but iOS is better.
They would be stupid to allow servers. Buy your own business line if you want that. Google doesn't want others losing bandwidth because some people want to run servers.
Bharat Ratna Sachin Anthem
There are really too many variables to have any idea. For example, in both instances I see that your traceroute identifies the hop to your router, and you're using the 192.168.1.0 private network. Since your business example shows actual reverse dns lookups (from the looks of it), I'm guessing it uses a commercial switch.

Unfortunately, there's no way to determine the actual cause of the slow down.

For instance, you said that the slow down happens after 5pm, which quite literally is when 80+% of the working force gets off work. It could also be an artifact of AWS, and not Verizon FIOS.

Also, 2 instances does not a trend make. There's no way to know if you're one of those people who were sent a letter because they were using terabytes of data a month, and they're simply protecting the network traffic of 99% of their other users. Granted, I assume you aren't, but I can't be 100% sure.

For a truly independent test, you'd need the same modem/access device, without a local switch (i.e. a machine connected directly to the modem), and you would need VPN access to test both identifiable and non-identifiable traffic.

If you could verify that Netflix traffic through the VPN, on the same network, without any interference through the router, was delivering much more bandwidth than the same Netflix traffic, but in the open (not through the VPN), and could do so for a statistically significant portion of the Verizon FIOS user base, then you'd have reason to complain. Until then, I don't see your claim being taken very seriously.

Just my opinion though, ymmv
A company needs to pay what that costs

This is unclear to me. The company needs to pay what what costs? As far as I can see, they are indeed paying hourly workers for the hours that are worked, so this can't be what you're referring to. What is the cost that they're not paying?
Fix government corruption and the countries infrastructure and maybe people will start migrating to India instead of away.
Doesn't seem to be shipping with Chrome beta yet.

Edit: Just got the update.
There's a bigger, MUCH bigger, point to be made about geography and finding other creative people than this article, with its glib, provably inaccurate quoting (1) can make.

The big picture is that there are always under-stated, inexpensive places where you can get creative work done which are outside the major, known centers (SV, NYC, LA, etc.). They are tricky to find because they don't have metrics like insane rent, barking realtors, etc. to mark them.

For example, everyone (including me) used to laugh at Kansas City. Then I met a world-traveling DJ who told me KC was one of the hippest places, where the "kids" where the most into the music than anywhere else.

But beware: places that become symbolically cool and ideal attract posers. In contrast, there are people who evaluate tons of metrics to choose where to live and work. I suggest evaluating towns on the quality of their makerspaces as one useful feature. Tech accelerator programs' presence is another signal.

Another town I'm hearing is great to work in is Boulder.

(1) I just googlemapsed Newark to Manhattan (mid-town). It's 17 miles, 30 minutes best case, 45 in 10:00am weekday traffic.
Simple and elegant. This is art.
* This is government giving me an incentive to make less money.*

Or at least report less income. I bet a lot of people will move into the shadow economy, and get paid in cash. Instead of getting a W2 with 50k on it, I can work a part time job and report 20k, and do some off books work for 30k. I would qualify for the subsidy, and get a chunk of cash that I don't pay taxes on.
common crawl
Thats the way I read it too.
Ask HN: Would you follow a set of instructions that solves you a big problem?
You've been given with a set of instructions that helps you move all way down the path to a solution of a big problem you were experiencing.<p>Do you think you will follow them?
And if not, what is your reason in choosing to not follow them?
When should you Pay for Facebook Advertising?
Highs,Lows and Pitfalls of Working from Home
Autonomy is really an embarrassment for the entire British technology industry.
Too bad the new ones have fucked-up keyboards.
Hardly. Do you know what "existential threat" means?
12 quotes you need to know before you get old
"You may not understand this baseball analogy so let me explain this baseball analogy with some baseball jargon." -- Weiner

"Well thanks that makes a lot more sense now." -- European
Of course, prosecution for tax evasion when you're noticed living beyond your means is an incentive not to do that.
I have no issue using the main amazon site with Jaws as a screen reader. I'm sure part of that is that I've been using Jaws for close to 20 years but it doesn't appear this guy used navigation by headers which makes amazon quite usable.
I wonder if they have estimates on how many of those hours will move to the shadow economy as workers just work more hours for cash under the table.
You can preorder for $39.99, or priority preorder for $189.99. If you simply pre-order and multiple people pre-order, then it goes to auction. I assume everything it's telling me is "available" is available as a pre-order, and the ones that aren't are priority pre-orders.
What I'm saying is if, for example, my spouse and I could work enough to pay our bills without working full-time jobs I absolutely would. And that would not require taking advantage of a government subsidy. If I worked 10 hours a week as a consultant at $120/hour, that's over $60k, well out of the realm of any real "subsidy" from the government for insurance.

So, no, I do not agree with him.
That's at best the average cost. You can also deliver a few terabytes for something like $3 in postage if you ship a tape, but that average cost would be deceptively low if you were trying to use that bandwidth to watch Netflix.

The real cost is building the infrastructure to handle higher and higher peak bandwidth. Suppose you're Comcast with 20 million subscribers, half of whom are trying to watch 5Mbit Super-HD Netflix during prime time. That's 5 terabit, and even if you could agree with Netflix's providers to divide it up geographically, it's still an outrageous amount of bits to figure out how to ship.
You neglect that a new supply-demand equilibrium will form, and since taxes effectively reduce supply, it will form at a higher price, with less demand.

End result : less sales, customers paying more, and Google earning less.

I do think you should consider that this will only raise prices for advertisers in France though. So it will be even easier for out-of-country advertisers to undercut France's local suppliers.

The problem is that most citizens don't realize just how big the state's take on a normal wage is. You believe it's ~55% of your income. Well, no.

In France, a business has to pay taxes to pay you, then you pay taxes on what you get (to make matters more complicated, these taxes are collected by your employer). In reality your bruto pay is about 130% of what you get quoted (just due to taxes). Out of that 45% remains (taxed at 55%). Then you have local taxes, since you have to live somewhere, these are at least 2% of income. And you add VAT 20% on most things you actually buy. This ignores various other things, like the fact that keeping track of all this requires people, and obviously the state doesn't pay for those, so they yet again increase costs for businesses.

But let's calculate. Out of what your employer pays you in France, you get to spend ...
100% * (100/130) * 45% * 80% = 27,6%. So the tax rate in France is 72.4%, for a person having a decent job in IT. We're not talking bank director here. And of course the French state is raising these levels. Also these are MINIMUM levels (for a decent wage), it's assuming you aren't investing in stock, assuming you don't own a house (or God forbid - more than one house), you don't own a car, ... If any of those are not true, you'll be paying even more.

I think it's beyond obvious that this tax level, even if it weren't going up, is not sustainable.
Verizon FIOS is exactly the product the article was complaining about...

> I realized that the one thing in common between me and our president was that we both had FiOS internet service from Verizon.
CAP and Google Spanner: the survival of eventual consistency
what group are you with? we're working on some relevant stuff

http://continuum.io/

I can be reached at hugo@continuum.io if you want to chat about it
I've noticed this when streaming from the PBS Apple TV app, but not so much the Netflix app or website.

Occum's razor would suggest the problem is likely with the video services themselves, and/or congestion from other people who are now home from work watching videos, than something malicious from Verizon.