skysight-inc/HackerNews huggingface dataset:
btw, anyone interested in something like this? I have an extensive codebase after trying to build a business around p2p vpn/filesync software. The business didn't go too well (various reasons) but the code is very high quality and still lying around collecting digital dust. We had (we think we had :-)) the best NAT traversal algorithms at that time. Multiplatform - Linux, Win, Mac. Written mostly in very readable old school die hard ANSI C :-)

In the wake of the recent NSA-related news I thought that this stuff may find a new use. If you have an idea and would like to devote some time and effort - you're welcome (I guess my contact info is visible in the profile).

I have no issues opensourcing it, it contains no close licensed and/or GPL-poisoned code. Everything we borrowed was BSD-type licensed. I just want to have some product to opensource instead of just dumping it on the Github and then waiting 4 billion years for life to conceive itself there :-)

Sorry for shameless plug.

Update for "Github ++" commenters: I'm all in to put it on Github (BitBucket is more natural in my case, because it's a Hg repo). But: the architecture was quite well thought out and internal APIs are quite clear, but they're not documented. We didn't have immediate open source plans. You wont be able to figure out how to use it, especially if you're going to use our "lower" layer - NAT traversal and friends. You need to know how it works to build a more universal API on top of it. Trust me, I know what I'm talking about - I did a few experiments with this code about a year ago and I spent a _lot_ of time figuring out how we did this and that. And it was _our_ code, we wrote it and discussed it daily for two years.
Don't forget Intercom, who've hired around 10 people over the last year.

Edit: 10 people in Dublin, I think their headcount is double or triple that in total.
These are federal judges. They have life tenure. Fewer patent cases just means more time for golf.
Retrospective: High Performance Browser Networking
I dated a Chinese girl in college who knew all about proxies, tor and vpns all because of the censoring. I was pretty surprised given most kids in college don't know about that stuff but to people who grow up there it seems second nature.
Airbnb Hosts Five-Day Hello L.A. Event With James Franco, Moby, Anjelica Huston
At our school in Australia, everyone was issued laptops last year. The rollout began with seniors (y12) and progressed down through the years. Within about 2 hours of having the machines most of my year had installed chrome, bypassed the web filtering, installed iTunes and copied their music to the laptops. The school knew immediately, and came around to the classrooms to inform everyone that we had now been restricted to 10GB of space on the laptops, and that they had removed iTunes and chrome.

For the remainder of the year everyone found ways to play games and to log onto various school servers and mess with things. It was more a point of we could. A lot of people still used pen and paper, or their own laptops. The most common use of the school issued laptops was free Internet, and thus youtube/ pandora.

From my understanding the younger years don't act such ways as we did being in year 12, and I think it's just a time thing. For them the school laptop is part of their schooling equipment, but for us we went through 10yrs of schooling without a laptop, so getting one was novel.
Your comment seems to imply that isn't what happens in countries like the US.

Given the disparity between the richest 1% and everyone else in the US, you should probably start addressing your own country's inequalities before climbing onto your moral high horse.
We don't build oil refineries above deep-sea oil wells.

We don't build foundries next to iron mines.

We don't cut diamonds next to diamond mines.

We don't put textile factories in the middle of cotton fields.

We ship bauxite to where electricity costs are the cheapest.

South Africa is the major producer of many important minerals, but it doesn't control the world's industries.

Why then would economics "favor industry controlled by Mars"?

I can conceive of a future where that's so, but only in timescales of several centuries, and it's not at all obvious that there will be any time when Mars will be more important economically than the Earth.
it probably it isn't , the problem is that the FDA is strict and it takes a lot of time even before starting human trials and even then it might take 5+ years depending on what is being tested.

I've also heard of some drugs that take 30+ years to test for long term side effects ( that's assuming the medical company has the finances to support it for that long).
It's a little silly to compare LAX or JFK to something like the Tallahassee Regional Airport and then make a sweeping conclusion that America needs smaller, more regionalized airports. LAX serves a very different purpose from Tallahassee Regional. It's the #3 busiest airport in the US, and also the #3 busiest in the US by international traffic.

LAX sucks, and I say that as a Los Angeles native and lifelong LAX sufferer. It sucks because it's so busy. It sucks because road traffic in and out of the airport can take longer than some plane flights. It sucks because it's filthy, and other than the newer additions to Tom Bradley, most of it hasn't been upgraded since the mid-70s. It sucks because the security line is one of the laziest and slowest moving in the country. It sucks for any number of reasons, but none of those reasons is remotely comparable to Tallahassee.

Small, regional airports are great experiences. I lived in Arkansas for a few years, and XNA (Northwest Arkansas Regional) is one of the cleanest, quickest, quietest airports in the country. That's also because the entire population of Northwest Arkansas could fit comfortably into a few blocks of LA. If and when XNA starts to accommodate even 1/10th of the traffic of LAX, I'll compare the two.

If we want to make apples-to-apples comparisons, I've been consistently impressed with the Dallas Fort Worth (DFW) airport. For a regional hub and a very busy airport, it manages really good on-time percentages, it's fairly clean, and the transportation system makes moving between terminals really easy. It's in light of airports like DFW, not the small regionals, that I can say that LAX sucks. (Even Chicago O'Hare, the #2 busiest in the country, seems remarkably more efficient, friendly, and clean than LAX).
You sound like a rubbish lawyer if that is really your attitude towards it.
I agree. If you're building a site you're going to end up maintaining for a long time, you should be building it from the ground up yourself. These sites are great at inspiration though! Your site showcasing extremely barebones demos is great.
Forgot to mention them and I'm typing on my phone. That growth has all come in the last 8 to 10 months too. Stagnant my ass :)
What's so horrible about it? Obviously, it isn't on the same level as any of the slide decks web designers put up that are in a sane format (HTML5+js / PDF) which don't require you to actually click through, but then

a) Theo De Raadt works much further down the stack

b) This is probably something put up by the EuroBSDCon folks after converting his slides (can someone who was at the Con weigh in on this? If he actually presented his talk like this, that's extra bad).
Scratch everything I said below. After reading what little documentation there is on FreeLAN, which isn't much, it looks like just another VPN solution like all the rest with nothing really special about it. The configuration looks different and it is interesting, but I don't see anything that makes it special, and the products claims of superiority over others seem unfounded.

--

I just happen to be here doing my first OpenVPN implementation this last few days.

It appears that FreeLAN is all about transparent bridging VPN, rather than routing VPN. Thus, the "LAN" part of the FreeLAN product name is particular apt.

It is noteworthy that the words "Ethernet" and "bridging" are absent from the product FAQ. This is most unfortunate.
The blood sugar sensors have been the problem.
Having long words does make brute-force cracking harder.
Check out Hutch (https://github.com/gocardless/hutch) - a similar system built on top of RabbitMQ
That's a bad use of statistics. There are significantly less wealthy people than poor people, so any single instance is going to be much more likely to be perpetrated by a person from a poor background. That doesn't prove that people from poverty are more likely on aggregate to break into your car.
Thanks! Another data point...

I personally tend to see it as the worst of both worlds. I have to deal with types _and_ I don't really get strong guarantees. I don't run into problems in Ruby that Go's type checker could help with. But that's also my personality: I like extremes.
So telling little gay kids that they were born broken and are going to Hell isn't abuse?

Don't you dare say that it doesn't happen or that it doesn't matter. Don't you dare.
I'd be very interested to check it out if it lands on GitHub. I don't think I'd be much of a contributor up front, I'm still getting my head around all the acronyms tossed around VPN networking, but I have a hobby project for which I've been researching how to build something like this.
Pretty cool! What does the "<huge number> to one" mean exactly?
Mostly, we started as a land of commercial opportunists taking advantage of royal grants. The religious zealots just played better in the history books of 100+ years ago, so they get most of the attention.
Please do not make angry and spiteful accusations without presenting any supporting evidence whatsoever. If you have evidence then please present it either here or to the proper authorities.

You should be more careful about what you say.

I am surprised that HN doesn't mark these posts down. Less foolish statements have been censured by the powers that be on this forum.
Hey, wait! That's my plan.

By the way, I don't think there's anything wrong at all with bribing early adopters. Just sayin'...
The only complicated part that I've run into when writing crawlers is accidental tarpits. It's very easy to run into a situation in which you're repeatedly requesting the same content via many different URLs.

For example, when a tracking parameter is added to any URL within the site:

http://example.com/?cid=104484&pid=12002348&ref=1294902

http://example.com/?cid=104484&pid=12002348&ref=1294904

http://example.com/?cid=104484&pid=12002348&ref=1294905

http://example.com/?cid=104484&pid=12002348&ref=1294906

You can quickly get to billions of permutations for a single site. The canonical tag solves the problem when it's there, but I still haven't seen a simple solution to the problem when it's not.
"Hacking" their iPad, as in running a widely available pre-complied exploit...
I would highly recommend storing the working set of links in RAM (with checkpointing to write it out to disk periodically). A Redis Set (for visited links) + Sorted Set (for unvisited links, ordered by priority) is perfect for this, since it lets you take up one full machine's RAM and does checkpointing automatically. If your crawl is too big to fit in RAM, get more machines and shard by URL hash. As others have pointed out, the file content itself should go in files, ideally ones that you can write to with straight appends.

The reason you don't want to hit the disk with each link (as both MySQL and PostGres usually do, barring caching) is that there can be hundreds to thousands of links on a page. A disk hit takes ~10ms; if you need to run hundreds of those, it's well over a second per page just to figure out which links on it are unvisited. Accessing main memory is about 100,000 times faster; even with sharding and RPC overhead for a distributed memory cache, you end up way ahead.

The reason to write the crawl text to an append-only log file is because disk seek times are bound by the rotation speed of the disk, which hasn't changed much recently, while disk bandwidth is bound by the rotation time of the disk divided by capacity, which has gone way up. So appends are much more efficient on disk than seeks are.
+1 for Github, I could think of some uses for this.
Be engineer #1 at Lob (YC S13) and build a suite of cloud APIs
Email us at jobs@lob.com with your Github link, resume, and any additional details you'd like to share with us.

-------

Company

Lob is creating a suite of API’s to revolutionize how companies operate. Our first API is a Cloud Printing API. Our product enables developers to programmatically facilitate printing and fulfillment. If you are passionate about API’s come help create the next wave of great API’s at Lob. Lob is a graduate of the YC S13 class and backed by leading internet venture capital and angels.

Team

We are currently a 3-person team (from AWS and Microsoft) based in San Francisco. We are looking for other passionate people who share our vision that API’s will eat up the world.

Job

We are seeking a software engineer to build the best cloud printing platform on the planet. You will be the first engineer to join and as such will have an unprecedented opportunity to shape the future of Lob’s APIs.

Responsibilities:
• Own the framework of the API that is the core of Lob’s business.
• Work directly to define, architect and build new Lob APIs.
• Drive towards successful deliveries of scalable, maintainable
and secure code.
• Create and define engineering best practices.
• Tackle challenging problems in distributed computing, HTTP, API
design and more.
• Build and maintain client libraries for our API in a number of
languages including PHP, Ruby, and Python.

Requirements:
• Experience leading engineers in a technical leadership role.
• Experience working with API’s and HTTP, preferably in PHP and Ruby.
• Full-stack development skills.
• Hands on. Passionate. Persistent. Creative.
• Experience with AWS.

Perks:
• Health, dental, and vision benefits for you and your dependent(s).
• Open vacation policy.
• Commuter benefits.
• Free lunch, dinner snacks and stocked fridge.

Want to stand out? Sign up and build an app using the Lob API. Include a link to it and brownie points for pointing out bugs or things that annoyed you or could better about the platform. Email jobs@lob.com if you are interested.
Not everybody aspires to doing nothing. Worse, few people aspire to doing nothing on somebody else's schedule and conditions.

That 'do nothing' looks like this: do nothing here for an hour or so while queuing for check in. Next, do nothing queueing for the security check; after that, do nothing sitting in some lousy chair for an hour (maybe more, but we can't tell you exactly how long), or do nothing time walking around some fairly limited shopping mall; you can't go outside. Now, do nothing for 15 minutes while boarding, do nothing half an hour or so waiting for takeoff (don't use your electronics!). Then, do nothing for a couple of hours in a noisy vibrating, badly air conditioned, crowded room, etc.
I think the key word there is "direct" -- AFAIK FreeLAN is P2P, where OpenVPN is "client -> server -> other client"
Racist fuck.

Oh I can't make baseless claims on the internet? What's your excuse?

Look I don't really like how Obama has handles anything but laying the blame on him is pretty fucking retarded when these programs have been in the works for decades.
IPhone 5S VS 5C VS 5 VS 4S VS 4 VS 3Gs VS 3G VS 2G
Why? When both are deserving of criticism, both receive criticism.
So give some indication of how they would in any way be able to show malice in this case, let alone a defamatory statement.
hacking- routing around obstacles

cracking- breaking obstacles

sounds legit imnsho
If you're from outside EU / EEA and are looking to startup something, this might be helpful:

http://www.citizensinformation.ie/en/employment/types_of_emp...

http://www.enterprise-ireland.com/en/Start-a-Business-in-Ire...

If you're looking to work, you need a company to sponsor you, there's a green card programme, and in practice, it's not that difficult to get in if you're a programmer with a CS degree or equivalent experience. Sure there are forms and red tape... but it's not as many hoops to jump through as moving to the US.

More info on work visas / green cards for Ireland here:
http://www.citizensinformation.ie/en/employment/migrant_work...
> It is easy to be a FOSS advocate when still living at the parent's home

Not this ridiculous, childish argument again. Your personal issues have nothing to do with FOSS advocacy.

There are many people who are paid exclusively (and well) to write FOSS. There are many more who contribute back to the products they use. The FOSS economy is vast, but difficult to see, largely because so few people pay directly for it, but it makes possible things like Google, Facebook, most of the Top 500 supercomputers, Android phones, most network appliances and so on. The list is much larger than would fit here.
Hey, the shameless plug would have been a lot better with a link to a Github repo. I'd advise you to put it up on Github and keep advertising it, good NAT traversal algorithms are probably worth something for open source projects.
Any idea why they would use long long rather than int64_t?
Bought 2 FPGA miner rigs from BFL. One of their first customers to take that risk. Cost about 30 grand. Liquidated 2 of my 6 underperforming retirement funds to pay for it as I was unemployed at the time (yes I am a little crazy and obviously have no dependents).

I now have about 330 grand in BTC. After paying off the original investment (and then some) by selling off 1/3 my holdings when it was $230. I also paid off the upgrade to 3 ASIC mining rigs (4.5TH) which should ship... Imminently actually.

I also have a 6 figure developer job but Bitcoin has made me far more money so far (on paper) this past year.

I'm still bullish on it. Welcome to Internet Gold 2.0.
Honestly, I'm a little surprised they weren't all completely open by lunchtime the first day. Kids, when given access to technology in a school environment will always find new ways to (primarily) play games, and those ways will evolve as the schools desperately struggle to keep up, but the school will always lose that particular arms race.
Sorry, no. "I should be grateful if they screw us over, because they're getting us from point A to point B" isn't really good enough.

Sure, it's easier than going by carriage in the old days,or from some true third-world airports. And I'm not one to complain when unavoidable things happen (e.g. people sleeping everywhere when the weather backs up).

But equally, when the airports have (a) a functional monopoly and (b) fairly simple, low-hanging fruit choices to make life more comfortable (e.g. plugs, wifi, reasonable places to wait), and (c) they spend money on "improvements" that do nothing or degrade service (bigger TVs screaming at me? Really?), then it's worth not being complacent about it.
I always find it interesting when there is a TON of articles on HN about building things from scratch, doing things yourself and essentially taking the slightly longer road for a better product.

I see a lot of these "starter templates" coming out almost as fast as new Javascript libraries. While I can see a benefit for some developers, I often wonder if the art of building a fast, responsive website from scratch has been lost in the sea of mass production website building.

Or is this just the wave of the future that I need to just deal with??

*EDIT: thanks for the advice from everyone. It does makes sense to have these ready made solutions so you can focus on what you really want to make great about the site or app you're building.
So this can be an open-source replacement for Himachi/Log-me-in?
Calendars work when other people are depending on your decisions, and it's basically more important to make a decision than anything else. Everything is driven by the need to make that decision. The decision may be imperfect, but the overall system can tolerate that most of the time - and when it cannot, it appears as a schedule problem.

Calendars fail when you need to perform labor to complete a piece of work, and you don't know how long it'll take. A to-do list is a detailed list of tasks to complete, generally in a specific order, to complete a piece of work. That work is probably part of a larger piece of work. There are dependencies between pieces of work. Times, if they exist in the to-do list, are generally estimates.

The only way to put tasks into a calendar, if you want the calendar to reflect reality, is to pad out each task with extra time. That way, the schedule doesn't fail.

However, if you padded out your to-do list with enough extra time so you could fit it into a calendar that could remain largely unchanged for the next year... your productivity would be pretty low. It would be a pretty relaxing job, however.

There are problems when these two different ways to organize work aren't reconciled correctly. You have work crunches, where people are forced to work late, or you have calendar failures where your obligations to outside parties aren't met, or both.

Both are intolerable, and a sign of bad management.
This is certainly not an issue with iPads, specifically. Students probably spend more time using computers for entertainment and social networking than they do for school, but that doesn't stop teachers from taking their students to computer labs to type essays. Just because something can be used for fun, doesn't mean that it has a place in schooling. Moreover, students very commonly get around the very weak security procedures in place, which, more often than not, prevent students from doing legitimate school work, rather than preventing abuse.
As mentioned these passwords aren't hard to crack.

Anything based on a word list is going to be inherently easy to crack, and with a predictable format like word-separator-word, it is even easier.

I realise this is a fun weekend project, and learning new languages is always a good thing, but I think it's a little irresponsible to make any claims that these passwords are secure.

Also as mentioned, if people were to actually use this for password generation it should be behind SSL, although I would discourage anyone from using passwords generated by a remote service.
Flying may be easy, but I'd challenge anyone to say the experience of getting off at JFK and finding a place to stay for the night is anything other than brutal. For such a cosmopolitan city as NYC to have such a decrepit main airport is scandalous.

In fairness; SFO is ok-ish, O'Hare is nice, as is Houston and LAX.
You forgot to include the Modernist Cuisine link.
Hi, I am the owner of the website. I must have been hacked it here are spammy links! How do I get rid of them?
What? Dubai doesn't have much resources, and the airport is a profitable international transportation hub. It also is one of the few airports in the world with a non-reciprocal open skys policy. The airport and the shipping port are how Dubai got to be so wealthy. Dubai deserves some criticism (particularly around labor rights), but yours makes zero sense.
Not an expert, but TeleHash [1] might be a more lightweight alternative than freelan for a lot of applications.

[1] https://github.com/quartzjer/TeleHash/blob/master/org/v2.md
I work at Intel, and am involved with the "Reliability Verification" team for some of our client products. We design our chips to last 7 years when run well over the specced frequency on "viruses" that are much harder on the hardware than any realistic workload. Server teams have even stricter requirements.

If any hardware is going to see increased failure, I'm guessing it's the hard drives.
> So far disagreeing with you = [...] what 'guilty' parties do to silence their critics.

I don't think that is a fair assessment of the above claim.

The claim is that threats of libel suits are what guilty parties do to silence their critics, not disagreeing.