skysight-inc/HackerNews huggingface dataset:
Here at ParseHub, we're attacking the problem from another angle. Our tool lets users turn semistructured html (even the complicated, interactive kind) into structured data. The user does this by visually describing relationships in and across pages.

The key idea is to make it easy for another party to add the semantics on top of your data. This solves some fundamental issues that you and Cory Doctorow mentioned:

1) The economics equation for tagging now works out. The user that's doing the tagging has an immediate need (and payoff) for doing that tagging.

A corollary of this is that the parts of the web that are most valuable (in the sense that users need them the most) tend to get tagged first.

The following are responses to Cory's essay:

2.1) The person that's doing the tagging is also an end user, so there's an incentive to do the tagging honestly. That doesn't stop the underlying website from lying. But that's an issue with the web in general, and is mitigated by things like SEO penalties, reviews, etc.

2.2) Again, the tagger is the person who benefits from the tagging, so as long as the data is valuable enough, it will be tagged despite laze.

2.3) We haven't overcome human stupidity. Presumably since the person tagging the data needs it, it will be at a "good enough" level to be usable.

2.4) This one doesn't apply; the tagger is a different person.

2.5) 2.6) and 2.7) These are tougher, and we haven't started working on them yet. You have the same problems when trying to consolidate data from multiple sources. One possibility is to have several alternatives and allow searching to choose between them. That's how Bloomberg solves some of these problems, though it does result in fragmentation.

I'd love to talk to you about this some more. You can email me at serge@parsehub.com

Full disclosure: I'm one of the founders of http://www.parsehub.com
Thanks, but I was hoping to get a feel for what HN crowd might be using, to see if there are some systems that keep coming up.
There is truth to this -- I do sometimes get caught up in irrelevant presentation optimizations. But sometimes the default output is clearly "wrong", or even nearly illegible. In the ideal world I have someone else (i.e. a publisher) to think about this stuff for me, but unfortunately that's not usually the case.
Ask HN: What to do when your once potential competitor becomes a real competitor
I've had this idea for a SaaS based product and started working on it not too long ago (about 2 months in as solo founder/dev moonlighting). Since it is for enterprise I figured getting a solid product that does one thing really well is more important than building MVPs of product features. I still have at lest 2 or 3 more months into development before I start selling version 1 of the product.

But now I see my potential competitor also rolling out the same product I am making. They have a $1b market cap, have a large customer base and I can imagine they would find it easy to sell it than I do. I was sure that this would happen some day but not so soon. Their offering seems good enough to entice customers. The only thing I can compete with them right now is Price. They charge a lot for their product and I can beat it by being a fraction of what they charge.

I am currently confused wether to continue building or give up and start-over on something else?
One of the biggest barriers to the semantic web is the barrier to entry. Scraping web pages are hard. Parsing HTML (which probably doesn't validate) is hard. Extracting semantic meaning from parsed HTML is hard.

Even once you've piled on the libraries and extracted the bit of information that you need, what do you do with that data? You process it a bit and store it in some kind of data structure. But at this point, you've could have just pinged the website's API and gotten the same data (and more) in a data structure.

It turns out it's a heck of a lot easier to return a blob of JSON than it is to process text in markup on a page. And smaller, as well: JSON often takes up far less space than the corresponding markup for the same content. That's a big deal when you're processing a very large amount of information.

There's the promise that AI will someday make this easier: if you eliminate the parse-and-process-into-a-data-structure step and just assume that an AI will do that part for you, you're in good shape. But that's nowhere near being a practical reality for virtually all developers, and APIs eliminate this step for you.

Even if you use something like HTML microdata, there's very few consumers of the data. Some browsers give you access to it, but that doesn't make it extremely useful: if you generated the data on the server side, why not just make it into a useful interface? Or expose the data as raw data to begin with? Going through the extra effort to use these APIs is a redundant step for most use cases.
Why Apple/Google Phone Encryption Is Needed
> (Of course, Julia is also specifically designed for performance, while most research languages won't be).

Doesn't that depend on the kind of research that is being pursued? If the research is about high-level, productive language features, performance is going to be a secondary concern at best. If the research is about a language being able to prove properties about programs - including low-level stuff like memory safety, not just high-level semantic properties - then the language might very well accommodate efficient implementations.

http://en.wikipedia.org/wiki/ATS_%28programming_language%29
Death toll of epidemics throughout history
Did you try the advice on the page? Hold WASD and try every other key. On my 2014 macbook pro, even WASD by itself fails, so I'd be surprised if the Air is any different.
I have a mid-2013 mba and it seems to work just fine for me. Just tried the hello world example! (It took me about 3 minutes to really get it under my fingers.)

Wow, this is going to be even a bigger learning curve than Dvorak which I already use daily...
that's just way to general and way too much depending on the objective thing called taste. Next to chocolate/coffee/... I also really like the taste of vegetables like carrots, broccoli, fennel, pumpkins, ... I really doubt they would fall under the category of stuff which is likely to increase reflux.
Interesting discussion, clearly the size and speed crosses the 'scary' threshold. I wouldn't worry too much about that however as the risk is small, people invest a lot of time and effort into building models and that investment means that it is very very painful for them if they crash them. In many ways the modeller has more invested in the outcome than onlookers or the folks in the area.

That said, its an amazing to me this guy can keep his head 'in the plane' which is to say at that speed can fly the plane to its orientation rather than his own. When I've flown model planes there are always times where I'm turning the wrong way because I've mixed up the front back / left right controls given a particular plane attitude and direction. (and yes crashed a couple which made me feel horrible and so I stick to vehicles :-)

Next up I hope someone can build a FPOV version so they can fly it from the "cockpit". That would also make for a great video.
Thanks! I've seen a few comments that also mention the Proliants, people seem pretty satisfied with them. And it might not be too slow, my current Plex server is my 2010 MacBook Pro.
Genetic Relations Among Procrastination, Impulsivity, and Goal-Management Ability
Chimpanzee Intelligence Is Heritable [pdf]
I know vim, but I don't think that change much. In fact, if I lost a month of work and did not have any printouts or even notes, I would in most cases be able to redo it in 2-3 days, and unlikely no more than a week. The reason is that I remember most of the decisions I made along the way, and don't have to spend time on making the right decisions about the code and architecture, since they were already made, and I would spend less time reading documentation and looking up how the problem can be solved in general.

What I describe is at least true when you solve relatively complex problems, and is a relative experienced programmer that take most high level decisions about the code yourself. If you have a very junior position, where most decisions are made for you by others, and you work in programming languages and framework that require a lot of boilerplate, then what I said will be less true. Then using the right editor may matter at least a bit. Even in that case I doubt it is a major factor.

On the other hand, using the right programming languages, libraries and tools may boost you productivity quite a lot, and have much larger impact than typing speed or input method.
Sublime Text 2 – Useful Shortcuts
It would be good if you could mention precisely what programs have you tested and perhaps provide some links.
Never heard of Jainism... interesting.

But you're right, in that many religions do have a ideas that are good for you.
I've just read this and the whole story sounds extremely weird to me...
I don't know how things are done over there in SF, but from my point of view there's no need to go to a City Town Hall to solve this...you book online, show up and play. It looks more a way to feed the Tech Hype rather than a real problem but...
The only food I've found gives me heartburn is black olives.

Conveniently, I don't really like them.
Author here. The title was a pun. � is U+FFFD REPLACEMENT CHARACTER which may possibly replace a badly encoded heart.
http://radar.oreilly.com/2014/10/isomorphic-javascript-with-...
Improving scroll performance (2012)
I wouldn't be bragging about "hacking" voicemail, as that's unethical and borderline illegal, despite your disclosure.

Last night, you submitted a "Show HN: We Hacked Jason Calcanis's Voicemail," which you wisely deleted. This isn't something to be proud of, especially since you strongly emphasize that you are YC alumni.

http://www.ycombinator.com/ethics/
I don't understand why they're using raid6 instead of file-level replication/integrity. They're already running an application over top of it - do the replication there and skip replacing disks...
"In France, for example, a serving of ice cream is typically a single modest scoop, while in America, it’s often three gargantuan scoops."

This was the first thing that struck me when I first moved here. Portions for all kinds of food from ice-cream, to coffee are huge. Why are huge portions such a common thing here?
You're assuming that everything he's skipping by giving forth the least amount of effort is more important that whatever else he's doing with his free time. It may be, it may not be,
I found that chlorinated water or high-fructose corn syrup triggered mine. That took a long time to isolate.
I can see how this comes off as an insular group sticking it to the government, but that's not the case.

If I gave the impression that we didn't create good APIs or good docs, I apologize.

We did, but that's not what the government wanted, so we gave them what they would accept. The government just was not very good at deciding what has to be documented and what doesn't. e.g., we had to document sample wire traces of messages that are all auto generated through IDLs and sent over a standard protocol. Rather than 2 page of IDL and a comment saying we use transport X (which is defined in RFC blah), we were actually required to submit 100-pages of traces. That obscures, that does not help.

Even if you wanted to do a great job of producing docs, we quickly learned that the process wasn't about creating great docs; it was about producing docs that the government would accept. Have you seen Office Space? It's that. It's thankless, because you're generating shit docs that aren't relevant that are judged by people who don't have the skills to judge them.
Let me be more clear: Long ago a friend kept suggesting
that I write a converter from TeX (maybe also LaTeX)
to HTML. I kept telling him that that was essentially
impossible because TeX is a programming language,
likely Turing machine equivalent, complete with
if-then-else, allocate-free, file read-write, while
HTML is just a text markup language. No doubt
JavaScript is Turning machine equivalent, but I'd have
a tough time believing that HTML is.

So, my suggestion here was not to convert TeX input
to HTML.

Instead my suggestion was just to convert TeX output,
that is, a DVI file, to HTML. Why? Because a DVI file
is essentially just text, or, as I outlined, it
specifies put this character at these coordinates on the
page, put that character there on the page,
go to a new page, etc.

To be more clear, say, about the file reading-writing,
that happens when the TeX program reads the user's
TeX input and before the DVI file is generated.
Given only the DVI file and displaying it,
there is no file reading-writing.

So, it looks like could convert TeX DVI output to HTML.

You pointed out that maybe HTML with a browser has
more flexibility than TeX output. Okay, maybe. But
I didn't claim that, given an HTML file, there would
be a TeX input file and a corresponding TeX DVI output
file that my envisioned converter would convert to
the given HTML file. Instead, I just claimed that
for a given TeX and DVI file, the converter would
generate an HTML file.

Or the converter would
be a function from the set
of all TeX DVI files to the set of all HTML files.
That is, for each TeX DVI file there would be
a corresponding HTML file from the converter.
But the function would not be onto the
set of HTML files, that is, not all HTML
files would be a value of the converter;
not all HTML files could be obtained
by using TeX input, the TeX program,
the DVI file and the envisioned converter.

You also mentioned some ways in which
HTML, say, with <div>, is more flexible
than TeX. Fine. But I was discussing
just converting TeX DVI to HTML.

And, again, I see no way to convert TeX
input, which is a programming language,
to HTML, which is not a programming language.

Whew!

More clear now?
Ask HN: How I can get out of a job that has me burned out and exhausted?
Four years ago I started a job and it was pretty good at first. But due to some corporate changes everybody just got slammed with work. Upper management does not think it's wise to hire more people so they are burning everybody out and people are leaving. The workload is unmanageable and it just never ends.

It's time to move on but I am just too burned out. I have even recently caught myself forgetting pretty basic stuff. My weekend are just spent recovering from the week really. I don't do much activity that I used to for fun because I am just so tired. I asked my psychiatrist and I am not depressed.

Any advice?
Its unprofessional and used in this case to be demeaning. Being the son of an immigrant has nothing to do with one's political ability, in any other workplace this would be considered harassment so I'm glad the Estonian government has taken it seriously.
This is terrifying.

It's incredible that you think this is okay.
Books are the new Horses
in Mavericks default save location was iCloud for docs but it didn't silently upload stuff afaik
There's already been multiple security vulnerabilities in Docker, and likely there will continue to be more in the future. Virtualization and sanboxing is hard!
Smell of a comet
Because it's three links, not one.
Thanks to timboslice for mentioning Gmap4. I am the developer of that browser app.

By my count there are 5 browser apps that I refer to as enhanced Google map viewers. Each of us devs have produced our own version of Google maps on steroids so you can surf maps (including seamless topos), display your data, or display other data that you find online.

In order more-or-less by launch date, these 5 apps are:
ACME Mapper
GPS Visualizer
Gmap4 (Joseph Elfelt - that’s me)
Hill Map
CalTopo (Matt Jacobs)

A few years ago the USGS made very hi-res scans of all (yup “all”) their paper topos. Matt shipped a box of harddrives to USGS and got back copies of those scans for the most recently published paper topo for all of the USA. Of course for some locations the “most recently published paper topo” is rather old. Matt whipped up some GDAL magic to de-collar those scans and chop them into tiles. He is hosting the tiles on Amazon’s cloud and invited me to display them with Gmap4 (where I call Matt’s tiles “t4 Topo High).

Gmap4 default map: http://www.mappingsupport.com/p/gmap4.php

Gmap4 homepage: http://www.mappingsupport.com/p/gmap4.html

Finally here is a project I just started a few days ago to use Gmap4 to display data that (1) is hosted on state and federal GIS servers and (2) shows public land boundaries and recreation features. Here is the top page for this project. OK, time to ’fess up. I’m a software dev, not a web designer.
http://www.propertylinemaps.com/p/public_land_map.html

You can customize these links. For example, here is one that displays the very cool New York state bike map zoomed in on a random spot:
http://www.mappingsupport.com/p/gmap4.php?ll=42.346429,-76.8...

(The html pages for these public land maps contain a plug for my startup which georeferences land surveys and property legal descriptions.)

One of the next features I am going to add to Gmap4 is the ability to click a GIS feature and see a popup with the attributes for the thing you clicked.

Joseph, the Gmap4 guy
It's an old post with old pricing, I simply don't see vendors pricing close to there system ( assuming your looking at the fourth iteration ) especially not including support.
You're an expert C programmer when your C program has enough users that its buffer overflows get CERT advisories from Homeland Security.
Am I missing something or is this benchmark indicating that VB.NET has superior floating point performance to C?
This is not going to end well.

Ethical quandaries aside (of which there are several) for a moment, I think this strategy speaks poorly of the startup. What type of signal does it send to prospective investors that you feel it's necessary to pull illegal stunts in order to gain attention for your round? A quality YC startup shouldn't need to go to such lengths to raise a round if the substance of your project/team is of sufficient quality as to warrant investment.
I mean, the obvious answer is 'do something else', but it's kinda up to you what that is, and also depends on your situation.

If you are single with no dependants, then it can be anything you want. Do something where you don't take work home. I burned out on Sys Admin work and worked as a bartender for a year and loved it and came back as a .Net developer.

If you have a family...Um... That's a much more complicated scenario. Definitely do something new, but navigating that is going to be a lot trickier.
Or a real life version of Descent, go go wingnut!
I agree with this, my thesis committee wanted my thesis as a research paper (irrespective of whether my work was going to be published or not) but in the final stages the graduate college declined to approve it in spite of my committee's approval because they require a predefined format of the thesis. The change of format took me a few minutes, thanks to latex. I can't begin to imagine how much work and anxiety it would have taken to change the entire format at the last minute otherwise.
Smart Hiring Tips for Tech Startup Success
What are your skill sets? If you're a good programmer you can easily land another job these days. If you don't have time to look and apply for jobs then may be you should quit your current job to look for a new one. It may sound like a bad idea now but in retrospect it'll may be worth it. Just think of the opportunity costs associated with staying at current job or leaving it. Good luck!
MathJax has something called "JSXGraph" that I've never used. Looking at it, it might take some getting used to, but doesn't seem too bad.

http://www.onemathematicalcat.org/JSXGraphDocs/JSXGraphDocs....
Is the video of the talk available somewhere?
Show HN: Paper OTP
Actually, completing eliminating your meal pre-workout may provide better results in terms of fat loss. However you may feel tired but having some caffeine and/or protein with limited calories may alleviate that. It's called "fasted training" and you can read more here - [http://www.theguardian.com/lifeandstyle/the-running-blog/201...]

If you want to go completely extreme, intermittent fasting only allows you to eat within a limited window (e.g. 6-8 hours). Lots more research has been done on that but the pressures of conforming to traditional meal timings especially via social occasions can be difficult.
Yes, that's exactly what I'm asking.
Is this for real? Is this the official direction for AngularJS 2?

Seems like a very big leap considering people are just getting use to the way AngularJS 1 works ($scopes etc).
I suffer acid reflux a lot of times. One trick I read some years ago proved to be magical: eat a teaspoon of dry, milled coffee. It works instantly and lasts for at least 2-3 hours. It can be tough to swallow the coffee at the beginning, but once you get used to it, it isn't that difficult.
But in 2014, 1PB in S3 – with 11 nines of data durability – costs ~USD$30,000.
I recently met a Uber driver who had retired from a successful career in the semi conductor industry and was trying out driving for Uber as he gets to meet new and interesting people.
What happened?

The Semantic Web happened, and is still happening. But most people don't notice, because the Semantic Web isn't, for the most part, about being visible to end users. But every site using microdata, microformats, RDFa, etc. IS part of the Semantic Web.

Google, Yahoo, Bing, etc., are all using elements of the Semantic Web.

Just because the average end-user isn't writing SPARQL queries doesn't mean the Semantic Web isn't around.

Are there still startups working in that space?

We are. I just gave a presentation on using Semantic Web tech in the enterprise at All Things Open last week, and a related talk at the Triangle Java User's Group earlier in the week, where we showed off a lot of the ways we are using the SemWeb stack.

Are people still interested?

Judging from the response to the two talks I just gave, I'd say yeah.

For more on my take on this topic, see:

http://fogbeam.blogspot.com/2013/11/dominiek-ter-heide-is-de...
Well I'm pretty experienced, nobody else is making decisions for me, and at least sometimes I do fairly complex stuff, but it still helps me a lot. I spend that time thinking, and then I can get it done without getting bored by the tedium and switching away to surf reddit. Or I think as I type and make wholesale changes as I go, because why not, it's easy. YMMV.
In 2003 I was in an EU project (Agentcities) that did interoperability demonstrations for distributed knowledge applications. We had to develop and use ontologies for ticketing, transport - and a few other similar things.

My honest expectation was that building these ontologies would take about a week of group effort. As I remember it we were still at it months later.

This convinced me that the SW was a bust. Moreover one of the roadblocks we hit was very illuminating to me.

Creating the ontologies and onward development/extension of them was hard because the tools were so poor (also other things like it is just... hard) but the lack of tools was widely noted as a clear issue.

No one did anything about it. We had protege then, and lo it is so now.
true! because the lectures are delivered asynchronously you can survey a broad amount of material. again, I definitely think that the world is a better place for having available courseware, but you shouldn't let the brand name of the professors institution (harvard, MIT, stanford, etc) fool you - it is still watered down. it has to be.
THE INTERNET OF EVERYTHING: 2014 [SLIDE DECK]
Improving the lives of ½ billion people
Had the same issue, just moved to another country changed job. Started going to the gym, started going to meetups. Take a long vacation and think about what you want to do before you jump ship.