skysight-inc/HackerNews huggingface dataset:
To put some perspective on this:
ryan@3G08:~/Desktop/bleh$ pdftotext David-Foster-Wallace-Infinite-Jest-v2.0.pdf
ryan@3G08:~/Desktop/bleh$ python dfw.py
size of vocabulary: 30725

The man passed Shakespeare by 1,896 words with that book.

code:

import nltk
from nltk.stem import *
import string

raw = open("/home/ryan/Desktop/bleh/David-Foster-Wallace-Infinite-Jest-v2.0.txt",'rU').read()

exclude = set(string.punctuation)
raw = ''.join(ch for ch in raw if ch not in exclude)
raw = raw.lower()

tokens=nltk.word_tokenize(raw)

stemmer = PorterStemmer()
stemmed_tokens = set()
for token in tokens:
stemmed_tokens.add(stemmer.stem(token))

print "size of vocabulary:", len(set(stemmed_tokens))
Someone need to make a app for these people
Hi there, upb author here, thanks for the shout-out!

The stock protobuf implementation is pretty close to optimal given what it does. Where upb is faster, it is faster by doing less.

For example, I can beat protobuf if you don't write the parsed data into a tree structure (or only write a few fields). I can beat it if your input has unknown fields and you don't care about preserving them. But if what you need is a tree structure that contains 100% of the input data, protobuf is hard to beat speed-wise (though there are still a few tricks, like arena allocation, that can beat it given some usage patterns).
I never thought to post there because I'm not looking for freelance work, period. Sure some still post there, but how many companies looking for full-time developers are looking there?

I would think the success rate in that thread for full-timers is pretty low.
Yeah, I know about those. There are industrial control computers that still run on Intel 386 (the original). But once those guys run out of spare parts they won't just upgrade the processor.
True, but that code isn't exactly a driver of new hardware sales.
As far as I can tell both editors were female (at least, Malke is a female name).
How so? With 51% of hashing power you can essentially rewrite the block chain to say whatever you want. What possible use could you have for a block chain that is not accurate and controlled by a single entity?
>I'm not sure why you guys ganged up to downvote on something obvious - PHP is loosing grounds to HHVM already.

Perhaps because some on HN are computer scientists, so to convince them it takes actual numbers and not some anecdotal evidence of what you personally use.

Judging from all available data sources, you are an outlier.

HHVM doesn't have that large a community (mostly FB people), is not installed in the overwhelming majority of hosts, still has compatibility issues, has few posts about it, there are very few mentions of companies using it, and, for what it is, has been largerly ignored in the whole PHP community (forums, etc).
I came here to say just this :) It didn't read right as "follow".
MIT scholar fights malaria with magnets
Sorry, had to AFK suddenly.

As for how I'd feel - I guess while I don't like the fact I'm being observed, there's nothing I could do about that. Somehow similar to feelings when others say things I disagree with - I'm not comfortable with that, but there's free speech rights.

Although, if that'd be within my powers to contribute to improving such laws (say, allowing to replace identification plates with something more privacy-respecting), I'd probably consider this option.
Help name our small-business-tech-startup
Hi All,

Help us pick a name for our start-up. We are creating a Job-search site for small businesses.

Swaha.com
Joberous.com
Job.ly
Hiringguy.com
Jobless.ceo
Avaca.do

and please, if you have suggestions of your own please add.

Thank you.
This is how kartlytics.com works for Mario Kart 64.

More info: http://www.joyent.com/blog/introducing-kartlytics-mario-kart...
Quite the opposite is happening in the long term throughout the Arab World and neighboring regions. As we speak, Iran (speaks Farsi) is presently at fertility rates below the rate of replenishment.

http://www.washingtonpost.com/opinions/david-ignatius-a-demo...

See figure 6 here:

http://www.aei.org/files/2012/03/21/-fertility-decline-in-th...
Nice redesign, as a designer, developer and user: I like

I don't like the way that video search is actually Youtube search (to use 'video' is misleading, sad face). And I imagine when it comes to images is the same.

DuckDuckGo, if you would please add other media sources... Google used to do this, now it's all about keeping the user inside Google’s ecosystem.
This bug has nothing to do with timeline freshness: the bug affected developers and not users. If you're having issues with the timeline, please report an issue here: https://www.facebook.com/help/181495968648557
Thanks for the feedback. To be honest, I've put far more work into the app than I have the website.

But to answer your question, it's stable and fully functioning, although there are plenty of features I have planned for future versions.

Basically, I wanted a shuffler app that was minimalistic and dead simple to use, yet something like a Swiss Army Knife for setting up and running a game. For example, Throne Room will generate a Black Market deck for you if needed, and "draw" three random cards for purchase when needed.

I couldn't find anything like this on the App Store, so decided to make one myself.
It's something to help you decide what cards your game will be including.
Cable companies are not utility monopolies. The granting of exclusive franchises has been illegal since 1992. Do they have lawyers and lobbyists? Sure. So do Google and Netflix and Facebook and Yahoo.

Companies don't give you what you want because: 1) its expensive; 2) they can make higher returns with that money elsewhere. You can blame lawyers and lobbyists all you want, but the bare fact is that what Facebook paid for WhatsApp would pay for all the lobbying capacity of the top 10 DC lobbying firms for 60 years. That's a really weak argument to lean on when the interested tech players have so much money and lobbying is so cheap.

Just look at what Google is doing with Google Fiber. They're demanding massive regulatory concessions, and still don't seem to be positioning it as a money-making business. If building fiber was a good use of capital, why would internet companies sit on the sidelines and demand someone else do it?
Here in Australia, 2+1 roads aren't very long - they're usually just long enough for a few cars to overtake a slowpoke, then a few kilometers further on you'll get another chance. You can't really cruise double-abreast on these roads, as they're not long enough for that.

Similarly you can't really bottleneck because the only input is a single-lane road - they're not long enough to add anything more than trivial traffic in rural areas.
Tech Can Do Better
I don't know about using it to actually write code, but as a work of art, it's beautiful. Arabic script looks artful to me (maybe because it's unintelligible to me, like Elvish?). So I must applaud this.

As for actually coding in this, I don't know. I'm a native Spanish speaker, and I avoid Spanish-translated programming languages like the plague. Memories of awful Spanish versions of Basic still give me nightmares. The lingua franca of programming is English anyway.
His good sense is obvious by the way he stopped going down the JIT route and zeroed in on the bigger performance drain, memory allocation, instead. The smart programmer knows how to write a JIT; the wise programmer knows how to not write a JIT.
People in the rest of the world don't get this, I think. They believe life has to be full of fear and desperation. It doesn't. I'm temporarily living in Berlin and it's a bit sad to watch all the homeless beggars around here.
This sounds very similar in concept to Cap'n Proto, and given how much hard-earned experience Kenton has and how much time he's put into it, I'd put my bets on Cap'n Proto if you're looking for something in this design space.

I haven't looked at SBE in detail, but given the high-level description I expect it would have a similar set of trade-offs vs. Protocol Buffers as Cap'n Proto does: it will have unparalleled serialize/deserialize performance (since they are basically no-ops), but sparse messages (where only a few of many defined fields are set) will be arbitrarily larger than protobufs, so a separate compression step will be necessary to be size-competitive, at which point some of the speed advantage is lost.
Rescale (YC W12) is looking for a platform software engineer
Rescale is building a simulation platform for engineers (of the non-software variety) to help them design better products faster. Simulation is a $40b market and used across a wide range of industries including aerospace, oil & gas exploration, and life sciences. Our platform has been used by both large established Fortune 500 enterprises to optimize existing products and new private spaceflight companies to develop rockets so you have an opportunity to revolutionize computing processes and tools used by the world's leading scientists and engineers.

We are well funded company by top tier investors (including Jeff Bezos, Paul Graham, and Peter Thiel) and offer a competitive salary with matching stock options. We are located in the SOMA district of San Francisco close to BART and Muni.

As a platform software engineer, you will be building a distributed workflow engine and cluster management system that will run compute-intensive simulations across multiple cloud providers.

We are looking for a few well rounded generalists to join our team. We prefer that you have:

* Experience writing software in Java and/or Python.

* Ability to context switch between tasks ranging from query optimization to devops at a moments notice.

* Ability to take complete ownership of projects, from conception and architecture right down to implementation.

* Education: B.S. in Computer Science or a related field, however relevant experience and proven ability trumps diplomas and certificates for us.

Some nice to haves:

* Experience with AWS stack, especially EC2, S3, SQS.

* Experience with other cloud technologies such as Openstack, Azure.

* Experience writing RESTful APIs and Django apps.

* Release engineering experience using Salt and/or ansible.

* Expertise or strong interest in the following areas: high-performance computing, code optimization, concurrent programming, security, encryption, certificates.

Interested? Contact us at dev-jobs@rescale.com
Basically, you can use this app to specify which cards you have (or don't want to use), specify special conditions (like no attack cards, for example), and this app will randomly generate a set of 10 Kingdom Cards for you to play.
It'd be good to even just put a line on the homepage that says what a shuffler app actually is/does. I've played dominion but wasn't really sure what the point of this was. (as covered by other comments in this thread)
I don't think ARM really has any inherent "power advantage" over x86; this paper might be interesting to read:

http://research.cs.wisc.edu/vertical/papers/2013/hpca13-isa-...

Yes, ARM architecture is simpler so AMD might stand a better chance, but I'm not so sure how they'll manage to make ARM cores reach x86-level performance and per-cycle efficiency. Currently in cross-architecture benchmarks like SPEC (which doesn't seem to have any ARMs in it at the moment -- hopefully this will change), x86 is at the top for per-thread, per-clock performance and at least a factor of 2-3 away from the next-best - which was POWER7, if I remember correctly.

And given that x86 has tons of intra-instruction optimisation opportunities that Intel are taking advantage of because it's such a rich CISC, and ARM doesn't ("enhanced REP MOVSB" is the first example that comes to mind)... personally, I'm not too optimistic. Either way it will be really interesting to see what happens, particularly the benchmarks.
Not sure why you were downvoted.

Industry routinely degrades skill and experience in favor of "just ship." New frameworks are continually churned out with the implicit promise that they'll fix everything (except their own lack of composition). Custom development is viewed as expensive when someone else can come along and paste several libs together, then apply duct tape to hold it all together. Domain modeling is viewed as esoteric. Testing is still hotly debated.

...I don't want to go on.
Occam's razor would suggest DPR lied and that he ran the operation from the start.
Few things.
I like the redesign in a broad, sweeping sense but:
1) Themes don't work (at least, they don't look good. I know this is pre-release and will be fixed)
2) Fixed header is too large and should be smaller by default (as well as toggle-able in settings)
3) The color change and underline for links are jarring on mouse-over.

Keep up the great work!
The only thing that really makes me jealous of OSX is BibDesk. I have never understood why nothing like Bibdesk has been written for *nix/Windows environments. Yes I know about jabref/mendeley/pybliographer/zotero, I do not think they come close to Bibdesk's citation AND pdf management.
My Biggest Problem with Siri on iOS 7
Does anyone know what font he uses in his terminal here: http://content.animalnewyork.com/wp-content/uploads/git.png
as a wheelchair user:

looks heavy, and spoke wheels provide suspension.

also there are tons of wheels built from a similar premise in the past ; they've all failed as long-lasting products.
Agreed. One thing to consider is how the features and performance of a language shape the tools. The tools can be great, but to some degree you're riding a long distance skateboard with a generator on the back...

Edit: This comment comes off as me making fun of PHP, when I simply meant to say that tools can make something effective but what underlies an effective work environment can still be crap. I don't think PHP is "crap," but at a certain level of complexity its easier to get the "average developer" to be effective using another set of tools.
Eurovision Song Contest predictions from a statistical model
I've tried Umano but couldn't stand their reader. I listen to swell radio all the time and would love a similar service with more content.
Honestly, I've had one connection or the other completely fail, and (aside from the weird issues above) I sometimes haven't noticed for a few days, despite heavy Netflix streaming on 2 devices. Whatever is going on in my local market, to me it seems to be functioning well.
Someone could put 20btc on a machine that only exposes ssh and see if they can get in. Then they'd earn it. :P
Thanks. I knew openssh had a pretty complex system for this, this is a good summary.
After Dark was cool, but my heart will always belong to Underware: http://macintoshgarden.org/apps/underware
I'm in Mountain View, so yeah, i'm in the thick of it.
We support Stripe and charge some on top of it for convenience.

It's like a delivery service that dusts the furniture after it's being delivered but doubles your delivery charges.
If it was Microsoft, it'd have to go through multiple rebrands before landing on something like Oculus 3.
Yeah, WordPress can get slow pretty quick, but a naked install should be pretty snappy. The codebase itself is pretty small (~50kLOC) but the DB queries can get ugly depending on the plugins installed. Naked WP on GoDaddy or similary crap shared hosting site can be slow, but certainly not on a VPS.
It's "standardized" as in everyone gets the same test in a given year. Absolute results on something like a college admissions exam are pretty meaningless since getting into college is a zero-sum game for all but the worst schools. All that matters is doing better than X% of the population.

Seems to me like incentivizing deep learning over memorization outweighs losing the ability to compare absolute results from one year to the next.
The original L3 article actually touches on this, sort of, by mentioning markets where ISP port congestion is not an issue (i.e. the UK) due to competition between ISPs.

Comcast will get paid by their customers as long as the routes they pass traffic through are 'good enough'. They have a (near) monopoly on the last mile in many markets, so 'good enough' can mean both 'barely working' and 'better than any other option you've got' at the same time.

So, you're right, but so is the parent: Comcast has no financial incentive to provide any more than just enough bandwidth to keep you from calling the support line to complain or cancelling your contract in frustration.

Where's the rest of customer revenue going, if not towards network upgrades? Well, let's just say the Comcast Center (http://archrecord.construction.com/projects/bts/archives/off...) ain't paying for itself...
I'm actually in US, but in my experience Apple devices are a minority. I agree it can depend on population and area you are in. I wouldn't expect it to hold steady. Apple aren't interested much in innovating in the OS itself. Neither is Google for that matter - Android is pretty stale too. It means that next coming innovative contender can disrupt the market.

Not sure whether EU dictates such thing as common ports, but I wouldn't be surprised if they do.
I know it's in progress. I'm anxiously waiting. If you tell me where I can send $ or BTC to help it go faster, I'll gladly oblige.
I've been talking to friends, and one friend who had a startup said they went for the big guns (Wilson Sonsini, Orrick, Fenwick & West, etc) since they thought it would look better to VCs when they went to get their Series A. That's a criteria I hadn't thought of. What do you think of it?
Building a client side application that has hundreds of components and be able to function in a stand-alone mode robustly, potentially over multiple user sessions, until a network connection becomes available, having access to a robust implementation of proven, testable software development patterns:

- Objective C
- Java + Android
- Monad and #C

Why are we killing ourselves with browsers? I mean, to a degree I get the cross platform deal... but unless you are building for exactly that environment (ie NOT A WEB APPLICATION) then it doesn't make sense to me... at all. There are better tools.
Triple-entry is the technical term for this type of book keeping.
I am looking to apply to the New York instance, as it is close to where I am located, however I am not exactly sure what someone would get out of going. From the outset it seems as though it would be very valuable to go, but I can't really tell what the tangible benefits are from going.

It is clear that I would be able to see world class speakers - but I can also do that online as I did last year when I watched a large portion of the talks posted. So is it also a networking event (obviously all these are that to some degree)?

I guess I am just trying to figure out if it is worth taking a day away from my startup, and spend money to get up to NYC to go (assuming I even got in). Can anyone with experience having gone to one of these give some insight? Thanks.
Intersil still makes an 8088, and it's quite expensive too: http://www.intersil.com/content/intersil/en/products/space-a...

As the URL suggests, there are applications where an existing, well-characterised CPU is highly preferred over a relatively new one where some previously unknown errata could have catastrophic results.
mavhc's joke[1] is apparently a little too close to reality.

[1] http://princessbride.wikia.com/wiki/Dread_Pirate_Roberts
You're not alone:

https://github.com/kemayo/sublime-text-git/issues/204#issuec...
Targeted for what and by whom?
Nice site. Is this for sale? There is no apparent revenue model - are there plans to monetize it?
San Francisco CA, Local, Part Time | Summer Internship

Stack: Ruby on Rails

Resume: https://db.tt/Yda2zfca

Contact: m.rampton at gmail

I'm a developer turned student looking to spend the summer learning and coding; I would prefer to do this with a company (i.e. a group of peers which hopefully includes a mentor or two) but will do it on my own otherwise. In August I'm moving to NYC to attend Columbia where I'll be completing my final two years as an undergraduate in CS. I should be candid that I'm a bit out of practice on the coding front at the moment (too many science/math pre-reqs, too few programming). With that in mind I'm looking for a junior position which would hopefully provide a well defined runway for accelerating and getting back up to speed. While I've done full-stack in the past, I'm generally more comfortable on the backend; but won't turn down the opportunity to practice or work on either or both.
Drupal is pretty slow if you disable the default caching, and sometimes even with the caching (depends on modules loaded) - part of the problem is Drupal's table bloat. I swear a naked install has 100+ tables (and with a few plugins and a few fields enabled, has 250+ tables - so you end up with tens and hundreds of queries per page load).
Yes, the first transaction of a block is allowed to "overspend" by up to the subsidy amount, currently 25btc. Obviously the miners pay these newly minted coins to themselves.
Just to nitpick about your Instagram integration comment - Instagram broke the integration, not Twitter. See: http://status.twitter.com/post/37258637900/instagram-photo-r...
As the dailyshow asked a while ago. Are Jews really white?

The answer in America is that they are white+, the answer in Europe is one of guilt and resentment. The idea that you should check the same privileges the world over is incredibly Americo-centric and racist.

Should a Basque check their privillage for being white while having been under constant genocidal pressure for close to 300 years? Should a Turk in Crimea do that because their ancestors were murdered time and time again by the Orthodox, while one in Anatolia shouldn't even though their grandparents contributed in one of the first modern genocides against the Armenians?

Privilege has nothing to do with skin color and everything to do with economic and social status. The Blacks of the US aren't disadvantaged because they are black, it's because they are poor and serve as the default criminal class. A place that the Irish had a hundred years previously. To pretend that it does is a way for spoiled college kids to feel they are making a difference in the world without doing anything.
Is this the first magicpoint presentation from the OpenBSD developers that you have seen?
JavaScript is a horrible language. The fact that a lot of good software is written in JavaScript because there is no good alternative in the browser does not make it any less a horrible language.

The problem with PHP is that it is a horrible language and there are plenty of better options in its niche. Those two factors combine to make PHP a nonstarter for programmers who are familiar with the other options.

I dispute that there is any good software written in Perl.
No, it's very easy to convince yourself that these problems are solved when they in fact are not. I have not seen any proof-of-stake mechanism which does not either require centralization (despite claims to the contrary), or devolve into proof-of-work as miners grind blocks until they find one that names themselves or one of their sock puppets as the next signer.
Seeking Awesome Front End Dev 
Techstars Boston company in marketplace & materials sourcing - We are looking for a talented front end web developer who has experience taking great designs and integrating into Django based templates and Angular.js front end. The developer should have experience using Bootstrap, responsive web, jQuery and organizing CSS tags and styles. Understanding of how templates, DOM objects and assets work in web frameworks like Django or Ruby on Rails is required so that it can be tested with the web framework we are building. Angular.js experience is a strong plus. Please mail hello@sundar.io if you are interested in learning more.
Two Suns Could Boost Odds of Habitable 'Exomoons'