skysight-inc/HackerNews huggingface dataset:
Im making my own offline wiki (fun side project). EN wiki dump is ~10GB. 8-9GB if you preprocess XML dropping useless tags and wikimarkup

falink = {b'Link FA|', b'Link GA|', b'link FA|', b'link GA|', b'Link FL|', b'link FL|'}

different language links/references, every article has a list of all the language version links (ex: [[af:April]] [[als:April]] ..)

langcolon = {b'aa:', b'ab:', b'ace:', b'af:', b'ak:', b'aln:', b'als:', b'am:', ................-my:', b'zh-sg:', b'zh-tw:', b'zh-yue:', b'zu:'}

I have a feeling changing wikimarkup to something more size optimized would help even more. Swapping compression algorithm can squeeze additional 1-3GB of savings without sacrificing decompression speed.

All in all with a lot of tricks you can go from 10GB to 5GB. Doesnt feel worth it. Bigger problem is searching thru this data on a 2-4 core ~1GHz ARM processor with 1-2GB of available ram. Indexing titles is simple and fast, but quite useless. Indexing all useful words would eat at least couple of gigabytes. Searching for a simple combination of three words would take couple of seconds every time. Its not like you can haul Hadopi cluster in your pocket.
This is something that has always bothered me. I've worked in software for awhile now, but never in the financial sector, yet the vast majority of my clients and employers have had third party security audits run on their code and systems. I don't know why every exchange doesn't do this and talk about it publicly.
IBM Watson Software Engineer

Pittsburgh, PA

Lots of positions (Frontend, Backend, QA, Doc, Design)

Technologies used:

Search engine indexer/crawler written in C.

Cluster management, sharding, replication, tiering written in Java.

Connectors written in Java/Scala.

Frontend exploration and visualization written in JRuby on Rails.

Check out all the positions here:

https://ibm.biz/BdRbgs
Is it going to work outside United States?
That was an old trick used by Liberty Reserve scammers too who would social engineer you to activate the API then clean out your wallets.
>> I've been following the Crimea conflict very closely (which almost certainly is also what caused Pavel's departure)
Reference is needed.
Their official response did not give any reason for ignoring the reports, nor did it even acknowledge that this happened. Disappointing.
6AM? Barely anyone is awake.
Nutshell – Ann Arbor, MI – nutshell.com

Nutshell is a profitable company building some top-tier CRM software. We are a tight-knit team that is passionate about designing and building beautiful apps for our enthusiastic customers.

We're looking for sharp designers and engineers to help take the product to the next step. We've also had some outstanding paid internships — if you're a student looking to gain experience, produce meaningful code, and bring home a paycheck, get a hold of us!

For more info, see http://nutshell.com/jobs/ or feel free to reach out directly if you have any questions: mike [at] nutshell.com.

Thanks for reading!
The gag-order is impossible to disprove. If anything in the release is bullshit, it's that.

I would consider it screamingly obvious that Coinbase reports stuff to the IRS, because they want to run a business, not be crushed to death.
A $300 Dell Venue 8 Pro Intel Atom tablet is faster than a Macbook Pro of 4 years ago.

http://www.anandtech.com/show/7263/intel-teases-baytrail-per...
Check for heapanalytics.com ..awesome eventing framework
Facebook group to be used for linux kernel patch review
San Francisco - AirPR - FULL TIME, INTERN - Full Stack, FrontEnd, Infrastructure

AirPR is a technology platform to increase PR performance. As technological innovation continues to shake up everything in the "media realm", AirPR's disruptive products, including Marketplace and Analyst have garnered attention from FastCompany, Bloomberg, TechCrunch, Forbes, Mashable, and PRWeek as well as Fortune 500 brands and fast-growing startups.

AirPR Marketplace matches technology companies and innovative brands with the top PR independents and small firms in the country.

AirPR’s first-to-market measurement solution, Analyst, uses machine learning, statistical analysis and other algorithmic techniques for big data analysis to measure the ROI of PR in a unique and compelling way. The product analyzes digital media activities from traffic to conversion to projected and/or actual revenue in addition to a variety of factors about your brand.

We are looking to hire for the following positions:

BACKEND / FULL-STACK SOFTWARE ENGINEER - Implement core features of multiple data-intensive production applications across different software stacks

FRONTEND SOFTWARE ENGINEER - Lead the front end efforts of two production, data-rich web applications

INFRASTRUCTURE/OPS ENGINEER - Lead the maintenance of a cluster of crawler instances, elasticsearch instances, multiple mysql databases and other systems.

To apply, please send your resume to jobs@airpr.com or reach me directly at raj@airpr.com.

For more details, please visit our careers page: https://www.airpr.com/jobs
Ask HN: What are the best April Fools of 2014?
You’ll find that user enumeration is possible on Facebook, Google, Dropbox, and nearly every other major internet site.

And yet, most banks & payment processors do not do this, for good reason. Seems like Coinbase is suffering from some domain confusion.
I'm curious what you do with them. Sage Devices doesn't seem to have a lot of info available but Bolt says y'all are doing "Home Energy Management". What in home energy management requires ~3.4msps?
Thanks for coming here and addressing the community. It's a thankless job. But thank you for doing it.
My guess is they didn't test correctly. They likely set up their tests to check that the string being returned was the same as the string that was stored without realizing that the value served was supposed to be transformed.
From the Hacker News Guidelines[1]:

> Please don't submit comments complaining that a submission is inappropriate for the site. If you think something is spam or offtopic, flag it by going to its page and clicking on the "flag" link. (Not all users will see this; there is a karma threshold.) If you flag something, please don't also comment that you did.

[1]: http://ycombinator.com/newsguidelines.html
To follow up, I will say that my favorite way to create a password is to use sayings from two or more of your favorite books or other sources.

So, if you like Harry Potter and Enders Game, what are the phrases that come to mind?

Harry Potter - expelliarmus
Enders Game - win all the future fights

Now you have a great password: "winallthefuturefightsexpelliarmus" Nice and long (33 chars), with some made up stuff. Maybe tack some numbers on the end.
As proven time and time again, most popular does not mean "the best".(especially, considering how many people there are in the US compared to any EU nation. That'd certainly explain the "number of successful businesses".)

Do you think those people starting companies would do any worse, if we placed them in, say, Denmark?

EDIT:Or maybe Israel, which has the highest density of start ups worldwide? I'd be curious to see the per capita numbers of countries.
https://github.com/Semantics3/2048-as-a-service#zest-princip...

Which seems to suggest April 1 protocol.
Apple's April Fools: 10% increase in most Mac prices in Brazil
Annulment for non-consummation is initiated by a spouse, not by the state.

I've been married twice in CA and on neither occasion was I asked about my sex life or child-raising plans.
Pix.do is awesome!
This is actually documented in the API. Turns out the API just wants your program to be polite and say hi when calling it.

https://github.com/Semantics3/2048-as-a-service#zest-princip...
Niches. I'd pay a small monthly fee to have news relevant to my niche clipped, summarised and sent to me.
News are usually not as time sensitive as you think, and if they really are then all your colleagues around you will already be talking about it.

I would find it comforting to be able to finish reading the news every day, just like a news paper. I also like the way you can refer to stories if everyone read the same news, "did you read the top news", as opposed to hacker news where items on the front page can go up and down by the minute. The constant refreshing of news is such a time sink. Picking the right stories for a fixed list of stories of course requires good editorizing
It says it in the article. Navalny was making statements condemning the Crimea annexation and giving advice on how best to apply economic sanction to the Kremlin-elite surrounding Putin.

After the US followed his advice Navalny even tweeted that he was packing his bags for jail because "someone was going to have to pay for [those sanctions]".
How to Track Events Through Complex Stacks
Average US user spends 162 minutes a day on mobile, 86% in apps, 14% on web
This is interesting, but I'd love to see an analysis that proves some sort of treatment effect of colocation.

Zynga has acquired 20+ companies on crunchbase. Is Zynga biased towards acquiring companies in the bay area, or are companies that Zynga would be inclined to acquire mostly located in the bay area anyway? Or is it that bay area startups tend to perform better / receive more funding than their non-bay counterparts?
Total returns is calculated at the point of sale. How do you argue this and not cherry pick? For instance, as mentioned this stock is very low risk so if you look at the drop during the crashes, you'll notice that it doesn't fall nearly as hard as other riskier stocks (risk vs reward). For a rock solid stock (low risk large cap) that offers great dividends, it's really hard to beat MSFT.
It's not. It's been a long coming process.
Usually come to HN to check out the good April Fools but some April Scroges took them all out.
Email sucked for a decade because spam got out of control. I ran a hand-built email server in my home for years, and know this problem decently well. However, with the ability to train their filters based on SO MANY people, Google fixed it. (Other systems vastly improved as well.) With the signal-to-noise ratio being largely a solved problem these days, it makes email a viable "platform" again.
What niche, if you don't mind sharing?
Computers are getting cheaper, but the high end isn't improving much over time.
Further, the security audit began this week before this issue. It was proactive, not responsive.
Applied projects and practicals are more along the 'working with lathes' line, forcing you to practice what you've learned.

"Critical Thinking" (and its development) is perhaps more nebulous, but I imagine that it comes with extensive work on proofs and problem-solving in more abstract situations.
Many people automatically assume that this word means something bad. Something about "cetic" makes them think "septic" or "toxic" even. I've had to explain the word a few times to co-workers. I picked it up from a crappy song, come on guys!
Actually it was originally a serious concern with the Facebook where CIA originally invested through one of its tech funds. KGB is not that smart :)
To author, the constructor is not a function it's a method.

I agree with useless comments but don't agree with blank 'constructor' method doc blocks that just say constructor as a filler.

Since most of the methods will have params/returns and better description than a simple constructor, leaving constructor without any doc-block is kind of counter productive and silly.
Popcorn Time, Piracy and the New York Times
One thing that is really hurting tech (as we see, in the distribution of capital and acquisitions) is placism. It's not good for the advantaged places (San Francisco and possibly New York) nor for the 99% of the country that's losing out.

VCs (the only investors in this game, sadly, because bank loans require personal liability, precluding anything that has any real risk) assume that if you're not in the Bay Area, you're not serious because "all the talent" wants to be there. It causes a vicious cycle. You hear a lot of murmuring about second- or third-tier hubs picking up when, in reality, things are probably the most skewed they've ever been.

It's not healthy for all the innovation to be allowed only in one area. The real investors (the people with the money) don't care where their money is spend as long as it makes a profit. But we have a system that forces people to compete for scarce space in what has become a congested and hideously overpriced part of the country... even though rent and living costs exert a gigantic drag on new business formation.

The only people who win under placism are VCs, big-city landlords, and HR departments (because they can look at a resume and evaluate it based on geography).
enet is a networking library which uses UDP but generate redundancy and other things so it has the advantages of udp with some advantages of TCP.
Interested in projects involving:

C++, C, Prolog, Erlang, Haskell

Games, AI; Systems programming; Complex desktop or server systems; wxWidgets, Qt; Mobile apps; Logic and functional programming; Compilers/Interpreters/semantics
I used that to compare because a lot of others email out at that time: Digg, WSJ, Quartz, etc.
Drop the /2048 from the end of the url and replace it with /hi/start/json
It really does appear to respond as advertised!

Is this the most elaborate April fool of the day?
The design and illustrations are amazing. Unfortunately this kind of effect gives me immediate and lasting vertigo (lasts a couple of minutes past viewing the site) when used to this degree. I'm not sure if I have an extra sensitivity to the effect.
From what I gather, first name and last name.

Stopping email address validation is, I think, impossible for a company like Coinbase, but revealing the name doesn't have to happen.

On the other hand, providing the first and last name could be very valuable to the users, though. If I send coins to bob@example.com, I'd like to see the real name behind that address.

On the other other hand, if anyone can make any first and last name they wish, then the safety of that goes away. Maybe I make b0b@example.com with the same real name.

EDIT The users agreed to have their names given to people they transact with. Does that include strangers attempting to transact with them? I'm thinking "no" but can see the other side.
News about Pavel's departure appeared long before the conflict you're talking about. So these two events are not connected.
I wouldn't say the fact is unpopular. What's unpopular -- or using two better words, wrong and stupid -- is the fallacy that because something was originally created for a certain purpose, it must be used for that purpose and only that purpose for the rest of eternity.
> Do you think those people starting companies would do any worse, if we placed them in, say, Denmark?

Yes. Facebook, Apple, Google, Tesla, etc. would never have happened in Denmark. I'm really glad my parents did the annoying work of immigrating to the SF Bay Area from Germany when I was a kid. Otherwise I would have wasted years of my life doing it myself.

Did you watch the Elon Musk interview posted here the other day? He said more-or-less the same thing: it was really obvious, growing up in South Africa, that California was the place to be to make things happen.

Edit: I don't know much about Israel. They seem to be doing a pretty good job, based on what little I do know. It doesn't sound like they're at SF Bay Area levels yet, but making progress: http://aleph.vc/the-israel-venture-capital-index/
Seriously, this. They are being nonchalant about this whole thing, but it may be damaging their most valuable asset - the community's trust in them. Just don't ignore repeated attempts to contact your whitehat address.
The buyer can't stop the payment as the wire is already complete and money in escrow.com's account. Escrow.com had to stop the payment and in this case they did so because there was a request from law enforcement.
I'd imagine it's one of those not-really-needed-until-it-is feature. And now, due to all this crying, they'll implement such a "I don't know this person" option.
Pretty cool! But the performance is too sluggish for there to be any 3d illusion on my 2013 nexus 7.

With a more subtle effect and better response time it could work.
TourBuzz (http://www.tourbuzz.net) - Atlanta, GA - Full-Time - Local

We've looking for a Full-Stack Developer to focus on metrics/data -- we have a lot of great data that we aren't acting on. You will focus on collection and presentation of data to our operations team, developers, business team, and even customers to provide actionable insights for improving the product. A full-stack developer with a business and data background would be ideal.

Our 11-person team has carved out a profitable niche in the real estate photography industry over the past 7 years. We are growing fast, have no debt and no outside investors. Our product roadmap is full of challenging and fun problems as we expand our product to other commercial photography niches.

We're a great fit for those that prefer an atmosphere where you're given the time and autonomy to digest a problem, collaborate productively w/the business and technical team, and expected build a robust and maintainable solution. Day to day you'll be using PHP, AngularJS, compass, ruby, coffeescript, chef, and postgres in an environment where we expect you to develop your skills and learn new tools to increase your productivity.

We have competitive salary/benefits with a flexible and relaxed working environment (few meetings or deadlines) located in Virginia Highland.

Reach me at alan@tourbuzz.net.
Waiting for BQP Fever
I haven't personally seen the system, or tested it, but I'm pretty sure if I tried to enumerate all Bank Of America account numbers I'd get shut down pretty quick.
replace "Russia" with "US" and "petro-chemical" with "military-industrial complex" or "financial" and your whole comment still makes sense as well
I've been using email as an application platform for years, and I agree with everything this author is saying.

I wish, however, that he hadn't written this article for two reasons.
1) Email suffers from the tragedy of the commons. The more email that is sent the less valuable each email app is.
2) Current email tools are woefully inadequate to deal with the existing volume of email users receive. Worst is the fact that email forces users into a LIFO queue and doesn't allow for import-based ordering. We need innovation in email processing more than we need more email based applications. (Even SMS has a better model for organizing data than modern email: one thread per counter party group.)
I work for AgileBits. As the document you linked to explains, this is an accident of history that we would love to undo. It is hard to provide the user flexibility that people want in selecting their data location.

We don't want to train people to ignore things like the Dropbox notification nor do we like violating the principle of least authority. But until we find a way out of this mess without seriously disrupting things for a very large number of users, we are stuck with it.

We don't usually reveal company internal processes, but I am personally to blame for this situation. When we first started explicit Dropbox integration, we discussed whether we should force a specific Dropbox location for all 1Password data. We had a number of power users who had some unusual set-ups and wanted to organize their Dropbox data as they wished. I pushed for supporting those power users. In retrospect that was a bad idea, but this was before the days of any real Dropbox sandboxing.
Even though the device can detect (supposedly) when a male is nearing ejaculation. The question is... can it stop the eventual release (if you know what I mean)? It takes discipline for a guy to stop the release. Real discipline.
But, a) is a buffer issue too. Of course no buffer is big enough if the stream is continuous. But the backoff works exactly because it doesn't overwhelm the router buffer, leaving it time between bursts to empty into the slower network.

When TCP 'backs off' that's failure to a streaming protocol - now we get to spend seconds retransmitting and performing 'slow start' probing to determine an ideal rate. Which blows the latency of time-critical packets to the point its useless (as covered elsewhere in this thread).

And this is almost always the upstream link - your local home or business network is probably gigabit. Your ISP link is very likely slower than that.
This kinda puts Telegraph project in a different light, doesn't it?
You say the article is bad advice and then proceed to give extremely nitpicky but ultimately similar advice: UDP is _this_ kind of optimization(latency) and not _that_ kind of optimization(throughput). Which is really attempting to strawman the article based on some notes tucked into its closing paragraphs, when the central point is passages like:

> In testing, on your LAN, on lo0, when there's not a lot going on in the game, delivery is totally reliable, so the code path for recovering from missed datagrams is never covered, the usability where users are dealing with lost traffic is never stressed.

That is some damn sound engineering advice right there: build when you have the test case. Don't whip yourself into a frenzy over it prematurely.
News about Pavel's departure started appearing ever since the hostile takeover well over a year ago. His actual departure was today which makes it very much possible, if not likely, that it was connected to recent events which undoubtedly resulted in additional pressure against his ideologies.
Heh, these April Fools jokes get more and more believable.
Yes they would. The real problem is your home router/gateway/modem will not - and you're normally behind a NAT, which in all likelyhood does not know anything about SCTP (SCTP also isn't very NAT friendly).
With that kind of attitude the internet would not exist.
http://blog.shubh.am/full-disclosure-coinbase-security/

According to the original researcher, he mailed them and got no response, and got no response at all from several other attempts at contact,.

I wouldn't be surprised one bit to find that the inbox for that address is full of spam and crackpots, but, like 'tptacek said, if you're going to have the list you had better dedicate resources to reading it.
Kissmetrics doesn't offer a free tier (they have a 14 day free trial but after that all customers have to commit to an annual contract). Mixpanel does have a free tier.

Full disclosure – I'm a founder at Heap, which is a competitor to both of these products. We do offer a free tier as well.
Do you setup a timed sleep to make sure that you return results in exactly the same time regardless of path taken?
I don't see how you refuted my point. Have you tried anywhere else? Did Musk?
Lingvist Raises €1 Million To Reduce The Time It Takes To Learn A New Language
Google Accepting Applications For Software Dogengineers
Study findings suggest that happy people write better code
The part about branding everybody on the wrong side of your argument as some pigeonhole category.
Also, you'll get no bulk pricing discount from Apple.
The difficulty of learning mobile, fragmented tutorials, and what's working
If you've ever played a German-style game like Puerto Rico or Catan, you're familiar with the concept of needing a set of resources, all at once, to advance.

The Bay Area has capital, talent, customers, users and (most of all) clueless corporate executives who will acquire anything, rescuing the careers of even the most brazenly failed founders. You're not taking much of a risk because everything is there.

Other regions have some or most of those resources, but the VC is skewed heavily in favor of the Bay Area and that shows no signs of abating. NYC venture capital exists, but there's even more pedigree-whoring in that scene (mostly favoring MBAs and banking flame-outs) than in SV.

I don't like that it's that way, but it is. If you want to do a startup, you're best off to be there.
See @jimjag's twitter feed (https://twitter.com/jimjag) for more discussion