skysight-inc/HackerNews huggingface dataset:
This is a hell of an idea. Haha, Damn you this has triggered my entrepreneurial ADD, it makes me want to build something around it! Venmo should not ignore this. They could really build upon this, and get some vendor lock-in if it gains popularity among their already loyal users.
Not saying I make of habit of this, but sometimes you have to pass sensitive things as arguments (passwords, api tokens, customer data, etc), it happens.

I think client side encryption by Bashhub would alleviate this security concern.
What's hard, however, is telling multi-byte CJK encodings apart, and telling them apart from UTF-8.

I've tried it, as I was working on extending my mojibake-fixing library [1] to the language that gave us the word "mojibake". The ambiguous cases actually happen.

[1] http://github.com/LuminosoInsight/python-ftfy

Suppose you found this string (which someone actually tweeted) encoded in Shift-JIS:

(|| * m *)ｳ､ｳｯﾌﾟ･･

Those half-width katakana with a comma in the middle look a lot like typical Japanese mojibake, so the classifier would be entirely justified in deciding that Shift-JIS is wrong. Next let's try decoding those bytes as EUC-JP instead:

(|| * m *)海劾餅ゥ

Hey, maybe that's a name or something! No other encoding works, so the classifier happily decides it's EUC-JP. Except this string is complete nonsense and the person actually meant the first string.

I do agree with you that it's a problem worth trying to solve (clearly). We can't just throw up our hands and say "this is a problem that shouldn't happen, so let's not solve it". Microsoft Office exists, and its mojibake-causing "features" will never be removed due to backward compatibility, so this happens and will continue to happen.

But, any ideas where the corpus for telling apart encodings should actually come from? I've been using Twitter, but this limits the domain. Only thoroughly defective Twitter clients send anything but UTF-8 to Twitter. There are lots of defective Twitter clients, it turns out, but the creative mistakes that Excel users make every day are one in a billion on Twitter. I can apply artificial mojibake, but then I'm not correlating the text with the encoding it's likely to be in.
Isn't science and things like the invention of the scientific method and Arab numerals deeply rooted in the history of Islam?
> Although I believe all channels are high-power channels now...

If they are, my Linux systems aren't yet aware of the change.

They make the claim that the only ranges with a 30dBm transmit power are 2402 - 2472MHz and 5735 - 5835MHz. All other WiFi bands are 23dBm. (Though it does seem like the transmit power in the 5.49 - 5.73 GHz range got increased from 17 to 23dBm somewhat recently.)

> I have yet to see any scientific paper that says 5GHz penetrates structural elements worse than 2.4GHz.

I can't point you to any studies, but -anecdotally- I've found that (at the same transmit power, and all other things being equal) a 5GHz link provides a lower SNR than a 2.4GHz link. Before I switched to an AP with better antenna and radio, I found that I would not-infrequently permanently lose the 5GHz connection in my bathroom [0][1], but the 2.4GHz connection could be reliably established in the bathroom and remained solid.

Even after I've switched APs, I get a substantially better signal [2] from the 2.4GHz connection than the 5GHz one.

[0] My bathroom is tile covered, filled with pipes, and the furthest point in the apartment from my AP.

[1] "Permanently" as in "once I left the bathroom I could reestablish the 5GHz connection".

[2] Obviously, a better signal doesn't guarantee a faster connection. At my site, 2.4GHz is so overcrowded as to be nearly useless.
I've been preaching this for years! Global warming makes as much sense as eternal damnation to non-believers. It redirects the environmental conversation away from tangible short term problems such as pollution to abstract long term problems like global warming. People can relate to problems affecting people (pollution and health, over-logging and soil erosion, over-fishing and lost jobs, oil and energy dependence, etc). Global warming is a lot harder to relate to. It's so abstract that it's easy for opponents to dismiss and spread FUD.

The shift in conversation towards Climate Change really hurt the environmental movement, IMO.
Really interesting overview.

If current systems are designed for parameters such as "...a human driver won’t be able to turn the wheel by 5° in 10 milliseconds...", then it's likely systems designed in the future for self driving cars will stop treating vehicles as black boxes and optimize the car's internals too.
This seems kind of like a joke, but I also want to point out that such a conclusion isn't supported by the data.

Just because certain categories are more likely to support Trump doesn't mean they overlap with other categories.

And then you have the massive problem with the fact that this is Facebook data. My guess (partially based on their advanced age) is that Trump supporters are less likely to use Facebook or have Internet access.
I wonder whether coal plants could be quickly converted to oil plants. Oil is cheap right now, and probably less bad wrt to particle pollution.
An open-source Mailbox clone could be popular, and a way for mobile (iOS/Android/etc.) developers to show their chops.

The self-starter types of people tend to route around obstructions and unpopular decisions by doing it themselves, better.
The ACME Protocol – Rioki's Corner
> This problem is worth thinking about (which is why a customer asked a team of CS researchers and linguists to think about it, including one barely competent programmer who nonetheless had reasonably good intuitions for what character distributions looked like), but it turns out to be much, much less hard than many people originally expected.

There are a couple related ideas that might make this more obvious in hindsight:

- You can determine the language of a substitution-ciphered text just from its frequency distribution.

- Imagine getting a page each of text in several different languages, say english, french, portuguese, polish, and turkish. "Normalize" everything to ascii characters, so laïcité turns into laicite. It will be trivially easy, by looking at any page in isolation, to determine which language is represented there.
That doesn't have to mean typing it at your command line. My approach is typically to set shell variables with read (if I need to type it) or xclip (if I need to paste).

Of course, client side encryption would be great in any case.
Dstat: Versatile resource statistics tool
Worth reading to the end. So much tragedy is elided.
I'm studying abroad in Beijing right now, and my throat began to hurt even at lower levels of PM2.5 simply because I wasn't wearing a mask. I'm very surprised at the number of people who don't wear a mask; they either don't value their health or don't know how bad the air is because they've been accustomed to it.
I totally agree with you. "Meet and greet" has worked for me so far. I'm tired of reading "send your updated cv/resume" line on every job description. While lot of things are changing in hiring process, this is the area where I see very few companies being innovative.

A person is more than his/her resume and I wish companies could realize this.
No, what blows my fucking mind is that the environmental conversation switched from concrete short term problems (pollution) to abstract long term problems (global warming). One is really easy for laymen to reason, the other is nearly impossible. It makes as much sense as the Bible to atheists. It's not about evidence. Modern environmentalists put down the gun and brought a hot dog to the gun fight.

You have hard evidence in the form of visible undeniable toxic pollution occurring in China due to rampant and unchecked fossil fuel usage. This is not data extrapolated decades out—it's happening right now! Instead of using this as evidence to justify current "stringent" environmental regulations in the West and why we should continue them, you have people still talking about melting glaciers and rising ocean temperatures.

Shifting the conversation back to pollution and renewable energy achieves the same result: stopping catastrophic climate change. And it'll get us there faster than the current Bible-thumping message.
I'd really love it if you repeated the same tests for Bing, just to get coverage. (Yahoo/Baidu would be the other big two.) Historically, Bing hasn't used fully functional headless browsers to crawl, which has limited its ability to index dynamic content like this.

Google has "only" 70% market share, so it seems irresponsible to make engineering decisions without testing the others. Google+Bing+Yahoo+Baidu get you to 98%.
C++ Static Analysis Using Clang
Saw Donald. Thought, Not again!! Trump at hacker news too!!
Well anecdotally, I've never had a single storage piece die on me. The only exceptions are two microSDs that got fried in my rpi. Apparently you shouldn't constantly read/write to them, and instead just put boot files on it and move everything else to usb.
Free WebinarLearn on Intercultural Communication While Outsourcing in India
But, any ideas where the corpus for telling apart encodings should actually come from?

If you want a lot of fairly natural Japanese, try Wikipedia. If you want something a bit more comprehensive and less restricted, the "Balanced Corpus of Contemporary Written Japanese" is a thing that exists, but you might have to jump through a few hoops.

That project is awesome, by the way.
It is unclear from description (and I am too lazy to read the code) how it works.

The first question is whether such paper "bill" would guarantee payment. Could issuer refuse to pay it, when presented. In other words such paper bill is analogous to dollar bill or bank check? If this feature could not be implemented with Venmo API, perhaps one can build some kind of escrow service.

My second question is about privacy. Is identity of the original paper bill "issuer" is disclosed to recipient?
How many people do you really think can just casually write an OS? I can set up automated almost anything with almost no lines of code. We've lose the specialization because so many people now have access to these incredible things.
TLDR: the researchers you admire are part of a school that disagrees with Dr. Hsu's school.

Or at least, sort of disagree. It's not that they have any results showing a method for increasing either IQ or mathematical capacity. They just don't feel that it's entirely, completely, totally and utterly proven that such a method (which the entire education industry has spent the last century searching for) doesn't exist. Well, sure. Obviously, in an empirical science, negatives are pretty hard to prove.

But let that be. Suppose your guys are totally right. It used to be, in days gone by, when perhaps the spirit of science was better understood, that everyone interested in science understood that a hundred flowers bloomed, contending schools are a great and normal thing, and scholars can disagree -- without attacking each other personally as failed physicists, college administrators, etc.

Let alone elitists, racists, and Trotskyist wreckers. Speaking of the spirit of science, and schools thereof, I wonder what your position on Professors Boas, Gould and Mead might be? Do you regard them as conclusively guilty of scientific fraud? Or do you feel that in some way the jury remains out? What do you feel Professor Turkheimer's views on the question might be?
There are simpler and less intrusive ways to solve outside-AST issues (like an automatic reformatting pass before each build or each diff)

What you're suggesting raises a bunch of new (non-trivial) issues:

- What would you do with code comments? Things like "f(/+old_value+/new_value)".

- How to store code before preprocessing (C and C++) ?

- How to store files mixing several languages (PHP, HTML, Javascript) ?

- How do you store code for a DSL?
I think it's the texture. I have had turkish delight (didn't like it), but a long time ago, so my memory won't be perfect.

Gummy bears are chewy. Turkish delight is just soft.

I actually do like gumdrops, though. :/
A New Free CA – Schneier on Security
Agree. Word of mouth helps. My first job was through word of mouth.

I would like to describe this as a "social proof". You're recommended by genuine people for a particular job.
Probably also one of the reasons to start the Chrome project, though their headless variant isn't open source.

Are there other headless browser beside PhantomJS? PhantomJS is based on webkit (Safari).
Ah yes, David Brooks, who once complained about an extravagant around-the-world trip because he couldn't stop to stare at a painting for four hours like another famous person once did. He's the worst kind of middlebrow writer.
How to Create Custom Checkbox and Radio Button Using Pure CSS
Configuration management systems (chef, puppet, cfe2/3) is a superset of package management#, which is, in turn, depends on frozen static artifacts of each project's build system.

# This is because configuration management installs files, packages, templates files and runs commands pre/post, similar to how most package managers work, but at a fine-grain level of user customized as opposed to maintainer customized.

The meta is that one could consider a "system" or approach by where the project build and configuration management systems were seamless. One main challenge in doing so would be that the staticness of artifacts allows for reproducible compatibility, whereas end-to-end configurability can easily become Gentoo.
Ask HN: Planning to leave. How best to handle stock options?
(I'm sure this has been asked before, but I must be bad at search, because I couldn't find the advice I was looking for).

I'm planning to leave the company I joined about 7 years ago as one of the first dozen or so employees. I have some options that are worth $X,000,000 as of the last tender offer, and would cost $X0,000 to buy. Exercising them isn't a problem, but I doubt I could handle the taxes. The company itself was valued in the $500M-$1B range in the last funding round. I'd hate to leave the options behind, but even if I could afford them, that's a ton of money to put at risk.

Does anyone have any experience with ESOfund? I've also heard that there are other private groups who help fund employee option purchases and taxes, but I don't know much about them or even whether it'd work with my employer. Besides those, any other advice on what the best things to do are here?
Your username rules don't allow hyphens but you don't lint them out of Facebook names :(

Cool site, though!
Agreed! This is a really specific topic and the entry is mostly aimed at technical artists working in the game or VFX industry and / or people having an interest in colour science.
https://github.com/cydrobolt/paypyrus/blob/master/pp/models....

looks like it's web app that holds transactions and sends them to venmo when redeemed
I'm asking something simpler than that: why would the company pay a Silicon Valley salary at all?

Several people here are taking it as a given that a technology company has to hire some quota of people from the Valley.
Speaking as someone (an American) who has lived in Shanghai for several years, I find the authenticity of the concept "Chinese dessert cafe" pretty questionable.
Earth-Moon L4 and L5 is still very unstable due to the Sun (and other planets).

Earth-Sun L4 and L5 is more stable, but almost useless as a waypoint; however there are already naturally captured asteroids (and a lot of dust) already there.

All orbits require station keeping in a dynamic solar system that is circling around a black hole.
Memory loss: To improve your memory
It happened to me too. I think recent changes in HN allow a link that got no attention to be resubmitted. Then the timing does the rest :)
Certificate Expiry Monitor
Canadian kids too!
Very interesting! What kind of use cases are you envisioning that this opens up?

I'd love to see a screencast or some screenshots.
I thought it was quite fascinating, both the sci-fi and the storyline. Strong recommend
Parse object to cli arguments
Thanks! I saw your retweet about it. Let me warn you that I haven't solved the CJK encoding problem, so Japanese developers are only going to benefit if their mojibake involves UTF-8.

The corpus I'm looking for needs to be messy and informal, unlike Wikipedia, as the ambiguous cases tend to be crazy emoticons. I guess I can't hope for more than Twitter with artificially increased mojibake.
> Jordan has had almost 30 years to mature. Lebron is not even half that.

This is a reasonable thing to say, but celebrity branding doesn't necessarily get better with time, and I think is actually particularly unlikely to do so compared to other forms of branding.
If I see this correctly it's not adjusted for population density?
So I only see two major downsides:
1) I basically I have to verify/transact every "printed" money the moment I get it - preferably using a smartphone - in case someone else has a copy of it and "takes" it first. Copies could be made with any high-resolution camera.
2) If the money travels from A to B to C in paper shape and the digital transaction will be from A to C then A will know that B has done business with C.
Is the advanced age part true anymore? Anecdotally, my parents keep trying to get me to sign up for Facebook.
I have no idea if it works well, but the SVG spec has a .getTotalLength() method for path elements, which should mean it's possible to calculate the total length in a browser quite easily. A decent JavaScript developer should be able to prove whether it works well or not in an hour or two.
That's an amazing display of hypocrisy by government leaders who usually keep right control over PR.
I'd be unsurprised yet impressed to learn that the company that makes air purifiers for the ruling class, and then publicly advertises that, was a CIA operation to foment a rebellion against the tyrannical government.
Google may be indexing dynamic content now, but the question I'm curious about is how it affects crawl efficiency. I can't imagine indexing JS content is as efficient as indexing content returned from the original HTTP request.
Despite being ex-Muslim (and being an atheist) I don't have (or care) any viable information about history.Specially about Islam's history.
If China is anything like India, corrupt elite are interested in things like money and power rather than quality of life. long term health, etc. Most people want to live in an urban environment inspite of traffic problems. Its just the mindset. Pollution doesn't kill you overnight so they don;t really care.
An App that lets you Challenge your friends to do a simple Dare, in order to support and raise awareness for a good Charitable Cause.

Benefits of the App:
1. Opportunity to Donate & Raise Awareness for a good cause cause.
2. You and your friends will love doing it because its fun.
3. Get involved with a cause you care about, and do your part.

Please note that only the last Dare Card (Drink Beer to save water) works
For an introduction to the problem, and to anyone who hasn't lived in a severely air polluted city, I highly recommend the documentary Under the Dome, released earlier this year and later banned in China: https://www.youtube.com/watch?v=T6X2uwlQGQM
Seems like a strange claim, considering many sites that new internet users use will not let you sign up without an email account
Arab numerals originate from India.

https://en.wikipedia.org/wiki/History_of_the_Hindu%E2%80%93A...
>Paypyrus is versatile like cash

But with none of the security, what a useful idea...
Could I not just print the same dollar twenty times then it's a race to see who redeems it first? Cute idea though I guess.
I wasn't really serious but I guess it was too well hidden when I look at the votes ;)
Not bad. The ordering of 4xx status codes isn't that deterministic (often, it's situational), and last time I checked, Twitter uses 429 instead of 420 now (they like standards).
One of the most unusual and, frankly disturbing, accounts of the onset of an illness that I have ever read is by author Laura Hillenbrand about her falling ill with CFS/ME. Alas, it is now behind a paywall at New Yorker.

A Sudden Illness - http://www.newyorker.com/magazine/2003/07/07/a-sudden-illnes...
Deflation for particular products is different than deflation in general, which eg includes labour.
Cite? Cause Al-Hassan Ibn Al-Haytham (Arab muslim), Al-Biruni (Persian muslim) and Ibn Sina (Persian muslim) among others played a big role in the development of the scientific method.[0]

[0] https://en.wikipedia.org/wiki/History_of_scientific_method#E...
I've always been puzzled at the two acquisitions. I know it's easier to say this in hindsight but there are a few reflections many had upon hearing the initial acquisition of those tools:

* So you've acquired a Gmail client - why? Surely whatever good comes out of that Google would just re-create into Gmail. Sure enough: Inbox. I'm not even sure how this would have fitted into the Dropbox strategy? I doubt they would have wanted to be acquired by Gooogle. I doubt they would have wanted to compete in the email space... If it was just to get attachments from email surely there are many other ways to solve this problem.

* Second thought: Dropbox has acquired a photo sharing and organization app. Surely they don't think they will win over Facebook, iPhoto, Flickr... What for? Store the photos? Even if it's an awesome product, don't they just risk Apple Photos getting better? Or wait... Here comes Google Photos.

Inbox. Google Photos. iPhotos. Facebook Moments. It feels like both Mailbox and Carosel were just ticking timebombs.
You'd have to weigh the trolley in a vacuum, of course.
I didn't shower every day. Then I got overweight. Now I do.
I can't decide if the state of the state of China is a cautionary tale for USA, or proof that USA is doing somethig right.
I gather that the only currently feasible software tweak you could add to WiFi [0] would be to make it a substantially ruder radio neighbor by failing to wait to transmit until its transmission channel is clear.

In that world, noone wins.

[0] Other, cooler schemes require that WiFi radio manufacturers put more smarts into their radios. There are several 802.11 standards that would make WiFi devices more performant in the face of interference, -probably- remove the hassle of AP channel selection, and distribute relevant metadata about an AP to clients before they connect to aid the human in selection of the proper network and the machines in determining if the client possesses -say- credentials of some kind from a partner network that this WiFi network will honor. The benefit of adding stuff like this is pretty obvious to techies. However, because most computer users are largely non-technical, it's (apparently) impossible to make the business case to increase the unit cost of one's WiFi products by $20 or so to cover the R&D costs. :(
There is no longest string
It's pretty easy to get started but you'll keep discovering new things for a long time.

You can control the curve by choosing how much to self-discover/look up online. Many of the secrets will take a good while to discover by yourself.
Resistance to last-resort antibiotic has now spread across globe
Overriding DNS for fun and profit
I disagree. Switching the conversation back to pollution will have the same end result as focusing solely on climate change.

Yes, a focus on pollution will result in cleaner dirty energy, but cleaner dirty energy is better than dirty dirty energy. Clean dirty energy is probably more likely to have lower CO2 emissions.

Climate change deniers may try to deny pollution, but pollution is a lot harder to explain away. Pollution happens in your face today (see China), but climate change happens 100 years away in extrapolated data models. You can explain over fishing destroying jobs instead of ecosystems. Or explain over-logging creating soil erosion that destroys homes.

People understand problems that affect people today, not ecosystems tomorrow.