skysight-inc/HackerNews huggingface dataset:
> It's not compressing individual file and then combing the compressed files into a tar. Accessing the last file requires decompressing the whole archive.

Yes, that is the whole point of this discussion. This limitation causes problems for some.

> What you described is the zip format.

That is not the zip format. Zip is a collection of file objects with uncompressed headers which specify the metadata and size of the compressed individual file that follows. As such, you can easily scan through accessing the headers.

> Both zip and gz use the DEFLATE algorithm so there's no difference in compression. The difference is in how the files are packaged.

Create 1000 files with the content "foobarbaz". Create two archives, first by using zip and then by gzipping a tarball. They will not be comparable in size. A tar is basically concatenating the files together with headers between them. Compressing this allows the DEFLATE algorithm to work across a larger dataset, and thus more efficiently. The zip archive might actually be larger than the tar before compression.

The trade-off here is that you get better compression characteristics from compressing one large file, but you don't get easy access to individual portions of the compressed file easily.

> Also gzip supports on-the-fly stream-based compression and decompression so anything requires jumping to the end to do reading and writing while compression/decompresion is no go.

The stream format works in blocks of up to 65k. That's the reason I said to read the last 65k of the compressed file. That should be guaranteed to contain at least one full block, which if I understand correctly you should be able to uncompress by itself. If the end of the tar archive is an index, and the footer of the index specifies the size of the index, you know whether you got the whole index in that last gzip block, or whether you need to get one or more prior gzip blocks (you can probably make an educated guess based on the index size). Once you have the index, which specifies file names and by offsets of the compressed file of the block at which the file/header starts, you can fairly efficiently index into large compressed files (again, assuming 65k max gzip block size and the ability to treat blocks independently).

The benefit would be that since the index is just another file in the tar, you can uncompress the format from a plain tar command with no negative consequences besides an extra file being present (the index).
I agree with you that the two chemicals are indistinguishable; I just think that that's not really the issue when people prefer 'natural' products. Now, most people also don't get the distinction you're making, because they're not chemists. What they see, and what they're reacting to, goes more like this:

Joe Public> I have a headache.

Folk Medicine Dr> Here, drink some willowbark tea.

DrugCo Chemist> No, take this aspirin. It's chemically identical to the active substance in willowbark tea, but much more convenient!

Joe Public> My headache is better, but now my stomach hurts. That never happened with the tea.

DrugCo Chemist> Oh, you have an ulcer. You're a sick person. Take this antacid medicine!

Joe Public> My stomach feels better, but now I'm constipated.

DrugCo Chemist> Wow, you're really sick... here, take this laxative!

Folk Medicine Dr> All these unnatural drugs are killing you. You should really just take the tea.

Joe Public> Yeah, I think you're right. Natural is better.
It's a democratic republic.

Unions are not democracies either, yet are incredibly strong.
I'll admit, perhaps I am wrong in the greater picture of things here. But you are also wrong on some points. Particularly man pages being superior to info. troff/nroff markup is needlessly complex compared to Tex. You can also use your vi keys in info as well.. Perhaps you can just boil this down to being comfortable using man pages, but info pages provide more options and usability when it comes to created documentation, that's just a simple fact. If you have trouble quickly finding the information you need when using info, consider reading the info info page ;).

In fact TeX is used/preferred over nroff/others for a huge majority of physics/mathematics academic journals. And quite a bit outside of it. [0 - 3]

I will admit for stuff I already know and understand enough of to be considered proficient with it, man pages can be quicker. For something I just installed and still need to learn info pages provide a much better platform.

You may find the following link enjoyable to skim through.
http://unix.stackexchange.com/questions/77514/what-is-gnu-in...

> What you see on the screen (on UNIX, cannot vouch for Linux) when you type `man ls` is an actual professional typesetting system rendering the content for stdout instead of a printing press!

Love the enthusiasm but (La)TeX falls into that description as well.

> That's because you haven't had the opportunity to enjoy SMF.

Maybe, I've put it on my list of things to tinker with more. Thanks for the link.

> That's is quite ironic [...] I am not succumbing to GNU/Linux group think is what one could call disingenuous

I don't care about you succumbing to any group think or whatever other word you can come up with. I am trying to show you why it is actually superior in many ways. Just because you are comfortable with nroff absolutely 100% does not make it better. To put it simply, you may be a professional system/software engineer but if you can't keep up with why these systems are considered (and shown to be) better than what you have now than you will just continue to be frustrated/fall behind.

[0] http://www.math.ucla.edu/~tao/submissions.html
[1] https://www.overleaf.com/gallery/tagged/academic-journal
[2] https://en.wikipedia.org/wiki/LaTeX
[3] http://www.catb.org/esr/writings/taoup/html/ch18s03.html
Cassini, Rømer, and the velocity of light (2008)
Only 1 sample.
Bird brains are dense–with neurons
No pin to remember, instead trying on physical presence of my finger. It's much more secure because because nobody can watch over my shoulder and steal my finger.
> we were burning $100K/m and making $9K/m in revenue

There's all that needed to be said, right there.
Space Data themselves made a public presentation[1] of their network of balloon with transceivers (called SkySite) years before Google started their project, so the proof that it was possible was already public information.

It's not clear to me exactly what has Google allegedly infringed upon.

[1] http://apps.fcc.gov/ecfs/document/view?id=6520007226
I am not defending any set of documents. My point which you seem to be ignoring is You can only trace what you have documentation for. So A: it's got to be written down. B: It's got to have a reason to be written down. C: It's got to be preserved. D: It's got to be preserved without being edited. E-Z: etc.

Further, none of this was directly recorded. It was recorded by a group with a tradition of making things up. It was further preserved by a chain of people with various vested interests.

For any other group of documents the assumption would be they have an accuracy approaching zero.

Assume there are groups A-Z. You have documentation from A talking to Q, Q talking to L, K talking to P. How accurate a picture can you get from that? Well, you can get the language correct... probably.
Nice! If you ever are working on something like that in the future, I am working on libchuck[1] which should make embedding easier, in spite of pervasive global state. Currently iOS/Mac only but plans are in the works to make it cross platform.

[1] https://github.com/spencersalazar/libchuck
i think the idea is a police officer would have to carry their own malpractice insurance as a prerequisite to the job. they pay for it because it's mandated.
There's a bit more to it.

Native lambda functions are "always" running (if they're frequent).

When the functions runs it will spawn the Golang process and send the JSON via STDIN.

It has ups/downs of course but the good thing about it (for me at least) is that I can write in Go/Ruby or any other language and just wrap it with Node. This way I can use already built libraries and data access layers etc...
Doing Linux Sysadmin Tasks from Your 8-Bitter
Why FlatBuffers (2015)
Next: The Children's Illustrated Guide to Docker Networking.
Can you give a brief overview of the diet you mention, and maybe link some resources on it? The website I found was basically un-navigatable.
> The key element that almost everyone overlooks, even people on HN building alternative payment systems, is that that tax mostly gets refunded to consumers via reward programs.

NNNNnno. 1) the price on everything is inflated 3% for what amounts to an archaic and insecure way to process transactions 2) It's not opt-in: that is, with few rare cases, I gain nothing, and in fact, must spend more money to not participate and 3) Even if I do participate, all I can hope for is, at best, 1.5% or so cash back. You might say, "Oh, well that's a fee for convenience and security. OK, then what the hell is that fee I pay for the card every year?

It's bullshit. Get rid of it. Make consumer credit illegal. People are too stupid, greedy and short sighted to consume it well.
Why work where your not happy if you don't have too? Demand + skill =p opportunities. Opportunities + happy relationship = I give a shit. I know making a living is important but I don't think working under this concept is sustainable. I have been in this scenario and it's dehumanistic and unsustainable in markets where your employees have options.
Historically array programming and functional languages are peers with quite different evolutions.
I'll take this opportunity to shine a light on the company I work for, Independent Software. We are in a similar space and value many of the things you do.

We run a program called Apprentice100 (A100). A100 is a 12-week program designed to teach emerging computer science students the real-world skills they need to be junior developers, connect them to the local development community, and match them with jobs. We're not a bootcamp - we work with students that have a formal academic background in CS.
We're also not a recruiter - we provide training and we value our community. We build relationships with all the students and companies we work with. We hold events to bring people in our network together and cultivate good Apprentice/company matches.

We do charge a flat fee to hire an Apprentice and in return the hiring company is eligible for a 70% refund on that fee and 50% wage reimbursement for 1 year. This week we became the first software apprenticeship program in the nation to be formally recognized by the DOL and DOE.

In addition to A100 we have been working more and more with mid and senior level developers.

I chime in here not only to spread the word of A100 specifically but also to say that some of us out there are trying to do job matching in a way that is good for everyone. It seems like dsk139 and other responders in this thread are doing the same.

------

My apologies if this message is scattered or littered with errors. I am typing into a very small comment box from a very noisy train.
"the goal to replace the paper menus and give restaurants full control over their online presence."

"Our business was seemingly working and from 30K feet — it looked great:"

"We had had happy customers and revenue almost from day one. Our revenue grew continuously for 11 months in a row."

"Despite of all of the above, Dishero was still in a mediocre category: we were burning $100K/m and making $9K/m in revenue. The revenue continued to grow, but the growth was painfully slow and unpredictable."

We're not in a bubble....
That or you can use Fanout Cloud which provides Pushpin-as-a-service.
It's the 'knowledge gap' trick. Create a bit of mystery - a mental itch if you want to call it that - and readers start drooling like Pavlov's dogs. The writing is good though, so I didn't mind.
I always thought nobody had any actual plans as to how the DAO could do anything useful.

Now I guess we know it won't. Either "hackers" will bankrupt it, or all the decentralization zealots will back out (and bankrupt it).
Scala's typeclasses are first-class values and they actually work as advertised.

Haskell's type classes are a mess because Haskell-the-spec (anti-modular, coherent) and Haskell-the-language (incoherent, "modular") work completely different and nobody cares and there us no real fix because both options suck, as soon as your project consists of more than one module.

It's the reason why no language after Haskell does type classes the Haskell way, and all of them do it similar to Scala's approach.

Could Scala have more syntax sugar? Sure! But people are more focused on getting them right first, before adding additional syntax.
As an Australian who's recently moved to US I'm absolutely dumbfounded by this.

I need a third-party app to transfer money to my friend (Venmo). Why don't the banks allow easy inter-bank transfer here?

And with signing with my credit-card, I feel like I'm back in 2010 in Australia when some retails still hadn't adopted chip technology.

Dear US, you're a great country, but please catch up.
OT but I wish Vimeo had an option to play the video at 2x the speed. YouTube has that option and I love it. Use it all the time for watching conference presentations.
Exactly what I was thinking. You look for the last slash and truncate.
In the 1970s this was called the mainframe bureau...
Hypothetical question:

Would you rather the city had to pay $22 million in damages, and take active steps to prevent their city police from engaging in kidnapping, assault, and false imprisonment?

Or, would you rather the city paid only $220k, and it became the new normal?

> On the other hand, there should be criminal charges against the cops.

In this country, the judicial system cannot police itself. Asking police to police police is an exercise in futility, and civilian oversight is nearly always subject to regulatory capture, as the oversight boards will eventually be composed of people who have a strong incentive to side with the police rather than "criminals".
My MasterCard is tap to pay and it's better than using the phone. Smaller lighter. I always have my wallet. Don't always have my phone.
This sort of strategy game AI in general works on a Dark Forest-ish theory, recursively evaluating what it would do if it were in the opponent's shoes to predict the reaction it will get to each possible move.

Since Go is zero-sum the only reasonable strategy is to be maximally malicious and assume the other guy is too.
The Geek Behind Google's Map Quest
I'm 5'6 and normal weight, I did a standard flight from EU->San Francisco and on the return when checking in I bought pretty much any update that was available to give me more leg room/space. I swear I will never do another 5+ hour flight that isnt at least business class. I had back pain for a month. My feet were swollen for a whole week that my shoes didn't confortably fit, etc that I will easily lose a paying gig over doing a flight like that ever again.
Oh, I'll read it then - thanks! :-)
If you're IDE doesn't do it, then I highly recommend using ack[1]. It's my go-to tool for tasks like this, and I've found it a joy to use.

1: http://beyondgrep.com
Cloud Functions are just the functions. Gae is that and more.
Not raw sugar added to food, which is sort of implied in the ggp comment. It's at least not clear if they mean a 5 pound bag of sweetener or 5 pounds net.
I'd have to do some search-fu in my reddit comment history. What I remember of it, is that the trolly-vagueness of patent claims is entirely necessary for the system to work as well as it does, and that the patent system is a well-honed machine essential to the proper functioning of our economy.
It's odd that it happened in a leap year, since this isn't even the same ordinal number of days into the year as in the preceding 3 years.
This presentation is far too long for such little content.
Yep. Neither does cash. And when you pay cash, you're not also feeding marketing databases, unless you choose to. Nor are you required to ask permission of the issuer in order to buy something.

I really like cash.
The compensation model also seems unfair. Many tech recruiters get a cut of engineer's hourly wage and even with that high price I found tech recruiting a very random selection process.

Many good managers I know don't believe that they will find stellar candidates via recruiters.
Cloning, coding, eh. Much the same.
this gets around the paywall for me:

http://www.wsj.com/articles/why-does-the-irs-need-guns-14661...
That's too much. Let's say Alpha Go is 9 dan pro or stronger. It would be 4 or 5 stones to a 6 dan amateur, one more stone to 5 dan. Let's say AG is a couple of stones stronger than the strongest humans. Still not nine stones handicap.
If they did, they should allow humans and limit the amount of energy used during the matches, like calories in a tuna sandwich.
So which content are you supposed to show to googlebot?
I did this. AppEngine is a far more cohesive and polished service than cobbling together Lambda, S3, API Gateway, SQS and Dynamo (which you'd need to do to actually have a fully functioning site).
I did a double-take reading this:

Google Maps appears differently depending on the country
of your IP address, allowing the company to stay on the
right side of the law in the many jurisdictions where it
operates. Log in from China, for instance, and Google Maps
is strictly controlled by the government, which
deliberately inserts errors into GPS systems close to
sensitive locations.

I already knew Google Maps will be rendered differently based on your location (http://qz.com/224821/see-how-borders-change-on-google-maps-d...) but this sentence is ambiguous - is Google inserting the errors? How do you insert errors into GPS systems anyway?

Guessing this meant that the Chinese government's GPS systems send your device incorrect lat/long coordinates near certain locations, but that seems counter-productive - wouldn't that just tip off people they were near a sensitive location?
Before I started using the watch I only used Apple Pay for novelty.

To be fair since I've gotten my watch Apple Pay is in WAY more places so I can use it on a regular basis.

I think Apple Pay would still win over the card for privacy (I'm REALLY tired of getting cards stolen) and speed over the current chip system.
I think the key difference is that Grubhub and Seamless offer restaurants an additional revenue stream without the overhead or operational headaches of doing in themselves.
Excellent list! Can anyone with personal experience with these tell me which ones are most worthwhile?

Also I'd like to suggest cs231n over the udacity course for deep learning
I prefer to have my customers promote my product. I'm just going to focus on their needs.

Its all about HIGH quality. Pun intended.
What do you think of http://www.overcomingbias.com/2015/10/requirelegalliabilityi...?
1) TARP arguably had a referendum immediately afterward in the form of the election.

2) The American people were paid back.
Are You a SLAPP Victim? Tell Your Story to Congress
I feel the same. I thought it was a good idea for her to take the job even if I had doubts about Yahoo's future. Assuming she wants to stay in the game, I think it likely she will have a long and successful technical management career.
While there are newer algorithms (almost all first order btw), one of the most commonly used for deep convnets, sgd with momentum, is from the 80s. It really is mostly about computing power - one gtx 1080 has more tflops than world's fastest supercomputer till 2001 [0]. The actual speed difference is probably an order of magnitude larger due to an absence of communication overhead and latency inherent in sharing work across thousands of separate cpus and lots of slow ram. That would make one gtx 1080 equivalent - for neural net training purposes - to a supercomputer from 2004.

[0] https://en.wikipedia.org/wiki/History_of_supercomputing#Hist...
Exactly, thank you for saying this.
yes, and the relative merits of well defined substances versus macerated hot water plant extracts will be discussed to the end of time. just don't ascribe magical 'vital' properties to either one. by the bye, drink enough willowbark "tea" and you might succumb to salicin poisoning. it's said to have shortened Beethoven's life. (next up: homeopathy doesn't cause any side effects)
But doesn't the patent office only look at previous patents when searching for prior art? Of course, other sources of prior art can be brought in as a defense, but it still may not stop someone from getting a patent initially and using it to harass financially weak opponents.
I like how he specifically called that "mediocre success"...
Many phones have magnetic switches for use with smart cases. When you close the case cover, a small magnet trips the switch and turns the screen off.

The magnet isn't damaging the phone — at least not at field strengths likely to be encountered in everyday life. Removing the magnetic field should immediately turn the screen back on.
Yeah, don't try to sell to restaurants. I'm not sure if that, or running a restaurant, is the worse idea.
Same experience as OP here both on number of applicants and number of qualified female applicants.

Take home test results were considerably worse for females too and they had over five days to complete a simple thirty minute exercise.

There might be responsibilities that get in the way but IMO if you can't find a slice of time to work on something that came up then I'll be really careful in considering you for a job.

Shit happens w/o planning and I'd rather have people I can count on.
Lots of intelligent replies here (like much of HN); having a Java & C/C++ background, I picked up Javascript some yrs ago for web work.

Now, I don't know how/if to move to Typescript or ES6? And any resources/books/vids you all highly recommend? (I built some corp stuff in Angular 1 but guess I'll have to move to TS for Ang 2 or learn React?)

Many commenters in this thread seem experienced in TS so thanks in advance for sharing any advice
Google.cn apparently is accurate to the Chinese GCJ-02 datum whereas Google.com, and presumably others, aren't.

(Source seems to be the wiki author's observation, but see https://en.wikipedia.org/wiki/Restrictions_on_geographic_dat...)
The prediction markets say something like 75% Clinton to 25% Trump. Either you know something they don't (and are about to make a lot of money) – or you probably shouldn't be making predictions with that degree of confidence. Especially considering how unpredictable the elections have been thus far.
I don't know about this. Perhaps it wasn't the best choice of words, but I doubt it was said out of malice. The reaction seems rather disproportionate.

Such a charged atmosphere.
Only for BofA credit cards. For some reason they won't let you use it for their debit cards.
Taking legal action against the most active sellers of viewbot services
Thoughts and Prayers: The Game
Speed of a Metrocard Swipe
This can become problematic if you're using an SSH agent and have 4+ keys loaded into it. The problem is that your agent will step through keys to try auth with, but most OpenSSH servers will reject keys after 3 failed attempts. This means that you also need to keep an up-to-date entry in ~/.ssh/config as to which key to use with which system.
I'm not familiar with Ethereum programs, but it seems to me that it's not possible to answer the practically-identical question, "How much gas does this program need to start with to guarantee it will either get into a loop or halt of its own accord before it runs out of gas?"

Or, to put it another way, it sounds like the language is Turing complete in roughly the same way C is Turing complete even though every C program ever instantiated is actually a linear bounded automaton because there's no such thing as an infinite tape.

Like, I can announce that my C-like language will always halt after a trillion-trillion operations and therefore the halting problem is "solved" for it, but for all other purposes it's almost exactly as difficult to reason about as a Turing machine.