skysight-inc/HackerNews huggingface dataset:
I think wonderfuly's reply missed the point of the question which is to explain it without having someone dissect the source code line by line.

Anyways, I did a quick look at the source file[1] and it looks like it depends on the assumption of github returning 35 commit titles per page. From that, it divides total # of commits by 35 to derive the url for the last page containing the 1st commit. (The url you'd arrive at if you if you repeatedly clicked the "Older" button on github to get to the final page which contains the 1st commit.) It then scrapes that url for relevant data. (It uses the cheerio library to help with scraping.)

I'm not familiar enough with github's HTML navigation and page formatting to know if this method is fragile or robust. Github does offer an API[2] so it may be possible to get the 1st commit that way instead of scraping HTML that was intended for display in a web browser.

Excerpt of the arithmetic:

function getFirstPageUrl(repo, num_of_commits) {
const COMMITS_PER_PAGE = 35;
var first_page = Math.ceil(num_of_commits / COMMITS_PER_PAGE);
return `${BASE_URL}/${repo}/commits?page=${first_page}`;
}

[1]https://github.com/wong2/first-commit/blob/master/app/github...

[2]https://developer.github.com/v3/git/commits/
Many series that calculate pi are very simple, as a result, it can randomly appear in physical problems. See for instance http://ics.org.ru/doc?pdf=440&dir=e
alterations not alternations, of course
The first commit of darktable-org/darktable was created by @ on Tue Apr 07 2009

Seems like you don't handle commits by users not recognized by github.
La grande bellezza / The Great Beauty was quite good.
thanks for you explanation!
The existence of a tool like first-commit makes me feel especially self conscious about my earliest commits on GitHub repos. It adds to the perception that one's initial checkin is somehow especially important (as opposed to the bug infested, barely-compiling disasterpieces I usually checkin.)

Now, it's like: "Uh, oh, this initial checkin better be perfect. Someone will scrutinize it with first-commit."

OTOH, no one has ever expressed any interest whatsoever in any of my GitHub repos. I doubt even first-commit can change that.
>Is caffeine really addicting? I mean, I can quit it any time, but I feel like shit.

Those are the symptoms of physical addiction.
The "Antiquity à la carte" map has an ancient terrain layer by default : http://awmc.unc.edu/awmc/applications/alacarte/
Show HN: ShouldRead – Get the articles you want to read as digest in your email
FYI HN recently added a "past" link that takes you to previous discussions.
The problem isn't dumbed-down summaries, the problem is that the dumbed-down summaries, especially those produced by people other than the original author, are often straight up wrong. Reading just the abstract, or abstract + figure captions, is a good compromise in my book.
I couldn't disagree more. R is great at munging pretty much everything but unstructured textual data. The tools are definitely behind Python if you're dealing with literal written documents.

I don't know anyone who considers themselves a "data scientist" of any sort that doesn't view their job as 80% or more data wrangling/munging/cleaning.

I write production ETL processes in R at my current job. AMA.
Not sure if the FCC has a set definition for IPTV that would make Netflix not IPTV ... if they don't, it would just require Netflix to say "we are IPTV too".
The "inviting a person to the org" issue sounds like a failing on the GH side. Why can't you just invite someone by email and let them choose the account to use the invite with (or create one)??
Using and abusing Renoise as a demosequencer
Could anyone explain to me whether this article is serious or sarcasm ?

And if it is sarcastic what exactly is he mocking ?

I guess that most HN readers would be unfamiliar the tools of the trade for big data and machine learning.
Why are you outraged?

In their blog post announcing it, they state that one of the main reasons is because it's meaningless and doesn't reflect the actual engagement around that link. I'm inclined to agree, I don't care about how many people clicked a button to share it, I care more about a discussion around something.
52 sec Indian advert about Sexual Harassment
He said that he did grow it upside down to avoid condensation.
Oh I didn't know that, sounds like this:

https://github.com/nicoSWD/put.io-adder/blob/master/README.m...

thanks, I'll try it out.
I get more download and upload speed than my package includes, and I am a Comcast customer. use salt, hats are gross.
Slackware only took me 8 installs vs 15 for Arch.
I love Raymond--he's got an erudite knowledge of Windows lore. The fellow delivers such good Microsoft standup that you can almost imagine the deadpans as he does them. Despite the constant head shaking directed at Microsoft, you can't help but laugh at how things are. Nonetheless, Raymond has rescued me many times when looking for the Windows equivalent of doing something.

Here's one of Raymond's Win32 API write ups/hacks for enumerating threads in a process:

"The tool helper library is sort of the black sheep of Win32. It grew out of the 16-bit TOOLHELP library, which provided services for system debugging tools to do things like take stack traces and enumerate all the memory in the system. The original incarnation of Win32 didn't incorporate it; it wasn't until Windows 95 that a 32-bit version of the tool helper library sort of got bolted onto the side of Win32."

"That's what happens when you're the black sheep of the Win32 API."

http://blogs.msdn.com/b/oldnewthing/archive/2006/02/23/53785...
Is your assessment based on using recent R packages? I recently learned about dplyr, magrittr and rvest in a couple of recent data science courses and it seems to me that data munging is a pleasure with R. For example, I had a rough time scraping Wikipedia using Python/BeautifulSoup (I might be a little weak using them tbh) but knocked it out with rvest and magrittr. I never wrote it up but this guy[1] did something similar and wrote a nice post about it.

[1] http://opiateforthemass.es/articles/james-bond-film-ratings/
Yeah, I am torn about caring or not caring.

On the one hand, it is a decent way to show readers how popular a post is and maybe feel more encouraged to share. On the other, now that I don't receive that count portion of the service, keeping the button installed means Twitter gets to still track my users.

People do use the buttons though to share. Before I added a LinkedIn button I received a number of emails from people asking for one so they could more easily share links.

I may just remove it though because when Facebook and LinkedIn have a good amount of shares or likes, it looks strange to have a button with no shares.
Maybe I missed the point, but you seem to be implying that you need to eat things with sugar mentioned on the label on a regular basis to keep your brain functioning normally.
Family drove across 11 countries from India to France over 111 days
What are "share counts"? I guess that's my short answer.

The only feeling I have about Twitter is mild irritation at the amount of attention it gets. It's not very useful to the vast majority of its users.

Twitter is extremely useful if you have some measure of celebrity, of course, which is why well-known journalists prattle on and on about it.

I don't have unbridled hatred toward Twitter. It just gets tired constantly hearing the MSM blabbing hashtags, and wading through a bunch of "share" buttons (that nobody uses anyway) whenever I want to read an article.

If these "share counts" are some means of letting users see how many people (didn't) retweet them, it's probably a healthy thing for Twitter. Since the average count for the average user will be either zero, or near zero, most of the time, it doesn't seem like it's good for customer retention.
5 Days of Christmas – Holiday Advent Calendar 2015
If you enjoy a calorie-free Advent with a new top quality app everyday until Christmas then "25 Days of Christmas - Holiday Advent Calendar 2015" app is for you. Last year's version had some big titles such as Candy Crush Soda Saga, Angry Bird Epic, CSR Classics, the Sims, some exclusive content, and more than 1 million downloads.

AppChocolate’s Advent 2015, 25 Christmas Apps is free to download from Apple iTunes App Store http://bit.ly/iPhoneAdvent2015 from the 27th November 2015 and on Google Play http://bit.ly/AndroidAdvent2015 from the 20th November 2015.

Please visit www.appchocolate.com for further information on Advent 2015, 25 Christmas Apps and its app catalogue.
Follow us on Twitter @appChocolate
Follow us on Facebook

If you would like to find out more, contact the creators or get a Press Pack, please email marketing executive Karine Assaf karine@appchocolate.com or CEO Emmanuel Carraud at emmanuel@appchocolate.com
What do you mean by data munging? Things like extracting data from XML files for instance?
It's probably corruption. It eliminates competition and breeds mediocrity.

If your capital isn't allocated fairly results will be pretty bad.
The Arch docs are superior (best that I've encountered in the Linux world) but Slackware is worth it to me to stay away from systemd.
Email groups (distribution/mailing lists) already exist

Meeting coordination already exists via caldav

Video embedding is mostly just a case of clients accepting <video> html5 tags

Strong crypto is available now via either S/MIME or GPG/PGP

The other features - "likes" etc are not applicable. Email is not a social network.
We run a large stateful service with hundreds of images based on whaleware and a thin layer of orchestration on top, and it works. We just dont expect everything to happen magically through an orchestration tool.
This task sounds almost uniquely poorly suited for R, but this has gotten better. For example, adding a column (did you append to the right or do an actual merge/join?) used to require copying the previous table but doesn't any more.

I wonder if you tried doing things like:

* preallocate a list, then do.call(cbind, your_data)
* Same as above, but with some of the faster alternatives to cbind like dplyr::bind_cols or data.table::cbind
* Use data.table, which has far faster joins than base R (so does dplyr) if you were doing a true merge/join

If it was truly just adding a column rom each file together into a file, these kinds of tasks are much better using UNIX tools, in my experience.
The only reason for them to remove this is that the tweet counts were always embarrassingly lower than the fb share counts.
Before Silicon Valley gets all flattered, consider:

"Soifer has long studied the proportion of Harvard MBAs who pursue careers in finance; when more than 3 in 10 head for Wall Street, it's time for investors to sell, he says."[1]

I used to work on Wall Street. I left because of this issue writ large. There are quite a few pieces of research claiming this trend is a negative indicator.

[1]http://www.cnbc.com/id/45030885
I think you're being insincere here. OP obviously (I assume) is not that devastated by this change like a death in the family. But he's unhappy about it, similar to as if your client changed their spec overnight, or if their database got wiped out of data, and they had no backups. He's trying to start a conversation about this.

Your comment doesn't add anything to this because HN revolves around developer/tech issues. By nature, almost ALL conversations/complaints here are 1st world problems
How I got better at debugging
hmm, will fix that
It is probably just me but I believe you should get into Corporate world at the beginning of your career because it will make you realize some of things that you don't want :). But on a more serious note, corporate world will give you exposure to a lot of things that startups may not. For example, when you work in corporate world, you will learn about red tape, bureaucracies etc that will teach you a lot. You will get to meet tons of people working for big companies and you can actually build a really good network.

In really big corporate companies, you will learn how different teams use different tools, methodologies and you may have to work directly/indirectly with many tools, processes etc. In startups, probably not so much specially when the team is really small. For example, I saw at least 10 different systems just for project management when in my corporate job and I probably would never be able to compare each if not that exposure. I hated it but that's the point. Now I know :)

I worked in the corporate world for 10+ years before I went into the bootstrapped product mode. My best achievement in the corporate world ? The extensive network of amazing people I met during those years. And of course, I learned tons about what NOT to do when you have the power of running your own company (no matter how small)
Hexagonal architecture
About CJK, at first I think there need to be a proper support for vertical writing layout and support for turning pages from right-to-left[1].

Hyphen currently seems to be handling vertical writing quite fine (but it is using default sans-serif font, which is less than ideal.) However page turning currently seems to be strictly left-to-right.

One of few apps I've seen to be doing well is Kindle (but unfortunately not ePub) and Bookwalker (has their own file format, although also has partial support for reading ePub file). My current solution for reading Japanese ePub books is to throw them into Bookwalker… which is kinda like second-class citizen in the app.

There are few public domain Japanese novels available in ePub3 format if you wish to have some sample (http://aozora.wook.jp/ click on "ePUBダウンロード".)
Depends on coworkers. When in school, my professors couldn't do anything if it wasn't in a nice csv file. But, us data scientist / statistical programmers are well versed in digesting data in almost any form, especially a database. When on a new project, I just get handed new ip addresses and login information and I am off.
AnyEvent for concurrency; no threads aside from the fork that causes child workers to pick up a message. The validation is in the parent, the child uses the data. The race would have to be something mutating the array, but I can only find one place where mutation happens. That part is a tight for each loop that appends source data to the target array. I will likely have to add logging, but the issue is so infrequent that the extra logging will be a mess due to the volume of data this service handles (around a billion requests per day, and maybe between zero and 200 requests will face this issue). Something will work out eventually; the bug must be exterminated ;)
The latest loud Sorrentino movie is quite awful.

I don't know, maybe hardcore movie fans find something in it, but this demographic is thin these days. For me as a common viewer, every single Italian movie I've seen in the last years was much better. And I'm talking random stuff from festivals.
How software gets developed (games/wccftech)
CERN+IS+STUCK,OR+IS+IT+2015+16+-+YouTube
Lots of creative Italians in Berlin and London. I reckon that's part of the reason. The climate in the country simply isn't supportive of artists. So they go elsewhere. To much more interesting places, where they can live well, and earn well.

As one personal example of someone I know in the industry who left... an Italian who left was not even getting paid for the subtitle translation work she was doing. For something like six months.
Suddenly I find myself really wanting some yoghurt.
A few key differences: the $350 model has a heated build platform, larger print envelope, but slower print speed. The heated build platform allows one to use a wider variety of materials---in my experience however, for these consumer printers it's better to stick to using PLA for anything but small objects, unless you're specifically designing for FDM. The steel frame should be an advantage (weight and stiffness to dampen vibrations) but the weights listed on the spec sheet show the $350 and $400 models to be pretty similar.

In the end, I don't know that there's much of a difference based on the spec sheets. It'll probably take someone with direct experience with these models (or the printers they're based on) to decide between them.
My pleasure! Great to hear that Mac version is a possibility. Is following you on twitter the best way to get notified about that?

Good luck with the app, I hope it does well.
Funny Git Commit Messages
There are still a whole lots of pieces of the puzzle missing.

I think it's all about creating ready to use containers which are running on different hosts which can replicate their data between themselves and handle failovers (they need to connect to etcd or zookeeper or consul for that).

For PostgreSQL it seem to have already solved (?) 2 times by different people:

https://github.com/zalando/patroni
https://flynn.io/

But we don't only need it for PostgreSQL.

You need ready to use data-replicating Docker images for storing/indexing log files.

And for statistics.

Probably ready to use containers for replicated/clustered Redis.

We need something for a replicated S3-like service for storing static files.

Which can be used for different things like:
- let's say you are running a website with Wordpress it can be configured to put it's files in a 'CDN'. So now whenever you you deploy Wordpress you point reverse proxy with caching (like Varnish) at your S3-like service.

A S3-like service could also be used to hold your own Docker images. You could put a Docker registry in front of it to push and pull to.

We need something, maybe also S3-type service, for storing the files of your local git repositories (which holds the sources of your Docker-images).

As far as I know in the ecosystem there is still a scheduler missing which can deploy these containers on the right hosts.

And there is also no standard API for starting new containers or whole machines when the other containers (or some monitoring tool) in a cluster noticed one is missing.

These things take time. Lots of time. :-(
People are attracted to these solutions because they can build cross platform GUIs. Native UIs are great, no one is averse to them, people just don't want to write and maintain several different versions of the same thing in different languages.
There is fighting for his corner, and there is fucking with a company's fighter program if they don't outright lie about the performance of enemy equipment.

That has a high potential of a own goal, to say the least.
My argument was that you cannot clean that specific hardware like you clean your table and cutlery. It is simply not convenient.

I don't see how you can wash a laptop under any circumstance, apart from a complete disassembly.
fijal is correct that I meant something much more fundamental than the bargain hunter problem.

Groupon's core selling proposition to businesses is that it will bring them people who can be cultivated into loyal, long-term customers. However, it's something of a fallacy because those customers are loyal primarily to Groupon. In fact, Groupon is actually a hyper-competitor to its business customers.

It's not just semantics or an issue of bargain-hunting. The model itself actively works against the core promise it offers to businesses.

BTW, while I'm not much of a Groupon fan, as a fellow-CEO whose tried something new and taken a lot of flack for it, I'll offer a little unsolicited advice: Don't let 'em get you down.
And? Why does it need to be secured? After all it's an ancient map. Unless of course you are afraid someone will snoop on your plans with Doc Brown?
Worse when you make the right choice but everyone else flocks to the crappy choice.
China prepares to rank its citizens on 'social credit'
Here's another story: I was optimizing the performance of a small, in-house x86_64 OS on a specific benchmark. I spent many months finding and removing/improving bottlenecks.

Once the performance was similar to competing OSes, the measurements from my performance experiments were varying by 30%! This was surprising because the benchmark was simple and the performance of competing OSes was completely stable.

Well after three or four days of frustration, I discovered that the problem was our test hardware: for whatever reason, immediately after BIOS POST, any memory loads executed for the next 10 seconds were 30% slower than memory loads executed almost exactly 10 seconds after BIOS POST. Initially I was shocked, but this may make sense -- it seems plausible that hardware manufacturers would run initialization code in the background resulting in quicker boot times.

Anyway, after we figured that out we simply waited 10 seconds after POST before we ran any experiments. I'm curious how common this slow-for-the-first-10-seconds thing is with other x86_64 machines.

Edited for clarity.
Ok. the source of the confusion for me then was that I was not previously aware that covariant and contravariant were terms that could be applied to vectors.
In the "Beautiful Code" book, there is a "Beautiful Debugging" chapter. The author describes how things like `git bisect` work. I had some success convincing people to use bisect at work by pointing them to this chapter.
Death by spam: lazy email marketing is killing our inboxes
People don't trust themselves as much as we should, which is why people are more likely to share something if it looks like it is "safe" to do - if others are doing it. I agree though that it would be better that if people shared something because they were compelled enough to do it on their own.
"Some places on earth are simply not fit for human habitation"

The last 3,000 years of human habitation on those islands would suggest that this is not one of those places.
I agree, but this stuff is getting better. I'm actually considering breaking away from the Rocker-derived stuff because the images get so big I'm pretty sure I could maintain a faster build myself. Problem is I haven't used R locally in Linux for a long time and the split off between things in the OS package manager and R can be a bit tricky with dependency management.

packrat has helped a lot with version control of packages, but it still doesn't quite feel like the right solution.

I've been really impressed in the last 5 years how far R has come in these areas though, so like you I keep coming back. By the time I start getting over the learning curve other places, R seems to have developed better tooling for what I want to accomplish anyway and I can come back and right cleaner, clearer, better software faster in R.
Yes, @HyphenReader (http://twitter.com/hyphenreader) is the best way to stay updated.
It is slow. And it is ok. Very few times will R ever beat any other language. Usually it is not off by much, but especially if coded by a novice using for loops vs apply functions can make is 100 -1000 x slower.

Another example is the immutable structure that causes R to be a memory hog. Creating copies of data everywhere. But, again if you plan well and execute the 'best' solutions you can avoid the giant pitfalls but will rarely ever beat a equally well written python equivalent.
Cool, that one of he way we planned to gather information, and our design relies on people to find and post it on our app/social media.
I wouldn't want the government influencing where or how I should live. But they do, every where, with housing projects, rent controls and public housing and subsidies for home improvements, from the US to Singapore to Hong Kong.
If you can generalize on similar problems and be correct more often than random chance, then you have a useful model regardless of the data backing that model.