skysight-inc/HackerNews huggingface dataset:
Because the specs just for parsing out the headers, body, attachments, etc. are fiendishly complicated. Think all sorts of indefinitely nested recursive data structures that have no fixed order.

But that's the easy part. The hard part is that there is no spec at all that governs what actually goes inside the body of a message. The easiest way to explain is by way of analogy:

Imagine that you've never left your village and know nothing of the outside world, but are tasked with building a car capable of circumnavigating the globe.

So you start out by building the first version of your car that can drive on your village's streets successfully. So far, so good, you think you've solved the problem and assume it will just keep working. But as soon as you get outside your village you see that the roads are no longer paved, so the car quickly breaks down. So you go back and build a new car that can also drive on gravel roads, and set out again. And this works well enough until there stops being roads at all. So now you go back and build a third car that can handle paved roads, dirt roads, and off roading. And this works for a while until you encounter sand... And water... And -100 degree cold... And 10,000 degree heat... And zero oxygen... And people start shooting at you. Etc.

And of course if you're not very careful then the time required to build each new version of the car will increase exponentially, since you need to make sure it still works equally well on all of the previous terrain you solved for.

This is basically email parsing in a nutshell. It's also why you keep seeing these companies get bought out for tens or hundreds of millions of dollars without many users, and sometimes without having even launched anything. Because email is by for the world's largest source of human knowledge so it's a very valuable domain to be able to work with, but only a handful of people really have the expertise.
From a purely technical standpoint the HL7 Continuity of Care Document (CCD) is intended to address this issue by allowing a provider to put a summary of a patient's entire chart (including a plan for future care) in a single XML file and then give that to another provider when transferring care. It works well when properly implemented, but unfortunately many healthcare providers haven't done so completely yet. There are also practical problems in just moving the file from one provider to another.

http://www.hl7.org/implement/standards/product_brief.cfm?pro...
How to Execute a Repeatable Twitter-Based Investment Strategy
I'm unclear as to why this change was made between one school year and another. Unless I'm mistaken, there was no lead time. This seems like a big bang software rewrite.

This kind of massive change should have a year or two or even four of prep work. People can adjust their jobs and schedules much more easily over that kind of time than a single summer.
Snapchat is testing a camera feature that lets you easily buy items from Amazon
I've been using Aquamail on my tablet for years, it's a nice mail app and they continue to support is. I use it on my tablet for the swipe feature especially.

On my smartphone I'm using MailDroid Pro. Like Aquamail, I'm using it for several years now, steady updates and good support. The reason I use MailDroid on my smartphone is the anti-spam plug-in (they charge extra for that though).
Social network based on Motivation and Productivity
> include entire frameworks instead of just writing a couple helper functions
> unhealthy insistence of code reuseability

The problem you're alluding is that until recently, there was very poor support on the web for the equivalent of Unix strip[1] or Proguard[2] (often used by Android devs). We need reliable and accurate dependency analysis to be able to properly eliminate unused code.

Today, with ES6 modules and a recent version of webpack, this is partly possible. Unused modules are not included in the final output file. I noticed a drastic drop in the final minified JS file size, after moving to a configuration that enabled this sort of (module) stripping.

[1] https://en.wikipedia.org/wiki/Strip_(Unix)

[2] https://stuff.mit.edu/afs/sipb/project/android/sdk/android-s...
iOS already supports two displays with AirPlay. You can have a separate image on the device and the display.
Then buy a fireproof document safe and put all those documents in there.
This...may sound silly.

But... There is something to be said for listening to an Opera in a language you don't speak. It completely bypasses any part of your brain that tries to intellectualize, and just hits you in the feels.

It's not always about status seeking, it's about getting away from the ugliness that pervades the world around you and getting lost in something beautiful in it's own right.

I don't often enjoy 'watching' Operas, the visual context keeps me locked in the state of mind I'm trying to escape from. Only listening. Rare exception to the special treat of a singer belting out in a random spot on the streets.

Just wanted to point out that not everyone looks at art as a social ladder, or even take the same things out of art that someone else does.
Linus has spent decades of his life creating and tending one of the most socially useful pieces of software ever created. Now he's being vilified by a bunch of craven busybodies.

Although he's treating it with undeserved grace in public, it seems entirely possible that this will end his serious involvement with the project. Which is tragic.
for the 10 or so websites that use them
That sort of arrangement incentives people in many unexpected ways, like people optimizing for the chance to get allocated a slot that can be sold at maximum price, rather than what is the 'best' for them overall. It then turns into a game theory exercise of course.
I really liked Astro. Can anyone recommend an email client for macOS and iOS that has scheduled sending and read receipts?
But that's only if they also got some experience working with static typing. Without that, they won't see the difference in difficulty, as they have no reference to compare to.
Brave can also be run just as a blocker
> The definition of "inclusive" as viewed by most of these CoCs is extremely narrow.

That is, of course, a complete lie.
Connectivity Fingerprints: From Areal Descriptions to Abstract Spaces
Isn't that why you have titles such as Software Engineer, Developer, Programmer? Software Engineer should have the engineering background and tackles hard problems whereas Developers and Programmers focus on products and features.
I configure a second YubiKey as a backup, and disabled SMS-based recovery where possible.

Many sites allow this explicitly, and will let you view details about the last time each key was used to log in.

Some sites that use TOTP only allow for one "authenticator" to be configured. In those cases, I scan the same QR code into each key.

This process requires you to retrieve your backup key from whatever safe place you store it in when configuring 2FA on new accounts, but that feels like a reasonable trade-off; I don't make new accounts very often, and when I do I can wait to configure 2FA until I have access to my backup key.
Just a sidenote, reading your comment it occurs to me that I have no idea - and as far as I can tell never read anything about - what is the proportion of code that is done 'for fun' versus 'for pay'.

If anyone has any survey or any discussion on that please reply so I can take a look at it. I'd like to confront my expectations with data
Point taken! Thanks a lot for your feedback.
Just a few points:
* pypeline is already taken :(
* My main reason for this was because initially I was thinking that you did an `import pypeln as pl` and then called things like e.g. `pl.pr.map` since you cant abbreviate the module inside `pl` then I picked short names, but then I decided to go for and import the module kind of strategy.

I am thinking about expanding the module names to their worker names:
* pr --> process
* th --> thread
* io --> task

And then have the conventions
* from pypeln import process as pr
* from pypeln import thread as th
* from pypeln import task as io # as ta?

This conversation is very valuable, thank you all for the feedback.
1) the visuals were excellent, and still hold up against contemporary games.

2) the narrative was high quality.

3) the puzzles were very satisfying to solve.

Aside from that, it’s just taste, my friend.
Could the West not take data from China in the same way they've taken data from the West to get ahead (arguing the capability, not the morality)?
Freelancers had the ability to set their price. With most of these gig apps, you have exactly zero say in how much is being charged.
Real-time CRUD guide: Front end (part 1) – Hacker Noon
> there are a lot of developers who don't care about quality

And the underlying meta problem is that the people who are supposed to be responsible for figuring out which is which haven't got the faintest idea how to tell. Compound this with the fact that most management structures are still based on factory-assembly floor management where figuring out who wasn't turning the lever as fast as they guy next to him was the most important metric and you end up with corporate structures where trying to figure out which developers are better than which other developers actually has the opposite effect than the one they want.
In Germany they used @googlemail.com addresses.
They tend to be the websites that matter a lot.
All of these terms are used mostly interchangeably, and it just depends on what company you are at. For example, Microsoft calls them all SDEs (Software Development Engineer) and Google calls them Software Engineers.
This is a great point. Medical researchers would do well to stop harassing people about their lifestyle (it's not obvious much headway can be made there anyway) and focus instead on the crazy number of deaths caused by interactions with doctors and hospitals.
Hilariously, the update mechanism likely opens an attack vector.
The speed limits will go up to reflect reality by then so it won't matter who/what is driving the car.
I don't know if I was just too young at the time, but I had Myst/Riven as a kid and never even began to understand what the objective was or what I was supposed to do. Aside from a little bit of walking back and forth, I don't think I accomplished a single thing in game.

Given the article references 6 and 8 year olds playing, maybe I was just a dumb kid.
Do you think that this is enough to convince a hostile sceptic?
Every current EMR / EHR application can export data in standard formats. That's not a significant problem any more. The federal government has effectively already imposed standards compliance as a requirement.

The problem is that there is no organization which can provide a stable repository for every patient's data and build secure interfaces to thousands of different provider organizations. That's extremely expensive and there's no real business model. Where will the money come from?
The Strategic Hamlet Program was adopted from the British, who used it to quell the Communist insurgency in Malaysia. Basically, round everybody up into a small group of villages for their "protection". Assume everyone who doesn't stay in the village is the enemy.

Notwithstanding the abuses in Malaysia (I'll leave it to others to question the necessity and efficacy), it definitely didn't translate to the Vietnam context. For one thing, in Malaysia the Communists mostly came from the ethnic Chinese community, who were a minority and already highly concentrated in the cities.[1] Vietnam had/has a similar ethnic Chinese minority (wealthy, urban, etc), but they were Capitalists, not the Communists. The pool of Communists was everybody else, the largely rural population.

[1] Interestingly, to this very day Malaysia still has laws which prevent Chinese from owning certain types of rural property, ostensibly to protect the rights of the rural Malay population. I don't know, but I presume such laws have always been in effect in Malaysia, even before the colonial era. At the time of the insurgency rural Chinese were probably already a suspicious group. In hindsight the insurgency was just an excuse for the powers (British, majority Malays) to reinforce the stable status quo, which is why the program "worked". In Vietnam the status quo was increasingly untenable.
Dask is relatively lightweight actually, because it is pure Python.

Also, there is "Streamz" which solves a similar problem, seems more mature and can work with or without Dask or Dask-Distributed.
Ok actually, yeah. That has been one of the biggest pain points for me too.
That's when they become old people
This might be obvious and not need to be mentioned, but if you're self-hosting, don't forget the obvious and often most flexible option: A Linux box directly running plain old Exim (or Postfix, etc.), Dovecot (or Courier, etc.), Spamassassin. No containers, no abstractions, no meta-configuration.

I've had this setup for a couple of years now and it's not failed me. Support TLS, SPF, spam checking, DKIM, can support multiple domains and aliases. Basically anything you can imagine. And, despite the FUD you might hear about not using a cloud service, my mails don't get magically lost into people's spam filters. The initial configuration/learning is steep, but I pretty much never have to touch it once it was working.
Which of the people signed on to that manifesto are also arguing in support of the Linux kernel CoC?
This reminds me of Mr.Dressup
How many personnel/posts were you assigning, out of curiosity? I've seen a similar problem, not automated yet, with around 20 staff members, who have varying conditionals which would have to be accounted for. It's not necessarily worth my time to automate for such a small # of people, then again it's a fun puzzle.

The current approach is a 2-month rotating schedule. Since there are day/evening/overnight shifts, with overnight being the least desirable and evening the most desirable, it was deemed most equitable to simply rotate members through different 2-month schedules. This way, everyone across the year will be doing the same sets/timings of shifts in different months. This becomes very important for evening shifts, in particular, since transitioning to/from that schedule requires time to overcome the jet-lag induced.
Doesn't matter. They'll get enough DoD contracts and other sources of funding to keep them alive because certain parties (rightfully) have a strong interest in domestically retaining this sort of specialty engineering capability.
I'm tired of these kinds of big predictions because there is absolutely no penalty for being wrong.
Author here! Happy to answer questions, take feedback, receive criticism.

Waves awkwardly, shuffles feet.
I got the mailings (though not phone calls) when I recently bought a used car with a SiriusXM radio (2012 model), though they stopped completely by about two weeks after the trial period ended. They may as well have not bothered, since the car didn't have a nav system built in so I was piping all the audio from my phone anyway.
Was your project done as part of the A-Lab?

http://mitsloan.mit.edu/actionlearning/labs/a-lab.php

My company had pitched the students of the A-Lab a couple years ago, but unfortunately we didn't get picked. BPS was one of the others pitching the students at the same event.
I found that the easiest way to do it on Mac is to download the Chrome Enterprise bundle, edit the .plist and convert it to a profile with McxToProfile, to get something like this:

https://twitter.com/gepeto42/status/1043587638568079360
> I think Sirus only makes money off the folks who forget to cancel after the promotional period. It’s like $20 a month and I’ve forgot to do it my self for a couple months.

they don't really have an ongoing per-customer costs, right?

so long as they extract the all the money you're willing to pay them, be it $20 or $90, that's fine. i expect they worry more about total customer count.
I think I understand why this is sinking, but I'm tempted to think perhaps it should not. On the other hand, I don't know whether this community can any longer discuss such matters with cool heads all around. Or whether any community can.
Wait, seriously? Not even the OpenPGP applet/with ykman configuration? In what modes does it do that? That’s send-it-back bad.
Smartphones are getting increasingly well-integrated into the car's stereo, though - especially in the Appleverse.

From a contingency planning perspective, even if their business is healthy now, they might also want to hedge against a long-term decrease in private car ownership. We're seeing quite a few trends that point in that direction: increasing use of ride share services, self-driving cars, wealthier folks moving back into the cities, increasing cultural interest in moving away from motorized transportation as the default, more remote work.
The Bill Rights are amendments "to" the Constitution, the very document that establishes the legitimacy of the government in the first place. How can you accept the legitimacy of the government and be anti-government at the same time?

Even the Anti-Federalists, the group that advocated for the establishment of a Bill of Rights were not anti-government.
It has been a while since I read Structure, but I don't quite see how his examination of Phlogiston theory vs. the contemporary understanding of oxidation fits in with your dismissal. It seems to me that Phlogiston theory isn't really a special case of oxidation, as currently understood.
Announcing Torch AR, the Design Platform for Mobile AR
CEO email threatens me with YouTube TOS, calls my channel shitty
This perspective reminds of a few answers to the Quora question "Do programmers who write bad code know that they are writing bad code?", which I was looking at last Friday when dealing with a particularly poorly coded app. For further edification/amusement:

http://qr.ae/TUGpLF
http://qr.ae/TUGpL5
MacOS 10.14 Mojave: The Ars Technica Review
I run Canny (https://canny.io), which is a tool that software companies use to keep track of feature requests from their customers.

One awesome thing you can do is ping everyone interested in a feature, and ask them how they want it to work. See it in action here: https://feedback.canny.io/feature-requests/p/tags. (Scroll down to Sarah's comment on July 20.)

Whenever we're thinking about building a feature, we ping all the stakeholders. This gives us solid context on how they want it to work, which helps us define our MVP. If we need to follow up for more information, it's easy to do that via email / Intercom.

Hope this doesn't come off as salesy – I really felt it was relevant.
I had always conflated selling the London Bridge with "selling" the Brooklyn Bridge, as in "...and I've got a bridge to sell you": https://en.wikipedia.org/wiki/George_C._Parker

Glad to hear this sale actually happened and worked out well for both parties!
It's not some hard rule. Just pointing out that a lot of these decisions can have very little to do with the type system.
It's true that it was fast, maybe too fast, although the district was planning this conversation for more than 10-20 years. But even if it has not been implemented, the debate itself may have been worth the trouble. The complex problem of start time choice is an incredibly deep and interesting question, and so is the interface between algorithms and public policy.
So, use python and static type annotations for the best of both worlds?
That's actually exactly what is happening in the market. R&D budgets at big companies are nothing in terms of market value when compared to small companies.

To put a little wrinkle in it, it's both big companies outsourcing R&D to pick from the winners, but also tax payers subsidizing the R&D through R&D tax credits.
They aren't taking DoD contracts. They used to, of course. That mostly stopped when Google bought them.
> For more details about what’s next for Astro customers, read Astro’s announcement on their website.

What's next? Scrambling to find a replacement email workflow in t minus 15 days and counting ...

There is NO "what's next". The product they are using is disappearing forever. Why are these product shutterings always phrased as a "bold new adventure" for former customers?

> We’d like to thank you, our users, for whom we built this company, and for whom we look forward to serving further as part of Slack.

I realize it is exciting news for the Astro VCs (maybe?) and, again, maybe Astro's employees, but this isn't how you thank someone for being a loyal customer. Apologize for screwing them at least.
Take a look at this Audi production video and you start to notice poka-yoke being used when there is a human in the loop.
https://www.youtube.com/watch?v=nZkyfZqlptA

In my experience these things are developed over time in response to failure. Always keeping the poka-yoke concept in the back of your mind helps when designing systems, but you don't really know how people will misuse tools until they're in action.
> We do not live in a just world. Pretending that success and failure are attributable to merit alone is the the self-serving moral vanity of the fortunate.

Again, I agree with you.
I also think this viewpoint is depressing to the point that people will reject it and invent some fiction to excuse their relative comfort. How it can be empowering—delivering tangibly improved quality of life for the people around you—is hard to tie to the premise that people are fundamentally subjected to their environment before their character. Rhetorically, anyway.
I use BEAM for my Dataflow jobs. But their local "DirectRunner" is just for testing purposes. As with Spark, BEAM is a huge beast, Pypeline was created with simplicity in mind, its a pure python library, no dependencies.
From the original article:

"Most architecture research papers are based on simulations running small, easily portable benchmarks that project potential performance if ever implemented. This article is not one of them but rather a retrospective evaluation of machines running real, large production workloads in datacenters since 2015, some used routinely by more than one billion people."

It's probably also the first time that Google mentions explicitly that the TPU is hosted by an Intel system, which obviously they manage for you. The phrasing around "18-core, dual-socket Haswell processor" is ambiguous and might not be the exact spec for a TPU host: it's not clear if the "platform that is also the host server" refers to just Intel or that specific configuration. Such ambiguity is usually deliberate, of course...
There are many PL researchers in the dynamic typing camp, “generally” is hardly justified.
Astro acquired by Slack–are all email apps doomed to failure?
Well I imagine step one will be to keep raising the penalties for speeding on the remaining manual drivers. After all it will be like 20 years before autonomous cars are a significant minority.

Some people will refuse to buy them for years. People will be buying cheap used cards for years, and those will be normal cars for quite a long time. Dollars to doughnuts the sensors and cameras and whatnot on a lot of autonomous cars will fail before the car itself does, rendering them back to manual. And again the used car market isn't going away.

There might be plenty of manual drivers in fifty years.
In the west we have total surveillance of personal communications, but we can't datamine anonymized health information.

Under what ideology does that make sense?
"import pypeln as pl" could cause quite a bit of confusion in Poland I would imagine.
Monzo hits 1M users
The visual quality of Riven is stunning.
Making of doc https://www.youtube.com/watch?v=RpE8NzIVDZ8

My article on riven graphics vs the latest in the myst series.
http://darkcephas.blogspot.com/2018/03/twenty-years-later-of...
Apple Subscription Notifications Are Almost Useless