skysight-inc/HackerNews huggingface dataset:
I used to watch Sports Center for highlights (now the internet makes sure I don't miss anything noteworthy) and occasionally the talk shows (which now rarely cover inside the lines topics). I think without reliable non-event programming it's hard to justify an entire channel.
Another startup takes on the strange world of the digital paper tablet
Does Proctorio have some automated way to analyze the user's hand/mouth/eye movements, and spot unusual activity?
That's quite shocking. I saw this in the advice section:

https://sites.google.com/site/thefaceofamazon/home/don-t-acc...

Please don't accept your offer. PLEASE don't go there. Your brains will not be wasted at Amazon, but your life will be. And no one will care.
Pebble Core[1]

3G, GPS, screen-less, wireless charging, keyfob gadget.

[1]: http://help.getpebble.com/customer/en/portal/articles/243992...
Absolutely. I think many companies don't have DDoS protection on their online infrastructure.

Patching, changing admin and default passwords, periodically changing passwords are all practices that fall behind.

With the rise of IoT and more and more devices that can be infected with malware, these connected devices get ignored. We protect our PC and maybe our mobile phones, but what about our IP-connected cameras and office phones. You can use the Mirai scanner to see what devices are vulnerable: https://www.incapsula.com/mirai-scanner/
解析JavaScript中toFixed进位规则
HFA in the WS might not be an advantage though. I'd argue it has actually been an advantage for the NL team if the AL team gets HFA in recent history because it helped their hitting. The last WS would be a good example.
Doesn't it stink?

I remember very clearly the first time I visited western Texas (from Europe) as a child. The smell was sickening.
How Relevant It to Apply for a Loan During Demonetisation
The Prime Minister of India, Mr. Narendra Modi, has scrapped the circulation and use of (old) INR 500 and 1,000 notes (demonetisation move in India), effective midnight, 8th November 2016, and replaced them with new currency notes of INR 500 and 2000.
#ReadOn @http://www.biz2credit.in/blog/2016/11/29/demonetisation-make-loans-affordable/
A Problem with Type Checking (in Python and Oil Shell)
It isn't even so simple as "work with others" - the other people involved here aren't even thinking at this level. Leap seconds are an ugly hack that were inserted without any thought as to the impact on computer systems. We should not use them, they exist as a vanity project imo.

Remember when leap seconds caused ALL JVMs to lock up until restarted? Or kernel bugs? ick!
Why not use LLVM and create a proper .so or binary?
KS is definitely friends/fools pre-seed.
Because they like spending time together but get tired of it when it's 24/7 for years on end maybe?
Yup, it seems awesome, but software needs to be written to handle it properly. I think it'd work no problem with software already written against monotonic clocks, but everything else would probably need some fixing.
Hosting Services that pays you
"install some gold plating ... pretend it's the best"

Is that Trump's trillion-dollar infrastructure plan in a nutshell?
That they kept going back on Kickstarter remains a mystery to me. Once you have to an extent established a brand and customer base, do you sufficiently benefit from Kickstarter to justify the 10% haircut on what you earn? Plus the overhead of dealing with the campaign and backers.

Their second campaign ($20 mil) happened RIGHT before the Apple Watch launched, and they promised full refunds up until the product shipped. I wonder how many people took them up on that once they saw what Apple was up to.
This made me think of a thing I've done in the past so here's a brain vomit about 'base page caching' - most of which is probably irrelevant here but perhaps someone will find it useful:

I don't know how dynamic or unique your pages are to each user or if they're largely ubiquitous across all users.

Assuming the latter I know that you can cache a base page in some CDN's through a different header. Akamai's DSA product in particular allows you to cache HTML using the Edge-Control header that has matching syntax to Cache-Control. Edge-Control is stripped out in transit, the client never sees it. This allows you to control cache TTL in Akamai's edge servers independently of the client side cache.

A quick look through Amazon Cloudfront docs seems to indicate that Cloudfront cache's will respect the Cache-Control header but this can get complicated if you don't want the same TTL within client side browser cache. Perhaps I missed something, though?

Even if your page is dynamic but you're willing to go a route like Angular or ReactJS polymorphic client side apps you can still offload a bunch of those basepage requests assuming your app is suitable for this kind of design pattern. The assumption is that you will be relying on API's so additional complicated caching calculations may apply ;)

Depending on how you construct your cache key you can do a certain amount of multi-variate caching and still achieve pleasant cache hit rates. This applies to both base pages and fronting API's with a CDN.

Regardless it looks like for only U.S. traffic (as a yardstick) Cloudfront charges 0.085 per GB so futzing with the AWS calculator I split a page I'm very familiar with (49KB) across your 3TB for US only traffic and the price comes to $304.68. No savings.

Looking around I see that Fastly (a lower priced than Akamai - Varnish based CDN) charges a $0.12 rate, the price there in the same scenario would be something like $400 (the number of http requests made factor into some of these pricing models.) Akamai comes in at $500.

OTOH a CDN I've never used (Stackpath) might cost only $140 which would get you close to half your current spend. Remember that depending on your cache hit/miss ration and how many cache flushes (cache object invalidation) that price could be anywhere from slightly to extremely optimistic as you still have to pay for the requests between your CDN edge servers and your AWS origin.

To be fair, when considering pricing Akamai is the big fish here and has something on the order of 170,000 edge servers sprinkled all over the world whereas some of these smaller CDN's have far far fewer.

Once you're into some CDN's there's all sorts of wonky things you can do with parent-child tiering models that can be leveraged to further limit the number of times a call is made back to your origin (aws) server.

Here's a pretty good CDN pricing calculator:
http://www.cdncalc.com/
The problem isn't starting up 250 servers.

The problem is someone putting up your hobby website on reddit when it's 2 in the morning your time, and you wake up the next day with a $10,000 bill.
A while back (~1.5 years), I learnt of a chip being developed that was under 80c in volume, came with BLE, buzzer, touch, flash, ram, built in power supplies, display and an 80MHz ARM plus included driver circuits for analog, segment digital and full LCD displays.

The play was "a watch can't afford not to be a smart watch" (from just vibrations and auto time sync/time zone updates etc... through to full app platform capability with a touch/LCD display).

I thought this was an obvious end game for smart watches if it got traction. This chip got canned after a giant semiconductor merger (as I heard it).
ESPN pays out an insane amount of cash for their deals with various sports leagues. Their business model completely relies on people who don't watch the channel to still pay them, and seem to be locked into that business model. If people who only watched ESPN paid ESPN, some estimates put the required monthly fee to be around $40/month. It's insane. They rode the gravy train for a long time, but don't seem to have an escape hatch.
Not administer it in the first place.

Paid homework projects are far superior. Plagiarism checks can be run on the provided solutions, and a follow-up conversation concerning the project at the interview should easily suss out anyone who had a third party to do it for them.

That approach also has the advantage of actually being a relevant to the position—unlike some generalized intelligence test.

Frankly if people are putting up with the test they have now, Amazon could probably get away with issuing unpaid homework projects, however classless that would be.
Ask HN: Is your company doing any data quality monitoring or mdm?
tl;dr: What does your company use for data quality/monitoring/validation/maintenance (or any master data management)?

Data workflow management is a recurring issue at many companies. There are several open source projects to address it[1][2][3][4].

But as data starts moving around, inconsistencies start cropping up. Did a new enumerable crop up in a field? Did a new field crop up in the source? Did an int get switched to a bigint? Does a field contain mojibake[5] and need fixed[6]? Did you start seeing nulls instead of empty strings somewhere? Are you seeing missing values where you don't expect them? Did the phone number formatting from the source change out from under you? Are duplicates showing up in a presumably unique field? Is there a discrepancy between your source and our data warehouse?

None of these workflow management systems seem to explicitly address this area. For all the data plumbing projects, there seems to be a distinct lack of anything to ensure you've got clean water running through all that plumbing.

The traditional solutions to this seem to be Informatica[7] and Talend[8]. The only newer project I'm coming across is a very new (and Hadoop-only) project from eBay[9].

I'm curious how companies here are approaching this issue. Is your company rolling its own solution? Or using something I haven't mentioned? Or maybe using one of the old school and heavy products like Informatica? Or maybe doing nothing at all under the assumption that your databases and data warehouses don't need the same level of unit, regression, and sanity testing that your applications receive?

[1] github.com/spotify/luigi
[2] github.com/pinterest/pinball
[3] azkaban.github.io/
[4] github.com/apache/incubator-airflow
[5] en.wikipedia.org/wiki/Mojibake
[6] ftfy.readthedocs.io/en/latest/
[7] informatica.com/products/data-quality.html
[8] talend.com/products/data-quality
[9] ebay.github.io/griffin/
Why do we allow WSJ submissions here if they don't want us to read their content?

I mean sure, you can go the "click web, then the right Google result" route. But that's like submitting a link to Adobe's most recent Photoshop update and then tell people "you can download Photoshop for free by starting your Bittorent client".

WSJ wants to hide behind a paywall. That's fine for them. But HN shouldn't be sending them traffic and enable that behavior.
The NFL is ahead of the curve here. Their streaming option for me as a non-US person is amazing. It's not cheap (250 Euro iirc) but it's also a ton better than normal games. Since I have no spoilers here as NFL results aren't even reported my usual NFL watching is:

RedZone (simulcast) for the batch of early games on Sunday which is roughly 19h-22h over here. Then watch the remaining Sunday games, including SNF on Monday in their cut down all snaps only version (about 45 minutes each compared to the normal 3.5h) and the MNF game on Tuesday (TNF on Friday or Saturday usually). If need be that can be shifted back a day (Sunday Redzone on Monday etc.)

All games archived and reviewable, All22 perspective is also nice to do some analyzing every now and then. The bundle includes Playoffs and the SB and some other stuff. I usually also watch Hard Knocks before the season for example.
I missed that. Thanks for the correction.
The legislative branch has delegated extensive 'policy' and 'rule-making' (arguable legislative) powers to the executive agencies, though vague statements in legislation, and broad interpretations by the courts. The same 'deference' which has allowed HHS to re-sculpt Obamacare on-the-fly is what gives the FBI, CIA, and NSA the authority to pursue these massive surveillance programs.

As a result of the tacit support the courts and legislature have given the executive agencies in the past, the legislature is now required to affirmatively act to stop most executive actions.

There have been some proposals to require legislation to enact any large change in executive branch rules/policy/interpretations, but there is little support for such measures, as most people do not want to rule back the administrative state, they just want the state to do different things.
It's awesome that nearly 10 years after I came up with MonsterID, it's still going strong. I love those cats.
"traditional" sports are also struggling to engage a newer audience
Loophole's gonna get closed as soon as such service would gain traction. You don't want to rely your business on that
It depends on user action. User flags affect submission rankings even before the [flagged] tag appears. There's also a "overheated discussion detector" algorithm that can also depress the rankings of a submission. I think ranking may also be improved depending on the rate of upvotes (besides just quantity), e.g., if a submission gets 4 up-votes in an hour it'll have a higher rank that receiving 4 up-votes over 4 hours.

Mods can add weight to a submission as well, but from what I've seen of their public behavior on the site, I suspect they're not using such weight very often.
92% of Millennials Do Not Trust Financial Institutions with Money Matters
I was on the market for a smart-watch recently.

I didn't get one because we basically have 3 options:

- Super expensive (more than a smart-phone), 'full-featured" models.

- Mid-range, not-that-useful models.

- Crappy and cheap Chinese products

Needless to say I didn't buy a smart-watch. And I feel that this is the same experience a lot of people around me are having.
According to the best climate models: Mexico, most of the US, Spain, Italy are completely fucked in terms of ariable land. Alaska, Ethiopia and parts of India are projected to be the only real benefactors. When food and water run out, Mad Max will be a comparative fairy tale.

Here's some quality videos by actual climate scientists (trigger warning: science):

https://youtu.be/ntOgBMgENTU

https://youtu.be/8iEj76iX-xE

https://youtu.be/UOm2t3QMR6k

https://youtu.be/iOztwk6bjjU
Actually a good comparison -- if reddit users came around and smashed up the equipment, I would be OK as I would have insurance.

I need "reddit / DDos insurance"
There's a couple different HN APIs you can use to analyze some of the data:

- https://github.com/HackerNews/API

- https://hn.algolia.com/api
This is rather overly complicated and should only be used for test domains you do not care about.

Much easier and very effective is to use the apache2 or nginx config file options to manually disable sslv3, tls1.0 and tls 1.1. Permit only TLS 1.2. If you want to, manually specify the preferred order or crypto.

Any modern browser supports TLS 1.2 just fine. I've done this for every httpd I admin and it has had no effect on reachability.
Yeah that's the thing, hydrogen is the key feed-stock for the Haber-Bosch process. I think currently it's mostly made from natural gas. Though earlier it was made by reacting H2O with coke (coal).

Makes me think about the flurry of ill directed excitement about a catalyst that with energy supplied electricity could convert water and CO2 to alcohol. One wonders if it wouldn't be possible use a similar catalyst to convert nitrogen and water to nitrate/ammonia.
Does love make you stronger or weaker?
It's the same people that believes in creationism, that their bible is an history book, denies climate change and blames hurricanes and earthquakes on gay marriage and now they have won the elections in USA
What can you use this for?
Wouldn't be much of a marriage if it didn't.
EC2 is not a Docker solution. EC2 Task&Service definitions are not Docker Task&Service definitions. So this basically ties to with the AWS platform. You can not move your Docker infra between AWS and Azure. Docker for AWS is the way to go, but I believe it could be enhanced greatly. I also think that AWS does not seem to support Docker Swarm very eagerly, because I think AWS still did not figure out to charge Containers, they are still charging Nodes.
I understood the intent and context. It's not civil or constructive and it's needlessly inflammatory.
In case they get acquired and the product line gets shut down, do you believe there's a chance that the community would be able to keep the devices alive working on alternative firmwares?
Aspera, is the current winner in Bioinformatics. The European Bioinformatics Institute and US NCBI are both big users of it. Mainly for INSDC (Genbank/ENA/DDBJ) and SRA (Short Read Achive) uploads.

For UniProt a smaller dataset we just use it to clone servers and data from Switzerland to the UK and US at 1GB/s over wide area internet.

Very fast, and quite affordable.
Looks like it is abandoned; first commit was June and last September.
Please don't.

We detached this comment from https://news.ycombinator.com/item?id=13076359 and marked it off-topic.
Plenty of teams will want this for dev/test.
I can't imagine why...?

In the news right now: http://motherboard.vice.com/read/new-program-decides-crimina...
They did for mine. I had to send some pictures in and they sent me a free replacement. It was a known issue with the kickstarter version.
Currently, Azure better supports Docker & Swarm.
non-[default] profile seems like it would work. I don't think aws-sdk/boto/etc will use non-default creds if you don't explicitly tell it to.
OS is usually taken to mean kernel + core applications.

Are Explorer and Finder "core"? Probably.
> And it's very hard to change without everyone else changing as well.

Sometimes I wonder if it's just a matter of "if you build it, they will come". As in, if there was a public works style initiative to build green cities from the ground up out in the middle of nowhere, and would enough people reconsider their current situation and trade it for a lifestyle and an environment that is less dependent on energy and other resources?

I've been trying to grasp the basics of 3D modeling and Blender lately, because I have an idea in my head of what sort of 'green city' I'd like to live in. Before I say any more, I should clarify that I understand almost none of the intricacies of city planning, material science, architecture, etc. and I don't want to come off as someone who thinks that learning all that is trivial -- I'm looking at it more as art, I just want to create a pretty model of a city that I can zoom around in from different perspectives.

What I'm envisioning is an dense network of open-air structures separated by wide passageways for walking and biking. The buildings themselves would all be the same height (5 stories maybe?) and the tops of all buildings would be reclaimed as community gardens and interconnected by skyway-like walking bridges. Living units would be minimal and adjustable in size by taking a modular approach [0], with not-so-strict zoning laws that would allow for makeshift small businesses and markets to open up amongst the community. Roads proper might exist once every 10 blocks or so. I'd imagine a city like this would be much cheaper to live in, so that too might be attractive for potential residents.

A lot of what I'm talking about is influenced by living in an extremely population dense area in Phnom Penh, Cambodia. I have about 5000 neighbors living in a 100m radius (seriously) and we all get along quite well. Here's a photo from the balcony of my first apartment here looking down our alley:

https://66.media.tumblr.com/23e3cc103960ec568bdc1a0086e71901....

It's amazing to live with everything you need just a few blocks away, but it would be even nicer if we could integrate greenery and vegetation into stairwells, and reclaim the tops of these buildings as open space for the community. This style of living has allowed me to get by comfortably without a car or moto for four years now, so I suppose that's at least a little bit green!

I hope this doesn't sound like the idle ramblings of a crazy person, but maybe if by some stroke of luck I become very rich, then after 10 years of learning I'll at least be capable of enlisting smart people to help me build a city like this. Or maybe Paul Graham wants to give me a billion dollars? That would be nice :)

[0] https://en.wikipedia.org/wiki/Modular_building
Not just that. FTP sites have tendency to not fail. HTTP downloads are really hard to keep up at 2gb+ over someones wifi. Dropped connections are quite normal and doing the correct resume work is possible but not trivial in practice.
So for files FTP is much better. Especially if the other side is just a script.
We detached this subthread from https://news.ycombinator.com/item?id=13073839 and marked it off-topic.
Maybe not the best solution, but for the js CDN of Google, I'am using a self hosted mirror with this list https://github.com/euh/googleapis-libraries-list

Unfortunately in HTTPS, I need to bypass HSTS protection and for Firefox it's annoying (I don't know for Chrome).

For the fonts I tried to create a self hosted mirror too, but Google does not offer to download exactly the exact fonts they host.
Data Diversity and Cutting-Edge Insight for Sales and Marketing
Data-driven decisions have the power to impact every business area within the typical organization, but none of these functions
carry the potential for game-changing insight like customerfacing sales and marketing.

Traditional customer data housed in a CRM system or marketing automation platform typically form the core of analyses these
days, but more companies today explore the potential of merging and marrying this traditional data with unstructured,
semi-structured, or multi-structured data.

From documents and emails to social media feeds and rich media, companies have the
opportunity to exploit data to develop a deeper understanding of their customers than ever before.

The challenge for many of these organizations, however, is that the variety of data needed for these innovative analyses is often
locked away within other functional areas.

Aberdeen Group’s
research demonstrates that the sales and marketing functions
face an elevated challenge around this silo effect.
That sounds so... horrendously awful.
Always? Without reading the article, sounds like confirmation bias.
I meant elide :)

The article skips over this conclusion while getting rather close. Nobody has really looked at this hypothesis in any depth because of the political consequences of finding it is true.
> Have you ever learned a new spoken language? At first, the learner understands by translating to primary language.

That seems like a good analogy. I underwent that process a few years ago while teaching myself to read assembly, and in the past, other spoken languages.
Yes I'm sure. When coal becomes cheaper as a fuel (efficiency being one path), if that opens up new applications or use by a broader set of customers, it's no surprise at all that total revenue could go up.

As for your example, most sentences are neither true nor false. Nothing interesting has a probability of 0.000 or 1.000.

"This sentence is false" is clever use of language, may be interesting to sophomore philosophy students while smoking weed, but its not useful and there's nothing paradoxical about it.
Does someone know why this is happening? This is not explained in the article.

I'm not American, don't have a TV and don't like sports but I'd like to know why they're loosing so much subscribers now. Is it the economic situation or people found a better alternative to watch sports?
Docker Swarm is a great idea. But I think that with Swarm, I don't have to deal(and see) with nodes (server instances). I would be able to just run and scale services(containers). Scaling with nodes should be supported and done with AWS and Azure behind the scenes.
High-value, illiquid inventory and double-ended marketplace with flakey demand: doesn't sound inherently scalable and risk mitigation seems absent. Good luck with that.
You can download their white paper here: http://tinyurl.com/zg4j3ml
Sign a prenup if that's your deal.