skysight-inc/HackerNews huggingface dataset:
Dislcaimer: I am not fully on bored with k8s and enable clusters that are not kubernetes as well as k8s deployments.

Is pachyderm actually used anywhere though? Especially compared to the hadoop distros?

Why would I use this over just spinning something up on EMR? If I were on prem, I likely already have hadoop installed. K8s is typically a separate cluster (mainly because it's still a bit error prone for anything with data applications, which is I'm assuming what you're claiming to solve?

Beyond that, re: kubeflow. The problem with just assembling some of these things and calling it "production" is you're still missing a lot of the basic things when people need to go to production:

1. Experiment tracking for collaboration

2. Managed Authentication/connectors for anything outside K8s

3. Connecting with/integrating with existing databases

4. Proper role management: Data Scientists aren't deploying things to prod (at least customer facing prod at scale where money is on the table, "prod" could also mean internal tools for experiments), they typically need to be integrating with external processes and different teams.

Many of these things are left as an exercise for the reader (especially in k8s land). Granted, tutorials and the hosted environments exist, but nothing is a "1 click" deploy that is being promised on any of these "See how easy it is!" blog posts that run something on 1 laptop.

A lot of things being promised here just don't line up for me yet. K8s is maturing quite a bit but when the story is still "Run managed k8s on the cloud or spend time upgrading your cluster every quarter" - I have to say it's far from close to anything a typical data scientist running sk learn on their mac are going to be able to get started with.

The closest I've seen to that that isn't our own product is AWS Sagemaker which actually solves real world problems by actually gluing components together in a fairly seamless way.

Let's just be clear here that we still have a long way to go yet. In practice, we have separate teams that need to collaborate. Data scientists aren't going to download minikube tomorrow and go to production without someone else's approval and going through a huge learning curve yet.

We're moving in the right direction though!
Credentials and prizes are heading the way of the dodo because we're slowly realising that while neither knowledge nor significance can be measured our opinions can be swayed by prestige and politics.
No, I am more talking about a standard process of applying security patches (and/or bugfix patches). I'm countering the claim in the article that using containers somehow makes software orgs more prone to "unmaintained" OS's.

I'm saying that has little to do with containers, and if anything containers make it a lot easier to get security updates.
I watched the Falcon Heavy launch with my kid and she was gob-smacked. I don't remember anything like that growing up.
A more charitable example of a valueless idea would be my idea of a jewelery company that takes you through the process of forging your own engagement or wedding rings. For something that sentimental, I think there's a lot of people who would appreciate being able to say they did more than just drop down a few thousand dollars on a jewelery store counter.

But, making goldsmithing accessable to the general public would probably be a very difficult business to start even for someone experienced. How do you cheaply train up random people to get good results? Maybe with the right equipment and expert guidance, people could do it. However, the research and design that would go into putting that workshop and program together would have to be pretty extensive.

Hence, as good as an idea as I think it is, it's valueless without a detailed plan and some actual validation.
I think Tim Cook was talking as a CEO rather than a liberal when he praised Trump's tax cut. Very few CEOs would have the luxury to do otherwise, except for maybe Gates and Buffet.
Flatpak was designed for packaging desktop applications, but it seems like it would fit your needs reasonably well.
>> In order for you to win someone else has to lose.

Please explain why this is necessarily true in the stock market.

You buy X at $Y. Then sell X to me for $Y+1. You won.

I then sell X to someone else for $Y+2. I won.

Hence in that transaction, we both win.
No it isn't? It's an argument for holding international indices too, not just S&P500 exclusively.
KISS and Occam's razor?
My startup is actually targeting tracking "insiders", currently the working project name is a bit different:

https://projectpiglet.com/

Although I have parked the "insideropinion.com" domain: http://insideropinion.com/

It turns out, that although there are a lot of insiders trading, people on the internet love to talk about their companies. Recall the last time you saw, "I work at Google?" on Hacker News?

That being said, I use it to trade regulrarly and similarly make money. Although I would reocmmend diversification as the top comment here currently says.
The bonuses were actually a crass tax arbitrage.

1. Issue bonuses at end of 2017, push out tax obligation into 2018
2. Mush into newer, much lower tax rate

There is a reason they chose to issue bonuses and not raises.
Ask HN: What's your salary / hourly rate?
Seems like it's been a while since this was asked. Curious as to changes in the market.
Sure, an index fund may win over time, but part of what a hedge fund is supposed to do is to hedge against the market. A lot of hedge fund customers are pension funds, people close to retirement, etc. For these people, the long term health of fund is of course important, but they can't afford the volatility - if their investment loses 10% of its value in a year, they may not be able to make the payments or subsist on the income as much as they wished.

As a result it's not really fair to compare the long term performance of a hedge fund with an index fund. Index funds are more aggressively invested and thus more volatile.
My input: 75/hr, UX designer.
I’ll admit that it’s not something I’ve verified, just an argument I’ve seen in favour of thise practice elsewhere, but it makes sense.

If a browser already has https://code.example.com/blah.1.0.0.js in cache, wouldn’t it just use that instead of loading it again?

Edit: This post from StackOverflow lists a number of benefits, most of which will result in better perceived performance when using Google’s CDN vs hosting jQuery yourself: https://stackoverflow.com/questions/2180391/why-should-i-use...
Follow up: "Nix for Data Science"?
Well shoot, somebody better tell Elon that. :)
I can't figure out what this is from the about page...

>> The project aims to radically change the way Web applications work today, resulting in true data ownership as well as improved privacy.

What is the product? How does it achieve its means?
> If the roles are mixed where you are being paid in stock then it should he fair.

Yeah and I think that's fine. Whether you are investing sweat equity or capital shouldn't matter. But if you're an employee getting paid market rate with a nominal slice of equity then you really shouldn't be talking with the board unless there is some sort of misconduct, not merely because you disagree with the product direction or whatever.
Chris Alexander’s Timeless way of building and Nature of order
Robert Pirsig’s Lila
Hah I applaud you for writing all the details. I have to agree that in some cases using Docker doesn't really do much anything at all. When speed and productivity is on the line at times it's better to just stick with the old ways. I'm sure some Docker-genius might be able to streamline that process a bit but agony-wise it might not matter.

To me Docker serves as a sure way to get programs work regardless of the OS while also being composable to end-user needs. Also they should be easily portable to cloud/production environment. The purpose of containers was in the first place handle complexity at scale with some performance benefits.
I think a better solution would be a negative tax rate instead of a 0% tax rate.

Imagine: On your first $24,000 / Year, you are taxed at -50%. This means, if you make $12,000, you get paid an additional $6,000. If you make $24,000, you get paid an additional $12,000. This is an additional reward for working! We want to incentivize working!
Self-driving trucks that make 95% of the route on highways automatically, and only take a driver for a couple last miles and the loading-unloading operations would still be a huge disruptor.
I don't think those are invalid points, but one consideration is that if a standardized format for encapsulating and controlling PII did emerge and was adopted, the value of the previously-released personal data would decay over time.

That is, if your current PII suggests that you are a fan of (Brand X) right now, it is more valuable than if it shows you were a fan of (Brand X) 5, 10, 20 years ago. There will still be correlations that can be drawn from historical data, and some data's value doesn't decay as a function of time (DOB, for example), but it would still be an incremental improvement over the current system.

As technologists, I don't think throwing up our hands and saying "It's too [late|difficult|expensive] to solve this problem!" is the right solution in most cases.
The Wired article you link discusses Nvidia hoping to deliver a system with lower power draw.

I think the intro kind of overstates the downside. Lots of people will be happy to pay for more fuel if it means they don't have to drive.
Hey, great minds think alike. It's truly a compliment and kind of nice to have TBL on your side!
The entire point of a hedge fund is to do this for people, for a fee. An index fund, on the other hand, is simply a direct purchase of stocks. 95% of Americans should not be blindly investing in indices because that would completely divorce the index constituents' valuations from their fundamentals - and as a result, when this is corrected, a lot of people would lose a lot of money.
OK, but what about the (many) hedge funds that are volatile? There are indeed funds that are better than index funds, but they're inaccessible to the average person, and therefore irrelevant.
Wishing that the landing page had a clearer explanation of how Solid provides a means for the owner of the data to control who can access their data, people and applications, as well as what the process of moving ones data from a given store to another.

This project looks like it has huge potential, I just want to be able to understand at a glance what privacy controls are in place without reading the source code before committing my personal information.

EDIT:

Found the specifications documentation linked to from some of the example apps[0][1]. It would be great to have more of this information on the landing page for the project.

[0] https://github.com/solid/solid-spec

[1] https://github.com/solid/solid/blob/master/README.md
Can anyone explain what this actually is? I get that it's apparently an exciting new project, but what actually is it? A framework? A programming library? A data specification? I honestly can't tell.

They refer to "applications built using the Solid stack" at one point, which implies that it's an application platform. But elsewhere they talk about how it's "a proposed set of conventions and tools", which implies that it's an interchange data format.

What am I missing?
This Criminal Obama Official Thinks He Can Beat Trump in 2020
Ironically, the evil businessman Bill Gates was always a nice guy. I had several business meetings with both Steve Jobs and Bill Gates and they were on the opposite ends of the spectrum. I was on the same dais with Jobs at a conference and had a personal dinner with Bill in Tokyo. Steve was the biggest ahole on the planet while Bill was very personable.

So I am convinced that Bill's current good deeds are reflections of his inherent personality and not related to his business persona.

P.S. Sorry about the name-dropping.
Less traumatic, maybe, but that still seems unpleasant. You go from this nice, calm environment, with basically zero need to do anything for oxygen, nutrients, waste, etc., and are thrust into blinding lights and noises; suddenly you must breath with lungs (after coughing out all the liquid filling them), the temperature is no longer always perfect, you promptly get to experience hunger and have to scream to be fed... Sure, C-section skips "get shoved forcefully through tiny opening" at the start, but you're not skipping that much.
A Tribute to Paul Pierce, ‘a True Celtic’ – NBA Countdown – ESPN
720p Netflix on Firefox on Windows takes less than 1% CPU for me, and I'm not sure which process it is, because they're all less than 1% CPU.

GPU usage, per Process Explorer, is somewhere between 1% and 7%.

The Firefox addon to force 1080p takes it up to about 2% CPU and 9% GPU. Maybe. It's hard to tell, it's usually below that.

Basically, it's a rounding error on a machine with properly set up decoding pathways.
And, as if to further illustrate the problem with dysfunctional WWW stuff, the ony way to comment on that article is via Disqus...
> but calling it a failure is quite hyperbolic.

as is claiming that Scala is a failure. If adoption and widespread use across industries (big data, hardware, server, web, etc.) is any indicator of success, Scala is just that.

The reality is that both languages are excellent; if you work in either for the day job you're fortunate -- there are far worse languages out there.
You should checkout my startups blog post on causality in cryptomarkets:

https://blog.projectpiglet.com/2018/01/causality-in-cryptoma...

Basically, we used it to generate pretty awesome returns, and we bias our "trade potential" advice towards reduced risk: https://projectpiglet.com/

It was easy for us to rack up some nice returns:

https://blog.projectpiglet.com/2018/01/30-weekly-returns-usi...

All that being said, I personally limit my exposure to volatile assets - so I wont put more than I'm willing to lose in cryptocurrencies, and regularly pull out profits.
What did the noble laureate economist among others tell the Google employees before they came into their IPO wealth? Yep, the “dogma”

http://ritholtz.com/2014/02/the-best-investment-advice-youll...

”One by one, some of the most revered names in investment theory were brought in to school a class of brilliant engineers, programmers, and cybergeeks on the fine art of personal investing, something few of them had thought much about. First to arrive was Stanford University’s William (Bill) Sharpe, 1990 Nobel Laureate economist and professor emeritus of finance at the Graduate School of Business...”
Extra 2.5kW for prototype cars?

I think it will halve as the tech progresses, just due to optimization. Also, no windshield means better aerodynamic possibilities that could compensate for the loss.
> We introduce a malware

How do you get malware onto one of these things? I guess social-hacking could be used but if you have that then no technical solution is needed.
This really strikes a chord with me. For as long as I have lived in the US I’ve strived for a bigger, fancier house, better car, more toys etc. and now that I’ve gotten to a comfortable level of all of that, I realize I’d give it all up for the benefits you mention. The grass is always greener as they say but it’s awfully tempting.
> How is he proposing to pay for UBI aged 18-64?

Everybody currently aged between 18-64 who is not living in poverty or is unemployed is already receiving that amount of money (or more) from her/his employer.

Hence, as a cheap palor trick you could just relabel part of the paycheck as UBI (so the money is there). In addition, you could then subsume most social services inside a flat amount, saving money in admin overhead.

The hypothetical counter argument is that lots of people would not work if given UBI. This has been shown to be false when tested. Also, social services in Germany and many Scandinavian countries are not that far off and these countries do not have 50%+ unemployment.
The tax breaks for the middle class are only temporary. Most CEO's are praising them because it's great for them and shareholders. Most CEO's acknowledge they will use the additional profits to perform share buy backs.

While the middle class got something, the majority went to the wealthy, and as per my previous comment on shares, they are not going to be flooding it back into the economy.

Also US corporate taxes were about median for the world, they were not absurdly high, you should check out some countries in Europe for that.
While there are a lot of positives for the tax reform, and US corporate taxes were insane by global standards, passing a revenue-negative tax reform during a deficit is fiscally irresponsible.

A lot of the negative press the tax reform got was based on a lot of highly ambitious parts that fortunately didn't make it into the final bill.
I'm not sure either what exactly this is, but it reminds me of https://blockstack.org/ when it comes to each user owning their own data storage which the app runs on.

Blockstack essentially lets you pick for example Dropbox as the datastore and an app would save files in a directory on your Dropbox instead of a server controlled by the app developer.

Solid seems to talk about also keeping track of your social connections. So I suppose it also tracks people's profile data and public keys locally?
How much of this subsidy will be captured by workers, vs captured by employers?
What happens when it's the opposite direction? I've seen board members contact employees and try to influence their opinion in an attempt to persuade the CEO about one thing or another. When a board member or major investor asks you out to lunch, it's very difficult to say no. It's bad and puts everyone in an awkward situation, since you as an employee may not have the full story.
Not immediately, as others have pointed out, but those who develop products that incorporate this approach, and those who embrace it swiftly, will provide us choices.

For example, if "MeWe" were to incorporate this I think they would grow faster and at some point put enough pressure on Facebook to do the same.
The stupidest era of all time
Remember circle?
I see this as another welfare program and we already have too many welfare programs.

If we all see that automation is or will be a problem for the labor market, isn’t it makes more sense to get the labor market ready to embrace the automation era?

Instead of making our youth going through college, why not have them sent to learn a craft or skill set?

I personal think only those who are good with school and like school should go to higher education. For the rest of us, a 4 years experience with no debt is far better 4 years education with 50 to 100k in student loan debt
not sure how trusting the guy who messed it up in the first place is a great idea
Great advice. I have Fidelity. What are the equivalent low-cost funds would you recommend on Fidelity?
I couldn't find a link to the GitHub on the page, but that appears to have a lot of useful info as well.

https://github.com/solid/solid
Of course Wikipedia holds the answer. I should have known.
The second they said "we're not fixing that" it became conscious deliberate inconsiderate abuse. That was a typical and awful response to that bug report.

The original poster essentially pointed out some bad engineering. "it works for most people" is an utter crap response to that.
Interesting observation. My impression was different - they do not reject or fight technology itself - they just take it as common, uninteresting part of life, which makes sense if we assume that at their time, Federation technology got into highly evolved saturated state where it did not change much for decades. The real focus of TNG is on people, exploring the new places, human relations, prejudices, ethics, that kind of stuff. It is really about an optimistic vision of the future of the western society. The hi-tech environment greatest role was that it attracted geek viewers and made those difficult topics easier to get exposed to.
If there is a guide or a book for taking an interview, the interview has already failed and is measuring the wrong thing.
Back in the early 80s when Reagan was decrying welfare and it's costs vs. benefits he joked that it would be cheaper for the U.S. government to abandon the relevant federal agencies and just send recipients a check each month. Full circle I suppose.
Cuil, more feel-good-divisive placebos to distract from the actual problem of being burned alive by the FIRE.
When you absolutely can't go to the law for help, you make sure to cover your ass really well.
Not only is this a nice demonstration of the power of open data, it’s also very exciting for a whole range of material science research.
> "If it weren't containers it would be a new programming language, framework, or another agile methodology. Your argument has very little to do with containers."

Agreed, containers are just one way to package software, they aren't the be-all-end-all when it comes to making software modular.

One example of a modular design abstraction that does not rely on containers is the data access layer ( https://en.wikipedia.org/wiki/Data_access_layer ). The idea being you can design a service that sits on top of a data store (whether that's a RDBMS or otherwise), that encapsulates the core business logic that you want the applications in your business to adhere to. This data access layer can potentially be shared by differing applications. The implementation of this does not rely on containers. Also, just in case "data access layer" (DAL for short) seems like a corporate IT term, I'd say the best tool I've ever seen that's used to build DALs is GraphQL.

http://graphql.org/
Apple sold more watches in Q4 2017 than the entire Swiss watch industry
Unless he set the fire, this story is absolutely false.
Thanks for the info. I totally forgot Hangouts was still using an NPAPI plugin, and I didn't realize Firefox dropped support for those too. Doesn't explain why Safari wouldn't be supported though, as Safari still supports NPAPI plugins.
Is this XEM activity abnormal?
See this NPR[1] article which listed the previous US corporate tax rate as the highest of advanced economies. This included France, Belgium, Germany. Also fun fact, go visit Dublin and see all the tech companies (Google, Facebook, Microsoft, etc) who have a Europe HQ there. The reason, they have a 12.5% corporate tax rate.

[1] https://www.npr.org/2017/08/07/541797699/fact-check-does-the...
I think there's a second, much more complicated problem looming on the horizon. Big quant, data-driven hedge funds are able to make sense of public data in ways that retail investors, and even old-school institutional investors, cannot. I'm talking about things like predicting crop yields, predicting quarterly revenues, or just seeing complex multivariate trends that others don't.

Clearly it's not technically insider trading to trade on your analysis of public data, so it's not really insider trading to tell others (e.g. friends, or "yourself" if you personally trade using information you gleaned from work) about the information. But functionally, it pretty much is insider trading, because you might be the only person in the world with that knowledge.

I'm curious to see how quant investing holds up over the future. Currently, retail investing is disadvantaged compared to institutional, but not so much that it's a waste of time altogether. Quant strategies will widen the gap. Hopefully average people will have the ability to invest in quant funds so they don't get left in the dust.
Children Hurt Women’s Earnings, but Not Men’s (Even in Scandinavia)