skysight-inc/HackerNews huggingface dataset:
Shopify | Data Engineer | Waterloo | FULL-TIME ONSITE http://shopify.com

Shopify is a leading multi-channel ecommerce platform that allows entrepreneurs to sell online, as well as in store using a POS, or through many other channels. Shopify Plus is an enterprise level offering that is tailored for high volume, high growth merchants, with features such as a wholesale channel, custom checkout, scripts, exclusive apps and APIs, as well as dedicated merchant success managers. Our data stack is built to support internal as well as merchant decision making.

We are looking for a data engineer to join our team in Waterloo, where you'll get to work on many aspects of the data lifecycle, including extracting data from source systems (relational databases, Kafka topics, external APIs), transforming the data using PySpark, leveraging our petabyte-scale HDFS data lake for data modelling as well as machine learning, and providing value to different stakeholders through preparing relational views in Presto/Redshift and dashboards/visualizations for easy consumption of key insights, as well as feeding insights back into operational systems.

Job Posting: https://jobs.lever.co/shopify/7887b412-23f7-46e9-9114-517b24...
The old taking the vigor of the youth; what an apt metaphor.
I don't think the ability to lie to government agents is a good argument against a law that allows them to ask for that information. At best it gets you enhanced scrutiny, at worst you go to jail.
I might be a bit. Although, I don't feel like it's too far from the kind of misuse we've pointed out with nonce re-use in AES-GCM or nonce re-use in DSA/ECDSA.

Anyway that was my point! Just wanted to write it up :)
> Can I flag you? Yes? Oh, there's the link. I just flagged you.

And you are holding speeches about tolerance??

How tolerant about different views are you? Or are you just misusing your power?

So much about the "tolerance of the self assigned tolerance watchers".
Now you too can have your own blood boy. Careful that your donor has good habits, or your cholesterol might go through the roof. At that rate, you might die by 120!

For those of you confused, it's a reference to a recent episode of Silicon Valley, which actually covered this.
All of the 'science' links reference studies on plasma - and their website even. https://www.ambrosiaplasma.com/ . So they are using plasma, which it's legal for a person/donor to sell.

Is there any way to find out what blood-banks, and if it's disclosed to the donors that this is where the blood is going? I'd donate to a donor awareness campaign for these blood banks.. If they are not disclosing, I suspect their donations would take a hit if people found out their donation might not go to burn victims or cancer patients, and instead go to modern day Ian McCandless's.
Their website looks like it was designed in FrontPage 2002: https://www.ambrosiaplasma.com - The whole thing is super weird. As someone who has an interest in transfusion medicine, I would absolutely not do this.
Well, if you are on a trajectory of a 30-year career job at one company with little to no changes in your income but adjustments and raises, then you probably don't need such a community. But judging based on Boggleheads forums, there's a need. Yearly re-balancing, changing your goals, windfalls, unplanned expenses, adjusting for tax efficiency, switching jobs, re-doing your portfolio because you did it horribly when you started, helping others who have a messy portfolio, and of course, the many questions every n00b has when they start.

Of course, Boggleheads would do just fine for any of these, but more options never hurt.
I completely agree with this. While I could (and have) done due diligence into a valuation of privately held companies in order to understand the value of a stock option, once you get to the later rounds there can be so much change to make any previous valuation calculation moot.

I really enjoyed the TL;DR stock option visualization earlier but for unicorns it would be a really interesting exercise to walk through various 'liquidity events' and their value and see the various percentages that went to which investors.
Let's please not do this here.

https://news.ycombinator.com/newswelcome.html

https://news.ycombinator.com/newsguidelines.html
Through, if you change the country without partner and basically expect her/him to follow without caring about her/his options/preferences where to go, then you are definitely not a marriage material.
Yes, but the counterparty risk - in case of a real crash - is pretty high IMHO.

Anyway, a couple of ways to do so:

You can short BTC using "USDT" on poloniex: https://poloniex.com (USDT is a cryptocurrency theoretically pegged to the USD, but their peg hasn't be very stable lately)

Another way, which could in theory be better (or not) is using options: https://www.deribit.com/
Do the latest builds support fonts with ligatures? [1]

One of the reasons I switched from Sublime to Atom was exactly that, but I'm willing to switch back since I've yet to find an editor as fast and lightweight as Sublime.

[1] https://github.com/tonsky/FiraCode
Please can you elaborate on your concerns with Segwit ?
> ... helping Covfefe supporters?

Dangit man!!! I snorted cola through my nose! You have any idea how much that stings?
Yes, the info I was missing, which you provided in your first reply, was that zxcvbn does use word lists. I should have acknowledged that in my reply, thank you.
Did you read any of the posts, or are you just copying your own old posts?

You also don't know me and you are just doing some guessing game here.

Just posting good sounding shallow words, is not enough (to get high marks here, it is, but that is nothing that makes better humans, I regret to tell you)
Usually in entropy estimates you assume the attacker has full knowledge of the password generation method used. (Kerckhoff's principle.) In reality, most attackers won't know what generation method you used, but it's better not to rely on security by obscurity when it comes to passwords.
Buy in bulks with discount. Pay to Swiss accounts. :)
do you want free blood? are you a communist European?!

...now grab the popcorn and see how the people against free healthcare is going to rationalize a defense for this.
I would add though that the HN community at large, when we do slide into politics, does have by far and away the most interesting discussions on that topic I've ever read. There's no comparison to Facebook IMHO.
Wow, adding Keras support is really slick! It's nice to be able to use Keras with a few different back ends.
Excel is the appropriate tool for one-off adhoc analysis.

When something needs to be regularly produced, then and only then should it be moved to a formal BI solution.

People have a lot of questions and Excel is an approachable tool for small analysis that users can self-serve with.
Judge Orders Cornell to Review Tenure Denial for ‘World-Class’ Professor
I don't know what would happen there. If you can convince them that you truly have none, you should be fine, but they may be hard to convince. Immigration officers can refuse non-citizens entry for almost any reason.
That's like a Google tax, with the plus that you consciously agree to let it track you more than ever... wtf!
The much more interesting question: what if it doesn't?
> I'd really love to read a modern book or in-depth tutorial on creating a statically-typed functional language, with discussions on pattern matching, type inference, tail call elimination, ADTs, etc

I'm interested in that too. I've heard good things about Appel's book [1], but haven't read it yet.

> There are so many great books out there on how to create a lisp, or a typical mutable object-oriented language

For what it's worth, I haven't found much about creating object-oriented languages. There's a lot on Lispy dynamicall-typed languages, but I haven't seen much on things like method dispatch, vtables, inheritance, etc.

One of the reasons I'm writing this book is to try to cover that. Even if you don't like OOP languages, I think it's worth knowing more about how they work under the hood since they are so prevalent in the industry.

> I've started writing my own in-depth tutorial on this subject using Scala as the implementation language

Interesting! Is it online yet?

[1]: https://www.cs.princeton.edu/~appel/modern/ml/
Anyone watch the Strain? http://the-strain.wikia.com/wiki/Eldritch_Palmer
i.e. medical researchers know how to add control groups for placebo effect, amateurs do not.
I think the problem of the sale of blood isn't people not getting paid fairly for their blood in the purely economic sense. There's no reason to think that the "full worth" of blood is that high since producing blood is pretty common "skill".

The problem is abetting those desperate to sell their blood and body parts are going to be abetting the downward spiral such people tend to be on. The most blood donors are homeless and drug addicts. Donating blood doesn't make someone more able to find a job, housing etc because it's a literal drain on their vitality.
Thank you! I put more time into this than most people probably realize.
I imagine that this will make some new WTF moments in web development, when my code will be considered as "bad ad" and removed from DOM.
>package management

Sublime has greate package management, don't see a problem here. Package Manage is now part of the app, works great too.

Same for theming tools (Unless we are talking about something different than being able to theme the app\syntax and work with your list of themes.)

Not sure what "social" is though. Sublime has forum and packagecontrol.io \ github repos what else do you need?
Because they do so much work upfront for you. I worked in algorithmic trading for a bit over 10 years but left in 2014. I spent a few months in my spare time building out a trading and backtesting platform, pulling data off of yahoo finance, connecting to Interactive Brokers via their C++ API, etc. It was all very slow and tedious, and during my googling one day, I come across quantopian. I felt like an idiot- they already had free access to morningstar with a decent API around it, tons of other datasets you could subscribe to, and a fully fleshed out backtesting platform with risk measures, pretty graphs, etc.

It would have taken me months-years to get to that point. Shortly after they also included integrations to IB and Robinhood so you could very easily take your ideas and actually live trade them. I immediately stopped development on my trading platform and just started using Q's.

Q could potentially take my algorithm and start using it themselves, though they actually put money into algorithms they think are promising and share the profits with you. That's a small risk IMHO. Hackers and the like... I did this stuff for 10+ years. People WAY over estimate the value of this code- you have an idea, you backtest, hope it works, and then you put it in the wild. I have never seen an algo that is a real guaranteed money maker (aside from arbitrage/hft stuff). What are these hackers going to do when they take a 10% loss one month and don't understand why? Some "signals" can be used in-line fairly generically with other algorithms to enhance their performance, but I will still bet on the guy that knows/understands the algorithms to not lose his shirt, then some hacker dude that likely has no capital to begin with and may not even understand the basics of financial markets.

One thing you seem to overlook is that it is one thing to go buy a bunch of historical data off ebay, but you need to constantly update that if you are going to live trade- Q handles that part as well.

If I was looking to make a business out of this, I would build my own platform. But using it as a research platform to invest my own money, Quantopian is awesome.
I stand corrected, it was 71.4% The 90% from NYT stood out in my mind.
Or, like myself, really truly doesn't have one.
That's not necessarily a dangerous assertion. SHA-2 is theoretically immune to foreseeable improvements in computational power. If you use something like SHA-512, a birthday attack will require searching through approximately more candidates than there are atoms in the observable universe. You can't meaningfully improve this by scaling up inordinate amounts of computing power.

If you can't rely on raw computational power to force obsolescence, you need either a major paradigm shift (a la quantum computing) or a clever cryptanalytic attack that bypasses the actual difficulty.

Quantum computers do not currently pose a serious threat to SHA-2. Grover's algorithm can offer a quadratic improvement to collision identification, but not an exponential one. That's impressive, but not enough on its own.

That leaves the last category, which is a clever cryptanalytic attack. This is possible, especially with novel mathematics. But it's not reliable for predicting risk.

So really, the only "future-proofing" we can do for SHA-2 is against vague improvements in the underlying math. In any practical sense of the term, it's not a dangerous assertion to claim SHA-2 may never be broken. As Thomas said, research will certainly continue on cryptographic hash functions regardless; moreover, "improvements in math might happen" is not reliable enough to calibrate forced obsolescence or regular updates to hash standards in the future.

Given the foregoing, some researchers choose to act as though SHA-2 will never be broken, because there's no meaningful way to assert that it probably will or to coordinate when or how it will, and because there are so many more productive areas of research to focus on where the current algorithms absolutely will be broken in the future. You can't productively work on future-proofing something any further once the space of coherent threats has been reduced to, "this might happen in the future somehow" without real specifics.
I played around with this the other day. I have a spreadsheet with a bunch of columns. It wasn't immediately obvious how to use the explore feature intuitively. It graphed data but not really the ones I wanted. I was also hampered by it using only about 200 pixels on the right side of the screen.

I started typing in a question but it couldn't guess what I was interested in. YMMV. Perhaps with a fairly simple spreadsheet you can intuit things? Back 10 years ago I built a google spreadsheet competitor called Numbler (well, I didn't know if was a competitor, google sheets came out a couple of months later). But one of the things I learned is that people use spreadsheets for just about everything, and it can be in the wierdest format.
The advantage is that you financially support the creation of content you value enough to read.
Scaling Elasticsearch: 1M Writes per Sec
I learned the hard way to always be prepared to
move on.

This bears repeating. I have had many jobs, and a lot of them were great jobs. Sometimes for whatever reason, you need/want to move.

It is quite often out of your control (e.g. the company is in trouble and they layoff your entire department or cancel the project you're working on) and even in socialist Europe there isn't really such A thing as job security (outside of the public sector anyway).

Even huge succesful companies like amazon/microsoft/google/etc sometimes have layoffs. Or they become less succesful for whatever reason you couldn't predict ahead of time and then have layoffs. Or they merge/buy another company and get rid of redundant/duplicate positions.
>without paying any attention to the result of the experiment.

The results are not relevant to my criticism of JM's specific essay:

He's misrepresenting the people who don't want politics discussion as "ostriches". The extra nuance he ignores is that many HN'rs acknowledge the pervasiveness of politics. Many also desire political discussion -- but not on HN.

He equates "avoidance of politics" == "politics not important fingers stuck in ears"

His essay does not address the issue of "avoidance of politics" == "avoidance low-quality emotional posts".

By omitting the full nuance of the opposing position, he's distorting the argument in his favor.
Presumably more is always better, but there's a very long tail of passwords so the hit rate will drop off a cliff, and now you're storing 5x as much data for increasingly questionable benefit.
The important feature is Keras compatability (although it doesn't seem to be in the official repo yet: https://github.com/fchollet/keras/pull/6800)

In terms of "how is CNTK better than TensorFlow," CNTK trains 5-10x faster at minimum on pre-2.0 LSTM benchmarks, which is big since LSTMs are used for a lot nowadays. (https://arxiv.org/abs/1608.07249)
yes, that is the book by Ash Maurya.
Branded Links: A Novel Way to Showcase Your Brand
HN rules are: full tolerance for differing opinions. No tolerance for low-quality or uncivil posting.
>many more contributors

Which is not always results in something good tbh.
The Go scheduler – Morsing's blog
Glaring omissions:

11. Security vulnerabilities and attacks (and the fear of them)
12. Technical debt
Nice. I see that on your profile page too. It is pretty easy.

I also like to use wildcards. hn@firstnamelastname.com goes to my single mailbox, but with headers intact.

Can really where the spam and affiliate stuff comes from, especially over the years, not just a few weeks.
How Will Marketers Use Big Data in the Future?
My grandfather's dad died in the coal mines. They dropped his body off on the sidewalk infron of the house. His mother married two more times and the other husbands also died in the mine. My grandfather then worked from age 7 to 21 in the mines. He died at 88 from Black Lung induced Lung Cancer.

Yeah coal mining sucks.
How is this not charity fraud?

If I donate to earthquake victims, I expect at least a portion of my donation to end up in the hands of earthquake victims.

If I donate whole blood to help those with medical needs, then I expect at least a portion of my donation to end up in the bloodsteam of someone with a genuine medical need.

The US has outlawed paid whole blood donations, so EVERY whole blood donation in the US is an act of charity.
At some point regardless of feelings you just shouldn't be 100% committed to some else's project, of which you have very limited control (if at all). You can be 90% committed and a professional and still get a lot done and do great work.
My Thoughts exactly. If it would repalce cash money, that would be a good motivation on top of that, as they might control the anonymity of transactions. I don't think they'd need >50% total, if only inland transactions are concerned (as would be the case with any other payment system, without further assumptions)
I think the difference is that inflation also involves goods that are consumed or desired for their direct utility. Not just "stuff I can resell for more later."
Yeah, same here, mortgage is huge in these expensive areas. But having the house paid off is part of our FI plan. That's probably not true of the more hardcore FI crowd. They believe, rightly so, that stocks are better investments than a house and that a mortgage is basically just free investment money. I don't disagree, but I want to own a home ... just cause. So our investment portfolio is definitely real estate heavy :P I sort of balance it out by having less in bonds and more in stocks compared to the Boglehead's advised ratios (I don't see the value in having bonds for an FI plan anyway, but perhaps I'm just misunderstanding something?).

EDIT: See my edit above; I realized I forgot to clarify that my $24k/yr figure was excluding mortgage.
We detached this subthread from https://news.ycombinator.com/item?id=14469497 and marked it off-topic.
And they also have builtin support for 1-bit SGD. Compresses a model "down to 1 bit per weight" [0]. Seems to be a general technique for model compression, but it's nice for deployment to have it built in. This also doesn't seem to be a new addition to CNTK, just something I didn't know before.

[0] https://www.microsoft.com/en-us/research/publication/1-bit-s...
https://en.wikipedia.org/wiki/Narcissistic_personality_disor...
> And I guess, you are just plainly the smartest person in the world.

Aww, blush <3.

;).
"Getting started with Raspberry Pi" is a wonderful introduction to systems, Linux, and IOT projects. Super approachable language, but also quite complete.
Aside from a few cryptographic details (like which elliptic curve to use), this system is identical to [BitId](https://github.com/bitid/bitid). BitID is already being deployed in the Bitcoin ecosystem. For instance, you can see it on the buy/sell service [Glidera](https://www.glidera.io/loginbitidqr).

One benefit of doing this in the context of Bitcoin is that users already have mobile apps that can manage private keys (with backups) and scan QR codes. With Bitcoin, if you lose your keys, you lose money, so there is a tremendous incentive for both users and wallet authors to get this stuff right. Using the same technology for logging in an easy next step.
I interviewed with them and received an offer in the past.

They changed their name from Weeby (weeby.co) to Blackstorm.

They claimed the same salary range and said they would "meet" my requirements. They ended up offering 120k which was far below my requirement and wasted a lot of my time and energy with them.

I'd stay away from them. When I asked them about the low ball offer, they claimed I could earn "raises" every month, all the way up to 220k.

I commented about them before on another "Who's Hiring" thread but it appears their comment has disappeared. How interesting...
Show HN: Strukt – a visual shell for tabular data
KeyChest – plan and track for 100% HTTPS uptime (Free service)
Sorry but it's really rare for someone to spend that kind of time on app and not be laughably out of date. I walk into engagements all the time and solve trivial performance issues and bugs that have befuddled the old hands for years, because they just haven't seen any variety or fought any hard bugs. Maybe you're the exception.
Standard Oil only maxed out at 90% market share. US Steel only reached 60% of the steel market. There were banks other than JP Morgan. A more nuanced view of monopoly has to do with how much power they can wield in the markets.
Oh oh. Young me will get into trouble again:
https://bytes.com/topic/c/answers/214712-using-return-parant...
Additionally, the primitives used in the SHA-2 core are well-enough understood and accepted that for SHA-2 to be broken, pretty much all the hashes are going to end up broken --- is how the rest of the logic would go.

(This is, I think, JP Aumasson's argument.)
> I mostly use hashes as part of signing/verifying small messages, say an 80 byte JWT, a Blockchain transaction, a certificate, an TLS/SSH packet, etc. Besides hashing large files (which I rarely do), I don't see where I would reach asymptotic performance, or even use tree-hashing.

The number I used is definitely not the best one. But I believe it applies to you as you're not hashing a lot of bytes so you will not see much of a speed difference between hash functions.

> SHA3's block size is 200 bytes, KangarooTwelve's is, if I'm not mistaken, 8192? I'm more worried about not even filling the first block :)

They have the same block size :o rather 8192 is the threshold before you start using the tree hashing mode. This way if you want to hash small messages you do not get a penalty from using KangarooTwelve! It's all good :)
This leads to go code being roughly as messy/clumsy as C (or whatever else) code in the sections that need concurrency and also need to change namespace. That's unfortunate, but I don't know that it really "raises a few eyebrows".

I mean, what's the better alternative to Go for this work? Maybe Rust? It is, at least more controllable at a lower level...but, not as easy to pick up for people coming from a C/Python/Perl/Ruby systems and ops background. I'm not saying one should use Go for containers/namespaces programming, but a lot of people are with some success (probably also banging into the namespaces issue now and then), I'm just saying it's not obvious to me what the better alternative would be.