skysight-inc/HackerNews huggingface dataset:
Lyft | Software Engineers - Data Platform Reliability | San Francisco, Seattle | ONSITE | https://www.lyft.com/jobs/4018514002

Data is the core of our business at Lyft helping us create an exceptional transportation experience for our customers and providing insights into the effectiveness of our product & features. To support this, we operate an extensive big data infrastructures in the AWS cloud. In addition to relying on big data compute engines like Hive and Presto, we also build an ecosystem of tools and services that allow all Lyft teams to leverage the platform as a cohesive service.

Experience & Skills:
- Extensive programming experience in Python or Go
- Passion for building tools and automation to make infrastructure more robust
- Experience working with public cloud platforms (e.g., AWS, Google Cloud Platform, Microsoft Azure, etc.)
- Experience designing, debugging and running fault tolerant large-scale distributed systems
- Hands-on experience with Hadoop (or similar) ecosystem - Yarn, Hive, HDFS, Spark, Presto, Parquet, HBase, Flink, Kafka, Kinesis a plus

We are looking for senior engineers with past roles in Site Reliability Engineering/Production Engineering to take our Data Platform to the next level.

Reach out to me at rsharma@lyft.com or @_ravisharma_ on Twitter.
Google/ITA. https://www.google.com/press/ita/faq.html
ESID, but some rural areas really, really need the jobs that would be created a lot more than the sentiments of a handful of people who don't want to move. In such cases it's in the community's best interest to displace holdouts in order to grow the local economy.
Ditto, thanks for sharing the articles.

For a trivially small set of mapping data, I like using VALUES to create a "virtual" staging table:

UPDATE reward_members
SET member_status = status_map.new_status
FROM (VALUES ('gold', 'gold_group'),
('bronze', 'bronze_group'),
('platinum', 'platinum_group'),
('silver', 'silver_group')
) AS status_map (old_status, new_status)
WHERE member_status = status_map.old_status;

I find this to be more readable than the CASE statement version.
This is more a meme than a reality. I'm sure that they do spend money to protect their business but it's a bit silly to think that they have a measurable effect on the tax code complexity compared to the money that comes from other special interests. People with simple tax situations could very easily full out the forms from the IRS. The 1040ez lives up to it's name -- doing it with software is in most cases just more convenient. And people with complicated tax situations have a tax accountant.

There's a middle ground with upper middle incomes and small businesses which have somewhat reasonably nontrivial tax code that applies. In the absence of software they would probably be pushed the accountant route. Generally people want this complexity because they pay less compared to proposed simpler systems.
I think he held that reverse zoom on the landing bay too long, but nobody's perfect.
> except it’s just stuff I want, and people I want to hear from.

Part of the value of Facebook for me is the opposite of this -- stuff I don't want, sometimes from people I don't want to hear from. It pops the bubble (which I'm VERY much covered by as an expat in Japan) and keeps my mind flexible while reminding me that other people think/believe different things, usually for reasons that make a lot of sense to them.

Yes, I think a concentrated community like a Slack channel is a great way to stay in touch with people, but it's usually so ultra-focused that when I focus on communities like that, I can really see/feel my worldview and perspective narrowing to the one I use every day for communicating with them.
> Use a Git GUI like SourceTree..

It quickly fails to scale. The issue is when you want to use commands to find the successors and build some processing over it..

>"The mental model for Git is needlessly complex" - Again, a Git GUI can make it really easy to keep track of "changed but not ready to commit..

That is a very limited situtation. In the course of using a VCS, for a long running project, one encounters numerous situtations where having a complex mental modal quickly feels exhausting...

> The exact same thing is available in Git via "git log --graph --all --decorate" or a GUI that shows the graph.

No. it is a bit different. In Git, branches can easily jump around, and the commits that were previously under a branch will have no information in them regarding which branch they were originally made..

>. Again, there is tooling available for Git to remove this requirement.

Again, you are not thinking like a power user. GUI's only works if you follow some predefined "happy path"..

> I'm just saying that his arguments here show a lack of knowledge about the available tooling for Git

To me, it seems that you are lacking enough experience to identify what the author is talking about..
It is by far the least intuitive configuration I ever regularly encounter.
I think the real answer is increased taxation and haircuts, call it a "reverse cost of living" scheme. I do know the current benefits are significantly less generous than the old system used to be, so it's primarily a problem with a certain generation rather than PERS as a whole.
My favorites:

- stripe.com

- ohdearapp.com

Simple, to the point & clean layouts.
Guardtime delivers a specialised cyber exercise for the UK civil nuclear sector
Is there a standard measure of disposable income after taxes and necessities like food, housing, education, healthcare? It seems comparing how much people have available for discretionary spending would be useful in many cases.
“Stave off episodes” or “cure” is a modelling distinction.

If the sense of depression doesn’t cloud over a life anymore, they both amount to the same thing.

There’s nothing trivializing about that. It’s just an individual’s story of coping, recovery, and hope.
So, of San Francisco county employees listed there, 3% have a total pay > $200k.

Given the cost of living in the area, it sounds like they might actually be paying competitive salary, though it also looks like a lot of the people in that 3% are actually firefighters or sheriff's officers who pull in a lot of overtime.

"Benefits" also isn't a great category to look at, because I'd be willing to bet that if you're a software developer your benefits package is pretty expensive too and you just don't realize it. Going by their definition of "benefits", and looking up some of my own records, it looks like $60k is not that hard to hit. Insurance and 401(k) matching (or pension contributions, for a government employee) are more expensive than you probably think they are.
The manually controlled elevators of NYC (2017)
Git, to me, feels like a purposefully obfuscated tool. Using git is painful to me in two levels. First one is the actual pain in using the tool. Second one is the disturbing realization that this tool became the defacto standard for version control system, which indicates a systemic issue within the programming community, where something, despite its obvious flaws and availability of superior options, can end up winning over the competition...
Look, you can push your code to a public git repository or you can complain about people looking at your code, but you can't do both.
While I totally hear you regarding the pain of python modules (particularly on Windows), the point of python 'distributions' like anaconda and canopy is to bring the kitchen sink along, kind of like mathematica.

The problem with Mathematica from a science point of view is that, being closed source, means you can't independently ensure the calculations are happening correctly. To be replicable, science involving data needs to use open source tools.
The person who is the last holdout has no more power than any other landholder.
Old-school Windows 3.1 Bezier screensaver rendered in D3.js
With regards to sharing, both Google and Microsoft have free hosting for shareable jupyter notebooks. Probably not quite as easy to get them from your computer to the cloud as a deploy command, but it probably wouldn't be hard to create a module that does exactly that (if one doesn't already exist)
I personally do not think any jobs will be except from being replaced by human-level AI. And there are many signs that this may happen within 10 years or even less.
How to make Package Managers cry by Kenneth Hoste. https://youtu.be/NSemlYagjIU

It's funny, but still useful.
Neat demonstration!

A while back I wrote a small package in Javascript for computing area proportional Venn and Euler diagrams: https://github.com/benfred/venn.js . The 2 circle case here is relatively easy, but the problem gets tricky when you have 3+ sets. I wrote up my approach here https://www.benfrederickson.com/venn-diagrams-with-d3.js/ and https://www.benfrederickson.com/better-venn-diagrams/
I wish it was easier for people to “come out” with their deficiencies. I’m miserable on the phone for example. I just can’t really communicate unless I’m looking at the person on the other end. Yet there are a lot of circumstances where there’s no other option, chief among which is discussing business opportunities. It’s stupid. Videoconferencing has been out there for 15 years, yet people are still not willing to accommodate such a minor request.
So? Why should the state be able to decide if I should have to move if I don't want to just because they decided they wanted to handout tax breaks to company?
Seriously, I have been writing code for almost 30 years now. I pick up new languages and packages and love hacking on new things still. Modern front end developmemt feels so bad in some areas. I spent full /days/ trying to tame webpack and friends and just gave up. "Modern" web front end developer is a weird and annoying place. I would rather battle pthreads and kernel bugs with gdb than try to figure out web front end. There are some bright spots. Vue is nice enough. Bootstrap has always made sense. jQuery is easy enough. But man, I remember IE4 vs NS navigator compatibility being more pleasant to manage in some ways to learning some of these JS frameworks. And I am not just expressing a grumpy get off my lawn sentiment. This stuff is legitimately obtuse. But in a strange way compared to say systems programming. Systems program is deep and sort of orderly. Modern JS is broad, chaotic, frustrating.
Tax money funds the municipality's services for the residents, building a factory creates jobs and tax money, which flow back to the community.

In theory, anyway.
That not what it's means to be a monopoly.
Installing Cloudron on a Home Server
The history of humanity will be documented by the superior beings that succeed us.
2018 – Dow 25,000, California budget surplus.
There’s also Google Colaboratory
That's why the Institute for Justice is there. A lot of states have laws against this sort of abuse.
Peter Sewell: Why are computers so @#!*, and what can we do about it? - https://www.youtube.com/watch?v=MBIHPLFmcgA
If you want good people, you need to compensate them, and you need to compensate them relative to the high cost of living in California. Otherwise, the good people will stay in the private sector and government jobs will be filled by people who couldn't succeed in the private sector.

That's happening to some extent already, but there are a lot of people who would do very well in the private sector who choose public service. For society's sake, we don't want that to be such a big sacrifice that nobody smart would do it.
I'm surprised there's no mention or discussion of the importance of open-source tooling for replicable science. Without seeing and reviewing the source, how can you tell that a particular calculation is right? Also, relying on costly tools such as Mathematica cuts off a sizable amount of the population from being able to replicate or play with your findings on cost grounds alone.
Because grey goo is supposed to consume non-biological matter. Viruses and prions require biological substrates, and when those are used up they stop.
The Network is Reliable
Standing on Distributed Shoulders of Giants (2016)
I am just a casual observer of American politics and I don’t have an opinion on it. But here in Denmark the retirement age for a police officer is 65. That these people should be particular worn out is not something that is in public discussion.
LightUpTheWeb – Social Highlighter
It should be plain unconstitutional to raise a tax on someone to pay a benefit to another. Whatever the court rules on the state not defaulting on its debts, pending that cost to someone that does not get, or want, the same benefit, should be equally pernicious for the law.
There's a line of thought that highly original thinkers can be so biased toward "I can figure it out myself"--that is, they get so many happy brain chemicals from the activity, or whatever--that referential thinking becomes their critical blind spot. Referential thinking involves consulting others' measurements and advice; tide tables fall into that category.

Once you build your own navigational mental model and realize you know how to navigate from first principles, as he did, I'm sure it becomes almost intoxicatingly tempting to get out into open water.
http://opentaxsolver.sourceforge.net

It seems to be relatively well updated but I wouldn't be surprised if it made errors.
This is the libertarian dream of freedom. The freedom of the strong to do as they please with the weak.
Have you had a look at org-mode babel?

It's extremely interesting how they have managed to create an all plain text environment that is in some ways[0] better than the current notebooks.
Of course it's not as user friendly and needs quite a bit of polish, and a major refactor to separate the above use case from the tangle use case.

The tangle part of org is even more interesting as it's probably the first fully literate system that allows you to completely document everything about
a software project. And since it's language agnostic I do mean everything from install, compile, connect to the external databases, export the documentation in every format under the sun and whatever else you can think of (including docx through pandoc).

I'm going through the source code slowly to get it streamlined, but the code is suffering from the typical lisp syndrome of "Everything is implemented everywhere."

[0] Being able to run multiple languages on the same org file, controlling environments for scripting languages, compiling on page for non-scripting languages.
I remember attending a party once and introducing myself to someone who, it turned out, I had met and had an extensive conversation with about an hour earlier. I totally didn't recognize this person.

I don't have full-on face blindness. I do recognize the faces of people I see a lot. But I still struggle to remember people's names, especially if I don't see them every day.
I see, often the person who has little desire to improve needs to be handled differently.

There are various ways to handle low performance, including talking to the person, finding out the reason behind the low performance. Most often it is caused by external factors.

Pair programming or any such coaching tool IMO are effective only after you dig deep into the reason behind low performance. Once the individual is ready to improve, that is when you can employ pair programming.
This what WhatsApp and Telegram do around here. Even just in my direct family we have three different groups: everyone, siblings, and a subset of the siblings. Works quite well.
I cut my unix teeth in the early '90s, on SunOS, and Cantrill really keeps the history relevant.

But truly, his Oracle rant was one for the ages. And this from me where our system RDBMS is Oracle, sigh.
That source has obvious serious data quality issues, which are dramatically evident if you filter by “University System”; the three highest paid entries with that filter, which are the same person [0], three times with the same job title and slightly different total comp figures. The same person appears twice more on the first page, too, with significantly different pay (but the same title, etc.)

[0] https://en.m.wikipedia.org/wiki/Jim_L._Mora
I assume that's over many years of the pension payment. Assuming average of 20 years of pension payment, that's about $300 per year per person.
Turn-of-the-Century Pigeons Photographed Earth from Above
I agree with you, that concentrating your worldview can become a problem. But at least now I’m doing it intentionally, and I don’t have Facebook’s algorithm doing it for me. Or, in the opposite, exposing me to things I don’t like just to get me to engage with it.
They just get thrown in the unemployed pool and their income average drops dramatically with severe ripercussion on the final pension calculations

I know because in europe we have an unrealistic retirement age and my father like many other lost his job in the 2008-2012 crisis. Been unemployed ever since.

What happens is that in the 50-65 braket you’re a huge liability with severe productivity drops and companies tries to fire you at the first chance they get.

The european system at least has some protections against unreasonable terminations, so we aren’t fully appreciating the maddnes it would be a free job market, but company closing or figuring out how to fire the old employees in masse drops huge chunks of unemployed for life into the society.

This is becoming a serious issue and it is going to peak in 20 years when all the people like me that don’t enjoy full time national contracts and their protection will get past their productivity prime.
Keeping Up with the Data Engineering Industry (Interview)
like the French, with their little enameled fly in the white of the urinal, in the movie theater you would not notice, watching the small Pan-Am aircraft rolling as it approached.
Passengers would not feel the roll and be thanking the baby Elvis.
Using Data to Help Fight Climate Change (Interview)
https://archive.is/nh7CF
Difference Between Artificial Intelligence and Machine Learning
No link, no comment.
I was going to say, didn't we all just discuss this?
Thank you for mentioning him, I didn't know of him. For anyone interested here is an interesting talk he gave recently: https://www.youtube.com/watch?v=xuNj5paMuow
NASCAR Rush Hack Cheat Code
They can always just cut public funding more and restore the status quo. It's not like their current lack of funds is because we are literally out of money, it's because they're not a priority.
These are outstanding. Once I finish them in SQL, I plan to do them all with Python/Pandas.
aka private group chats
If only we lived in a world where this were more common than the present one, where many have the expectation that someone else to wipe our assess for us when it comes to things like this…
clearly they deserve to be forced off it without compensation if they dont accept.
Changing the Constituion...or Bankruptcy.
>...You can't do most blue collar jobs at 50, much less 65.

The vast majority of blue collar jobs are in the private sector and they don't get pensions with COLA and free medical when they turn 50 or 55. It doesn't seem fair that government workers are treated differently.

If someone is disabled there are government programs to help them, but I see little evidence that the many of those government workers retiring at 50 are actually disabled or incapable of work since many go on to have another career.
H&R Block and Intuit Lobbying Against Simpler Tax Filing (2017)
Interesting my understanding was that they were influencing load factor simply by scaling back the number of flights per day on a certain routes. Might you have any links?

I imagine as someone else also pointed out that this venture being discussed here will ultimately used to oversell even more.
Since the author is talking about using Jupyter for research papers, how do you do basic things, like bibliographies, naming tables and referencing them later?

I have seen table of content, but those have been generated by a big block of javascript.
Just because there's a smell, that doesn't mean it's a bad one
In Film, the image is only recorded 50% of the time. In my 50 years of experience, no one in Hollywood knows that. Well, not no one:)
What is your favourite marketing/growth talk?
Can be related to sales, marketing, sales, growth etc
So you were working on a lab proof of S.L.A. Marshall's Men Against Fire? ;-)
https://en.wikipedia.org/wiki/S.L.A._Marshall
More recently I’ve found if I meet someone new, either at work or socially, I write down their name, or email it to myself on my phone.

After the initial interaction I can then make any additional notes I think might help in remember relevant information about the person.

I don’t keep any of this info, afterwards I’ll either know their name from repeat interactions and delete it as unneeded, or not need it anyway, and delete it or throw it out.
Interesting (and not entirely surprising). Reposted that article for more visibility: https://news.ycombinator.com/item?id=16841449
+1 for notabug. I use it everyday and it has always worked perfectly.
After Elon Musk, HN seems to have found a new demi god to worship. Kubrick.
This is hilarious.
Exactly, you can be a programmer and be a capitalist too. May the best paradigm or hybrid of the various paradigms win.
Vue CLI 2 is also a zero config approach (if you are ok with whatever template you are using). The big thing in v3 is that it's based on plugins.
I suspect if the potato was encased in ash and mud, floating in average ocean surface temperatures (away from the poles), it would attempt to germinate. Tubers love trying to grow. If it did, it would break apart its case in no time.

That's just a hunch I have. Maybe you're right, and the ash or something in a particular clay would inhibit germination. There are so many variables. It's fun to think about - I often wonder how some plants haven't ended up in certain places over the last millions of years.
What's the chances of retroactively lowering pensions?

1. Progressively lower pensions. Skim off the top earners.

2. Create projects for the community and declare that the saved money will be used for those projects for better optics.

This won't lower trust in government pensions by that much because this is just correcting what is seen as "unfairly high" pensions.
> How is it possible that they can retire on 90% of their peak pay?

Because the pension formula is an age-based benefit factor times years of service; for the “2% at 55” plan, the benefit factor ranges from 1.426% at age 50 to 2% at 55 (hence the name) to 2.418% at 63+.

So someone retiring at 63+ with 37¼ years of service will get just over 90%.

But that's a plan that is common to run of the mill civil service. Public safety pensions tend to have higher benefit factors at the same age (but top out, in benefit factor terms, sooner), so that level can be reached earlier.

> It seems that it's based off of years of service instead of quality of service...

Job type will effect which plan you are in.
That can't work of course and will just lead to endless lawsuits that everything is a "benefit". Need more funds for education? Can't do it because you need to raise taxes on the people who aren't in middle school. Need funds for a new roads and their maintenance? Can't raise taxes because some people might never drive on that road or heck, don't even have a drivers license.
John Carmack is an absolutely brilliant speaker. Conversational, captivating and effortlessly natural. I could listen to him talk all day about the most arcane bits of graphics development which i'll never understand but am fascinated by regardless.

His QuakeCon talks are particularly good.

QuakeCon 2011 - https://www.youtube.com/watch?v=4zgYG-_ha28

QuakeCon 2012 - https://www.youtube.com/watch?v=wt-iVFxgFWk

I like his talks because he's always interested by what he's doing and it tends to make me interested again in code.

Linus Torvalds is another surprisingly good speaker. His talk on git - one of the dryest possible topics - was very interesting. There's not many other people I'd sit and listen to talk about SCM.

https://www.youtube.com/watch?v=4XpnKHJAok8