skysight-inc/HackerNews huggingface dataset:
Agreed. For me, Kafka's reliance on ZooKeeper is the most annoying one. ZooKeeper is difficult to manage. And both Kafka and ZK, being JVM apps, are memory hungry, and the heap is difficult to tune — they need lots of headroom to avoid accidental GC pauses or OOM events.

Kafka also puts some of the complexity burden on the client. It's been a while since I wrote anything for it, and I believe you can tell it to manage the log position for you now. But by default I believe a client needs to talk to both Kafka and ZooKeeper (or store the log position somewhere else).

There's definitely room for a simpler solution for those who can't afford the complexity of managing Kafka.

I looked at Apache BookKeeper [1] recently. It has a nice design and now supports Etcd for consensus. Unfortunately, like Kafka, it relies on a fat client, and that client is currently written in Java, making BK impossible to use from a language like Go or Node.js.

Apache Pulsar [2] is a layer on top of BookKeeper that provides pub/sub semantics and high-level features like functions and schemas, and offers client support for multiple languages. On the other hand, Pulsar requires both BookKeeper and ZooKeeper (and doesn't support Etcd). In theory you could run zetcd to emulate ZK with Etcd, but... it gets a little bit ridiculous at this point.

I've looked at NATS Streaming, but its clustering story looks a little unfinished.

I've previously built a system that built a log on top of Postgres. You can achieve a decent approximation of Kafka using transactions and LISTEN/NOTIFY, and with table partitioning and replication you can even get some scale out of it, especially if you're able to distribute independent logs across completely separate Postgres instances. But it's ultimately not as good as a dedicated store.

I particularly like your idea that — if I understand it correctly — data can be stored independently of the log itself.

[1] https://bookkeeper.apache.org

[2] https://pulsar.apache.org
To the downvoters, you're wrong! Python3 is a distinct language.

This is all you need to know: Python3 broke "Hello, World!"

It doesn't get any more fundamental than that.
Thank you, this is what I was looking for.
Something to consider: there hasn't been a great way to get Python 3 on RHEL / CentOS until this year. The IUS repo is an option, but it makes distributing a Python 3 package difficult: you have to get EPEL installed, then IUS, then you can finally get your own package in.

I'm happy to be able to drop Python 2 support in my projects, but I've had to hold off on some of them that run on RHEL / CentOS.
Real multi cloud. I want to be able to spread my app all over the 3 public cloud infrastructure.
I don't know. When I had the option of taking a 401k loan, my impression was it was a thing that had no reason to exist, much like an HSA. It's all a net loss to society to set up these games with rules for avoiding taxes that bait people into making decisions that cause problems later on.
I suppose the problem really is that I don't know, just that it interests me and that the field I do know more about does actually have quite an overlap, but pretty much none of my knowledge is in the intersection, st least as far as I know.

On the financial side I've only ever read things like the Economist, FT, consumer investment stuff. I'm keen to try a more quantitative/engineering textbook, but I'm naïve even of the right search terms for an entry point.
Location: NYC

Remote: No

Willing to relocate: Only in US

Technologies: ok at many

Résumé/CV: generalist with client, sales, startup, finance background

Email: codecomedytv@gmail.com

Looking for part-time but intellectually fun role.
I hope Apple’s is better than what they have now. I lost my AirPods and used Find My to find them, and the “last location” wasn’t even the last time I used them! It can’t even keep track of a device actively connected to my phone. I only found them because I happen to sit on them.
wouldnt that be illegal hiring discrimination?
Which word? "manned"?
I don't think it's misconstrued at all. You build things worth millions or billions by doing the actual work to build them. Not by aping the personality traits of people who built other things.
No insights that I can support. My long-unrefreshed impression of thimerosal after looking into its toxicity as a vaccine preservative is that it was statistically insignificant. Impression not informed by data later than about 2005.
Wouldn't it better for MIT's reputation if people weren't jumping to the conclusion that one of their professors would willingly rape people? Did anyone actually believe Marvin Minsky of all people would do that? I wonder what he will have to say about this when he gets unfrozen.
Absolutely. We're still pretty small so we don't use formal names or structures but in essence yes.
Because leadership or success in life in general or creativity is not only about sitting at home and studying after school. It is one factor but there are multiple of other factors. The fact is that we don't see anything special from all those hard working Asians, that's the bottom line, they are good for some type of upper middle class maybe. The Asian success is a glitch in the high school system that awards hard work over talent, social skills and creativity, but Harvard is a bit smarter than that and they know nothing interesting will come out from someone who just ticked boxes and put extra 4 hours a day into studying and violin lessons.
What the situation really highlights is this: don’t make breaking changes to things. Perl 6 had to learn this lesson too.

Linux’s staying power has a lot to do with the policy of “don’t break user-space”
The scramble suits were straight out of the book.
Location: Los Angeles, Culver City, etc.

Resume/CV: https://www.linkedin.com/in/doorty/

I'm your middle man between business and tech and product. I've been a professional developer for 10 years. I've been a manager and solutions architect for 6. I've been an entrepreneur for as long as I can remember. And I have an advanced degree in human-computer interaction.

Email: brent (at) doorty -dot- com
As crazy as that may seem on the face of it, it’s actually kind of genius for merging the roles of those who need to configure / don’t get git, and those who need to develop against the configuration.
Cloudcenter.
Well, that explains why I couldn't think what they were called! ('Obviously not a quarter... Dime? No, that's not right...')
All the people that are crying about print() never did any migration. That's the easiest part, it can be fully automated. In fact you will almost never use print in any serious program.

The unicode is the most difficult part of the migration, because most of python 2 code is actually broken, it can't be automated because you need to know what you want whether you need text or bytes.
>but Harvard is also not entitled to federal research grants

There is no entitlement. The government is purchasing research for the money. There is no obvious connection between Harvard's undergrad admissions practices and the money Harvard gets for research.
Thank god we're not speaking German...
Thank god we have diversity and hate crime laws instead of colonizing mars and beyond...

The weak will reap what they sow.
That is so absurdly true :) Thanks for catching it.
Yes. That's why a recession spirals from a little bit of unemployment to a lot more unemployment. The cycle feeds on itself.

Eventually, companies stabilize themselves, or maybe the US Government steps in for hiring / temp work. If the US Government steps in every time however, that creates "moral hazard", so its not something that policy makers like to rely upon.
The good students already saturate the bullshit metrics. We would need a pipeline of way more extra hard high schools, and that's another ethics problem. It would be harder to justify the legacy students then, that's a plus.

Also, let's be real, jobs are too moronic for all this. The American economy is a joke that doesn't deserve a more vicious rat race, and that's all we'd get from this. There's no "talented (10^-n)the" way out of our current predicament.
I have never seen a coherent definition of POC. It seems to be based entirely on political expediency.
I know when I interviewed 3 years ago, they wanted k8s experience as well.

I found out that too was a hard requirement at the time, but only at the 3rd interview.

Then again, it HAS been 3 years. Lots of things change, esp in tech.
When you have no substance then appearance counts for a-lot. Sadly, people can get pretty far on appearance alone. But Epstein is such a shady guy, how could some one be a billionaire (maybe an exaggeration) and no one knows what they do.
The real travesty after this is overturned is that that judge will still be sitting and practicing law.

If a higher court overturns your decision, then there should be consequences.
ARM's ASTC encoder patents – is it safe to write encoders for this format?
That's putting cart before the horse. The only reason to care about CO₂ emissions is because they threaten our technological civilization. The planet doesn't care about CO₂.
Dolly | Back-End Engineer - App Team | Seattle | Full-time, On-site

About Dolly

Dolly was created to reimagine the big and bulky item delivery experience by putting the customer in control and optimizing for convenience and safety at an affordable price. After delivering more than one million items, we are the leading on-demand delivery service trusted by retailers like Lowe’s, Costco, Crate & Barrel, Big Lots!, and many more.

Headquartered in Seattle, Dolly is currently operating in 21 markets and will soon be everywhere nationwide. We're passionate about creating a customer-centric brand that brings customers back time and time again. Our team is ambitious and humble, with innovation at the core of everything we do.

About the Role

As the App Team Back-End Engineer you’ll be working within the App Team on the iOS app, Android app, and book.dolly.com back-end. Typical tasks include working with designers and app developers to solve problems and implement solutions. You’ll outline solutions, build endpoints, iterate through improvements and changes, QA, and release. You should be a problem solver with a creative mind to implement solutions. We work within a deadline driven Agile methodology.

Your Skills:

- Full-stack Javascript - Node.js - MongoDB - REST API design - Strong understanding of data structures & algorithms

What We Offer:

- Health insurance included - Dental & vision included - Transit subsidy - Unlimited PTO - Pizza Fridays

Send me a note with [HN] in the subject line to chad@dolly.com
Maybe you put your device somewhere the winds blow for you. Think of the 200mph westerlies that blow through the Drake Passage.

Aside from the distance from civilization, you've got water, power, and air movement all right there.
Why only re-evaluate non-high school degrees? Career oriented education could start significantly early. There's no real reason why 16-18 year olds couldn't already be appropriately skilled to work in many fields save individual maturity.

My big priority would be ensuring continuing access to education. Schooling that pushes certain students toward skilled blue collar work seems potentially a little classist if folk aren't given the appropriate opportunities to achieve something else, if they want it, throughout life.
It's called a right of the people because back when it was written, the militias were made up of "the people", but not in an individual, "each person gets a say" kind of way.

This isn't the scholarly debate people make it out to be; there is a clear meaning, and it's been muddled over the past 30 years by special interests who have corrupted the original intent of the law.

The problems the second amendment was written to solve don't exist anymore, so the second amendment shouldn't exist anymore.
> The irony is of course to downvote to hell any dissenting comment in a debate about democratic values and censorship in China...

Please don't confuse PR posts conducted by China's 50 cent army lauding absurdities such as the virtues of a totalitarian regime as "dissenting comment".
One good reason is the Unity -> WebASM pipeline isn't well suited for the web. Firstly Unity is built as a more heavyweight monolithic solution, decreasing load times, additionally, it's not meant for more seamless integration into web pages.
The bias you're talking about is real, in my observation, but you can't counteract it by ranting and breaking the site guidelines, let alone baiting others into downvoting you. It's a direct consequence of HN's demographics, which are overwhelmingly Western, and there's no way to change it other than slowly and patiently, by adding good information.

Of course it's frustrating to encounter inflammatory comments that are based in ignorance. But if you respond like this, you feed those comments and give them greater credibility, while discrediting the very side you're trying to defend.

If you know more, then a better way is to share some of what you know so that others can learn. In any case, if you post here, please stick to the site rules regardless of how wrong or ignorant other commenters are or you feel they are.

https://news.ycombinator.com/newsguidelines.html
These posts are so tiring.

It's usually from the same people that are super active and obnoxious on FB. Posting every single hours of their life. And suddenly realizing they addicted to it. And they still need to post about it.
Fantastic writeup and well worth re-posting, thanks. Gotta check out DDLab.
What was gained from diversity?
This is but Man in High Castle-inspired fantasy. Maybe if Britain had taken over the world, there would be nothing to Brexit from.
PlayCanvas works great in the mobile browser all the way back to iPhone 4S. AFAIK, Unity still doesn't officially support mobile WebGL builds. Try making this in Unity and running it in the browser on a low-end to average Android/iOS device.
"a couple more years of improvements and you could have a machine able to reliably do the work of 2- 3 employees"

I see frozen uncooked pizza in stores. I feel like it existed 20-30 years ago too although I'm not sure exactly. Surely these are not hand made.

Whenever I read about impending automation, I wonder which millennium I'm in.
Maybe it's a problem in certain tech-oriented subs? I generally stay away from those and hang out other places more geared around art, local interests, travel, etc. and the communities there generally seem quite fun and friendly.
> I don't see why being plant based, a more sustainable and ultimately less cruel way of consuming food, should be rejected because there's cruelty to how we grow crops like quinoa.

less cruel to whom? I made it very clear that for me, your plant based, "more sustainable" way of consuming cause misery to lots of human-beings, and for me this is more vile and cruel than raise animals to eat nutritious and healthy food.
and I thought the screen scraping / Selenium solution was wack! Wow!
The only use for Find My for Airpods I’ve seen is the ability to have either earpiece emit a chirping sound. The current location tracking is limited I think for battery life preservation - I also find that inaccurate.
Oh I wouldn't count on that; I mean if it came to a vote maybe but it wouldn't.
I really think you might want to reread my previous comment because it clearly states the things you’ve said but disagrees that something overheard in supermarket is evidence worth investigating as context is all important. Thanks!
Because “leadership” in anything requiring a democracy requires people to vote for you or at least not actively work against you. This is far from impossible, America’s leadership class heavily overweights Yankees and Jewish people compared to their share of the population but change is always hard. It’s probably a lot harder if there’s a constant drum beat of race talk insisting that X-Americans have a completely different life experience from Y-Americans but it’s not like this is unprecedented. Anti-semitism was widespread across Europe before, during and after Jewish Emancipation and in every country where Hitler and the locals didn’t kill them Jews are over represented in the professional and leadership classes.
Freenome | South San Francisco, CA | Senior Engineers (Frontend and Backend), ML Engineers, Bioinformatics, Staff Quality Engineer, Engineering Manager | Onsite | https://www.freenome.com/careers Freenome is an AI genomics company on a mission to empower everyone with the tools they need to detect, treat, and ultimately prevent their diseases. By applying advanced machine learning techniques to recent breakthroughs in genomic science, Freenome is developing simple blood tests to detect early-stage cancer and make treatments more effective.
The Engineering team is responsible for the heart of Freenome - the genomic data, its (anonymized) patient-related metadata, the genomic pipeline, and the Machine Learning platform for running experiments. We run a Postgres/Python 3/React stack on Google Cloud via Docker/Kubernetes. We're a small team looking to scale quickly over the next year, so now's a great time to come for growth opportunities - growing teams around you, working on cutting-edge platforms for pipelines and ML!
The goal is defined - equality. If it mattered to you it wouldn't be a complicated concept to grasp. And just as I said in my previous comment, this is the exact sentiment that prevents the goal of equality from being reached. Just because something has never been done that doesn't mean that it can't be done. And if you and everyone who doesn't support such a policy are unwilling to participate, then you're right, it will never be achieved.
I'm surprised I never see playcanvas on HN. It's great technology that should be better known IMO.

I first came across it working on a project where I needed to load and animate a number of complex .fbx character models. Spent loads of time trying to do this with three.js (in 2017) + all manner of converters to different formats. I tried every supported loader and they were all broken in various ways.

Then somehow I found playcanvas and had the models loaded and working flawlessly in a very short period of time. That experience extended to basically everything else I tried with the system—it's well polished.

The editor UI is very nice, and yet remains lightweight in a way where I still feel more like I'm working with something like three.js than e.g. Unity. I personally still prefer three.js for most projects I work on, but it would be a very good option for certain projects and I always keep it in mind. It's also open source: https://github.com/playcanvas

The downside is for the free tier you get their logo on your app, and you can't hide the source (and anyone can fork your project). On the up-side, the pricing was something like $15/month last time I checked.

For a very simple example, here's an asteroids game I spent a few days making with it: https://playcanvas.com/project/479850/overview/rocks (you can play or jump into the editor and modify from that link.)
You mentioned harvesting metals out of meteors so I took you at face value on that word. Point is that it's more about efficient use of labor and capital. And we still have a long way to go in realms of automation technology, energy tech, virtual reality, finance, biotech, medicine, space tech and countless products and services that will continue to grow the economy for decades if not centuries to come. That being said, a recession will happen at some point. Difficult to speculate as to when, my guess is that if we are, it won't be a deep one.

M1 money supply is not typically used as a measure of economic growth. Money supply can increase while the economy is tanking (see Venezuela). Real gdp or other similar figures are typically used.
Interestingly those who tend to be more realistic in their self expectations are more prone to depression.

False confidence may be the route to happiness or at least optimism.
DAAC - Documentation As A Configuration
Managers can facilitate the establishment of a direct connection. Good ones are routers or switches or whatever the analogy would be!
I thought the difference between arrogance and confidence is being right.
Plus the engine codebase is open source (MIT): https://github.com/playcanvas/engine :)
> There were no such policies for various Christian groups.

Say what? See https://en.wikipedia.org/wiki/Anti-Catholicism#United_States
I agree that full sentences (e.g. like Email subjects or blog post titles) are better. Tagging commits with feature/bug/etc is not particularly useful, as more often than not the line between feature, bug, etc is blurry. At times it can also be unclear what tag to use, leading to arbitrary choices. For example: is a performance improvement a feature, or a bug fix? The tags also add no value when reading commit messages.

Setting that aside, the conventional commit "standard" (https://xkcd.com/927/) doesn't focus on what I think is the most important aspect of a commit: a good commit subject and message. In fact, prefixing the subject line with certain tags limits the amount of characters you have for writing the message; assuming you want to stick with the usual 50 character limit.
"because the industrial revolution lead to an exploitation of child labor"

I'm skeptical of the idea that before factories, farms didn't use child labor. Isn't the practice of closing school during the summer kind of suggestive?

Anyway, you seem to be arguing the opposite of the previous post, that there were more jobs and this was bad. I thought the issue was there were fewer jobs and that was bad.
> We need to make sure that we don't leave older people behind

old people can now summon rides on their phone and be out and about instead of being home-bound.

> and we don't pull the rug from under our childrens feet

Everything we build, our children will inherit. It will be their responsibility to improve upon what we leave them. It's not like older people end up taking these technological improvements with them to their grave.

There are more jobs than just fast food. People did jobs that weren't fast food before McDonald's existed and people will do jobs that aren't fast food once McDonald's is fully automated. Right now, on the Internet, you can learn so many things for free. The necessity to learn a skill that pays the bills will drive people to learn skills that can be used to provide goods and services others are willing to pay for. All that is necessary is to open your eyes and look around and see what people are willing to pay for.
I was in high school at the time, and it encouraged me to pick a lucrative career track. I did have an interest in programming -- I didn't choose it solely for the money, but it made me prioritize financial security. Seeing our financial markets melt was impactful. I remember my economics teacher showing on the projector a graph of the Dow on one of the large three-digit (possibly four-digit) down days and talking about the significance of it. It shaped how I view money, and would be somewhat attribute to my interest in achieving financial independence before standard retirement age.