skysight-inc/HackerNews huggingface dataset:
It provides a Python DAG building library like Airflow, but doesn't do Airflow's 'Operator ecosystem' thing.

It also is very opinionated about dependency management (Conda-only) and is Python-only, where Airflow I think has operators to run arbitrary containers. So Metaflow is a non-starter I think if you don't want to exclusively use Python.

Airflow also ships with built-in scheduler support (Celery?) or can run on K8s. Metaflow doesn't have this. Seems to rely on AWS Batch for production DAG execution.

Airflow ships with a pretty rich UI. Metaflow seems to be anti-UI, and provides a novel Notebook-oriented workflow interaction model.

Metaflow has pretty nice code artifact + params snapshotting functionality which is a core selling point. Airflow is not as supportive of this so it's harder to do reproducibility (I think). This is encapsulated by their "Datastore" model which can locally or in S3 persist flow code, config and data.
TikTok BYTEDANCE and MUSICAL.LY sent US user data to China: class-action lawsuit [pdf]
My gosh this is incredibly accurate and my experience as well, though I could never clearly articulate it on why until now. Can you give some more stories on specific instances?
Related news article:

https://www.bbc.com/news/business-50640110
Why the socialist country comment? They weren't mass replaced until the 80s anywhere.
the author is focused on finite games, which are games that you play to win. but it's interesting to think about applying the same logic to infinite games, where the goal is to keep playing forever.

For instance, capitalism is a game that most players assume we'll just keep playing. How do you deal with some players having an advantage? Currently, the advantage only compounds (literally, ie compound interest). What if instead, the game became more difficult for those players, as discussed in the article?
Russian software will be mandatory on all devices sold in the Russia
I guess (?) - minus the input spec being not YAML but more language native (pythonic for e.g.)
Congrats to Sundar! He and Nadella need a movie about how they came in and ran things.
Paywall, fan-tastic
I think the word asset is being used in a particular sense here. Page views are not liquid or transferable.
It is really unbelievable that a legitimate domain can be transferred so easily without any verification or due process. Isn't there an EPP-code-based domain transfer process to prevent exactly things like this?
China's schoolchildren are now the smartest in the world
Raw, user-submitted point-by-point data for pro tennis matches
Also hasn't the cost of hosting gone down significantly since 2005?
Decks of ‘perfocards’ and square lined journals, yeah. I watched how he enters codes through tumblers and didn’t understand until there was a keyboard computer connected to tv+vesna.
Interesting. I would call it a phobia, because after looking up images of lotus seed pods, I had no reaction to it at all. I can see how someone would associate it with an insect nest or something, but it doesn't bother me at all.
You'd think Europeans would want to foster a real tech market before trying to regulate it but I guess it's cheaper to just leave the expensive heavy lifting to the US and China.
How can you tell? I'm curious as to which specific details you're referring to.
Robo Hives Counter Bee Population Declines
Or Mumbai?
Or Jakarta?
Python Eats the World
Always interesting that on Hacker News, people are always so ready to throw in the towel and call something impossible and list the 83 reasons why.

Unless it is about starting a business and making money via ads.... Then they're willing to devote thousand of hours of their life thinking creatively about how to solve problems to "change the world".
Yep. Even the RuneScape wiki owner forked their own wiki after Wikia became malicious in terms of ads. It even supported by RuneScape devs themselves. And even then, the original Wikia wiki is still competing on Google SEO after a full year. And this was a real niche. Imagine a big website.
I never liked the idea of explicitly changing the rules in order to make a game more fair for new players. If you become accustomed to changing the rules whenever you find yourself outmatched, and then find yourself in a situation where the rules can't be changed for whatever reason, then you're not going to enjoy yourself.

It's much more enjoyable for everyone, in my opinion, to play by the same rules as the group, but judge your own performance by a different set of rules that you keep in your own head. Maybe try to beat your own previous score, or set yourself a personal challenge -- something like "take one of my opponent's pieces" or "make the longest word in the game".

It's entirely possible to enjoy playing a game that you have little chance of winning, it just requires some creativity.
C-for-all: Extending C with modern safety and productivity features
In the Seattle area, offer up has been taking off and has so far been much better than Facebook marketplace about lowballing. Generally things sell quickly and buyers are much more serious.
Location: San Francisco
Remote: Open
Willing to relocate: Only if it's the Caribbean or somewhere cool (Japan, maybe?)
Technologies: Blockchain/VR
Résumé/CV: https://docs.google.com/document/d/18QlxAOY1OH9wh7dbDaoIOFoaVAF-hqUO2gvKkdHuigg/edit
Email: jaeson.booker@students.makeschool.com
It's true that if you create a perfect fork that search engines will punish you and not even display the results, but that's not to say you can't change that. If the edit-base of a wiki moves with the fork (and this is essential), you can continue to create new content that search engines will index. If you also go back and make tweaks to existing pages, you won't get penalised. It's not a quick process, nor is it simple, but it's possible for a fork can survive, grow and even move above the original.
If it's reverted back to non-profit then prepaying is still a bad proposition because then you're paying today the same amount you would be able to pay years from now -- and paying it to the for-profit entity now instead of the non-profit entity later.

And I don't see any reason to expect the annual probability that it's transitioned back to a non-profit to be a lot different in the future than it is right now, which means that if it makes sense to migrate then it doesn't make sense to wait. Especially when continued use of the domain only increases the migration cost as it gets further distributed as your active contact information.
Oh, so what if it's not a direct descendant and only a cousin? It shares enough DNA that people looking at the structure would assume common elements.
For those unfamiliar with C language, can you provide a good introduction about what is going on here? Do you mean that all logic for Brainfuck is encoded as format strings in printf function?
I like anecdotes. I like data better. Nuclear is a very safe energy source compared to the majority of what powers the world, period. Wind and solar are also extremely safe.

Wind is very low carbon, about 11 gCO2-eq/kWh. Solar PV is a bit higher, around 40. Hydro varies dramatically from excellent to terrible based on biogenic methane emissions (region dependent). Fracked natural gas is abhorrent with >400 gCO2/kWh, and even worse (in some cases worse than coal) when the short term warming effects of methane are factored in. Nuclear clocks in at 12, beat out only by wind. These are the IPCC full lifecycle numbers, of course.

Here's another good (and live) view of worldwide carbon emissions, in CO2-eq/kWh generated [1]. You'll note that a lot of very low carbon countries are very high in nuclear.

I am a pragmatist. I see a climate challenge and I want all low-carbon energy sources. Everyone cheers for wind and solar, including me. They're doing phenomenally. We need 10x or more of them. No one disagrees with this. Nuclear is far more controversial, and is the topic at hand in this subthread. Don't tell me I'm anti wind and solar just because I point out challenges with them. All energy sources have challenges. I just refuse to tie my hands and not support nuclear because of irrational and unscientific fear. I want all low-carbon hands on deck. It's much more interesting for me to explain the basis behind why nuclear is actually less dangerous and scary than the vast majority of people think than it is for me to say we need more wind and solar.

Regarding electricity's share of total emissions, the only non-combustion solution that I'm aware of for transportation (40% of emissions) is electrification. As buses, cars, trains, and even short-run airplanes electrify, we can decarbonize the transportation sector by using decarbonized electricity. Hydrogen is another option, and nuclear reactors are one of the most excellent ways to make hydrogen without lots of carbon emission. As for process heat, it's difficult for anything to reach fossil-fuel temperatures, but there are lots of interesting efforts with hydrogen blast furnaces and electric arc furnaces that may get us there. Electrification as a means to reduce total emissions is a need shared by all low-carbon energy sources that I'm aware of, including wind, solar, hydro, geothermal, and nuclear. Advanced nuclear and solar thermal are unique in their abilities to reach process heat temperatures.

My goal and value system is all about decarbonizing the world effectively and justly. I want to base my decisions on data and rationale. I'm looking for people to help in this goal, which I consider noble.

[1] https://www.electricitymap.org/?page=map&solar=false&remote=...
I don't think they can. No matter how smart the people working on it are there well always be a group of equally smart people on the opposite side trying to game it.
Technically, they could sell the domain & the new owner could maintain the site as-is, but I really don't think that'd happen.

The WMF is mission-driven. A large swath of their funds are spent as grants to other organisations, and they could par that back without affecting their ability to operate.

[disc: Wikipedian since 2004, many friends who are WMF employees]
They want to make the product appeal to all users and not just techy ones. And If I product managers or CEO or whoever can print his message bold he's happy.

Very few non techy people know what markdown even is. (From my own experience asking friends etc.)
At least -0.0% are.
Chill out dude, no one's actually going to behead you.
>>>Why do professions need to aim for 50-50 but not non-professional hobbies?

And it's not like it's ALL professions. I don't see anybody pushing for 50% female representation in coal mining, logging, or waste management.
Doesn’t the go tooling mandate this if you are >= v2.0?

The rest of mod looks fine but tying paths to major version changes was a mistake IMO.
I wouldn't expect to see a new kind of product coming out of Google. They have 0 track-record of product innovation. Their main innovation power is in the back-end, on the implementation side.

Internet search existed before Google, but they came up with a newer and much better way of implementing it. Internet email existed before Gmail, but they vastly improved the offering. The iPhone already existed, but they came up with an alternative in Android. Same story repeats with GSuite, Chrome, Chrome OS.

YouTube was sort of new, but it was an acquisition, so I don't know if it counts.

When they do have ideas for innovative products, they fail to deliver.
3D printing is helping museums in repatriation and decolonisation efforts
Still have mine. Stopped using them for notes still use as bookmarks.

132 column lineprinter paper was made for kindergarten
Playing with people who are better than you is easy. Just accept they're better than you and keep losing.

Decide if you are comfortable with your current skill level or not. If you want to get better, train up. If you are happy with your skill level, then keep losing. That's fine, and I think its healthy to decide to place limits on your skill.

Skill is an infinite treadmill: you can continuously get better at pretty much any subject from now till the end of time. Deciding when to get off the treadmill is just as important as deciding to stay on.

> Games of skill are less appealing if you know a certain person will always win.

I disagree. I will always lose to Magnus Carlsen in Chess. I will always lose to my friends in (insert any FPS game here, I'm bad at all of them). I will always lose to Mew2King in Super Smash Bros: Melee.

My inability to defeat the greatest players of a subject does NOT make the game less appealing. Indeed, I often times seek out the challenge of stronger players, especially when I'm explicitly trying to get better at the game.

Losing constantly by playing vs players who are better than you provides a learning experience. You should find other players you can win against of course: you'll never learn to win if you keep losing. But losing teaches you what bad-habits you've formed from playing vs weaker players.

I think that's the key: losing all the time is unfun. But I can definitely take "losing for a whole week" or "losing for a whole month" in a row, especially if its for training. Finding players of lower skill, equal skill, and higher skill, is important.
Why Google shuts down so many services
Sounds of things like: trips to conferences, buying SaaS subscriptions/software licenses, consultants (for the first one), etc etc
You can also ask why not more female top leaders and top investors. Females are so reputed to be competitive by nature..
I think the decline of Microsoft in the mid-2000's was mainly caused by them missing the boat on the two massive shifts in computing -- from desktop software to web and mobile. Google, on the other hand, is firmly entrenched in both web and mobile. Until there is a similar shift (if there will ever be one), I don't see Google stagnating the same way that Microsoft did.
Hets Ransomeware spreading like wildfire
On 1st of December. I spotted .hets on Downloaded Torrent files. It's attached to the Executable with Perfect hiding capability. Upon opening, It starts Internet Explorer then Downloads and installs Headless Chrome browser and locks down whole files in just 3secs.

Extension: .hets

Unfortunately there is no key or patch available.

Keeps all your file encrypted demanding 920 USD Approx.

Even if you pay and email, they seems hacking into email too.

Beware guys.
Yes, nothing fancy. On the router, Dnsmasq and Dnscrypt-proxy with "forwarding rules" mapping domains or TLDs to desired resolvers. Any queries not matched get forwarded upstream to a server running Dnscrypt-wrapper and Dnsmasq, which logs and resolves over Tor.

https://github.com/DNSCrypt/dnscrypt-proxy

https://github.com/Cofyc/dnscrypt-wrapper
Honest question not being sarcastic: if this cold start latency is so important why chose function over elastic beanstalk or other auto-scaling type system?

Answer could help us try something new. We currently use large google app engine 'apps' after failing to get functions to scale quick enough (and hit limits). we have SUPER bursty traffic that needs to scale up to hundreds of instances very fast.
Would you really want “sponsored” rows automatically appearing in your Facebook-managed database?
Are you from Netherlands or did you migrate to Netherlands? I ask because I would like to know if it is common for Netherlands natives to have their office at such a convenient distance from home. In the UK, it usually takes a 1 to 2 hour train ride to reach work by train.
Five Years Later, Who Really Hacked Sony?
I agree, but I don't think there is a substantial number of software shops that use relevant degrees as a hard filter, nor is there a significant number of non-degree holders bursting with realized CS talent that the field is somehow blind to.

I took the intended sentiment to be that of finding talent among non-degree holders that won't necessarily present itself in a typical CS interview scenario. Thus we need a way to identify future CS talent that is merely in need of training and mentoring. And so the problem reduces to, in my opinion, to finding people who are smart and unusually self-motivated. But there is just no good way of doing this.
I'm just now realizing why I might have failed my interviews that I thought I nailed some questions in...
A large chunk of the feminist movement was and is women and men actively working to prove that biology is not a limiting factor in what women can choose to do with themselves

That's got nothing at all to do with what was being suggested.

Saying women have different "interests" -- or priorities, which is a better word in my opinion -- isn't suggesting they are incapable nor suggesting society should constrain their role. It's suggesting they have agency and make choices which fail to serve some abstract narrative about the theoretical importance of so-called equality of the sort that gets debated and hypothesized about in articles like the one under discussion.

I was a homemaker for a lot of years. Self-proclaimed feminists have a long history of being incredibly ugly to me.

I'm not the only person who has noticed that feminists are basically openly hostile and contemptuous towards homemakers:

https://www.youtube.com/watch?v=rQ1xOOyENmw
Ask HN: Is it viable to make a living learning/creating niche IT solutions?
I want to make a living as a freelancer but am interested in other routes besides the usual web/mobile developer. With knowledge of application development, basic electrionics & IoT, how viable is it going around finding small businesses and creating/selling niche hardware/software solutions? Any examples of individuals doing this?
I don't understand how you get that out of my comment. Regardless of what problems the parent poster actually faced, it's clear from their descriptions that (1) at this point they are genuinely experiencing problems from their expectation of discrimination (it's not like the "anxieties and nervousness" creeping into their heads would have any benefit even if the interviewers are in fact biased against them!), and (2) their usage of terms like "LatinX" indicates that they had a lot of exposure to the sort of writings that tell them to expect concealed discriminatory attitudes in everyone - which, even if true, is very unlikely to be a healthy or useful mindset for the putative target of those discriminatory attitudes to have.

I would argue it is comparable to (an outward-oriented version of) body dysmorphic disorder: instead of social anxiety due to the perception that people are disgusted by your appearance, you get social anxiety due to the perception that people hold a negative view of your ethnicity.
The ability to ask for money more insistently and for a longer period of time.
I think you're basically describing egalitarianism, correct me if I'm wrong. I'd recommend Rawls as good philosophical material on the subject. Always been how I view the world personally and I think people underestimate how much of it could be compatible with free markets and a good deal of general and important freedoms. Of course that's a much longer debate.

To get back to the point, what the author describing is also egalitarian. I think people are generally more interested in it with a game because of the finite setting. Golf handicaps are a perfect example that would have fit well into the article. People get more wary as the scope expands.
There is apparently a semi-standardized process where a hydrated nut butter is fermented with yogurt bacteria for a few days:

http://www.bccdc.ca/resource-gallery/Documents/Educational%2...

I'm not sure if this process has been attempted with hempseeds. It's a fast bacterial process, in contrast with the slow fungal fermentation of dairy cheeses. I wouldn't really say it's a commercial-ready process at this point; I'd like to see something done with proper cheese cultures!
Correct me if I'm wrong on the following, as I have not yet used Metaflow (only read the docs):

It is conceivable to execute a Flow entirely locally yet achieve @step-wise "Batch-like" parallelism/distributed computation by, in the relevant @step's, `import dask` and use it as you would outside of Metaflow, correct?

Although, as I think of it, the `parallel_map` function would achieve much of what Dask offers on a single box, wouldn't it? But within a @step, using dask-distributed could kinda replicate something a little more akin to the AWS integration?

Tangentially related, but the docs note that data checkpointing is achieved using pickle. I've never compared them, but I've found parquet files to be extremely performant for pandas dataframes. Again, I'm assuming a lot here, but I'd expect @step results to be dataframes quite often. What was the design consideration associated with how certain kinds of objects get checkpointed?

To be clear, the fundamental motivation behind these lines of questioning is: how can I leverage Metaflow in conjunction with existing python-based _on-prem_ distributed (or parallel) computing utilities, e.g. Dask? In other words, can I expect to leverage Metaflow to execute batch ETL or model-building jobs that require distributed compute that isn't owned by $cloud_provider?

As an aside: hot damn, the API - https://i.kym-cdn.com/photos/images/newsfeed/000/591/928/94f... Really cool product. Thanks for all the effort poured into this by you and others.
If they have children, most likely they got at least $1000 in refunds on their taxes. Since they are poor they get most of their FICA back on their return.

I use Turbo Tax to help out people in my area who don't even know how to use a computer. Most of them are poor and I do it for the cost of Turbo Tax and the fees they charge.
Is capitalism actually assumed to go on forever though? The idea of a post scarcity society isn't new. Hell, Marx's presentation of how communism would arise was largely rooted in the idea that capitalism would increase efficiency to the point that it would no longer make sense to follow its model any longer.
I wish more people would take this lesson to heart, not just in games but in life.
It looks like here the whole domain transfer was bypassed on the pretext of a possible botnet participation. The OP is absolutely right. Domain transfer needs to be much more robust than this.
Russia Bans SHUTTERSTOCK for Hosting a Picture of Poop with a Russian Flag on IT
Metaflow does come bundled with a scheduler that can place jobs on a variety of compute platforms (current release supports local on-instance and AWS batch). In terms of dependencies, we went with conda because of its traction in the data science community as well as excellent support for system packages. Our execution model also supports arbitrary docker containers (on AWS batch) where you can theoretically bake in your own dependencies. In terms of language support, we have bindings for R internally, that we plan to open source as well.

I wouldn’t qualify metaflow as anti-UI. For model monitoring, we haven’t found a good enough UI that can handle the diversity of models and use cases we see internally, and believe that notebooks are an excellent visualisation medium that gives the power to the end user (data scientists) to craft dashboards as they see fit. For tracking the execution of production runs, we have historically relied on the UI of the scheduler itself (meson). We are exploring what a metaflow-specific UI might look like.

As for comparisons with Airflow, it is an excellent production grade scheduler. Metaflow intends to solve a different problem of providing an excellent development and deployment experience for ML pipelines.
Waymo is a new kind of product coming out of Google, as was Chromecast, as is the so-far-successful Stadia. I'm there there are others, but those are a few I can think of off the top of my head that are delivering very well for the technical challenge they pose.
Hey, this is Jijo from Buy Me A Coffee. Thanks for the feedback! We believe 5% is a reasonable fee to build and maintain a platform that allows creators to connect with their audience and generate more income.

One way to look at it is the % of additional revenue they earn because of Buy Me A Coffee.