skysight-inc/HackerNews huggingface dataset:
hmm, I'd like to digress

>- Lots of different kinds of nodes

well, that's not a problem of slurm (which will happily start your process on all nodes), but of typical MPI programming. And once you are running something computationally intensive over multiple nodes today, you are still using MPI.

>- anything more complex dependency wise than a handful of shared Conda envs

you can put whatever dependencies you want on your NFS (or copy them to your node). If you're running on a single node it behaves 100% like running with a special login shell on os XYZ, so I don't know what problems happen with dependencies. The main problem would be that it doesn't include any "service discovery" beyond OpenMPI.

>- anything involving docker

have not used it, but there's enroot/singularity. The first of which is apparently dogfooded at Nvidia. Probably might need some adjustements for bases images (because MPI)... As I don't know about the policy within these 5k+ cloud companies: can employees just execute any random image from dockerhub there? This seems a little dangerous...

> anything vaguely untrusted

linked to the docker case? Does kubernetes reboot nodes then? Slurm can do this. And while classical Slurm use cases definitely require a shared account (because of the shared fs), slurm should afaik merrily execute your programs even without any shared account than slurm. You can attack this obviously, but so you can attack kubernetes and while it gets more scrutiny it's also a byzantine collection of FANG-style requirements.

EDIT: What you can't work around is Slurm needing a comms-channel back to the controller, which you though could just firewall off (jobs don't use Slurm to communicate...). As each job can execute a Prolog-script, you can even only selectively allow traffic to flow between allocated nodes quite simply.

>- any kind of partitioning worse than 3 nines e.g. connectivity or uptime instability

that's indeed the case

>- anything more complex than 3-5 priority levels of scheduling

what kind of scheduling does kubernetes implement? I guess you could write a plugin for slurm doing that

> It's great if you hit that niche but it frankly struggles with the complexities of even moderately heterogeneous work loads.

except that your points didn't pertain to this (except maybe for the dependencies, if you think about actual service-dependencies), I fully agree
Scraping Infinite Scrolling Pages
HN thread also worth reading:

https://news.ycombinator.com/item?id=22558182
>I understand you have been conditioned to think MS bad G$$gle good

That's a lot of assumptions you're making there bud.

>Windows gives you much more control and freedom than your Apple or G$$gle operating system.

But I run Linux and Windows.
Is there anything like this for PostgreSQL?
Orms are generally a lot of extra work down the track. They do 80% of things very well and save loads of time but you will spend an amazing amount of time on the other 20%.

Learning SQL is worth it.
Problem: 225 radioactive asteroids heading for Earth
What is a nazi? I might say it's someone who was a member of the Nazi party in Germany during the early 20th century.

You might say it's "groups that goals are to harm others"

Someone else might say it's anyone who doesn't support progressive policies because to do otherwise would cause harm to people, many of which are "marginalized" and "under-represented".

Let's see if we can agree on what a nazi is before we start figuring out what people are allowed to say and think in private.

>Ideally there would be a public organization, not aligned with specific political groups, making the decisions in a transparent way.

Good luck with that.
Chart library billboard.js 2.2 release: Gauge enhancements,Pie outerRadius&more
B: I want a de-googled browser! I don't want my browser phoning home to Google!
G: Ok, here's Chromium, with proprietary bits removed.
B: You've removed access to proprietary Google APIs that allow the browser to send and store stuff on Google.
G: Yeah, isn't that what you asked for?

It's not very hard for someone to spec out an open protocol for an end-to-end browser profile sync service. Those who want complete control of privacy can then run their own servers/containers and sync their browser to them. Those who want Google integration can user Chrome, and later, write an extension that allows Chrome to also utilize whatever open sync protocol exists.

There's too much whining, and too little coding. I think for the amount of time used to write articles like this, people could have already spec'ed out and MVP'ed such a service. This reminds me of the cypherpunks mailing list in the 90s. Like 95% of all the messages were political whining that X didn't exist, or Y doesn't do what they want, or bitching about the government. Eventually the hackers forked the 'coderpunks' mailing list, to work on actual solutions.

Chromium is a giant gift horse of a codebase that doesn't need Google integration, because implementing a browser from scratch is almost like implementing Unix from scratch, it's an enormous undertaking. It works amazingly well in my Oculus Quest 2 with WebXR integration (and :( Facebook integration). Chromium is being used in wearables, smart home devices, automative dashboards, the same way linux is endlessly reused, even if the forks aren't all useful as desktop replacements.

Thousands and thousands of products are being released thanks to OSS forks of AOSP, Chromium, or Linux, which if they didn't exist, would make life very hard for hackers and startup entrepreneurs who would have to pay enormous license fees, or do enormous amounts of work to bring up simple devices.

I guess what I'm saying is, developers these days face a cornucopia of riches in the ecosystem, but instead, HN is filled full of threads of people virtue signaling like they're an oppressed minority population. There's a lot of things which are non-ideal about every major platform developers face, but the successful entrepreneurs shut out the noise, and find opportunities in filling in the gaps.
Does a user have to write the rules?
Before you change your internal mental calibration, this of course changes based on latitude and time. The difference between daylight and a cloudy day midwinter in Northern Europe is probably not going to be 100x.
In my (direct) experience most security researchers, have very poor practices in general. I come to this space from the side of anonymity and general paranoia - because I find that interesting. That paranoia leads to horrible security experiences for me, but I feel much safer in my practices.

If you always assume your data is at risk, and that your data can become your person, you'll take care of it. In the modern era, we're almost post-goods. I couldn't care less if someone broke into my house and stole my TV/monitors/stuff - and it's happened. But the last thing I'd want stolen is data I hold near and dear.
This comment breaks the site guidelines egregiously. Would you please read https://news.ycombinator.com/newsguidelines.html and stick to the rules when posting here? We're trying for something a bit different than internet median here, and cheap accusations of manipulation are even a notch or two below that.

I downvoted the post because it was a snarky one-liner, which is also bad for HN. I'm not a fb employee and I don't care about fb, but I do care about HN.
Chrome sync isn't why people use Chromium. So if a browser doesn't have bookmark sync to a central proprietary service, all of a sudden there's no point in using it?

I'm a Google employee and I don't even use Chrome Sync for my non-corporate accounts.
James R. Flynn, Who Found We Are Getting Smarter, Dies at 86
Rclone should work nicely for this.
He's the one who made the animations.

They're incredible :)
We tried pg_upgrade going from Postgres 10 to Postgres 12 and it didn't work. An individual instance was about 8 TiB in size. We left it running for over a day to see if it would complete. Instead, we used an approach similar to logical replication described in the article.

To be fair, our use case was probably close to pathological for pg_upgrade. We had lots of TOAST data and dozens to hundreds of indexes per table.
Of course! Thank you. My rowing days are long behind me but when everything comes together there truly is no sport like it!
Creating solutions looking for problems is a common issue for would-be founders and it certainly has been for me for years.. It's a bit weird to hear the dismissal of an idea that I could totally have seen myself run with (and agreeing with said dismissal!)
> The most mind-boggling thing about development IMO is the fact that it works at all, let alone so reliably.

This sounds to me like engineers talking about a code base :)
That's like saying a car is only safer if you can be 100% certain it won't crash.
It’s because generational theory is bogus of course!
You can work around this by sticking rclone in the middle which does support soft delete: https://pricey.uk/blog/restic-backups-without-delete/

In short, give rclone your keys, (small ~/.rclone config file) tell restic to use an rclone backend and add an extra argument when running restic. (See the blog link above, all explained)

There's an open issue for this which doesn't seem to have moved: https://github.com/restic/restic/issues/2134 - it does have a couple of PRs linked on there which implement proper soft-delete.
amazon connect is more or less pay as you go (you need to pay a fixed price for the reserved inbound number)
Huh, really. I haven't gotten around to watching American Gods, and Westworld isn't my thing, but I also enjoyed the title sequence for The Man in the High Castle. It isn't one of the ones I'd watch every time, just because it's so chilling, but I do very much enjoy it. The show itself was incredible, of course, and also has a bit of a chilling feeling to it. It's a perfect fit.
His expectations ("predictions"?) are predicated on three things: climate-change, peak-oil and "cultural bankruptcy".

I understand the most realistic scenarios for climate-change do indeed suck for everyone involved, but won't lead to mass human extinction - and the predictions of "water wars" were not grounded in realpolitk.

Of peak-oil being a harbinger of imminent societal collapse is immediately bunk: the world's economically leading countries and supranationals have already put in place plans for post-oil sustainability - such as fossil-fuel car sale bans within 10 years. Furthermore Covid has demonstrated that society carries on functioning when air-travel is cut to a fraction of its former volume - leaving only international shipping and road-haulage as the remaining oil consumers without a decent post-oil plan yet - but it's demonstrable that there's plenty of oil left to keep those services running for decades with current proven reserves - considerably more-so with the expected end of gas-powered cars within a couple of decades.

The author's definition of "cultural bankruptcy" seems to be "the US is exporting individualism to the world, which will mean an inevitable decline to non-cooperation and (insert your preferred game-theory metaphor here)". Whatever one may think of that, he doesn't establish a reasoned connection between the two - just hand-waving.

I think the author just has an anxiety disorder that needs better management.
Sure, you can have different make targets if you really need to. Or Makefile.linux and Makefile.embedded everybody understands what to do in that case.

I simply don't understand the explosion of complexity associated to autotools, cmake, and the like.
A message I received from telegram on Jan 12 2021 says it has more than 500 million active users. “Telegram surpassed 500 million active users. In the past 72 hours alone, more than 25 million new users from around the world joined Telegram. Thank you! These milestones were made possible by users like you who invite their friends to Telegram. ”
> You really haven't explained why TransferWise is worse than your recommendation.

Transferwise uses rates close to what the central bank/governments is paying, which is far from the actual market rate. Plus the whole 6% fee.

> "breaking the law and exposing yourself to prison time"

I was going to call out this as FUD, but actually it's just you showing how you haven't been exposed to different systems.

First, whatever you do at an exchange needs to be reported and legally you will declare the income whether coming from the sale of crypto or an international payment order.

Second, you are thinking as someone who deals with a functional and not-so-corrupt tax authority. Your logic does not apply in a Banana Republic. All of these complex tax systems are full of loopholes precisely to give a way to do business that resembles normalcy to a privileged few. The ones that represent the institutions are in the game. The "strict rules" and threat of jail time only applies for those that oppose the corruption or that break their own internal code.

There is a reason there is a quote that says "For my friends everything, for my enemies the law." which is attributed to a Peruvian politician.
I was just wondering if people ever claim to be time travelers from the future, and if so what kind of reception they get.
Not afraid of endless browser wars. End of the war and google left standing on the other hand...(more specifically the chromium derived stuff)
> only 32% [0] of people care enough about privacy to switch to a service that preserves it

This statistic reflects my unscientific view also.

I am very privacy conscious (I still have a gmail account but that's for job hunting only!) but I know few others that are, however, if these others experienced something detrimental as a result of giving away their privacy then I suspect that 32% figure would increase... but until that happens, people won't care.

Protecting your privacy online these days is time-consuming and, if I'm honest, exhausting: it's a constant arms race between stopping evermore intrusive code from data mining the hell out of me and just being able to use things without constantly analysing them to ensure they're legit.

In fact, yesterday I went to the eff site [0] to see how much data my browser was giving away and even though I have it locked down (I still have js) I was unique anyway...

I've asked myself in the days when I feel like just giving in "what is the danger from <shady company> knowing all this stuff about me?"... And, in all honesty, I haven't come up with an answer that would satisfy that 68%.

[0] - https://coveryourtracks.eff.org/
this line of thinking is a race to the bottom
It retracts from the credibility of a documentation platform that the blog post announcing it makes one of the most basic mistakes of writing text online; line length should be kept to 60-80 characters to make it readable. It can be stretched a bit up to 100 chars depending on font-size, line-height, etc, but this blog post features a whooping 163!
It does indeed! Had never heard of dn42, although I've been out of the loop with regards to this stuff for years now. Will certainly be having a look at dn42 :-)
To be fair, Google can deliver that quality because they have so much more data. For every search in Bing where a user clicks on the first result and never clicks back on the first search, Google will much more. Likewise, for every frustrated chain of search refinements in Bing, Google will have many more to learn from.

Their position as market share leader gives them everything they need to know to maintain quality. Any deterioration in search quality with the data Google has means far worse than the competition in relative terms.

Which is a complete shame since people like quality in absolute terms so it’s gonna stay that way. Even I’ve tried DuckDuckGo and Bing - regardless of how not-Google they are, the results are absolutely worse. So I’m not switching either, despite knowing how Google keeps its position.
The mechanisms used in the earlier era - law, common sense, etc., have gone out of the window now that anyone can weaponize a social media mob into harassing targets into submission.
Say, your program is an editor of png files

Say you are writing a program to edit images that can potentially read lots of different formats. However most people don't need support for .sgi or .ecw files and won't have the libraries to read those formats installed. Your program is still perfectly usable without those libraries and so you should still be able to compile and run it, just without support for those formats.
I think this is a just-so-story meant to explain something that doesn’t require an explanation. It’s just gambling. Gambling is fun and human beings have always done it. You don’t need to posit anything special about Millennials. New forms of gambling come around every once in a while and this is one such event.
> Your comment appears to imply otherwise. Did I misread it?

My comment wasn't very clear. Sorry about that. Usually we think of a judgment "on the merits" as one that occurs after considering both the law and facts of a case.

> Do you mind elaborating on the difference?

In the case of a motion to dismiss for failure to state a claim, the judge in theory assumes that the facts alleged in the complaint are all true. If he dismisses the case, it is because as a matter of law the plaintiff cannot win. In such a case it is incorrect to say that the evidence was found to be lacking because the evidence was never considered.
Another Syncthing fan here. The software is great. But I used DO spaces for storage and it's pricy. One of my "to do" lists for 2021 is find a cheaper storage solution and move my backups over.
Click on the parent link, filter by $5k or more, scroll to the bottom. They actually donated. MDN doesn't seem to have that meta tag.
I recall during either during the 90's or mid 2000's that Canada was loosing a lot of medical school graduates to the United States for much the same reasons as well. There was some articles about it reversing in the last decade though.

On a personal note: I did QA, test automation, and current am technically Sales Engineering (though I'm finding I dislike it quite a lot). My last raise brought my salary to $52,000 Canadian a year at year 9 of my career. That's about $34,000 USD or so. I'm guessing that's not exactly stellar pay in the US.

Personally I'd seriously consider heading State side too if I could. As is I haven't the foggiest idea if I am qualified, how to find out, or what companies would even consider someone like me.
If data is sharable, it doesn't mean that it is trivial. In your example with shards by user, simple message sent between users in app becomes are very non trivial dance to be done reliably.
Changing Times: The Vindication of Raymond Bonner (1993)
Not sure if this is ironical. Either way, it is a donation as the MDN pages do not have a <meta name="monetization" ...> tag and the payment wouldn't go through OpenCollective which does not seem to support Web Monetization.
The original Celeste now has a sequel you can play in the browser
This was always true for female actors, but up to about the late 1970s male actors - even leading ones - could have any kind of head on them ... Some wonderfully charismatic ugliness going on. I think the pendulum will swing back eventually. I hope.
That is gold!
It's the picture at the top that is the video, took a while for me to load.
Except for these "greenhouse gases" which reflect an annually increasing amount of radiation back to the planet?
Hiking the GR20 in Corsica
I think Secure Scuttlebutt would be an awesome technology for a post-collapse world... I see how travellers arriving to a settlement could spread the updates of the network offline using the Gossip protocol, thus bringing news from far away.
i cant see how using a chinese based app store is any better than google/apple

if anything,you're more open to potential exposure of your data ,bad verification practices and CCP intelligence gathering
Actually you are right there, we do not need new radical ideas. We need creative solutions to the existing infrastructure's we have put in place.

Come to think of it maybe we haven't stagnated and in fact are a little overzealous with the creation of a new "language/tech/platform" every week that is going to beat [insert perfectly fine dev language].
The point is they're refuting your claim of intent.
There's always peeking into sgx enclaves...
The specific problem of syncing bookmarks is probably solvable with an extension. But the move suggests that Google doesn't view Chromium as something that people will use directly, like they're not interested in people using open source Android without their proprietary components. If they gradually make more and more pieces Chrome-only, it will get harder to make a relevant browser by forking Chromium, because there will be more to reimplement before people consider using it.

And, of course, that makes perfect sense for Google. Chrome is no longer the scrappy insurgent. It's the king of the hill now, so it can start putting the fences up against competitors.
I didn't quite like the first episode but show got build up so quickly to something really good. always last episodes of every season were too damn good.
I stayed at Jim Haynes’s place in Paris a few years ago—it was listed on Airbnb and seemed like an obvious choice.

He was welcoming and friendly but I didn’t spend enough time with him to properly connect.

Our world needs more people like this.
Clearly we need a better measurement. I suggest picking an open core, then reporting the number that can be produced per square meter. Some choices:

https://en.wikipedia.org/wiki/Category:Open_microprocessors

The IBM A2 and the UltraSPARC T2 look like sane choices. Perhaps there is a suitable RISC-V.

So then comparing processes, we could say that process X can do 54255 chips per square meter and process Y can do 83802 chips per square meter.
> that the blog post announcing it makes one of the most basic mistakes of writing text online

Your comment is a valid criticism of the Open Collective website (if you at all feel like it, please send it directly to them — see the bottom of the webpage), but it's not the fault of the "Open Web Docs" project. They probably have little more influence on the design of the website than somebody using indiegogo, patreon or kickstarter has on the respective platforms.
I suspect the main distinction in weapons designs is whether staging is used or not. Single stage designs will use some fusion through boosting and multi stage designs have multiple fission and fusion components (primary fission boosted with fusion and the secondary has a fission "spark-plug", the main fusion fuel mass and surrounding mass of fissionable material acting as a tamper and the main source of energy).

Most of the energy from most "H-bomb" designs actually comes from fission.
Weird. Moogsoft [1] has been around for years and they're an AI-based monitoring startup. A lot of other monitoring tools (AppDynamics, DynaTrace) incorporate some ML to help with root-cause and alarm deduplication. It's not the core of the product though, it's more like a helpful feature. I personally never found any of that shit to work in practice.

[1] https://www.moogsoft.com/
I'm very impressed, this made my day (my month ?). Too bad your site lacks some nice video demos on the front page.
To other HN readers, look what I found in it's tutorial : https://www.youtube.com/watch?v=dkvB4nb8PXw
Check out /A Canticle for Leibowitz/. Each time CollapseOS comes up, I picture a team of monks cycling alternators around the clock to keep a system powered while another compares parchment to a vacuum-tube display.

I think for its chosen niche, the key qualities are (1) low power draw and (2) the ability to boot and be usable with no on-disk storage. The z80 system has that, but you could build something much more powerful. Burn the OS into a rom, have it copy into ram at boot.