skysight-inc/HackerNews huggingface dataset:
To follow up: I ended up building my own Docker images which contained the build tools (also known as the npm burning dumpster tire fire with extras thrown in), source code and all dependencies. This allows me to get reproducible builds, the modern-day analog of "./configure; make".
Software that transmits information about its user (including their PII[1]) by misusing that user's computer hardware and resources without that user's consent and against their wishes is malware: specifically it is spyware. Netdata goes a step further and does it silently, without even notifying the user that it is spying.

https://en.wikipedia.org/wiki/Spyware

People don't like their common, popular software being called that because it's truly not a good thing, not because their software isn't spyware (as you can see at the above link).

It's become somewhat popular amongst unethical developers to pretend that this sort of collection without consent is somehow okay or necessary to their ends as long as the users don't see it happening; this belief is not shared or widely held by users. Indeed, when exposed to users, it generates huge distrust of the manufacturer, and sometimes makers of software will backpedal, such as GitHub's Atom now offering[2] a consent dialog on startup[3] for user spying.

[1]: An IP address + timestamp, in practice, usually uniquely identifies a person, and is thus personally identifying information in reality, regardless of whether or not the GDPR classes it as PII for purposes of regulation or not.

[2]: https://github.com/atom/atom/issues/4966

[3]: it's still nonfunctional, sadly: https://github.com/atom/telemetry/issues/33
I guess it's more like they don't want to have their brand associated with "inappropriate" content. From my (European) perspective the bar American corporations use is weird, but seems plausible to me.

Also I believe they come to it as a media corporation - access to content has to be restricted, so they can charge. If archive.org has too many texts/videos/... people don't watch their movie (not that it works that way ...)
>Conversely, if I were sysadmin at a bank I would most definitely be concerned what was running in my network.

I've worked at a bank. It's a docker file. Running Hadoop. On top of a Linux Container. Running in Rhel 5. On top of a vmware hypervisor.
There's definitely a quantative difference between the amount of other individuals' personal data in your bank records vs in your social network account.
Yahoo has sent emails to everyone allowing them to click a button and get a zip file prepared with everything they have posted or stored on every Yahoo Group they have ever participated in.

Blog author and people here believe that outsiders with no connection to these groups have an inherent right to download and republish all this information despite having no license to do so. Yahoo/Verizon seems to think differently.
Our climate is like reckless banking before the crash
Linters complain when you don't pin the version, though
Larry Page and Sergey Brin: a timeline of their rise and disappearance
I guess cell is more efficient due to the DMA. Note the Cray manual says "There is no path between Local Memory and
real memory. Vector registers must be used to implement block copies.", i.e you have to spend CPU cycles copying data.
Changes to BBC iPlayer on Some Samsung Devices (December 2019)
Maintaining a static archive is remarkably inexpensive. The total amount of textual data included in even Google+ was likely only a few hundred GB. Images and multimedia, of course, would have been far more, though sampling-based estimates suggest that these were a few hundred KB each, on average, on about 30% of all posts.

The mean post size on G+ was rougly the same as on Twitter: about 120 characters. (Quite possibly because most G+ posts were themselves repurposed Twitter content.)

Static content does not require ongoing moderation, though it's possible that problematic content will be periodically identified.

The bigger challenge is actually in the publishing engines. Even where these are static, it's possible that vulnerabilities will be identified. That was Google's (not especially convincing) excuse.

A challenge of the Internet Archive / Archive Team method of archival and access is that in preserving the original formatting and packaging of content, the bandwidth and storage requirements are increased tremendously. By about two orders of magnitude in the case of G+.

Were the Archive to focus on the actual originally-authored content rather than all the associated chrome, both factors would be tremendously reduced.
Startups should immediately consider managing their cloud?
Fixed spreads, no hidden fees
Some devices from 2018 are no longer supported :(
> If the restaurant overcharges you or you are not happy with your webshop purchase then the bank will not help you out.

I don't know what it's like in other European countries, but I have to enter my PIN code before a transaction can take place (except for very small transactions). So since overcharging or webshops charging my account cannot really happen without my explicit permission, I don't really see how that could happen?
This is not "the tradeoff", but too easily a straw man because bcrypt (et al) cost so very little as to effectively cost nothing at all.

Think about your server consuming resources: It needs a [machine] password stored someplace in order to authenticate itself to those resources. If it stores this encrypted, then an operator must be present to decrypt it when (re)starting the server. If this is stored unencrypted, then it is not and the server can be started unattended (or autoscaled or whatever). That is a security tradeoff because there are both real benefits and risks gained and lost with each approach.

If docker was ever a tradeoff, it was between taking the time to have a thoughtful architecture versus trying to get acquired, and I think we know which way they went.
`curl | sudo bash` should never have become a thing in the first place. To me, it's the most "WTF?" mode of installing anything. Especially when the source is HTTP.

In what world is that secure?

Pity Qubes is so heavy, otherwise I'd be using it
Oculus Quest Will Support Hand Tracking in Early 2020
That was a fascinating article indeed--thanks.
A Piper’s Last Song
Those costs reflect the actual social costs of that hosting. Prior to GDPR and similar legislation, those risks were externalised onto users and society at large. They're now being shifted, properly, to where they should have been borne in the first place, on the service providers themselves.

Blame risk-externalising business practices and willful ignorance.
Planet Nine would be an interesting addition here.
The article focuses on Hadoop, but the generalization to containers is spot on.

Containers have become the first stop method to hide overly complicated build processes. When you've noticed your wiring has become a complete mess of knots, just put it in a box so no one will trip.

It seems to me that containers are useful for deploying final setups, but should be a no go for packaging tools.
Wrapping is not a good default, and actually it's not that common a scenario.

When you want arithmetic to wrap, you should use some way to explicitly denote that you want it to wrap. (I think it could look like an operation with a modulo reduction or mask applied to it.)

defer is way more transparent than RAII, because your code is right there in the function call, not hidden in a pile of classes that might change underneath.
Also, it seems that Raft is easier to understand and implement, according to some papers and blog posts I skimmed.
I sometimes have problem doing `./configure && make` because dependencies varies across different distro, which have some subtle differences that make it not easy as expected.
Yes, they own what employed workers produce. But especially before there was such a number of freely available open source licenses software vendors licensed tons of stuff, often in source, often without permission to relicense the source and over time developers refsctored the licensed code, which makes it hard to trace code back. Especially since version control often was done by having different sets of floppies, which are all gone.
To add my pet theory, it's a attractive to kids because it's an immediately understandable job. "Pick up all the rubbish, put it in the truck, press the button, move on". You can imagine a kid watching the whole routine and feeling like they understand every part of it, the wider context and the minutiae.

The classic "what do you want to be when you grow up" responses (Firefighter, Police, Doctor, Chef, etc.) all have that property of being immediately relatable.
Since I got to know CDK[0], I prefer it over serverless. It's supported by AWS, too. It can deploy your lambda, or it an just generate a Cloudformation template - these 2 covers the most important features of serverless that our team uses.

[0]https://github.com/aws/aws-cdk/tree/v1.18.0/packages/%40aws-...
This will get everyone riled up but I think the problem with solving climate change is that the people crying the loudest does not want to solve climate change but want to fundamentally restructure economies and societies - as support for my point of view here I would cite the green new deal.

If people were interested in solving it instead of using it to drive another agenda it would have already been solved.
I dunno, they didn't explicitly say anything about it, but it seems about the same as someone getting really angry that someone thinks pi = 3 in a society that has for centuries legally enforced, on pain of death, that pi = 10.

Yes, pi is not 3 but are people really unaware of the social signals they give off by being so outraged at the mistake given the context?

To extend this analogy far beyond what is wise, I'm not really sure there are that many people who think that pi is 3, probably mostly 3.1 or 3.2, which makes fixation on extreme outliers who might believe it's 3 extra odd.
> We don't want wealthy people to have an outsized influence on politicians.

Why not? I just want to be free.

That means no elections to begin with (no government), but as long as elections exist I don't care who runs the show as long as they keep cutting government spending and leave me alone.
Create Your Own Mario Typing with UseKeyPress and Faker
The co-living is split into 3 apartments per floor with 6 floors. People in each apartment (~6 people) share a kitchen.

The main difference to a regular apartment are the events in the building - yoga sessions, regular community dinners, weekly football matches, parties etc. Everyone in the building gets to know each other pretty quickly. Average age is about 29.
So it's an apt analogy after all.
TikTok simply bans all politics, regardless of the side. Whether you like it or not, it does not seem very hypocritical to me.
Money Management Tips to Reduce Unnecessary Business Costs
I've used Serverless framework a bunch. I'd never deploy to Lambda without it. It's far better than eg. Zappa which only supports Python. Would highly recommend it to anyone writing for serverless services :)
Serveless is the reason why I learnt js. It's that good.
I’m guessing you don’t have children.
Prospecting for Hash Functions (2018)
Great news. They've been hard at work for a while and it's finally come to fruition. Congrats
Truth be told the whole front-end ecosystem relies on those servers being available, so in their absence any development everywhere would grind to a halt - as it almost did during the left-pad scandal.

While I agree that this is not exactly the sanest approach, within the ecosystem there's no incentive to work differently.

Also, like someone else mentioned - dependency hell only got worse over time - setting up a new project you're likely to have several versions of the same library in your node_modules.
Is there any reason bmp would work better than png? I've always used png all this time.
Oh, it's been years since I was involved with any of the actual running of it. I don't even have a shell account any more. In the early days it was "the server", a spare PC that was donated. These days it looks like they have a donated cluster: https://www.srcf.net/faq/about#system

The "backend" will be Apache. On day 1 we used SSI (server-side includes) for "theming" pages, which were all in handwritten HTML. I suspect it's still like that given the five blank lines before DOCTYPE. It looks like some bootstrap CSS has been sprinkled on it since then. There's no front-end Javascript because there doesn't need to be.

> Until 2006 we had just one server in use, kern (a dual Athlon 1.6GHz PC with 2GB of RAM and 400GB of disk). Before that we used to run on an ancient Intel Pentium running at 166MHz with 128MB of RAM. How times have changed :)

Indeed. That ancient system was perfectly adequate for serving web pages to a few thousand people for light use. At the time I was carrying around the amazing new thing that was a computer you could fit in your pocket and play music illegally downloaded from the internet on. It was a Toshiba Libretto 30 with 8MB (eight megabytes) of RAM and a PCMCIA sound card.

Our systems approach to the SRCF was very much "what is the simplest thing that could possibly work". Apache+CGI+PHP with UNIX user accounts will get you a long way if you let it.

The real achievement is political and personal. I'm amazed that they've always managed to find good enough volunteer staff for the whole thing for twenty years.
Some of the design of decisions that lead AVX512 are explained in these slides from Tom Forsyth http://tomforsyth1000.github.io/papers/LRBNI%20origins%20v4%...
One of the reasons mentions is 512 bits is the same size as a cache line.
Even worse, now comment chains can't be expanded without logging in.
The Netherlands. Most if not all credit cards do not allow you to carry a balance. It must be paid at the end of the month in full.
These are percentages of what, exactly?

(If it's 'type of payment method' owned: possible. But if it's volume of currency exchanging hands then it //really// mismatches with my experiences in US vs Northern EU)
Overly Attached
Found it in this comment and thought it was interesting enough to warrant a submission: https://news.ycombinator.com/item?id=21737951
Sure, but it wasn't immediately obvious it was that specific when I looked, hence the question.
Who still uses Hadoop anyway?

https://spark.apache.org/
https://www.iguazio.com/data-science-post-hadoop/
Don't turn it into an ageist thing, unless you are particularly old, there will be plenty of older developers that also don't understand this.

It largely comes from understanding _why_ reproducibility is a good thing, and there are _lots_ of open source maintainers that understand this that are likely "younger than you". The vast majority of developers though focus on other things, that SQL injection attacks are still a thing indicate that we as a community have a _long_ way to go on the security front.
For groups, especially, this simply isn't realistic to expect.

When the G+ shutdown was announced (see earlier comment, I was one of the "Plexodus" organisers), the whole question of what to do about Communities migration hadn't even occurred to me. It wasn't until a community moderator happened to mention that they had a group with 400,000 subscribers and no idea at all to even begin that I started looking into this.

The first result was to create at least a framework for organising and planning:
https://social.antefriguserat.de/index.php/Migrating_Google%...

It's a really basic thing. I've found no evidence that any such guide has ever existed online. I make no claims that what I came up with was the best, or even effective. It does seem to have been the first. Win, me.

We created a "short FAQ", formatted for posting to G+, which we posted again and again and again and again and again, to as many communities and spaces as we could. Because when you're trying to reach a mass audience (10ks to millions of users, 10ks to 8.1 million communities), mass repetition is necessary.

https://social.antefriguserat.de/index.php/G%2BMM_Short_FAQ

It's hard enough to motivate people to turn up at one place once every couple of years to mark a few spots on paper, when they all know that this happens regularly -- election turnouts tend around 30-40%. Getting mass compliance on a complicated, unexpected, and technical process (with social and legal entanglements) is far harder.

Many groups glide by on minimum maintenance for years. Whatever initial technical competence was required to set up the group be long-lost. At best, moderation skills are known (and even that is a long stretch). Migration is an entirely different skillset, one rarely exercised, and, as noted above, extraordinarily poorly supported.

TL;DR: your expectations are entirely unreasonable.
But it is consistent, which is very important.
Give me rsync and a sysadmin any day over a circle jerking dev ops team.
it's a triviality to say that you can control for educational attainment (and opportunities for education as well as class) when accounting for differences in IQ: it's hard to do in practice because social science is complicated and requires ACTUALLY DOING THE SCIENCE so gwern's glib comment is just wrong here

clearly we're talking about the impact on IQ of whatever factors we make up to describe IQ, and obviously, and provenly, education (and therefore the ability to get education) is in play here, which gwern's glib rebuttal ignores
I recently went as far as setting up Bigtop on a VM to build the Deb packages, I gave up after 2 days. I would rather suffer through 2 root canal procedures back to back without anesthesia.
I would rather build it in a type-safe and memory-safe language - but if that is not allowed I would go for C++ even though I have my issues with it.

Catching TypeError in python and handling it is not a substitute for static typing.
That's still dangerous and a retrograde step security-wise. There should be no third party code that is running on your internet banking session, including browser extensions.
Student Run Computing Facility
Fixed.
Thank you!
I Taught My Computer to Write Its Own Music (2015)
There have been lots of reports that this 'Get My Data' function doesn't work. One of the demands made by the blog author is for Yahoo to fix this so it actually does work.

Additionally, the 'Get My Data' only gives you access to all the files / photos that you uploaded to the group. These archives should not be considered complete archives of the group - is it really reasonable to suggest that in order to completely back up a group, every member must complete their own data request?
Apologies for not writing a summary of these, but I fear I'll gut out important stuff. However, here are some links that certainly can do a good job at telling what's been happening in Hungary:

- https://www.vox.com/policy-and-politics/2018/9/13/17823488/h...

- https://www.nytimes.com/2018/12/25/world/europe/hungary-demo...

- https://www.foreignaffairs.com/articles/hungary/2019-08-15/h...

- https://www.economist.com/briefing/2019/08/29/how-viktor-orb...
It’s not a layer of abstraction any more than Terraform. You can’t just take your functions and port them without changes.

Besides, you can easily do all of your configuration in the web console and export a SAM CloudFormation template for your CI/CD pipeline.

As someone else mentioned, there is also the CDK.
Is this the future of Facebook when personal data use become heavily regulated, the data will become harder to monetize and the next big thing rize on the horizon?
honestly it's disappointing when i see people with training in stats make these comments: I'm a fucking poet if I'm anything at all and yet I find myself drawn into these ridiculous discussions about stats (in which I have no formal training) where I feel like I'm one of the only people in the room who knows how to divy up numbers
Awesome development!
DREAD from 2004

http://www.defensereview.com/world-exclusive-video-dread-wea...
Advanced Query Accelerator (Aqua) for Amazon Redshift Available for Preview
Jan Czochralski had also interesting life. Polish, born and educated in Germany, moved to Poland after independence in 1925. During WW2 he had been allowed by Germans to run his laboratory (and had been helping Resistance at the same time). For that readon there was no place for him under Communism. He run a small cosmetics lab in his homerown until his death in 1953.

[] https://en.m.wikipedia.org/wiki/Jan_Czochralski
1, I can fit the US on a linear trend amongst high income countries.

2, there’s no necessary reason why increasing health share with rising real income is unsustainable. We can and have increased share spent on health while increasing real expenditures across the board.

3. I touch on some reasons why this may curve up and then eventually flatten out.

4. No, not everything fits on log-log slopes and us is very close to the trend.

https://randomcriticalanalysis.com/2019/12/03/no-means-no-th...
> He would press his tongue hard against the roof of his mouth then release it with a suction "pop".

This is an alveolar click, known as a normal part of certain African languages.

If you've seen the name "!Kung San" around, it is the sound indicated by the "!K".
My all-time favorite talks
The limited amount of VRAM in the DS is the real issue. Even the lack of RAM is an issue.
Yeah, and sysadmin would be so much nicer if it weren’t for all the users.
I don't mind it not being default - but the section doesn't mention at all how to get wrapping behavior. Just one sentence like "use this different operator to get wrapping behavior" would be fine, but since they didn't mention it at all I kind of went away with the idea that it is not supported at all, which honestly would be a massive problem.

>defer is way more transparent than RAII, because your code is right there in the function call, not hidden in a pile of classes that might change underneath.

I mean, sort of? It seems way less composable though, if you have an object which contains 5 different resources, now you have to defer 5 things? How does this interact with return values, if you defer file.close() for example but return the file, does it still get closed? And if you have a heap allocated array of those objects, where objects get inserted at different places, defer doesn't work at all anymore, since it's just bound to function scope? Because that's usually the scenario that can be annoying to handle in C (opposed to just closing whatever was opened in the same function scope), so it seems a bit odd to me to kind of violate that "no hidden control flow" principle for something that doesn't even solve the primary issue that C resource handling has.
And it would be regulated as a firearm in the UK ("a lethal barrelled weapon of any description from which any shot, bullet or other missile can be discharged"; section 57 (1) Firearms Act 1968). There is also a specific list of prohibited weapons in the same act which are firearms even if non-lethal.
I bought a hardcover Le Guin anthology recently after balking a bit at the price. But then I was amazed to find it stayed open when I put it on a table and very happy to have paid the premium! Now, thanks to you, I know there is a name for this technology.
I usually try to make a point of educating the users that, when it comes to software, there is no such thing as "it is not working". Software always works; it might work incorrectly, unexpectedly or confusingly, but the only way for software to "not work" is that the hardware never switches on at all.
> 60k downloads of 6GB models per day

Wait... you mean the actual computation is running client in the browser? I didn't even open this "game", but I assumed such high cost is because there is a separate GPT-2 running on a GPUs for each and every user.