skysight-inc/HackerNews huggingface dataset:
Well, here's the thing. I don't go there. I do my best to have morals and principles that stop me from putting users at risk. I would push back at anyone telling me to do this.

If you go there but for the grace of God, that is a bad thing. You should not. You should figure out how not to do that.
> I'd love to see a study where researchers take things that are seen as good/important/essential to modern life and measure the amount of public/government sponsorship that helped bring it about.

Essential technology investment of US tax dollars?

NASA spinoff technologies:
https://en.wikipedia.org/wiki/NASA_spinoff_technologies

NSF, DARPA, IARPA, In-Q-Tel, ARPA-e (2009)

List of emerging technologies: https://en.wikipedia.org/wiki/List_of_emerging_technologies
> Governments spurred the rise of solar power

Govs are in the business of broadly benefiting the public now? - And at the expense of fossil fuel shareholders who have handsomely paid for their legislative privileges?!?.

Where's the honor in that?
Charlie Munger's No: 1 Mental Model
The keystone mental model that helps Charlie Munger avoid bad decisions.
> Isn't the entire pen-test/security industry based on exposure (of your "brand") though? What you can bill depends directly on how well known you are & your past work, in lieu of an objective measure of how good at it a person is. Geohot could bill thousands (or tens of thousands) per hour of his time and no one would bat an eye, but if some guy named Blake tried that, he'd be laughed out of the room.
Setting aside moral qualms for a moment, the engineering problems they're having right now are probably one-in-a-career problems, so it would be interesting work, without a doubt.
It was a lone comment that actually has several compelling implications that we would hope the TuSimple company thinks about. Each step of that has to have functions related to those actions backed up by many neural nets. And if it's hardly worth discussing, why is it the only comment you replied to in this entire thread?
I'm also the odd one out, so many enterprises moving to spark on databricks.
That's not the reason, and we all know it.

We live in a capitalist free-market system. Amazon (or any entity) is free to choose with whom they do business (oh the irony!). They are dropping Parler because the the current political climate has manifest in such a way that they think it will cost them more financial and/or political capital than the alternative (recall there is a lot of antitrust sentiment out there right now).

Too bad so sad. Sorry not sorry. This is exactly the kind of "freedom" for which many of the above platform's users would advocate. Parler's PR team is missing the opportunity to applaud AWS for exercising their freedoms.
Play store should allow to filter by license and anti-features. That would make it as usable as f-droid.

As an example: try to find a non-ad-infested flashlight app on play store, then try to find a single ad-infested flashlight app on f-droid.
If you are wondering why they do this, the answer is not because they don’t trust TLS.

It is (likely) because they use geographically distributed terminating load balancers, perhaps owned by someone else or run in someone else’s POP, and are trying to prevent passive collection of passwords.
>Oh please. Based "purely on market forces" can't exclude carbon emissions.

Huh? A bunch of people with no altruistic tendencies, and who are incapable of coordinating through any means but pricing, will not stop overfishing or carbon emissions. I don't get this often repeated thing about how not taxing carbon is subsidizing it, or how cap-and-trade is indistinguishable from naturally occurring markets. Both of those things are clearly artificial constructs built on top of the naturally-forming market. It's like many people are trying to use a perfect society as the zero-mark which all deltas and relative measures are measured from, while the state of nature (and the absence of a policy) is the obvious zero-mark to use.
What a click-baity title. This isn't worthy of the front page of HN
I'm with you. One thing I try to do to combat that is to "commute to my bedroom office via the garage" --> I go for a short loop ride in the morning that replicates my commute length.

I find that it really helps my energy levels and mental state in the same way my commute used to. Obviously, it takes a bit more discipline, but I actually look forward to it - a chance to check in on the neighborhood etc.

Another hint is it do something new on the route every day. It has grown to be quite a mental challenge to figure out a street or alley (or way of hooking things up) that I haven't taken before!
First it gets removed from Google and Apple stores.
Then it gets deplatformed from Amazon.
Now a hack that was in the making for a while due to political motivations.

This is a political purge.
It will be focused on the true expression of a small bird vomiting whatever it had for lunch.
The personal data of everyone who has used the site is in the public interest? Are you high?
That sounds reasonable enough, although I do question somewhat what the value of using it colloquially is, since it confuses the legality of it and, at least in my experience (which may be atypical), when people mention money laundering, its in the context of whether transactions or actions are legal or not. Although I have heard someone mention (once!) "legal money laundering", by which they really meant tax avoidance -- that is, moving money around in such a way as to minimize their tax liability. So maybe you're right about that! You're definitely right about how to address it, at least then people can correct it if they wish then.

> Heck, just buy the gift cards direct from amazon.

Indeed, unless you're out to commit fraud or legal-definition-money-laundering, there seems little point in jumping through the hoops.
And a lot of insincere attempts to address extremism look like "censoring Republicans".
Not moderating their uh, “content”, is very expensive for the rest of us. It’s potentially, an extreme expense for Amazon. No one has an obligation to let their business suffer for you.
It's pretty amazing that the article and the whole comment thread neglect OSes.

I use Debian with i3 on a 10 years old laptop with 4GB of RAM. It's my only workstation and I'm a software engineer.

I usually run two browsers including a tab for slack. Everything works fine.

Tip: install the documentation OS packages for all the libraries you need and also read manpages. Works well when you are on planes often and makes you a better developer than relying on search engines.
I did not hear that.
I'm sure there are many people who are going to jump at the chance to finally be able to loan their USD 75000 worth of computer out to a throwaway HN account...?
An even if they didn't agree with the sentiment, many or even most of those on the platform were perfectly happy to fraternise with those that did.
"[flagged]". I'm a HN noob, is there a way to see it? Or what did it say?
Call the spade a spade.

There is an inappropriate use of the word "researcher" in the title. More appropriately this should read "...scraped via IDOR vulnerability."
And thus the private messages/videos of all should be leaked by vigilantes?

I am equally concerned about what happened about the Capitol, but the actions taken by tech in response are unacceptable to me.
I had a really fascinating conversation with a leader at a local energy company. He discussed some challenges with pricing in producing electricity that might help here.

The BIGGEST expense for a power company is infrastructure. They have all of these electrical lines running everywhere. When they run the lines, they are designed for growth YEARS from now AND for the HIGHEST demand time frame.

This is to say: the company spends LOADS of money to run wires that are 99% unused. The cost of running the wires is a fixed expense that gets passed on to the consumers. As people move to solar power, they stop paying the power company. They stop paying for the electrical lines that were already run and already expensed. This cost is then shifted to the other consumers. Thus raising the cost of electricity for everyone else (in the short term).
> The lack of .h files alone is a huge grievance for me

That's an interesting point... Besides C and its derivatives, and OCaml, do other languages have separate definition files? It seems like newer languages, even statically typed, normally don't.

I suspect the reason is that you have to duplicate all definitions, which seems like rote work. It also feels less necessary with IDE tooling: IDEs I know have a view for all definitions in a file.
I think it was around 2014/2015 but didn't remember exactly when. I was in a programming bootcamp there was someone in my cohort on a temporary visa to the US. He managed to stay in a decently expensive area near our bootcamp, paid the bootcamp fee, and other cost of living. We asked him how, he said he was selling bitcoin to fund it. He sold it at $500 each.

If I calculated correctly he probably sold more than 20 bitcoin lol. He could retire now if he kept it.

Imagine how he feels right now, lol. But as long as he made profit, that's all that matters. Hindsight always 20/20
What are some examples of risk not taken that have lead to falling living standards?

My understanding of the data is that living standards have fallen because wages for most workers have been fairly stagnate since the 70s while the price things like housing and healthcare has skyrocketed.
If people don’t adopt a mindset of repair/upgrade and just continue to replace devices at the same rate, then sure more material is going to be used. Those devices will be easier to take apart and recycle though.

This isn’t just about phones and laptops, but also appliances, and people aren’t really upgrading fridges or stowes because a new model is available. Many only get new cars because the repair bill now exceed the monthly cost of a new car.
> You can split it so that each subgroup of the five can reconstruct the entire phrase.

How? Example: Split a secret phrase ("correct horse battery staple") between 4 friends with a quorum of 2.

- Alice: correct

- Bob: horse

- Carol: battery

- Dave: staple

Great! But that's a quorum of 4. How do we reduce it to 2? Each person needs two words:

- Alice: correct horse

- Bob: battery staple

- Carol: correct horse

- Dave: battery staple

But what if Alice and Carol want to get the secret? Or Bob and Dave? Well, each person needs the entire secret.

- Alice: correct horse battery staple

- Bob: correct horse battery staple

- Carol: correct horse battery staple

- Dave: correct horse battery staple

...but now the quorum is 1, and all of them just have a copy of your secret. If you want to be able to have arbitrary quorums, you need cryptography.
According to Wikipedia, there are 4,000,000 active Parler users.

You think you can assert with confidence that there are not 40,000 people with Parler accounts who want mass executions?

I'd like to think you're right, but I'm not as confident as you are.

Not after watching someone beat a Capitol Police officer to death with a flag pole flying the American Flag. People think they are defending their country against evil. Like me, apparently.

How many QAnon followers are there? How many believe the most outrageous claims? I would not be surprised if 40,000 do. Would you?
Ask HN: Who is working on fully decentralized social networking?
I imagine that the news about Parler having its plugs pulled both from app stores and AWS hosting has many of us thinking: what will it take to build a solution where that's simply not possible?

I know of Matrix, Mastodon, and PixelFed (and use the first two), but is there a 'facebook killer' in development right now?

My concern is that, while seizing control of social networking from big corporations is surely a great idea, it may be initially inundated (and thus, socially formulated) by the same whackjob culture that flocked to Parler from Twitter.

How can we ensure that balanced and healthy communities form on the decentralized web?
I am not a car specialist, but I am not buying this. Alternator can be upgraded: https://www.trucknews.com/products/600-amp-alternator-for-mi...

With 600 amps@24V one has 10 kW power for computers and the truck. That’s what 300 decent graphic cards consume.
Most trucks are moving to the single tire setup for the higher efficiency.
That is not what optical illusions are.
Weighing the pros and cons of ethical programming
Wikileaks would never publish anything that hurts authoritarian cause, so it's highly hypothetical.
Except for 120% of what you made. So I guess you didn't have much to sell to begin with.
What is djb? I tried googling it and couldn't find anything that made sense.
(IANACL)

Here’s the relevant process per the constitution: https://en.m.wikipedia.org/wiki/Contingent_election

Basically, if there is no absolute majority of electors, each state gets one vote in the house for president and two votes in the senate for VP.

All of that only comes into play if there is no majority winner though, so I don’t think just keeping them from voting would do the trick.

The Presidential Succession Act only covers succession in case of removal from office and only until an election can be held, so it is technically true that Pence would be in line, but that assumes Trump was removed and the electoral votes had still not been counted, a highly unlikely combination. Even then just counting the votes would resolve this problem. https://en.m.wikipedia.org/wiki/Presidential_Succession_Act
It's disgusting that total strangers can read our public social media postings.
Antitrust legislation isn't built around 100 % monopoly, but rather dominant force and cartel-like behavior, especially if they act to suppress growth of potential competitors. This is the core of antitrust jurisprudence: markets only work in presence of vigorous competition, but big incumbents are highly motivated to obtain so much influence that significant competition does not have a real chance to grow and threaten them.

There is a longish recent staff report on the Web of the Congress regarding behavior of Amazon, Apple, Google and Facebook (almost 500 pages) [0]. I actually read most of it. These platforms have already engaged in a lot of stuff that is anti-competitive. And the latest purge of Parler is, among other effects, also a suppression of a potential competitor.

Of course, the tech giants say that they weren't officially motivated by a desire to suppress a competitor, but they acted against potentially competing firms so many times already that one should be wary about their explanations.

[0] https://judiciary.house.gov/uploadedfiles/competition_in_dig...
Didn't WikiLeaks publish the decryption key for the Manning leaks and all the unredacted messages got into the wild?
And now information about your account has been leaked, and will be lumped in with more nefarious accounts. I have a feeling that a significant number of people have similarly made accounts out of curiosity. I've had my parents and some less technically inclined friends recently ask me what Parler is because it's been in the news. These aren't people that fall under the alt-right categorization in the slightest, and they're also not people who would think to use fake information if they were signing up for something to see what it is like.

Even if the platform had terrible and dangerous content on it, we should avoid assuming that everybody on it supported that content, and we shouldn't celebrate their personal information being leaked.
Yes he did. Perhaps not pedantically and explicitly, but implicitly he did. It's no different than a mob boss saying 'wouldn't it be a shame if X had an accident', and then X dies at the hands of some associated people.

Did the mob boss explicitly (and perhaps pedantically) call for the person to be killed? No. Did he call for the person to be killed - yes.

I'd point out that Trump has been doing stochastic terrorism for the past 4 years. That he uses a few simple rhetorical tricks, he appears to be a pretty simple man. One that seems to work amazing well is to take multiple contradictory positions. People then try to interpret this. Some go with the interpretation that suits their view (like - he's telling us to storm the capital). Others look at it an try to unify it into some whole - as if Trump is articulating some kind of coherent position that you can divine by looking at the contradictory positions.

No, there isn't some special sophisticated underlying reasoning - it's cover.

Such nuance is perhaps hard for Snopes to get into. If they answer the question literally then they have to conclude no - because he didn't literally say that. He went right up to the edge of explicitly asking for it, and then mumbled a few 'peaceful' bits at the end.

His supporters knew what he meant. He knew what he meant. This was all for his benefit. He knew his followers were talking about doing this (I mean I did).

He could not know for sure it would happen. That doesn't mean that wasn't his intent, and that was not what his actions encouraged.

I would also point out, typically (perhaps always) with previous Trump scandals it's worse than what it initially seemed. More information comes out - and it gets worse. With Georgia election call - we find out they had tried to make the call 18 times. That there were two calls to persuade to 'find votes'.

I have little doubt over the next few weeks, and years as more comes out Trump will look significantly worse around this than he does right now.
SQL proficiency is important but I wouldn't say it supersedes programming experience. To me, Data Engineering is a specialization of software engineering, and not something like an analyst who writes SQL all day.

As DE has evolved, the role has transitioned away from traditional low code ETL tools towards code heavy tools. Airflow, Dagster, DBT, to name a few.

I work on a small DE team. We don't have the human power to grind out SQL queries for analysts and other teams. Our solutions are platforms and tools we build on top of more fundamental tools that allows other people to get the data themselves. Think tables-as-a-service.
I want to minimize the external environmental costs of electricity production and distribution.

Given that the market has selected the least energy-efficient cryptoasset, we should not expect markets to just change given the existing incentives.
At least the 'pretty girl' in this example can point guns when she's a fiat - so she definitely gets a few bonus points for that.
Diablo 2? That takes me back. I remember running it on a 600 MHz machine with a gigantic, 75 lb CRT monitor, and a Voodoo 5 card. That video card gave me a real advantage playing on Battle.net, because I could pump more frames through that card than most people could in Glide mode than most people could with the shiny graphics cards of the time. There could be 100 mobs on the screen, and I wouldn't lag.

Good times.
Phone unlocking doesn't get much attention, but it is an integral part that no one wants to address or get their hands dirty with.

There are many more locked phones in drawers or acting as mere paperweights than people actually care to disclose.

Several years back we ran a poll to understand lifetime recycling habits.
People aren't proud of dropping a phone and shattering the screen, but they are less proud of having thrown a phone into a drawer because they couldn't be bothered to run the obstacle course set up by their telco to keep them in check.

Phone right-to-repair should be EXPLICITLY INCLUSIVE of unlocking, otherwise it is only solving a part of the problem.
I've had an iPhone since 2009 and I'm definitely familiar with the "time traveling" effect of upgrading phones, but I think it has diminished a lot as the technology has matured.

I've been using a 6S since 2015 (this thread caught my interest because it's now somewhat of a Ship of Theseus as I've replaced so many parts over the years), but the 11 Pro I bought last year was the first time a multi-year-gap upgrade felt rather incremental, especially for $1100. I returned it and expect to continue to use and repair the 6S until they drop iOS support for it.
Betting 1000$ is not a crazy risk.
There's a good chance you can find a compatible version of LineageOS. That should extend its lifespan considerably
Okay, so this is admittedly snarky but we've seen this sort of blog post so much that it has practically become an Onion article: Why Haskell Is Our Secret Weapon, by Startup You've Never Heard Of.

And then when someone points out that nobody knows who they are or what they've built, we get commenters talking about how company X, Y, and Z are also using Haskell. And those claims also come up short...most of them can't say where or how it is being used because they don't know...just that at some point in the past, someone emails were exchanged between someone@bignamecompany.com and someone@haskell.org, and now there is a piece of copy on the Haskell website that disingenuously claims BigNameCompany is powered by Haskell!. Who cares how pervasivly it is used...if someone writes a config parser with Haskell, all of a sudden we can claim that BigNameCompany would fall over on its face if Haskell wasn't there protecting it.

Come on. Nobody cares that Haskell is your secret weapon if you've never overcome an opponent with it. Or built an entire profitable company on its back. All these types of posts do is fake an authority so you can jump straight to your fallacious argument by authority.

If you want to argue the merits of your favorite language, then do it. Don't make us sit through an argument about how your language makes you special when you aren't even noteworthy enough for a 10 sentence Wikipedia blurb. There are a lot of valid and powerful technical arguments in this article, but they're ruined by framing them all around the premise that we care about how it makes you and your startup special.
I think the difference is that while it may not be entirely practical to replace Twitter or Facebook as the primary means of discourse, it is certainly more practical than replacing the government. Twitter and Facebook imposing their own flavors of information censorship is a lot less dangerous than the government doing it universally.
Are you working in this field? I am looking for a consultant to setup a modern data processing pipeline for a data driven hardware product I am building.
> building data pipelines in Spark, Flink, etc. goes way beyond knowing SQL

What if you build you data pipelines in sql? curious if you have an example of a data pipeline that needs spark?
This vicious lethal (effectively kills Parler) action by Amazon - driven by a mob of woke employees - will cause long term damage to AWS. I had plans to use AWS for a potentially huge SAAS business, even though it is not likely to be contentious, just the thought of them being able to destroy everything overnight, without due process, without recourse - sends chills down my spine. I cannot now imagine, being able to trust Amazon for critical infrastructure ever again and I'm sure many other entrepreneurs will feel similarly.
I am really happy with the way Hackernews works and the way moderation works here. Thank you!

I do not know if there would be a possibility to scale it for a real social network tho.
Where you are going wrong is that none of what you say demands a hack or a data dump.

Get warrants, subpoenas, etc., and go after those inciting riots/sedition.
It's interesting how the Democrats have chosen to move against Trump and his supporters. They have no interest in bringing the country together, they are doing everything they can to divide it. The Tech companies, the media and even Pelosi and Schumer are really setting things up for a massive confrontation. For some reason they don't feel like they need to think about the 70 million plus that Voted for Trump.

Cancel Culture, shaming voters/supporters, Tech companies deciding what one side can say, etc. These folks will not be silenced, they will react and it won't be pleasant.

Junk away...