skysight-inc/HackerNews huggingface dataset:
In data engineering your goal is "standardization". You can't afford every team using their unique tech stack, their own databases, coding styles, etc. People leave the company all the time and you as a data engineer always end up with their mess which now becomes your responsibility to maintain. You'd at least be grateful if those people had used the same methods to code stuff as you and your team so that you wouldn't have to become a Bletchley Park decoding expert any time someone leaves. Or you'd hope the tech stack was powerful and flexible enough that other people other than engineer types could pick it up and maintain themselves. They mostly cannot do that, because there is no such powerful system out there. Even when some modern ELT systems get you 80% there, you, data engineer, are still needed to bridge the gap for the 20% of the cases.

Data Engineering really comes down to being a set of hacks and workarounds, because there is no data processing system which you could use in a standardized systematic way that data analysts, engineers, scientists and anyone else could use. It's kind of a blue-collar "dirty job" of the software world, which nobody really wants to do, but which pays the highest.

There are of course other parts to it, such as managing multiple data products in a systematic way, which engineering minds seem to be best suited for. But the core of data engineering in 2020, I believe, is still implementing hacks and gluing several systems together so as to have a standardized processing system.

Snowflake or Databricks Spark bring you closest to the ideal unified system despite all their shortcomings. But still, you sometimes need to process unstructured jsons, extract stuff from html and xml files, unzip a bunch of zip archives and put them into something that these systems recognize and only then you can run sql on it. It is much better than the ETL of the past, where you really had to hack and glue 50% of the system yourself, but it is still nowhere near the ideal system in which you'd simply tell your data analysts: you can do it all yourself, I'm going to show you how. And I won't have to run and maintain a preprocessing job to munge some data into something spark recognizable for you.

It is not that difficult to imagine a world where such a system exists and data engineering is not evem needed. But you can be damn sure, that before this happens, that this position will be here to stay, and will be paying high, when 90% of ML and data science is data engineering and cleaning and all these companies hired a shitton of data science and ML people who are now trying to justify their salaries by desperately trying to do data engineers' job.
Yep the government has for a while been dismantling any opposition by stacking the courts, replacing critical state media, attacking journalists and so on. The support for this kind of law is actually just consequent because social media is the platform that lends itself most to riling up a mob.

It's simple majoritarianism, rallying a hyper-loyal voter-base and disadvantaging scholars, intellectuals, scientists and so on.
Probably because most of the pre-orders had enough time to beat the game.

The main story lines are not crazy long, maybe 30hrs or so. The side quests aren't nearly the quality of Witcher 3. Most are just, "run into this building and kill this guy / steal data from the terminal, then run out." They only serve as something to do while you're exploring the city.

With no multiplayer or generated content, I can't imagine why anyone would spend more than 60-80 hours playing the game. It makes sense that fewer people would be playing it by now.
The perception is that some kinds of speech are harmful. For example, I'd be ok with banning car ads that feature beautiful women. From that I wouldn't take the step to banning political talk of violent rebellion, but I can see why others would.
RouterOS is not, but Mikrotik added wireguard support to their firmware sometime in mid-late 2020. IDK if its out of beta yet.
You're leaving out that they murdered a capitol police officer. People who were in the building have said they feared for their lives.

Again, let's not downplay the seriousness of what happened.
> Simply put, the average person is not prepared for lawyer level rhetorical devices in the wild.

Maybe we should figure out how to educate people to prepare them?

Can we really build our safety on our ability to keep stupid people ignorant of stupid ideas?

I think that's the kind of security through obscurity that is currently failing us so hard. Stupid people are finding stupid ideas anyways, sharing them, building upon them. Trying to keep them away from stupid ideas is like trying to keep your body perfectly germ free. You can't really do that. Not in the long term. You are better of figuring how to boost your immunity.
My ISP Is Killing My Idle SSH Sessions
If he gets out of this with a few very long apologies and crippling debt, but alive and free, then he will be already much luckier than millions of others.
No they don't. You are making this up.
It's not so much "opinion on a revolutionary advance". When it comes to AGI-related stuff, we are quite literally like contemporaries of Leonardo da Vinci, who have seen his plans for the helicopter and are postulating that helicopters will cause big problems if they fly too high and crash into the mechanism that is holding up the sky above us.

Also, this is not the mainstream opinion on e.g. fusion, or electric cars and smartphones (20 years ago), or a computer in every home (50 years ago). Those have been arguments about money and practicality, not about "we don't even know how such technology would look or what it would be based on".
This was the final straw for me. I'm migrating to alternatives after a very long time with Firefox. I just can't trust the product of a wildly ideological organization which clearly has hangups about free speech and how users spend their time on the internet. (For some reason you never hear these people about Tor which undoubtedly has been conducive in many human rights violations).

I've tried Brave and it looks and feels good. And the ability to donate to random Twitter users directly from the browser interface is a brilliant and innovative feature that I intend to start using.
I agree that the writing for the main quest was underwhelming, but there were a couple side quests that really stood out enough to redeem the writing in my eyes. Specifically, the Peralez and the Sinnerman quest chains felt really memorable, interesting, and engaging. It's a shame the main story wasn't up to the same the level.
I still put the important part of my network behind my own router similar to yours (and in terms of security I think ubuntu server + whatever you need has likely much smaller attack surface than OpenWRT which is a piece of software just too tasty not to be exploited).

Outside that, wifi part is hard to get right and smart switches are nice to have, but they are PITA if the firmware is never updated and there's no single place to nicely manage it all.
Regarding anonymity you don't need to use Tor and I2P just to stop actors like iknowwhatyoudownload.com from profiling you. Something like Dandelion/Dandelion++ is a more lightweight solution. That's what Monero uses to disassociate transactions and IP addresses (so that the transations cannot be linked together).
It sounds like Parler is responsible for the leaking, if they truly had no authentication requirements on their API endpoints.
in other words, almost no one compared to at least 2 billion potential users.
[1] is the exact same link linked to by OP and is not convincingly an issue
[2] is about an opt-in system that is easily disabled if accidentally opted into
In your opinion, should bakeries be allowed to refuse to make a custom wedding cake for the wedding of a gay couple? (e.g. Masterpiece Cakeshop v. Colorado Civil Rights Commission)

https://en.wikipedia.org/wiki/Masterpiece_Cakeshop_v._Colora...
K well the summer riots caused 20 billion in damage and destroyed peoples livelihoods and we didnt hear of a coup when the fringe stormed the white house. I have no problem calling out both sides but the hyperbole seems to go one way.
Having owned several products from both, Mikrotik equivalents are generally way more feature packed but I find them hard to use. EdgeMax stuff is more polished, but has fewer features. Performance is comparable for the most part.
Why resistance is common in antibiotics, but rare in vaccines
I'd include Max Blumenthal and Ben Norton on the list.

I want to say Glenn Greenwald too, especially for the stuff he did several years ago, but he and Taibbi are sort of occupying the same lane now. I hope he can escape the tomb that "The Intercept" became for him; he should have quit them much earlier.
Which has always been Twitter's defense when similar things happened on their platform. Shouldn't 230 apply here?
No, I do not accept that you are "clarifying." You are intentionally moving the goal-posts.

The question we were discussing was whether or not many of the USERS are calling for mass executions.

I provided ample evidence, despite your "find me a single post" challenge.

Now we might want to engage in a different discussion, about whether Parler was correctly moderating that content. But that is not a "clarification," that's a new topic.

I do not have access to information about how long content was allowed to remain before it was removed. Do you?
I agree that is a possibility, but he probably didn't mention it because it's so remote. When you have someone's laptop with a bunch of private sexual photos, reams of PII and emails, and you can verify with witnesses and crypto that the emails check out, the rational explanation is "maybe the laptop is real" rather than "maybe Google got hacked six years ago and the extremely valuable private keys were saved for this".

That is, I do agree with you and your technical analysis, but don't see the point of nitpicking his Twitter reporting. I think if you're on Twitter, you already know that you're not getting every little detail of a story.
Gab is made by a Polish Guy. Andrew Torba. Here is an article he wrote:

Social Credit Score Is In America: Visa Blacklisted My Business and My Family for Building Gab

https://news.gab.com/2020/06/26/social-credit-score-is-in-am...

Him talking about the migration to Gab

https://tv.gab.com/media/5ff8989c87e3f385144ad67e?viewKey=70...
That's murder.
Without backup or evidence, that sounds like a very populist thing to say.

Makes me wonder if with data, math and statistics 'right' or 'left' can be distinguished at all: since they are so ambiguous and fluid concepts.
I don't follow him either, but it is almost certain that the movement of "stolen election" talk from allowed to verboten is what caused his page to be suspended. I don't have access to his previous facebook content, so I can't search it.
> I guess I was approaching that question from a different angle where "wrong kind of association" was from the perspective of Big Brother. So I probably made an incorrect assumption about what the parent comment intended.

I agree with you that there probably is an element of this in the parent comment. Linking your "Cell phone at a protest" to you is probably going to be at the behest of the government.

What the implications of social media and "big tech" are in our society is definitely a conversation worth having. It's just a shame that it's often only brought up in order to distract or deflect attention from bad behaviour. The conversation would be much more productive if it happened at a time when people weren't so inflamed by the issue of the day.
> I don't regret pre-ordering at all, because they have always done right by me.

I bought the game a few days ago and, apart from the NVIDIA RTX timed-exclusive, I haven't run into any issues with it. It's already a touch above the usual Witcher release.

It's also worth noting that, at least from my perspective, there was a vocal crowd begging for the game on account of "something to do during the pandemic, assuming bugs warts and all". I'm not sure if this is why they released an objectively non-functional game to previous-gen consoles, but I would be inclined to believe the excuse.
No, it's not because of an API, it's because of the monopoly of Facebook. Without the monopoly they would value security of their users and would be afraid to loose them.
>You can think of it as people waking up to offenses that have been allowed to go unchallenged for way too fucking long

"People" is a general term, "offense" is a relative term. What you may consider an offense, I might consider a complement. Additionally, what you consider an offense today, you might not do so tomorrow. There is no such thing as a static set of provisions that can handle all cases of immorality across all of time and satisfy all people.

>The price of Freedom is Eternal Vigilance

The price of freedom is nothing, the price of consequence is eternal vigilance. The only reason you would need to be alerted if someone commits an offense you deem immoral, is so that they can be punished for the offense. You can't reverse an act that someone committed, but sure if you have constant oversight of their actions you can definitely punish them as you see fit. Law is synonymous with punishment, but it is punishment that applies universally to all parties, as opposed to the Terms of Service applied by modern corporations, which (by design) can be applied to whomever and can be ignored for whomever the corporation feels like. Hence why it's a slippery slope.
How do these websites collect this money?
So in keeping with the law at the time (well the law they passed), they elected 5 justices to replace up coming vacancies. Later it was ruled that 2 of those nominations were unconstitutional (I think because they were for justices who's terms expired after the new legislature was seated), but the newly elected Law and Justice government refused to seat any of them and elected their own slate of 5 justices. When the constitutional tribunal refused to include those 5 justices until the dispute was resolved, rather than back down the new government raised the threshold to conduct business so that the new justices would have to be included and even worse chose to interpret a clause requiring a majority to mean a supper majority and gave themselves the power to remove justices.

The constitutional tribunal ruled this new law unconstitutional, but because that ruling was not made under the new rules introduced by the again according to them unconstitutional law the new government ignored it.

It's one thing to pass unconstitutional laws and quite another to pass unconstitutional laws and refuse to listen to listen when you're called out on them
is this rhetorical? Clearly because Westerners don't care about Myanmar but do care about the US; there's nothing more to it
i've got this on my todo list of projects. looks super interesting. there seem to be a lot of flavors of these boxes and i'm having a difficult time figuring which one will work best. i don't know anything about the manufacturers.
> the error could also be more obvious and the code just fails open. someone has a try/catch and returns true either because of an accidental mistake or because they don't want users to be locked out when the provider is down.

Failing open would be a catastrophic mistake either way. "The auth provider is down, just let everyone in!"
Yes, they do. The recurrent donations can only be given to verified accounts.

You can send tips to unverified accounts (different thing from a monthly donation), and if the target does not verify their account in 90 days you get the funds back.
And the court would say that this is the same as removing it
Courts are not programs, they are used to people trying to get by on technicalities.
That rarely works
You have been provided evidence by multiple people on Brave's shady practices yet you are the one who seems to be such a fervent supporter in the face of much evidence provided to you that no other mainstream browser (besides chrome maybe) has shown so consistently even though they have been around longer than Brave. You tell people 'what have you been smoking' then when you are proven wrong, you still try to come up with excuses. I never even knew the CEO until I came across the last hacker news article on Brave's dodgy behavior. Stop making assumptions about people on the internet.

Why should I research for you a topic which does not negate the shady practices that Brave has been at fault for? If you want to donate money using Brave go for it, the evidence of what Brave has done, and done so consistently on many fronts is out there. If you want to look into it, go for it, I am not your personal researcher, a lot has already been done for you.
facebook can simply pull out of the nation
V7 supports Wireguard and UDP OVPN, it's in beta but reasonably stable, at least for home use.
you are not supposed to mention this, your hackernews and aws account should be terminated for wrongthink

and don't forget: BLM "protests" were "fiery, but mostly peaceful"
https://i.kym-cdn.com/entries/icons/original/000/035/101/CNN...
I didn't say that, I don't know what the answer is. But the fact remains that there are not enough resources for the consumption level where we are now. If another billion people are raised to China levels it will be a bigger disaster.
Any reason why an ISP couldn't shut you down for sharing child porn on a decentralized social network?
> Actually setting up a server is not difficult.

And yet you point me to a YouTube video, rather than a link on their website.

The documentation itself strongly encourages setting up your own server to have your own user information and then federating into a system, and yet, the documentation doesn't seem to describe, in friendly terms, how to do that.

It might be easy to set up, but I've had trouble discovering all of that in their documentation.
Every few weeks this issue comes on HN. It's hard not to mention my startup, The Factual, which is proving that people will pay a modest amount for ad-free, unbiased news on trending topics. I suspect this will get downvoted but I don't know how not to scream "we have a solution" to a problem so many have. So as not to be entirely biased let me mention other good offerings: The New Paper, Knowhere News.

Of course, our solution is not for everyone. If you have a well-tuned Twitter feed, or have figured out forums like HN/Reddit where you get news and commentary you trust, then we may not be as useful for you. But for the vast majority that just want the facts on topics of importance our daily newsletter is an easy way to stay informed and then get on with life. And we've priced it to be affordable for everyone so that factual news is not just for the rich.
He also continues to claim that Trump will ultimately win the presidency, that covid-19 is a bioweapon deliberately unleashed on the west, that the CCP is in collusion with (just about) every mainstream media, and financial instution, as well as controlling democrats.

He's responsible for the abomination of misinformation that is gnews and gtv which has been consistently spreading absolute bogus regarding the pandemic, the election, and politics, for a really long time.

Yes, Guo is right about some things every now and then, and yes he without a doubt knows more about the inner workings of CCP than 99.9% of people.

But let's not give him more credit than he deserves, he's not a fucking prophet. Let's not build another political cult of personality around an eccentric billionaire. If you take a look at gnews/gtv, a Guo cult of personality really is the only description you can think of.
My understanding is that HFTs function in a complete race to the bottom, with the only profitable activity being to trade faster and with slightly faster information than the next HFT. There is no secret sauce to keep them from eating each other as the costs to create a new HFT are not all that high vs. the profit opportunity of shaving a few percent off the commissions of the dominant trading system. Faster links and faster trades between exchanges mean they carry less risk when carrying out arbitrage (while also lowering the amount of arbitrage available).

The fact they made crazy profits initially is more of an artifact that they were competing against humans rather than other automated systems. In a few years we may see them reach the point of diminishing returns where all exchanges share a common pool of liquidity that adapts in a few millis to new information.
Great router!

The only issue I have with Netgate is pricing!
It does neither incite or produce imminent lawless action, nor likely to incite or produce such action.

Twitter contains worse.
I don't know if Brave supports it, but I learned a while back that in Firefox you can add "smart bookmarks" (I think that's what they're called) where you put a "%s" in the url and then when you hotlink the bookmark it will substitute any words after the bookmark keyword into the url.

I've used that trick to add custom search keywords for multiple websites that didn't have an "official" Firefox search engine.
The reason most people go with Ubiquiti for home use is the price -- that Aruba switch costs $3500 new. The ubiquiti switch costs about 1/10th that at $399.

Can you get free firmware updates from Aruba or do you need a support contract?
I recently invested in UniFi hardware with the UDM Pro and this isn't exactly correct. UniFi Protect (the video security line) requires remote access and Ubiquiti Cloud accounts or it will break in a million weird ways. If you disable cloud login you cannot reasonably use UniFi Protect.
100% agree - And the problem is that this isn't a 'hypothetical' situation.

Amazon and these large players will absolutely be asked by governments around the world to intervene in similar situations. Sometimes the fraud will be false, but sometimes it will be real - that's the world. Is it now Amazon's job to be the world election supervisor and arbiter of truth and shut down dissenting speech?

And can we trust these companies to act as neutral arbiters of the truth? (As an aside, the answer is absolutely not. See: Google Maps and Crimea / Ukraine / Russia)
More discussions on Ubiquiti subreddit:

https://www.reddit.com/r/Ubiquiti/comments/kv9fc8/ubiquiti_e...
By that standard Twitter should be in a lot of trouble as well. And probably Facebook too.
No. There are always a lot of discussions on HN I don't much care about - so I ignore them. Meanwhile, a historical event took place in the United Sates this past week. "Big Tech" has reacted to that event. That reaction is being discussed. Seems like an appropriate topic for HN to discuss. If you don't want to discuss that issue there are still posts such as how the new MacBook Air is the best computer I've ever used. So I suggest ignore what you don't want to read more about and click through the things you do.
But in this case, the country isn't demanding FAANG censor stuff illegal in Poland for Polish audiences (which I'm sure already happens to a degree), they're arguing they should be punished for removing anything which isn't illegal in Poland (if a Pole objects). And I doubt Poland has laws against trolling or spam...