skysight-inc/HackerNews huggingface dataset:
Launch HN: Hubble (YC S20) – Monitor data quality inside data warehouses
Hey everyone! We’re Oliver and Hamzah from Hubble (https://gethubble.io/hn). Hubble runs tests on your data warehouse so you can identify issues with data quality. You can test for things like missing values, uniqueness of data or how frequently data is added/updated.

We worked together for the last 4 years at a startup where we built and managed data products for insurers and banks. A common pattern we saw was teams taking data from their internal tools (CRM, HR system, etc.), application databases, and 3rd party data and storing it in a warehouse for analysis. However, when analysts/data scientists used the data for reports they would spot something suspicious and the engineering team would have to manually go through the data pipelines to find the source of the problem. More often than not it was simple things like a spike in missing values because an ETL job failed or stale data because a 3rd party data source hadn’t updated correctly. We realised that reliability/ trustworthiness of the raw data was essential before you could start abstracting away more interesting tasks like analysis, insight or predictions.

We wanted to do this without having to write and maintain lots of individual tests in our code. So we built Hubble, which connects to a data warehouse and creates tests based on the type of data being stored (i.e. freshness of timestamps, the cardinality of strings, max value of numbers, missing values, etc.). We’ve also added the ability to write any custom tests using a built-in SQL editor. All the tests run on a schedule and you’ll get an email or slack alert when they fail. We’re also building webhooks and an Airflow operator so you can run tests immediately after running an ETL job or trigger a process to fix a failing test.

Instead of asking users to send their data to us, the tests are run in the data warehouse and we track the test results over time. Today we support BigQuery, Snowflake and Rockset (which lets us work with MongoDB and DynamoDB) and are adding more on request.

We’re planning on charging $200 a month for a few seats, and $30-50 for extra users after that.

We’re still at an early access stage but want the HN community’s feedback so we’ve opened up access to the app for a few days, you can try it out here https://gethubble.io/hn. We’ve added a demo data warehouse you can start with that has data on COVID-19 cases in Italy and bike-share trips in San Francisco. Thanks and looking forward to hearing your ideas, experiences and feedback!
Now Seeking Retail Investors for Focus Group – $50 Amazon Giftcard
I am putting together a focus group to conduct research for a product idea we have. We have a 15 minute Q&A style interview and are seeking people who:

1. Have at least $200,000 in their stock portfolio
2. Manage their own investment account (I.e. not using financial advisor or roboadvisor)
3. Are not day traders, have an average holding period > 3 mos.
4. Are not actively trading options

If this applies to you, please contact me and we will schedule the interview.
We are offering $50 Amazon giftcards for your time.
I have met stupid intelligent people. Sometimes knowledge just doesn't seem to translate to actual behavior and decisions (it's mostly about the lack of decisions, IMHO).
Poland Invaded Czech in 2020
Related Journal of Pediatrics Article: Pediatric SARS-CoV-2: Clinical Presentation, Infectivity, and Immune Responses
https://www.jpeds.com/article/S0022-3476(20)31023-4/fulltext

Results
A total of 192 children (mean age 10.2 +/- 7 years) were enrolled. Forty-nine children (26%) were diagnosed with acute SARS-CoV-2 infection; an additional 18 children (9%) met criteria for MIS-C. Only 25 (51%) of children with acute SARS-CoV-2 infection presented with fever; symptoms of SARS-CoV-2 infection, if present, were non-specific. Nasopharyngeal viral load was highest in children in the first 2 days of symptoms, significantly higher than hospitalized adults with severe disease (P = .002). Age did not impact viral load, but younger children had lower ACE2 expression (P=0.004). IgM and IgG to the receptor binding domain (RBD) of the SARS-CoV-2 spike protein were increased in severe MIS-C (P<0.001), with dysregulated humoral responses observed.

Conclusion
This study reveals that children may be a potential source of contagion in the SARS-CoV-2 pandemic in spite of milder disease or lack of symptoms, and immune dysregulation is implicated in severe post-infectious MIS-C.
Only 200 out of 5,000 known species of mosquitoes feed on mammalian blood. If we could only target those 200, we could remove a great source of misery from the planet.

In fact, only 8 species carry disease, e.g. zika, malaria.

That said, mosquitoes have been around for 100 million years and it seems unlikely we can wipe them out without some scary technology.

Probably for the foreseeable future we're going to have to settle for managing the problem, draining malarial swamps and encouraging predator species like dragonflies for example.
15 Years of Django Podcast
Popular fertility app shared data without user consent, researchers say
You might be interested in GEM Mosquito Control [0], environment friendly and effective.

[0] https://www.appropedia.org/GEM_mosquito_control
The problem is citi is the guarantor of the revlon loan .

It is more like your dad paying your credit bill in full instead of the minimum and now saying he wants the money back
UNICEF seems to contradict themselves here then https://data.unicef.org/topic/child-health/malaria/
You don't have children, right ?
"I'd even filter them out for manufacturing or fast food work."

What an awful approach to hiring. But, perhaps you see it as a good way to make sure that all of your colleagues are the "right" sort of people and that you never have to work with someone as lowly as a manufacturer or restaurant server.
How does one get one of these onto a trailer and down a boat ramp? It seems like the hydrofoil adds enough draft that it would scrape the bottom on a lot of public access ramps.
I'll agree it's not a perfect analogy. But if you want to press me on a potential abuse of a government-mandated and punishable order of wearing masks: Abuse of power by corrupt government officials that can use this extra and easily-fakeable "offense" in order to punish individuals that they don't like. Or what about the negative social aspect of creating laws that have neighbors secretly reporting each-other for this? Or the potential for child-traffickers to gag + hide the gag with a mask while they're busy engaging in trafficking?

If you sit long enough you can come up with a potential abuse for any government law or idea. Just as is done with mass-surveillance. What we don't do is sit down and come up with extraordinary ways and means for us to use powerful tools/ideas/solutions such as surveillance in a responsible and safeguarded manner that is not exploitable by bad individuals in government, or bad governments themselves.
So you're in favor of zero cost licenses and zero cost delivery of said licenses. If your means of identification or authorization to vote aren't free, then you're advocating for a pool tax, which is illegal.

I'm not sure if you realize that there's only a handful of confirmed cases of voter fraud in the US in decades. The current system, based upon an address registration and someone confirming their information at the polling place, has achieved this result.
Have you considered a solid oxide fuel cell to charge the batteries and increase the range? They can run on anything from ethanol, to LPG, to hydrogen.
I'm sorry but this comment is both wildly off-topic and needlessly inflammatory, suggesting the OP is fine with the over-sexualisation of children? Come on. We're two steps away from reciting QAnon posts here.

But in an attempt to bring things vaguely back on topic: I'm actually curious to know if left-wing movements have been aided by YouTube and to what extent. Its effect on the right is very well documented but on the left I've tended to see the outrage on Twitter, Instagram and Facebook more.
I've added some discussion/clarification of these issues in the post and addressed the issues in more detail in another comment: https://news.ycombinator.com/item?id=24224189 .
This was a surprisingly good read and data-driven.

I found it surprising that the top reason for failure was product-market fit followed by team. I would have thought finance (#3) and tech (#4) would rank higher.
wow 9gag here on HN? What a time to be alive.
YouTube owns more than discovery too: they own relationship between viewers and producers.

Most of the YouTube channels I follow have no external means to notify me about new videos. If I were to stop using YouTube, they were banned, or YouTube subscriptions stopped working the same, they would have no way to actually contact me about new content, and they’d lose me.

Effectively YouTube owns the relationship between the creators and I. This can be changed, CGPGrey has been building a mailing list for this reason, but it takes a lot of painstaking deliberate action to achieve. Migrating to a new platform alone is insufficient.
'Beige gold': Criminals are making a fortune by illegally recycling cardboard
What's a better term for people with a lack of critical thinking skills and/or a lot of unexamined closely held beliefs?
With religion ymmv. A lot of people do not believe in some super-being, but do believe in belief and the benefits it brings them. A feeling of happiness, a social group to belong to, and a way of coping with the bigger philosophical questions around death and the meaning of life.

Religion is too broad a term to sweep everyone under. It’s very diverse.

Now creationists, who believe the world is 5.000 years old - yeah, that’s a whole other bag-of-fish.
That would still take collaborative data from another dataset outside this product. Compliance would be up to whoever hosted this, and the collaborative data set to comply with the request anyway.
All the Youtubers I am subscribed to have sponsors which is arguably not a representative sample size but still means that I can feel good about blocking YouTube's terrible ads on their videos.
parents messed that up (clicked accept by mistake to a microsoft upgrade pop up when that was a thing), system no longer booted and had to reinstall...

Also, I'm old, maybe things have improved but I've had upgrades wipe my hard drive due to centos anaconda bug once (centos 5 to 6) other times it just did not boot (yay using encrypted boot partition but thats on me and updating grub fixes it)

Added benefit is it also forces me to check/update backups
Glad to hear you enjoy your work. For me, it was just going through some checklists under enormous time pressure at large financial institutions and mostly alone, without any of my team members on site. If I were to do the job today, I might be able to look more into the details of the systems/applications I am auditing, immerse myself in them and have some meaningful conversations with the people I am auditing. Thank you for your perspective
Running Docker on Linux is absurdly faster than on a Mac or Windows. My experience was comparing a company-purchased $3500 new MBP with an old Windows gaming laptop running Linux Mint.
On top of that, my old laptop originally cost 1/3 of the price of the Macbook Plus And didn't require a overloaded dongle because it actually has USB and HDMI ports.
Facebook Delenda Est
I think it was the 3rd one I've ever given.
They both are Celebs. Pander to an existing base. Joke about/blame everyone else. Define success based on their Like counter.

And most importantly produce no sustainable outcomes on any issue whatsoever. "He tried" is not what Leaders are remembered for.
People who have limited storage resources? One of the wonderful things about making content for YouTube is its low barrier to entry, and that probably includes a lot of people using their mom's hand-me-down MacBook Air. Maybe people who haven't been bitten by significant data loss before? Sure, it usually only takes once, but maybe that would be their first time? Lots of young people on that platform that are probably really used to everything just kind of automatically being backed up in a cloud somewhere.

Someone not having your level of prudence and understanding in their MO doesn't mean they're idiots. Did you learn everything you know by reading the docs and best practices recommendations and acting accordingly, or did it take a couple of stinging mistakes to bring you to where you are? Your attitude is the stuff that nightmare bosses/parents/teachers/mentors are made of. Mellow out.
Can we stop pretending that CNN has anything to do with the "far left"?
The numbers are a bit weird:

> Malaria kills one child every 30 seconds, about 3000 children every day.
> Over one million people die from malaria each year

3000 deaths per day * 365 days in a year = 1 095 000 deaths per year

So basically no adults die from malaria?
OK I was in Ocean City NJ at the beach a month ago. This is just not true. I was in the women's bathroom- no masks, 6 inches from other people, no airflow. I'd say about 1/10 wearing masks. People crowded together.
Video files are large, so you usually have to store them on some kind of external disk. And it's very possible to lose an external disk. If videos are your livelihood then I imagine you're going to be a lot more disciplined than that but there are plenty of hobbyist vloggers out there.
> "I only block ads because of privacy reasons."

> "OK, then we'll offer the option to pay a small fee to support the content creators and not have to deal with ads."

To offer a counterpoint, if you're trying to protect your privacy, signing into Google to watch Youtube videos is probably not the right way to do it. Google isn't offering any guarantees that Youtube Premium data isn't used exactly the same way that any other data would be. They're still building a profile on you, and your recommendations are still tailored based on that profile.

This is also one of the big issues I have with online newspaper accounts. Part of the reason I'm blocking ads and trackers is because I don't want newspapers to track me either. I don't want somebody to be monitoring what I read. Logging into an account is counterproductive to that goal, so at best I'm going to give them money for an account and then never use it.

I pay for a Youtube Premium account at the moment, precisely because I wanted to signal that I would pay for content. But none of that subscription money is actually going to creators I watch because I never log into it. I'm just throwing money at Google for basically no reason.

Adblocking is a better option than Youtube Premium not just from a UX perspective or monetary perspective, but also if you care about privacy, because it means you can handle all of your account stuff through local RSS feeds and NewPipe on mobile, which is a significant win in the fight to stop Google from putting me into a box.
That's awesome! You can do it from home, too.
As someone who’s worked with the Marketing Dept. a lot in my prior role, the reason e-commerce sites (and possibly Reddit) do the things you mentioned is because they’re overly focused on new user/customer acquisition vs keeping current customers/users who know the the products’ value happy.

There’s almost always a bit of political drama behind the decision too: Marketing gets to say that they’re acquiring new users in short term (thereby increasing their budget and clout in the Org) while destroying customer value in the long run
Does 2+2=4.00?
I'm sure this won't be a popular comment, but based on the descriptions in the article, the flat earthers seem very similar to the Trump supporters I know (family, not by choice).

The clear distinction is the absolute unwillingness to listen logic without screaming what-a-about conspiracy A, or conspiracy B, or C. Or the classic "your just a socialist" inbetween talking about their social security and medicare benefits.

There's clearly a segment of the population that has the inability to compute simple logic without triggering a fight/flight/amygdala response.

I used to think education was the problem.

But I'm starting to think this inability to control their emotional response when hearing anything that conflicts with their "belief system" is the hack that various organizations leverage to build a cult-like following.

Edit: thanks for all the fanfare(sarcasm towards the downvotes), I think that it proves my point.
Legislation requiring companies to pay remote workers at least the minimum wage of the location the remotely operated machine is located in seems like a good idea.

When operating machines in California workers should be paid the Californian minimum wage. Companies that refuse should be denied the opportunity to operate in California.
Some A.I. experts are concerned about a lack of transparency in OpenAI's GPT-3
And in the South, the schools opened.
There is also a hybrid client[1][2] now, written in Rust, and Electron. Although the command-line client will always be my favourite, as I always have a terminal window open anyway, at least those who dislike the command-line or prefer a GUI client have another option now.

[1] https://discussions.agilebits.com/discussion/114964/1passwor...

[2] Read-only for now, as it is a development preview.
I like to think about this as not being transactional. Rather, I like to think about this as funding the creation of additional content.

Regarding funding Google, I like the discoverability that they provide, and the infrastructure that delivers the content. I continue to delight in the value that I get from the YouTube recommendation algorithm. I have discovered content that I would have likely never found in the past - it expands my horizons.

Of course, YMMV, and you are certainly entitled to make your own choices here. I thought that I'd share my perspective for others who may find it valuable.
£35k is about £27.4k after tax. You have forgotten about national insurance.
We also use Torqeedo, and a 42 kWh battery (35 ish usable for foiling). The thing about range in electric boats is that you rarely get figures for range at different speeds.
A 35 kwh regularly built motorboat won't get near 50 nautical miles at 20 knots plus, due to plain physics.
I've met a number of religious people who were quite good at their technical jobs that required critical thinking skills. So long as the knowledge, skills and behaviors required of them don't clash with their identity beliefs, there's no problem in terms of performance.
Presumably Apple's app store would continue to exist as a first-among-equals even if regulators forced them to allow alternative app stores on the iOS platform.
> I don't see it mentioned in the article, but what gets me every time is that the "right-click" trick only works the second time you try to launch the app. The first time, right-click or not, MacOS won't let you launch the app.

Thanks for the comment! I've referenced this in a new addendum to the article.
Those stats are for children under 5. So the total for children more broadly defined is likely to be higher.
Cloudflare Workers Deploy Buttons
So, effectively, you're saying you aren't allowed to have a server that logs requests?
If you count on ad revenue in any way, getting subscriptions matters. This is true even for channels that wouldn’t be categorized as (scare quotes) “influencers”. Your subscriber count directly affects your ability to turn each new video into more views and therefore more ad revenue.
There's a new cluster of super-tall buildings going up around Central Park, though, that are changing the situation a bit. Housing for handfuls of billionaires shading the public park used by millions.

https://www.npr.org/2014/04/23/305643904/nyc-s-tall-skyscrap...
Your sprint planning is deeper than sprint planning some other places. Some places that at least claim to be doing Scrum will groom the backlog in one meeting, then choose which stories go on the sprint in another. Anything that needs agreement among developers is then tackled in pair programming or fairly ad-hoc "hack sessions". Implementation details, including details of code interfaces, user interfaces, and system interfaces, are left up to the contributor unless there's a need to align effort before that story is done.
Eh, they have elastic beanstalk which serves that purpose. This is for Kubernetes, which almost explicitly states is for more fine tuned control of a system that needs scalability.

I think it's both unfair and ill advised to want that type of simplicity with Kubernetes.

That being said, I don't really understand why this is necessary when there are already a lot of tools out there to manage clusters (other than AWS wanting everything to live in their console)
iOS: Missing Pictures, Presets, and Watermark Data After Lightroom CC 5.4 Update
No, I was not positing that YouTube itself provides no value -- I was responding to a comment that asserted their reason for subscribing to YouTube Premium was to support content creators. I suggested an alternative.

Personally, I do not disagree that YouTube is worth paying for. But I have reservations because I believe their parent company (Google) already profits tremendously in morally objectionable ways. Thus, I try to avoid giving them my business as much as possible.

Unfortunately, the reality is Google (and YouTube) are practically impossible to compete with in all things data.

To play devil's advocate: you say you use adblocker (I assume you use it on sites other than YouTube) -- but why? Because the modern web is practically unbearable without it? But is there not an implicit contract when you visit a website and consume their bandwidth, that you view the ads? Are you not, in effect, stealing? Sure, advertisers don't have the right to your attention, but don't the content creators have the right to your financial support?
Of course, but in the case that the app is not actually "attacking" you, and is instead just poorly written and/or poorly thought out you're reducing your risk.

A lot of time you can attribute compromises to ignorance rather than malice.

So an app that is stupidly logging the clipboard and doing dumb things with that data, rather than being a malicious app.

Not much can help you if an app on your machine is in a position of power.
Yeah - I think we're going to see a large rebalancing of land values and salaries as remote work becomes more common. The areas that are too far to commute to the city, but close enough for a day trip or the odd visit, are looking really appealing right now.

Although, this is in Europe. A house on 3 acres of land where you could get the train to SF for work in an hour would cost a LOT more than 100k I imagine.
Can confirm that Corona is an actual place in the Queens borough of New York City.
>Trump supporters I know (family, not by choice)

What is the implication here? Is it bad to have friends who are Trump supporters?

EDIT: I see my point of political bias proven, complete with intolerance, rationalization of said intolerance, gross assumptions, and overall it leaves me disappointed that the HN crowd allows this.
Does anyone else thing this is a terrible name? Reading the topic, I immediately went to peertube.org/.com/.net to check it out. Turns out it's really just software for self hosting your own videos.
How can you limit "financialization" without at least some risk measure?
> Can't really recall any instances of obama actively trying to negotiate peace.

In 2013 the Obama administration actively tried to negotiate peace with the Taliban:

https://www.theguardian.com/world/2013/jun/18/us-peace-talks...
If you want to share your every-day events and pictures why not just host a blog? Then see how many people are actually so interested that they'll visit the site :D

RSS feeds would help aggregating updates from several people.