skysight-inc/HackerNews huggingface dataset:
> But will this problem be big enough for VC investment is the question?

That's a great question. Thinking about where problems arise in data pipelines, there are fundamentally two moving pieces:
1) Your data – you're continuously getting new data without a real ability to enforce your assumptions on its schema or shape.
2) Your code for ingestion and transformation that needs to evolve with the business and to adapt to changes in other parts of the infra.

Datafold's Diff tool currently mostly addresses #2. It can add value to any company that runs ETL pipelines but most impactful at large data engineering teams (similar story to CI or automated testing tools).

Regarding #1, wouldn't it be useful if we tracked ALL your datasets across time and alerted you on anomalies in those datasets? And I am not talking about rigid "unit" tests e.g. X <= value < Y, but actual stats-based anomaly detection, akin to what Uber does: https://eng.uber.com/monitoring-data-quality-at-scale/

So, with diff, we already compute and store detailed statistical profiles on every column in the table. Next, we are going to track those profiles across time.

Diff is just the first tool we've built to get a wedge into the workflows of high-velocity data teams and start adding value, but it's just the beginning of a more comprehensive and, hopefully, valuable product we aspire to deliver.
>If the tumor didn't affect the decisions that led to the defendant being a defendant

...But that's literally exactly the question at play in the title. When the tumor DOES affect the decisions that make the defendant the defendant.

All I can add is that having spent a lot of time on the meditation cushion observing the workings of my own brain, it's laughable to me that people think they have control over their brain. And by some very objective standards most would consider me to have quite a bit of such control. I can attest that this control is a massive illusion.
Some large malls have been successfully converted to
mostly residential "villages", [0], [1].

[0]: https://www.boredpanda.com/americas-oldest-shopping-mall-mic...

[1]: https://www.bloomberg.com/news/articles/2020-06-30/a-case-fo...
Fitting a Podcast on a Floppy Disk
The implication of the article is that if you're using a relational database management system, you need to know SQL.

I agree. I wholeheartedly recommend Stephane Faroult's SQL Success as a beginner book. Read that with attention, and you'll be ahead of 95% of people messing around with RDBs.
A lot of problems stated are characteristic of any ORM not just Django. People pick ORMs specifically for trading convenience and tooling with loss of control. Any escape hatches that the ORM provides is by definition hacky.

These days when I know it’s a long term project, I prefer laying out the domain entities as plain classes and wrapping database operations as class methods with raw database statements.

This lets me use the underlying databases to its full potential and gives me enough control without leaking database code into application logic.
Right now trying to grow my followers number. Though it looks like people get used to retweet & like quite trivial posts like, "how to live properly: - eat well, - sleep 8 hours ..."
"Still open" was your criteria, not mine (as in when you said the other malls were "no more").
I support a very large database, containing product data for a major US retailer. If I understand the history of this database correctly (I am not directly on the team that manages it, but my team supports them in various ways) the database began life as an MS SQL DB. Many years ago it was migrated to MySQL. Now, they are in the process of migrating it to Postgres. So yes, migrating data to different DB's does happen, especially when you consider an applications life over decades.
Agreed. I have a background of depression too, so I was able to sympathize with the person but not on that level. Most of my help was just being there for them and taking care of them, and the idea of somebody is there for them was clearly helping.

We got medical help for the recovery, not in the drugs way, but a professional with the experience of dealing with the kind of problems the person had.

Our job was to keep them going with their lives. That was it. Feeling of being cared and loved allowed them to get professional help that they would not seek otherwise.
I still have the iPhone 6. Since it became "obsolete" I stopped keeping tracking of iOS updates but I feel like it hasn't hurt much. I can't really install many apps anyway since it only has about 11 GB of effective space (the "System " uses 6.87 GB)
Not to be funny, but for anyone with even a slightly high profile, Twitter is horribly broken. You fix it by muting everything. So yeah, I’m not surprised that the only people they speak to are ones they know professionally or personally.
I don't have experience with Django model migrations so can't comment on that - but running script based migrations without a CI like that in any nontrivial environment sounds like asking for trouble, but how did you not catch the issue when a dev pulls from master and migrations aren't working - everyone just does local patching and ignores that the master is broken ?

I've seen this on a .NET project, we didn't have a CI and this one guy had a tendency to commit dirty migration scripts breaking people's databases - I've seen it slip a few times to the QA deploy process before it gets caught because everyone assumed he would fix his shit and was too busy cleaning up his crap so we would just comment it out locally to get it to run.
T: A Dialect of Lisp (1982) [pdf]
But what if manhole is just mankind hole? (It probably isn't, I didn't look it up). Man doesn't always mean male, or does it?
If you can remember the title of the book I’d love to read it.
I live in the high desert of central Oregon and finally got sick and tired of trying to maintain a lawn in the desert. I removed the lawn then planted a ton of zone 4/5 draught tolerant native plants, most of which flower. There are bees everywhere now. And drip irrigation so much less water used. Feels great!
I started saying this last March, the next big crash or rather the biggest fallout from the pandemic will in commercial real estate. Just because of how the industry works, these commercial real estate companies are leveraged like crazy and it's not like you can turn around a rent/sell the property easily in this market. Banks set aside billions last quarter in expectation of this happening.
I am not a salesperson, so take this with a pinch of salt but I would imagine:

The need exists, you've got the right target, it's useful and effective, it's a huge market, you pitch it right, the timing is perfect BUT not all the decision makers are on board. E.g. manager wants to buy it, compliance is not keen.

The need exists, you've got the right target, it's useful, BUT this isn't a pressing enough problem. They have bigger problems, and those problems are worth spending their precious hours going through a procurement and evaluation process. So even if your product is free they won't use it. They wont even bother to decide if it is suitable. E.g. do you want to meet me to evaluate my free "tennis ball fetcher from your neighbours garden".

The need exists, you've got the right target, it's useful, BUT they are not used to paying for such a solution. An example might be a JS framework, like a React competitor.

I think the last 2 are problems for a MVP level thing where you are trying to work out if there is a market, rather than an established sales force.
Love the transcripts! Thanks for this thoughtful addition.
I’m fine with bailing out companies as long as the owners and managers forfeit all their equity.
A standard designed by people from Google, discussed exclusively by people from Google, fast tracked into Chrome by people from Google and then released in Chrome with utter disregard to any issues raised by other browser vendors does not a standard make.

Unfortunately, since most web devs develop under Chrome (and rarely if ever test under other browsers) this perpetuates the myth that "Safari is holding the web back" or "Firefox is slow and doesn't implement standards fast enough".

Here's total Web Apis counts in different web browsers: [1]

- Chrome: 7106

- Firefox: 6376

- Safari: 6130

Of them: browser-specific APIs that developers cannot reasonably assume are a part of the web platform:

- Chrome: 949

- Firefox: 507

- Safari: 546

And in 2017-2018 Chrome removed over a thousand APIs that were only implemented in Chrome, but were assumed to be standards"
[1]

And if you look at the omissions tab, you'll see that Firefox and Safari and not too far behind Chrome. But they are very wary of implementing quite a few standards just because Chrome fast tracked them (Constructible Stylesheets? Safari flat out refused to implement them. Signed HTTP exchanges? Mozilla considers them harmful and will not implement etc. etc.)

[1] https://web-confluence.appspot.com/#!/confluence
Was it a backdoor, or a hidden door, or .. a utility panel?

The difference, in my opinion, is in the documentation and frequency of use. Is it overt? Does the customer really know its there, and what its for?

Perfectly fine to have an access panel that gives you access to the buss .. if the pilot knows you're doing it.

But if its some random entrance in the back of an alley, only 2 or 3 users in the universe know what it is and how to use it ..
Are number of these same parents complained rather loudly when programming was added to the curriculum, because if they didn't understand "the technology", they didn't want it in their home.

Think... The sort of people who print and mail pictures someone found on the internet, because they never touch email.

They don't actually want to visit any website.
"Anything that smells like safety automagically justifies the damage it does. Only monsters want less appearance of safety."
More and more apps break with custom ROMs now though. Netflix is the big one.

Still probably worth the trade off though - Lineage OS is great.
Trump's win was the product of an antiquated electoral process, not some "will of the people" or he wouldn't have received 5million fewer votes.
The primary use case for such passwords is not confidentiality. It is to bypass overzealous email virus checkers.
The footnotes lead to some fascinating context into the associated research field.

The World Values Survey, which started in 1981, is "the largest non-commercial, cross-national, time series investigation of human beliefs and values ever executed, currently including interviews with almost 400,000 respondents. Moreover the WVS is the only academic study covering the full range of global variations, from very poor to very rich countries, in all of the world’s major cultural zones".

"WVS consists of nationally representative surveys conducted in almost 100 countries which contain almost 90 percent of the world’s population, using a common questionnaire" .

Their latest research study examines "Values In a Time Of Crisis" & the effects of the Covid-19 pandemic on values.

"a natural experiment indeed—to study how people’s moral values behave during times of crises. In the face of lacking evidence, we cannot take it for granted that the glacial stability of values observed in normal times continues throughout the Corona crisis. This uncertainty opens new territory and raises several imminent research questions:

- Does the Corona pandemic impact on people’s values? In other words, do people change their values under the imprint of this crisis?

- If yes, how massive are these changes? And if these changes are massive, in what direction do they move?

- How enduring are these changes, once an end of the crisis is at sight and once its economic consequences are overcome: do people’s moral values revert back to their old setpoint or does the crisis leave a lasting impact?"

http://www.worldvaluessurvey.org/WVSEventsShow.jsp?ID=416
I actually did not know the actual meaning of the word.
> Seems like an outdated term. Downvotes accepted.

Manhole is, indeed, an outdated term. Generally the preferred term is "Maintenance Hole". Still abbreviated MH, and people in the field use all three interchangeably (much like metric/imperial).

Source: I work with storm/sanitary/electrical maintenance holes.
You mean this? https://twitter.com/deletescape/status/1291422841834016770 It's literally just the word backdoor, with nothing to suggest anything nefarious related to it. I expect a bit more than that before news starts reporting on it.
Which billionaire has turned a good idea into a billion dollars without at least hundreds of employees?

And what of users? The value in social media companies, for example, comes from the number of users, who provide free labor in producing content.
Right, mine works fine as well. So you think that Apple should release the specs for the latests iOS that works with the iPhone 6?
There is a lot less pain tricking down if the lenders and real estate owners take the brunt of it.
This resonates quite deeply with me as somebody who's suffered from cerebrospinal fluid issues. Bad idea to say more than that.

Anyways, it appears that there's a large amount of things that can go quite wrong in the form of tumors/lesions/CSF issues around the brain that can cause an unbelievably broad spectrum of strange to fucked up shit, and hilariously, be cured near overnight if they're found and treated.

It's awful/funny to me because 60 years ago, talk of this would probably have you ostracized from the medical community/seen as batshit insane. I really hope we're able to see great strides into
readily accessible and reliable (as in, those interpreting them actually give a shit about the fine details, though I presume this will be solved by AI) brain screenings/imaging in my lifetime. Really, really hope so. It currently pains me there's only really three institutes, and furthermore really only three people pioneering serious research into inappropriate recurring CSF leaks (those being Stanford, Cedars-Sinai, and Duke - more specifically, Dr. Ian Carroll, Dr. Wouter Schievink, and can't speak for Duke)

If I ever have the ability, I think one of my actual life goals would be to put large amounts of money into awareness of CSF leaks and their prevalence in those with connective tissue disorders (which also need more awareness spread...) and funding of young scholars who really want to dig into solving them.

https://www.google.com/amp/s/www.nytimes.com/2017/11/02/maga...

I used to have an amazing vocabulary and placed in the top 10 of a state spelling bee when I was like 12 just from playing RuneScape. Never looked at a dictionary or spelling bee study book in my life at that point. Post CSF issues... my vocabulary is absolute arse, as can be seen in my poor choice of words in the bulk of my post.

Sorry for going off topic from the actual article... but uhh, brain stuff. Central diabetes insipidus is another absolutely ARSE thing that should have more awareness... Pituitary gland issues can be caused by so many different things and cause so many issues, which when properly diagnosed, are typically quite treatable.
This has nothing to do with the "defund the police" narrative, Portugal did this 20 years ago.
If curious see also

2013: https://news.ycombinator.com/item?id=5966328
Well, this year we for one don't, in fact we're having the exact opposite, but last year we did have a hot year and everyone said it's definitely climate change. I think we're not yet at the point where we can feel it, we're just projecting.
> banks cannot possibly be allowed to re-value what real estate they have on their books

Tell me more about this? Why can't banks re-value things that constantly change in value?
I think that an important missing piece in realizing the full benefit of machines that print houses is software that does automated building design.

The way most suburban residential construction is done these days (at least in the U.S.) is to start with a large area, split it up into relatively homogeneous lots, and flatten them out as much as possible so that they fit the requirements of one of some set of floor plans that were designed without regard for any specific lot.

The alternative to this is to do custom designs that take the considerations of particular lots into consideration, like the position of the sun during the day, the direction of the best views, layout of the yard, etc.. This is expensive and hard to do on a large scale, because you can't amortize the cost of the architect over multiple buildings.

Another alternative is to have a software package that takes a given lot and generates a floorplan optimized for that lot (and the needs of the buyer, if known). This is a hard problem, but I think it gets easier, or at least more interesting, when combined with machines that can build houses. With 3D printing, the design can be as complicated as you want, with little impact on cost. You can have funny-shaped walls that aren't at right angles with each other, vaulted ceilings, gothic arches, flying buttresses, or any kind of ornamentation or functional feature without regard for having to consider the difficulty of expressing the design to human workers. If done well, it could be a major step forward for well-designed residential construction -- you get a custom building on every lot that's optimized to match the site rather than forcing the site to match the builder's requirements, and the marginal cost of the design work is low (probably more than zero, since you'd need a human to review the design and possibly negotiate with customers).
I have a quick suggestion for you: two options you can mitigate this "issue".

Option 1: make it free, up to a certain dataset size. You can harvest interested leads like the gentleman above.

Option 2: (if you don't want to deal with a huge volume) offer it for $50 one-time fee, up to X size, for Y months (e.g. $50, up to 1 GB, valid for 3 months). Nice way to filter qualified leads.

There are variations from the two options above, but I think you can easily get the general idea.

Thoughts?
Farming community in Australia.
Does anyone know of companies in the United States making cross laminated timber / cork hybrid prefabs? I thought these were pretty cool.

https://www.pslcomp.com/projects-catalog/houses-from-corkbea...

https://www.pslcomp.com/construction-technology/glued-cork-b...
It's not just property tax. The investors who fund the mortgages would have to take a haircut. Which could destabilize banks, pensions, insurance companies, any institution relying on endowment earnings to operate, etc.
The US has too much retail space. Per capita, it has 5x as much as Europe (23.5 sq ft in the US vs 3-4 sq ft in most European countries) and 8-10x as much as Asia (2-3 sq ft). We may be looking at a permanent decrease as a result of this pandemic. But even if it goes down by 20%, the US will still have way more than anywhere else.

I think we'll be better off when we use the excess retail space for something else whether it's apartments, warehouses, or offices. But the transition will be painful.
People Are Flying Again–But Only for Cheap Vacations
As opposed to this?

>the past couple of months have seen a sudden increase in Nexus 6P battery complaints, with many users reporting that their phones suddenly shut down, even though there was plenty of battery life remaining

It's not a simple system crash, because your phone will stay dead until you connect it to a charger.

https://android.gadgethacks.com/news/nexus-6p-battery-random...

That seems especially problematic if you are on the go and need to make an emergency call to summon help.

A working phone seems preferable.
Authors, Don't Drive Pair Code Reviews
The gut-brain axis is a huge deal. Hardcore neuroscience is affected by probiotics.

There is even a class of them called psychobiotics.
Thanks. I just checked the video. Looks neat! Excited to try it out.
I was just referencing the 2008 financial crisis where the US literally printed money to save businesses that should have failed.
I recently watched this documentary "Jasper Mall" about the slow death of a shopping mall, it was quite fascinating: https://www.imdb.com/title/tt11262098/
From what I recall you are correct. But I also vaguely remember that there was another little open source tool that integrated with Migra to check data as well? Or was it a custom-made script?

Sorry, can't find it, I wish my comment could be more useful.
This is the same level of magical thinking as "abolishing police", in that it completely ignores the deadly realities on the ground and the people who suffer the consequences do not intersect in the venn diagram with those proposing the thing. In fact those who suffer the consequences tend to be overwhelmingly against the proposal.
We still support it (www.theguardian.com).
But this is about what your ISP does to your packets between when they receive them an d when they pass them to you - it would only be interstate if your ISP processed your packets in a different state (maybe your fiber crosses into another state)
Intel employes 100,000 people, and most of them aren't even aware of most of Intel's transgressions, let alone approve of them.
Pretty ironic that this is being done by a company that makes healthcare software.
Anybody else wondering at the rate of bad news around Intel at this moment? Like, is someone after them or is this just bad luck?
Command Not Found: Install any command on any operating system
I worked for a company that made servers. In the on board management system's source code I remember seeing "base64 encryption". I think they removed it by the time I left, but still.
Totally right and after thinking about it I came back to remove the first sentence -- that facts don't care about your medical condition -- of my comment because it contradicted the rest of what I said.