skysight-inc/HackerNews huggingface dataset:
Your argument implicitly rests on the claim that most of NYC buildings are built right up against height restrictions. I can find no evidence for this, and frankly it doesn't make much sense - have you seen the NYC skyline? Nearly every building would have to have an individual height restriction for this to be true. There isn't nearly enough monotony to support it.
That building stands out so much in the sky line it's like a middle finger to the people watching it. You the type you can afford with "fuck you" money ;)
> But they aren't given that choice.

If your argument is framed that the ultrarich aren't given enough choices in how to live in luxury, I'm not sure I'll understand the rest of your post. Yes the building code has a problem that is contributing to this issue, but let's get real here: The ultrarich are given all the options in the world. Not every option they choose need be so offensive to regular people.
Pretty cool demo for causal.app.

Feedback on the framework itself:

* I found the interface to widen/narrow the variance of ranges painful to use. Why not just let me plug in an exact number?

* I assume the output for the variance is 95% interval? This should be stated.

* There's major math problems with respect to how you are handling variance on compounding rates and reporting it. Most importantly, the distribution should almost certainly not be normal (lognormal makes more sense). If you don't use lognormal distributions, your confidence interval after N years makes no sense as the product of two normal distributions is not normal (nor even symmetric) - I'm actually not even sure how to interpret your confidence interval after 30 years because of this fact!

* The line becomes impossible to see if it has no variance!

Feedback on the calculation:

* I'm guessing all these numbers are real rates, as there is no inflation?

* Monthly rent is really "rent realized" as you are ignoring vacancy.

* I'm not following how you are calculating accumulated rental earnings. It is more than the sum of historical rental earnings, but less than your rental earnings being re-invested in the market

* "We assume that these cover at least the cost of your monthly mortgage payment" -> including interest + principal? I'm not sure if your calculator per se relies on this assumption, but this would not hold in many markets (e.g. SF Bay Area)

BTW, for those who want to do a simple buy/rent trade-off: I have a google sheet here:

https://medium.com/@usaar33/an-up-to-date-buy-or-rent-calcul...
The First Known Interstellar Meteor May Have Hit Earth in 2014
I'm not sure it is a a shortcoming though. It's an entirely defensible proposition that under some circumstances, accuracy and reply speed is inversely correlated with intelligence.

Consider: you ask two colleagues a deep and subtle yes/no question. One immediately replies 'nah'. The other thinks for a long time and then finally replies "I don't think so, but I'm not totally sure..." Which of your colleagues has demonstrated greater intelligence?
I don't think it's straightforward at all. The premise of the article gives a lot of counterarguments. The developers are bypassing these laws to build luxury apartments for the rich, and so even if height limits are the only reason buildings are twice as tall (which is probably not true), and there was twice as much housing, it could very easily be housing that's built for the mega-rich (think a high-wealth overseas person who will purchase it and then rent to a high-income local professional worker). That living space would be anything but "affordable". Not all housing is created equal.
The health care system in this country is a crime. It is structured to take advantage of people at their weakest and most helpless. We spend 3 times as much per capita as most other industrialized nations and get worse outcomes overall.
Question I have: do you need to actually collect this information at all?

I appreciate the no share, but if a service never collects it to begin with then it’s never an issue including if you get hacked for instance.

I’m curious not a judgement.
> Am I the only person here who finds it completely insane?

Your are sane, the situation is batshit.

Your priority is to get your data into one place, and one format. But that will take time and money, so you need to make a business case for change.

Your first point you need to hammer home is that its expensive to explore your data, because it's all over the place.

Second you need to come up with a rough number of hours that are wasted a month by each member of staff (and consultant) The fact that you have consultants means that your company is burning money, finding allies in your managers is a good shout. They will be constantly asked to justify the cost.

Third, and bonus points for this, come up with a use case for a current project that can't be done until the data is in the same place, format and is sane and normalised.

Don't worry about pipelines, thats a technical issue, what you are facing is a cultural problem.
Let me just plug https://mockoon.com/
The argument is that the "equipment" is unnecessary, or at least made to take up more room than it should. I would say a workplace for anyone is likely more important than space that is deliberately wasted.
id(dictionary) is the key you want: immutable, reliable, cheap.
Yeah Buffett's co invested $232 million in 2008 for about a quarter of the company.
My dentist and his team of hygienists are big fans of waterpiks, but not as a substitution to anything. You would still brush and floss (with string) as usual.

A waterpik used incorrectly may cause gum problems, so maybe that's why dentists don't like them across the board. If you put the thing on the highest setting and aim it so it pushes your gums up that may cause damage.

But if you keep it at a low / medium setting (a lot of waterpiks go from 1 to 10 in terms of pressure) and aim the water straight at your teeth and trace your gums then you should be good (there's videos showing how to do it). Not only does it remove all sorts of food particles, but it also stimulates your gums.
The others who reside there also won’t be as invested in improving the local area as an owner-occupier would be, as most of the benefits of the area becoming nicer would accrue to the landlord through the rental market.
A minimum wage job is not that hard to get if you own a car so I'm curious how long these people are working at less than minimum wage before they find another opportunity. Maybe these people are only working a few hours a week to make a few extra bucks?
Not to mention the narrowing of In-Network providers. I can't shop around if my Network has already been reduced to the smallest size possible.
Residence also obligates one to pay taxes, and all of the infrastructure you mentioned can be improved with money.
I don't see why it is a loophole, it actually sounds like the law is not so bad.

If technical space was counted then the building would be 1/4 shorter? Could be.

In the grand scheme of things you can certainly debate housing that sits empty, but that doesn't seem to be the main problem in lack of stock. Your neighborhood NIMBY that doesn't want affordable construction in affordable neighbourhoods seems to have a bigger impact than just tall towers for millionaires.
The Mueller Report is about as famous as you can get. That it can get taken down is proof of how messed up the system is; that it was put back up is not proof that, say, a unique, legal work you or I create would be put back up with the same speed.
oh yeah, sorry - that's indeed what I meant.
> The shortage isn't about the amount of available housing at all, it's about people's ability to live there too. And if you're just doubling the building heights, you haven't talked about wages or ability to live there etc.

How is the housing shortage not about the amount of available housing? Wages don’t need to increase if housing prices fall as a result of an increase in supply. If the problem isn’t a shortage in housing, it wouldn’t be a housing shortage.

I also don’t agree with the commenter you were replying to; it’s a naive assumption that height limits are responsible for less construction. More likely, it’s hard to purchase properties, tear them down, and rebuild higher. This would be solved at least partially by what we call a “land value tax,” which incentivizes economically efficient use of the land [1].

[1] https://en.m.wikipedia.org/wiki/Land_value_tax
The argument is that people should be free to spend their money as they please. And if someone is going to criticize the height of a building, literally doing it from one of the tallest buildings in the city is ridiculous.
This article is weird journalism. It presents decent counter arguments to the problem, which is nice but also leaves the average skeptical reader confused about how much waste is actually occurring on these floors. Surely _some_ mechanical space is needed, and the wind-flow anti-sway idea doesn’t seem crazy, but it’s really hard to draw a real conclusion. The fire ladder height problem in another comment seems valid, but surely most skyscrapers just aren’t ladder accessible.

But my biggest gripe (at least on mobile, maybe it’s different on desktop?) is why aren’t there pictures off the so-called wasteful spaces? Putting aside the argument that more space is needed for future batteries, let us see an example of what this actually looks like. That would certainly go a long way toward clarifying the wastefulness. I know what the outside of buildings look like, but those are the only pictures I see. At least get the outside of the problematic barbell building, or diagrams, or something!
> The building and nearby towers are able to push high into the sky because of a loophole in the city’s labyrinthine zoning laws. Floors reserved for structural and mechanical equipment, no matter how much, do not count against a building’s maximum size under the laws, so developers explicitly use them to make buildings far higher than would otherwise be permitted.

Like most things in today’s society the reaction to this seems to be one of two: double-down on the zoning enforcement or eliminate it.
So what would be the point in building affordable housing in the middle of Manhattan of all places? Could people who absolutely require cheap apartments actually live there and afford to use the amenities?
Germany, for sure - tenants usually own their own washing machines and most of the time, their own kitchens, including all appliances, cabinets and the proverbial kitchen sink. Tenants are essentially paying for the right to occupy the dwelling, and that’s about it.

Therefore rental price to purchase price ratios have historically been lower, as well as home ownership rates. Rents in desirable cities are going up faster than they had been, though, and Berlin has quickly gone from being one of the cheapest cities in the country to one of the most expensive.
You seem to have shifted the burden of proof to others to disprove your unsubstantiated claim, and then criticized the quality of the evidence offered.

Please raise the level of discourse here by offering new information to support your claim.
It took me a few moments to realize the headline wasn't referring to software developers. I don't know what a luxury SW developer is!
A lot of the people who take care of themselves are following bogus advice (though it is/was often considered the gold standard at the time they followed it - salt reduction is mostly harmful, many eggs/day are mostly helpful, etc)

So it’s really hard to draw any conclusion from these cases.
It’s part of the natural expenses of owning a house, but is not relevant to an anticipated inflation-based increase in value of the underlying asset.
I really don't understand this position. The country has a housing crisis because many of the cities in this country do. Removing the connection to the rest of America is an incorrect way of looking at it because of cause and effect: this is such a big problem in America today that it is affecting people who weren't directly in the housing-short markets themselves.

A weakness in part of America is a weakness for all of America. It works this way with the outside world too - our housing shortages are part of a global problem. We are all in this together. Framing the issues that the world cities have internally as something that isn't a problem for people living elsewhere is just denying that we live in a connected society.

One groups problems affect the other groups.

> And the ones with the worst housing problems have the most restrictive real estate laws.

Do you have a citation for that? I don't believe it's true.
Macaw
People have not caught up with 3.5+ yet. I see plenty of code not using f-strings, chainmaps, pools and the likes.

We can't expect them to known about dataclasses yet.
let me know which platform you're on and I'll comment here when I've got the client for you. probably will be later today or tomorrow.
> “However, most implementations are incompatible with modern DNS requirements, including redundant DNS setups or dynamic responses from DNS-based traffic-management features,” Beevers said. “Legacy DNSSEC implementations break even basic functions, such as geo-routing, and is hard to implement across multiple vendors, which means poor performance and reduced availability for end users.”

Does anyone have more information related to the above quote? I’d like to understand better what they’re referring to.
My (controversial?) opinion is that the civil commitment laws aren't good enough. A (mentally ill) person shouldn't have to become a danger to others or themselves before a serious conversation about involuntary commitment can be had.

And I acknowledge and fully accept that this is a very rough position to hold today. But, it is born out of over a decade of direct personal experience. It's come from watching the state of California continually fail to provide adequate support to my clinically diagnosed family member, to our family as people who care about this person, as well as failing to protect to public from him time and time again.
Like others have said, the technical infrastructure is usually a manifestation of the people processes of the corporation. I think it's valuable to kinda ignore the technical stuff initially, and instead first understand the requirements of your customers. It's totally possible that the current system, as weird as it is, might satisfy your customers' requirements best. Unlikely, but it's possible.

But given that they hired you, chances are they know the current system isn't great, and they didn't possess the domain knowledge to fix it. I'd guess you & your company are aligned high-level that change is needed. It's just a matter of making sure you can align your ideas with the short- and long-term goals of the company, usually with a convincing story explaining how your technical changes drive business value.

For example, you mention that data exploration is hard, and I'm inferring this is a problem because you have multiple consultants independently scouring your datasets. If so, you could communicate to your customers that you can reduce consultant onboarding time from 5 days to 2 days (made that up) if you invested in aggregated datasets or a centralized data warehouse. If you can translate this to a dollar figure (like consultant hourly rate), that's even better.

As for what part you tackle first, I'd suggest finding a problem everyone knows about, but is straightforward for you to solve. Goal is to display immediate value, and gain the trust of the people around you. You don't solve the systemic problem immediately, but the trust you gain is currency you use months from now to really invest in the system. Because truth is, higher-ups rarely value invisible things like data quality or maintainability, they respond very positively to shiny new graphs and numbers.

FWIW I don't know if it's just me, but I feel like the bulk of data science is the ugly pipeline and architectural decisions you're facing now. I read people doing interesting modeling & machine learning work, but I keep wondering how much work went into getting the data into a modeling-ready state. I haven't worked at a company where the % of data team effort going to pipelines is less than, say, 80%.
I think it's as simple as them not doing the math. Self employment taxes, gas, vehicle wear, etc. They just see the check is bigger than what their prior minimum wage job was. Probably true for Uber, Lyft, etc, also.

And, to be fair, it's more flexible, as you say. I suspect some drag their kids along, or work for Instacart after their day job (or other obligations) is done, etc.
i just looked up this interaction. you seemed well intended enough :)
That actually depends on how it gets copied and pasted.

I can think of at least two ways off the top of my head to move the source from folder A to folder B while leaving hidden folders behind. They both assume you're using a graphical file explorer, like non-developers are likely to do.
It's a pity that you link to a page that compares DNSCurve to plain DNS.

DNSSEC has the feature that it works even in the presence of caching (recursive) resolvers.

DNSSEC only solves half of the problems. That's why you use DNS-over-TLS (or DNS-over-HTTPS) for the other half.
It will push prices lower, but only after pay for doctors and drug makers and all the other well compensated medical professionals come down.
You changed my perspective a little bit by asking the right questions.

> Moves from an architecture that is clustered for scale (ie. spark) to one that only scales vertically

I did a quick estimate of the volume, and we won't reach 1Tb before > 5 years. We're not in a line of business where the number of clients can increase dramatically so it's fairly predictable. I don't want to design for imaginary scaling issues.

> Potentially introduces yet more sources of truth for some data.

It is more intended to replace the current mess.

> SQL is terrible language to write transformations in (its a query language, not an ETL pipeline)

Actually this is the point that concerns me the most. The need to transform the data in non-trivial ways. But surely people didn't wait for Spark to do this?

> Unless you can very clearly demonstrate that what you're making is meaningfully better

This is a very good point, and I think I should come up with a quick POC to demonstrate and get buy-in.

> Could you perhaps find better way to orchestrate your spark tasks, eg. with airflow or ADF or AWS Glue or whatever?

I feel that it would just be solving the mess by adding more mess.
Interestingly, the Geneva Convention was barely used at all, and the "excuses" given were mostly based on the politics of the military instead.
Jeopardy Wasn’t Designed for a Contestant Like James Holzhauer
Claims of Shoddy Production Draw Scrutiny to a Second Boeing Jet
You missed the point. No one at the restaurant is getting a tip. The same person who would package up the food if you picked up in person (and who you would customarily tip) is the same person packaging up DoorDash orders, but with no incentive. The person getting tipped is the delivery service employee.
Show HN: Deep Learning Roadmap for Researchers and Developers
> How is the housing shortage not about the amount of available housing?

The name of the problem itself oversimplifies the problem space. There are lots of scenarios playing out today where there is ample housing and still a housing shortage. A major problem is that often the houses available do not match the ability of the renters to pay. So you can have lots of expensive houses being vacant, and lots of renters with nowhere to live, and have a housing shortage.

> Wages don’t need to increase if housing prices fall as a result of an increase in supply.

What? Yes they do! Wages are already too low to support a normal housing market, due to long-term wage suppression of the middle over many decades. Wages definitely need to rise for this problem to fix.
> Empathy does not resolve genuine disagreements.

Empathy enables compromise.

Many disputes cannot be resolved to the full satisfaction of all parties, short of spawning a parallel universe for each sentient.
Taiping and pacific theater were influenced by western thought.

Taiping was led by a religious Jesus inspired fanatic.
Japan was just copying Germany.
I saw that comment elsewhere in this post’s replies and it’s better supporting evidence for why it’s harmful to give us integers than I ever could have dreamed of.
The problem with that approach is that varying the length of the redacted text would effectively alter the document and forever muddy the waters as to what the original text could be. This would likely result in endless speculation that what might be released at a later date is not, in fact, the original text. It also makes it much more difficult to assess whether or not fighting to get one or more parts of redacted text released is worthwhile. (i.e. what appears to be a name or phrase in one area might not be deemed important vs a page and a half in another or vice versa)

So let's say Congress takes this to court and gets an order requiring the A.G. to disclose the contents of one or more sections/types of redactions. There would likely be little confidence that any future unredacted text they receive was the original text rather than yet another modified version of it (i.e. maybe one or more words would be added/removed etc.) By disclosing the exact length of the text, as imperfect a solution as that is, it makes it likely that any future alterations can be more easily detected.
For some history of teeth (not just human teeth) try the BBC In Our Time podcast episode The Evolution of Teeth:

https://www.bbc.co.uk/programmes/m0003zbg

Being a Melvyn Bragg podcast, it includes a reading list:

Barry K. B. Berkovitz, Nothing But the Tooth: A Dental Odyssey (Elsevier, 2016)

John A. Long, The Rise of Fishes. 500 Million Years of Evolution (The Johns Hopkins University Press, 1996)

Neil Shubin, Your Inner Fish: A Journey Into the 3.5-Billion-Year History of the Human Body (Vintage, 2009)

T. M. Smith, The Tales Teeth Tell: Development, Evolution, and Behaviour (MIT Press, 2018)

Peter S. Ungar, Teeth: A Very Short Introduction (Oxford University Press, 2014)

Peter S. Ungar, Evolution’s Bite: A Story of Teeth, Diet and Human Origins (Princeton University Press, 2018)
The app does need to know what your email address at gmail is in order to work.
The Reason Why People Can't Write Well
“Two-Tiered Caste System”: The World of White-Collar Contracting in SV
And why not? The expansion bus supported intelligent peripherals with their own embedded computers since day 1. It'd be totally fine to format a floppy, or defragment a hard drive, or backup your entire volume library via a downstream network modem, without the computer being even aware of it.

Think of an Atari 800 as a small cluster of specialized computers each doing its own thing, connected through a serial bus. BTW, other computers of the time, most notably the C64/128, also did that.

I spend my weekdays in front of a computer that has two displays daisy-chained through a serial bus. The hard drives are on other serial buses, just because I have a couple extra ports.
> The shortage isn't about the amount of available housing at all, it's about people's ability to live there too. And if you're just doubling the building heights, you haven't talked about wages or ability to live there etc.

It's supply and demand. More available housing means lower prices.
I think “DoorDash orders” in this case is referring to the individuals working _in_ the establishment. Not the drivers.
Almost 10,000 years of civilization and we’re still trying to figure ourselves out.

Why is it so hard to codify “Don’t be a dick”?

Because then what do you do about someone who is being a dick?

But what if they just were being a dick to someone who was being a dick?!

Who decides what counts as being a dick? What if they are dicks?
I love my HSA as well, but perhaps there is another viable way to offer them besides linking them with HDHPs.