skysight-inc/HackerNews huggingface dataset:
> sql to write etl in will drastically reduce the amount of work needed to write etl.

:)

My experience with writing an ETL in SQL is that it is almost never, quick, easy, correct or easy to test, and also almost always denormalized, or unconstrained (dimensonal keys which aren't 'real' foreign keys, just numbers so you can parallelize the data inserts and updates without constraint errors).

So... your milage may vary with that.

It's most certainly not true that writing any kind of ETL that uses SQL saves time in all cases.
You cite a bunch of very valid criticisms, but then to say directly to the OP (as they posted their own article) that there is "nothing of value here" is excessive, IMHO, and symptomatic of a kind of discourse that only flies online (unless you would say that to a person's face when they presented you with something they created, and perhaps some people are that direct and lacking in empathetic communication).

Is there new information here? No. But it's presented much differently from the official documentation and perhaps some beginners would find a guide like this less intimidating, more consumable, whatever - people have different learning styles. Maybe the people that would prefer this tutorial over another are a small minority, but I take issue with the sweeping statement that the work the OP put in here created no value for anyone at all.
Could you please review the guidelines and start following them? You've been posting a lot of uncivil and/or unsubstantive comments.

https://news.ycombinator.com/newsguidelines.html
You seem to imply that I'm proposing something new and radical, whereas I'm actually just describing how community mental health is practised in a lot of places, including some parts of the US.

I wouldn't be willing to work as a psychiatric nurse or a social worker, but clearly plenty of people are. There are all sorts of jobs I wouldn't want that other people love and vice-versa.
Because that paragraph aligns with my personal experience. My mother was a successful software engineer when I was a kid. And because her company had this attitude that required every employee needed to work 40 hours on normal weeks and 60 hours when a bug patch was needed, she always said it was her biggest regret that she kept working after me and my sister were born. I don’t see how preferential treatment towards hiring women helps diversity, when in my experience the biggest hindrance to diversity is the business expectations on employees. And how different would it be today if someone was in my mothers position at Microsoft? I know they pay lip service to all these but I don’t think she would be respected if she asked for 15 hour work weeks for 8 years. My mom would love to get back into software engineering now, but since she wasn’t allowed to take on a lighter load, she’s lost skills and can’t find good work.
Ask the Australians, they’ve had a few scandals with Chinese car imports and safety.
God forbid we let freeloaders like this into our country!

/s
Fortran 77 was the language I used in my first job in 92 on DOS and Unix. Can't see the benefits over other languages like C, Go, Python though. Unless you've got some specific high performance floating point ops requirements?
Modern Java is quite a fantastic language. They are steadily releasing new features (8 - lambdas, 9 - modules, 10 - type inference, 11 - jvm improvements, 12 - switch expressions, future - coroutines) and imo better than most of the languages you mentioned because it is quite simpler and with a larger ecosystem.
That's sort of right. It's not that we find it morally unacceptable to involuntarily commit people.

It's that we don't want to pay for it. We shut down all the state mental hospitals. Which moved that population to jails, prisons, and the streets.
Mark Zuckerberg Should Be Held Accountable
True, but this shouldn't be done on the streets. At some point they need to be "taken" to a safe facility.
Spot on!!

Everyone has cargo-culted distributed file databases, and they’re good in specific use cases — if you have a large volume of data with a very high number of writes. Hardware and RDBMS performance have improved over the years to the point where if you’re not Google (or certain scientific applications), you probably don’t need much more than postgres. It’s completely within the bounds of feasibility of modern systems to store a 100gb database and its indexes entirely in memory. The only reason you need to scale beyond a single server in most business contexts is when you’re topping out IOPS.

If you just have a lot of data and are doing mostly reads, an RDBMS will almost always be faster for that reason. It’s also FAR easier / faster to write complex queries for an RDBMS.
I call BS on some of these, like EQ > IQ at Github, lol.
Yeah, some interesting thoughts. I will have a think and see what can be done to extend the Monkey
I have the book Modern Fortran Explained by Metcalf. It does a great job of providing modern examples of traditional code as well as examples of the new features.
This is clearly a problem of the industry capturing the regulatory body. There surely should be a bipartisan consensus to appoint non-industry representatives to regulatory bodies to serve only the public interest.
Factors that are proportional to house value (property tax, transaction fees, maintenance costs) have a big impact on relative profitability because the marginal gains are actually small.

Most of the "advantage" of home buying comes from the ability to borrow money at (e.g.) 4% and hope the home appreciates at (e.g.) 5%. Small taxes and write offs can double or negate profitability.

(The down payment part of the investment might also be good diversification, but it is unlikely to appreciate as fast as the same cash would in stocks.)
Teslas are popular in Beijing because EVs have a different pool in the license plate lottery. Rich people who would’ve gotten a black Audi instead settle for a Model S.
Not sure why you're being down voted but it's a good question since my Professor spent some time to explain this. I think if you think of the literal definition in the English dictionary, then the wording is correct. However, most people in the technical community would agree engin is a subclass of motor that uses a cyclical process to convert power to motion.
BYD sells more cars then Tesla, and Tesla’s sales are down from last quarter.
Of course, each noobie is confused about who to properly do things :)
Libraries and tooling. And a pretty good track record.
It puts me hundreds of miles out, in the wrong country.

I find these IP lookup tools vary greatly - some will match certain IP blocks better than others.
Interesting - I had the complete opposite experience: Python was the first language I'd tried in a long time that just worked as I'd expected it to. After understanding the initial indenting rules, most of the code I tried could be written as pseudocode, which surprisingly worked the first time.

I was really impressed, most languages have so many stupid syntax requirements, which really shouldn't be be needed these days - everything compiles to the same assembler code so lets not pretend these languages are doing magical things.

The goal should be for programmers to get the logic across to the computer in the simplest form - and Python is pretty good for that (apart from zfil - seriously, can you get any more unintuitive)
In my experience nearly all standard old code will still compile just fine, except code which relied on compiler-specific extensions and directives. Unfortunately, there does tend to be a lot of code out there using these proprietary directives.

Things like metacommands [0] will need to be converted to something standard (or removed) to work with modern compilers.

[0] http://www.ousob.com/ng/fortran/ng4e22.php
Thanks for the pointer to jkcfg. Our helm chart templates are getting too complex for the tooling and it's making me wish we were using a more powerful programming environment. One where we could reuse code more easily across projects. We could still write our configuration code in a declarative style, that's a matter of code structure.

I do like helm's interface around packages: install, upgrade and test. I like that packages have a tree structure that you can compose (if you opt to do so). It'd be nice to extend the interface further to have other common actions you could apply to a more advanced package (e.g. backup, restore, chaos test, add tenant, remove tenant, etc).
Python's documentation is not the worst, but it's certainly nowhere near the best.

As for JavaScript, these days I almost entirely rely on the MDN documentation and hardly go to Stack Overflow for that topic.
Maybe but in general, I am unmoved by any slippery slope argument that depends on evolutionary changes to a species.
More interesting, there are "mobile libraries"
https://en.wikipedia.org/wiki/Street_Books
Hey,

Yeah I will check that repo out and see what you've got.

Thanks, hopefully the UI is easy enough for people to do what they need to. :)
I'm actually modifying the site DOM to remove the dark patterns. There's no request for remote content that I can block in most (all?) cases. This is fundamentally different than an ad blocker. It's closer to a curated selection of grease monkey scripts
to be honest the analog redaction techniques are pretty bad.

For example there's a list of names, alphabetical. Two names are redacted.

Michael Cohen, Richard Gates, [REDACTED], Roger Stone, and [REDACTED] (newline) [REDACTED]. The final redaction could fit approximately three letters.

The fact that these are analog redactions makes it really easy to tell that the two other people are Kushner and Donald Jr.

Meanwhile if they had opened the report in Word and done [REDACTED] they wouldn't have these super-basic issues.

There _is_ an advantage in that you can have more confidence that the original document is merely being redacted and not completely changed, but it's not really beyond motivated people to actually change the source doc if they wanted to.
If you're implying that abuse by elites is some new phenomenon within the last 50 years I completely disagree. In fact social inequality has probably been more favorable and egalitarian during the last 50 years than basically any other time in human history, and US history. There's always room for improvement, but it's worth remembering how far we've actually come.
How to syncing data between application instances? Easy
Engineers Diagnosing Voyager 2 Data System (2010)
A lot of our modern focus on race also dates back to such well-meaning attempts, ironically enough. There was a very real focus in the Progressive era to try and get people to see themselves as "white", in preference to their more meaningful ethnic origin - this is something that impacted people from Germany and other parts of central Europe quite a bit, because of how wide-spread anti-German sentiment and discrimination was in the run-up to WWI. Of course racial self-identification is considered especially divisive today, but it used to not always be viewed as such.
I felt a part of my soul drift away when I saw an ex-coworker put a for loop in a yaml file. Joe Beda (Heptio) talks about the problem here: https://www.youtube.com/watch?v=M_rxPPLG8pU&t=2960s

Just use Python (or Lua if you want something simpler/lighter). Or, like Brigade, even JS. Hell, use BASIC. But these bizarre template-language-DSL bastardizations are horrific when it comes to maintainability. Incremental evolution from a config file to a full language is a path wrought with peril, and only ends in damnation!
The huge advantage of housing is that the government essentially supports infrastructure to get massive leverage. With 1:5 or 1:10 leverage, 10% appreciation with 1:10 leverage means you double your money. The downside is that with a 10% decrease you lose all your money.

Otherwise real estate is not liquid, annoying to manage, and constantly incurs real costs.

The stock market is relatively competitive as an investment and includes REITS which let you get some of the returns of real estate without the hassles.

I had vacation rentals that cost about 50K each and returned about 8K/year after costs (each). But in the end when there was a problem and the maintenance company wasnt available, I was the one that had to drive 3 hours. I really needed to own at least 5 to make them worth owning. But then there would be the hassle of people constantly coming and going.
Yes I think so! It's a major Inbox feature that people miss. You should probably focus on implementing the most missed Inbox features after launch :D
A lot of these are manager-dependent, like 'fosters psychological safety'. My impression is that these are snapshots of how the companies would like to be seen, which is what they are paying for. They aren't paying for an 'audit' of what their true value are, or for insight from employees (like Glassdoor).
> I understand that the product can only become great if each & every suggestion is listened to

I've actually heard strong arguments for the opposite. Your vision is what counts. People often don't know what they want until you show them.
It got me within one city block of my location. I’m in NYC.
Something like this would be cool, and probably significantly harder to implement, for GraphQL.
Yes, a lot. I feel that I'm doing it more often now. I'm 5-year exp. now, and the unexpected expectation of ensuring that it should be self-sustainable in the future is making me spend more time in even small thing, which is definitely over-engineering.

Often meeting goes like,

Person 1 - this should do it

P2 - But if we do that, that will also cover that2 in future

P1, P3 - Make sense, let's do it.

P4 - We should also do that3.

All - Lets put up our points on a Doc, and discuss it again tomorrow. We shouldn't build something which we have to revisit in the future, it will be a waste of time otherwise.

All agree, adjourned.

(P1 to Pn are interchangeable)
Agreed, although I thought it was a key value store as a service at first
[random internet remarks]

Reading a book is easier than finding customers. Without customers, all the books in the world won't matter. Reading books is useful in school. It's useful before interviews. It's not a substitute for facing face to face rejection. Reference: Before the startup http://www.paulgraham.com/before.html
In rural areas it's quite a bit different.

Where I am in rural southern Missouri, I've got very few choices.

1. Mediacom - horrible customer service, decent speed when it works but sometimes unreliable. Data caps on all accounts.

2. Centurylink DSL - horribly slow and horribly small data caps.

3. TotalHighspeed - 3 megabits for $75/month via Wifi dish.

4. Verizon LTE - ~$100 for a 15 gigabyte per month data cap, then it's throttled to ~600kbit/s once 15 gigs is used.

Note that the only one that doesn't have explicit data caps and multi-year contracts is the tiny WISP with extremely slow service. Verizon and Mediacom both have 2 year contracts with cancellation fees. Centurylink has data caps so small that it isn't even worth considering. Most of these options are only available inside city limits, if you live far out of town your only option is Verizon or a Satellite provider with outrageous latency and data caps.

Government might not always do a good job providing service but I'd love to see literally any new competition enter the market.
Yeah, but when you let the bean counters make engineering decisions it is all about cost and nothing about value.

So when you are actually engineering tangible real world items (eg cars and buildings) that have substantial embodied energy "over engineering" can sometimes actually mean making something of long term quality and value that lasts past fashion and trend.
One of the creators here :). We wanted the subscriptions to be gone forever rather than just labelling or deleting. Thanks for your support!
It sounds like your org needs two things,

1. A data warehouse for this data

2. Awareness of software/data best practices

That being said, while I agree code duplication is bad, data duplication isn't as long as you are maintaining data lineage. In some cases data duplication good.

I also wouldn't care too much that you have 100Gb max in a big data architecture. So what? It's not like you're going to be able to get rid of it easily. A data warehouse built from a new set of pipelines seems like the biggest bang for your buck.
This is false. The Leaf passed 400K sales last month:
https://newsroom.nissan-global.com/releases/nissan-leaf-firs...

Tesla had delivered more than 500K cars by the end of last year: https://insideevs.com/tesla-production-deliveries-graphed-q4...

So the Leaf has outsold each Tesla model but not Tesla in total number of vehicles.
This. 10,000 downloads would already be a terabyte of bandwidth
These are going to be recognized as a policy disaster.

There are many cases where a somewhat expensive treatment saves a very expensive hospitalization.

For instance, a steroid inhaler for asthma costs about $200 a month, maybe you have two $200 specialist visits a year. So for $2800 a year (not covered by high-deductible insurance) you can probably be symptom free or you can take your chances and have an exacerbation and a $28,000 hospitalization (which insurance will pay some of after the deductible)

Docs hate them too.

With real insurance, you have maybe a $20 copay you pay at time of service and they know they are going to get paid by the insurance.

With fake insurance, they don't know what you are going to pay until months later when the insurance gets around to telling them. Then you get a bill that says you owe $291.44 for some unspecified service you got 6 to 18 months ago.

(They can't tell you what it was because that would violate your privacy)

Needless to say they have a big accounts receivable this way, many people don't pay or they pay late (e.g. a few months after getting a bill they don't understand as well as something that says "THIS IS NOT A BILL" they don't understand). This is not good for their finances or their state of mind.

In theory high-deductible plans might lead you to shop around between providers to get a better price but in practice nobody can or will tell you what things costs and it doesn't work.

It's a perfect example of the neoliberal mind at work.
It's a custom solution based off of PHPWiki that they aptly call "GoWiki."

More info here: https://senseis.xmp.net/?GoWiki
This is what I have problem with too. I dislike most forms of dogma, and dogmatic liberalism, freedom of faith, speech and so on can be toxic too. I mean too often it seems like it just makes taboos shift. The smile-or-die mentality, the rainbow crew of Star Trek, the outrage that Witcher rooted in ancient slavic history and myth doesn't contain black characters...

I think one of the healthiest approaches was shown by the Monty Python group. They made fun of religious people as well as of atheists.

I would like to live in a society where it's okay to make a joke about race, religion, sexual preferences and gender once in a while. Many things are fine in moderation. It's bad when someone keeps hammering one group over and over. People always told jokes about forbidden subjects. When you can't tell jokes about X at all, I think it signals a problem related to X.

I have yet to explore lectures of Jordan Petersen, but I found one of his remarks interesting. One of his studies shows many similarities between right wingers and social justice warriors.

One way to define conservatives is people who want to force most of their rules on others. One definition of liberals is people who want to enable all people to live however they want as long as it doesn't harm others. Going by these definitions, social justice warriors can be considered conservative. They've just moved to another camp.

I'm trying to say perhaps liberalism/conservatism is not the value of the variable, but the algorithm. What you do with your values. You can try to force your rules on others, or try to inspire and lead by example, or... just don't care. Or something in between.

I'm being vague and general with most of my points because comprehensive error handling can obscure the message.
> All these things exist in many developed countries, but they don't solve the problem either.

You're just claiming this without providing any evidence and I believe this to be false (in tendency), unless by "solving the problem" you mean "perfectly solving all problem in each and every case". In general, adequate medical treatment and improved living conditions will improve the situation. With proper medication and treatment people can live with schizophrenia.

As for putting people who pose no threat to the public or to themselves into closed institutions against their will, this is obviously immoral and not even worth discussing. At the meantime, every country I know of already as laws for mandatory closed therapy of people who actually pose threats. That includes the US.

Overall, it's not clear to me what you were trying to say. Given that the obviously immoral solution is out of question, that there always remain some problem with the outliers for which the help doesn't work? Of course, these will always exist, just like there always will be criminals. But that's a truism.
A set of greasemonkey scripts could work but my intended audience is more casual than greasemonkey users. Having a curated set of scripts bundled into its own extension makes the marketing story and installation flow easier.

I also think the security will be better on my extension. You have to give greasemonkey edit permissions for all websites whereas I have a PR in the works where you only grant permission to the sites you want to disengage from. Even now it only asks for permissions to the subset of sites it modifies. Due to the nature of how web extension manifest permissioning works, greasemonkey can't offer this. If you look at their permission model it says "This add-on can: Access your data for all websites". IMO that's way more dangerous than your paranoia about a new extension with tight permissions.
Mortgage rates are substantially lower than margin lending rates though.

Borrowing to buy a house at 4.5% you might think, "Not much risk, will likely appreciate faster." Borrowing to buy stocks at 10% and you're almost certainly not going to come out ahead.

(Maybe my broker has terrible rates, others could be more reasonable.)
I also feel that spending a lot of time reading Uber/Netflix blogs (or similar stuff) is not what I should do, for an hour, first thing in the morning.
What about the hypothesis that focusing on empathy is the problem, rather than its application the cure?

Gloomy as it is to say, technological superiority has been very comfortable but doesn't offer any new way of tackling the fact that humans are basically the same as they have been for the last millennium; large groups of people who simply are not going to agree with each other.

What is important is maintaining the institutions that have been wildly successful in mediating conflict between diverse groups, and that all the different tribes of a society make an effort to accept that institutions are more fair and reasonable than the alternatives.

Empathy does not resolve genuine disagreements. If it solves a problem, the problem was one of perception rather than reality.
> The pre measurement wave isn't a statement of our ignorance of the system but rather a description of reality.

Post measurement particle is description of our ignorance not a description of reality.

It still evolves according to Schrödinger equation (which degrades to newtonian dynamics for sharp and narrow waves) but for historical reasons we choose to talk about it as it was little billiard ball, not still a wave just sharpened and narrowed down by intraction we call measurement.
Currently building receiveco.com. It helps local businesses to get customer feedback and based on it asks for reviews on Google, Yelp, etc. I am currently searching for a co-founder better if someone who's got experience in marketing. The app is 95% complete. Email me at the email on my profile if you're interested.