skysight-inc/HackerNews huggingface dataset:
(please excuse my typing. i have one hand to use ATM)
yup. we bet super hard on sql too. Its fantastic if you know what you're doing. We ca import arbitrary data and expose it as normal tables to our customers for analysis/transform/export along with having a silod access controlled place for them to see just their data. sql is a great technology, and is extremely flexible.

I love it. If you're looking to learn it and fundamentals, check out Jennifer Widom's course from Harvard. I can safely credit her w/ my career.
A good starting point could be understanding https://en.wikipedia.org/wiki/Declarative_programming
The impact of the gas crisis, a preference for foreign imports, and the continued (real or percieved) lower quality of American-made vehicles might act as several intervening factors for the fall of Detroit; moreover, while all unions intervene on behalf of their employees, not all enforce wage ceilings.

The Screen Actors Guild is a counterexample for both points - Hollywood continues to be world-leading, and top actors continued to be paid well, while even the actor you've heard the least of has a minimum wage, down to rules around how many times they can be called-back for an audition.

The free market relies on free association, equal footing, and complete information for both parties. For most people, the business has a significant power advantage. Moreover, management is organizing together in order to depress wages through non-poach agreements - why shouldn't the workers work together as well?
Look at the car towns in Germany and you will see the long term effects of unionization on industry. Companies do well and their employees too.
I mean, the easy answer is make the web view send messages to Node instead of doing the node integration.
It's a fairly new paradigm, and I've noticed these things spread slowly in the Python ecosystem (Python 3 was released over 10 years ago). But I use it, and I've started seeing it in some other python packages lately.

Also keep in mind it is only for python packages, not applications--the primary benefit is that it is impossible for the tests to access files that are not part of the package build.
The only question that remains is--Accenture or KPMG?
Not quite the timespans some folks have mentioned, but I’ve been at my company 6-7 years. I helped start it, and it was recently acquired. It’s still super fun to work on. That’s enough for me.
Changing the design on a daily basis doesn't seem like a winning strategy - the engineer will never be able to complete anything since they're chasing a moving target, and so you'll never get an MVP that you can actually give to customers and get feedback on.

I don't think you necessarily need to fire your PM, but sit down with him and ask him to slow down. New ideas are great, but if he thinks about them for a while before suggesting them to the engineer, it will weed out some of the bad ideas before they get implemented. (Maybe the PM should switch to decaf coffee or get more sleep?)

If this continues, your engineer will burn out and/or quit.
Buzzfeed-news is a separate entity if i am not mistaken?
I love SQL. I love SQL for Data Warehousing even more. There’s a school of thought for DW that goes back many years. Many dimensional modeling practitioners know who Ralph Kimball is and also know the Inmon vs Kimball battles. To this day, star schema as a design pattern has helped dozens of analysts in my company abstract the relationship between measures (facts) and how to slice them (dimensions).
Mate your PM isn't managing very well if he can't get his thoughts on the same path for more than a few days. Tell your PM to sit down...work his shit out...if he thinks he needs to change his mind tomorrow...tell him he better have bloody good reason a. to change his mind. and b. why he didnt think of that reason the day before when he put the plan in place. Your PM is screwing you.
> will eventually illicit a market response

Completely off-topic and unrelated, but on the small chance that this helps you (or anyone else reading): illicit is something forbidden or illegal, while elicit is to evoke a particular response.
SQL is just fine. If incrementing a view counter, giving a one star review or inserting a log entry is important to you, you absolutely want that wrapped in a transaction. If you don't think so now, something will force you to think so at some point in the future. If you wait that long, it's probably too late.

The direction this line of thinking trends in is not thinking or caring about what data you're storing or caring about how it scales. If you're successful enough, this becomes an enormous problem. It literally is a problem that sinks otherwise successful companies.

Not thinking about your data model, not caring about the interactions of your data and not caring about the reliability of your data is a very expensive problem. It's also one where you don't know better until you do. Take some advice from the rest of us, please. We're saying this for your benefit, so that future you doesn't follow in our footsteps.
The Shrinking Singapore Stock Market
> Netflix is so melded with AWS.

But it isn't.

Netflix core service (video streaming) runs entirely on hardware they produce that runs in their own datacenters and embedded in ISPs. Billing, account management, video transcoding, etc. happen in AWS, but all that stuff can go down and customers don't get that upset.
An Exhausting List of Differences Between VB.NET and C#
So if I don't already have Chrome I now have to install it?
Yeah, I use AWK constantly, not just for reading files line by line, but whenever I need to e.g. create data in some format, like CSV or XML or for my programs, or to write repetitive code in a program or LaTeX file (e.g. for a lot of images) etc. It's just so quick and easy, such a versatile tool, a pleasure to use. I learnt sed and grep too but rarely use them.
Quantum Theory Made Easy [2]
I think one of major reason for being powerful is its bases on pure mathematical foundations.
Bavarians vote to save bugs and birds–and change farming
Quantum Theory Made Easy [1]
I wonder how they thought that it was a good idea to capitalize on a brand that they previously damaged beyond recognition.
I'll second this hypothesis. Also unlimited 3d world time: I have _vivid_ recollections of very large maps, spaces, etc.

I can remember every WoW raid environment, every detail of every CS map I played, etc.
This Compression-decompression algorithm is even better than Facebook's Gorilla
I have the same issue, procedural thinking. I've made some small progress thinking in sets and working to re-phrase my goals in terms of sets of data, sometimes using window functions (row_number(), etc) when I need n-1 items from the query.

Some problems can to be assembled from CTEs / subqueries when you might have reached for a procedural solution to 'finish' the problem. Grasping CTEs was a big thing for me and now I'm wrestling with issues of style mixing CTEs with tiny subqueries and wondering if the increase in readability (for me) is correct.

I'd love to see suggestions for digging deeper on this too.
There's no reason why we have to wait for the intra-city transit to develop before developing the inter-city transit, though. Ideally they'd happen in parallel, with the inter-city rail fanning the flames of demand for robust intra-city mass transit.

And we should be clear here that "mass transit" within a city (especially one the size of Merced or Bakersfield) doesn't necessarily mean a full-blown metro network. Even a decently-sized bus system would be a step in the right direction (and in fact might be all that's practical or necessary for the smaller cities). On that note, both Merced and Bakersfield do already have bus networks, and the rail connection between the two would be a good way to spur further expansion.

The "two train stations to nowhere" are - from what I can gather - a temporary situation while we rejustify the rest of the network. Those stations are likely already in-progress and too late to cancel (probably because they were the easiest).
But, the thing is so much code is removed in serverless. I'm not saying cloud providers aren't fighting to lock you in. It is just so much easier to switch if you have 1% of the code you used to.
Right now serverless is definitely not simpler than a monolith. It's "simple" if you squint but any real workloads have you dealing with high concurrency for almost all tasks that a single monolith could handle with a single instance.
> It's nearly 5 decades old

5 decade old sql is nothing like modern sql with tons of proprietary extensions, partition, windows, collations, typecast, json and god knows what else. Your examples " Hive, Presto, KSQL, etc" are a proof of this, they are so vastly different from each other you cannot simply learn "sql" and expect to use those tools in any serious manner.

This is precisely the proof of opposite that sql has not stood the test of time.

How is this even close to sql of 5 decades old,

CREATE STREAM pageviews (viewtime BIGINT, user_id VARCHAR, page_id VARCHAR)
WITH (VALUE_FORMAT = 'JSON',
KAFKA_TOPIC = 'my-pageviews-topic');

or this

CREATE STREAM pageviews (viewtime BIGINT, user_id VARCHAR, page_id VARCHAR, `Properties` VARCHAR)
WITH (VALUE_FORMAT = 'JSON',
KAFKA_TOPIC = 'my-pageviews-topic');

anything that looks vaguely like a weirdly formed english sentence is sql?
class Foo {
public uint Bar { get; set; }

private char[] _baz;

public char[] Baz { get { return _baz;} }

public Foo() { _baz = new char[5]; }
}

This is cheating a bit on the array part. But the length of that char array is set in stone and cannot be changed from the outside. However, the Bar property uses a standard C# datatype.
This was the main reason why I built BorgBase[1] to host backups: You can set individual SSH keys to append-only. Then this setting can be protected by 2FA. This should give good protection against such cases. Many other providers still allow SFTP access, which makes append-only mode useless.

1: https://www.borgbase.com/
Would love to see this on [f-droid](https://f-droid.org/en/)
>No, if your software has a security issue, it's refundable. Write good software.

There are 0 companies that can provide consumer software on the lifecycle consumers have come to expect without any bugs. You write software. Are you willing to claim that you can just "write good software" and never ship anything with a security issues?

Because otherwise you're advocating for consumer tools that use nasa's release cycle. Which like, that's cool and all but I don't want to rely on hardware from 2012 or 2005 running software that was developed from 2010-2014 and has just finished its verification process. You're advocating for a world where we just got the verifiably bug-free Nokia 3310.

And that doesn't even begin to discuss the clusterfuck that would be open-source in this situation. Am I liable for heartbleed because I use OpenSSL? Are the openSSL devs?
One could always place the spare in the cabin for situations where it will be less accessible.

But yeah, major design problem.
A thing I find even more user friendly is Import-Excel https://github.com/dfinke/ImportExcel

It's a powershell module that allows you to easily dump things directly to excel files, does pretty decent datatables, multi-tabs, etc.
> I've moved to writing backend code. I'm surprised most of my peers cannot write anything more complicated than a join.

I'd wager more don't even know what a join is.
Another parallel: the animation industry. Life's a lot better after you get into a union shop, according to my friends who stuck it out longer than I did - the studios are constantly pushing to have one person's work duties expand to what several people used to do without paying them anything more, and the unions fight back against that and generally make sure that if you can keep picking up union jobs, you can afford to live in Los Angeles.

Like games, animation is an industry full of eager kids with stars in their eyes.
Is it just the 3 of you? Why do you have one PM for one engineer? What is your role? What value do frequent changes bring? Is there profitability in sight when sticking with a plan?

Ask yourself hard questions. If you're coming on an online forum to offload the responsibility of having a hard conversation with a team member due to a fear of hurting someone's feelings, maybe you should fire yourself.
Wow!

That's the coolest thing I've read in a while. I can only imagine how much fun it must be to work as a Nuclear Physicist.
Publishing can be free or near free depending on the platform - there’s no need to be on store shelves anymore. For a AAA game though you need to either have a real hit of a game, or a giant marketing budget to convince people their friends will play it. Else, you need have a reputation - making good games is hard.
American style unions are illegal in Germany.
That's the thing about ass-pains, though: humans are prone to simply not do them. That's why the trick to getting humans to Do The Right Thing™ is to make it as easy as possible to do so.
Once your SQL gets into 500-1000 lines, and hours of runtime, I would suggest using data frames instead (in R or Python).

I wrote this post to introduce the idea:

What Is a Data Frame? (In Python, R, and SQL) https://www.oilshell.org/blog/2018/11/30.html

It's often useful to treat SQL as an extraction/filtering language, and then use R or Pandas as a computation/reporting language.

I think of it as separating I/O and computation. SQL does enough filtering to cut the data down to a reasonable size, and maybe some preliminary logic. And then you compute on that smaller data set in R or Pandas -- iterating in SECONDS instead of hours. The code will likely be shorter as well, so it's a win-win (see examples in my blog post).

I can't think of many situations where hours of runtime is "reasonable" for an SQL query. In 2 hours you could probably do a linear scan over every table in most production databases 10-100 times.

For example, if your database is 10 GB, you could cat all of its files in less than 5 minutes (probably much less on a modern SSD). In 2 hours, you can do a five minute operation 24 times. I can't think of many reports that should take longer than 24 full passes over all the data in the database (i.e. pretending that you're not bothering to use indices in the most basic way). If it takes longer than that, the joins should be expressible with something orders of magnitude more efficient.

I've mainly worked with big data frameworks, but I think that almost any SQL database (sqlite, MySQL, Postgres) should be able to do a scan of a single table with some trivial predicates within 10x the speed of 'cat' (should be within 2x really). They can probably do better on realistic workloads because of caching.
It would be interesting to hear some contrasting reports from people who have actually needed support.
>you have to pay 2% of its value in taxes/year?

Sorry for being naive, that is the first time I heard of property tax in % of value every year! No wonder why so many comments were referring to what happens to China when they introduce property tax.

Coming from places where we have tax, but none of them are as high or based on its property value. Isn't that basically "renting" the property? For a million dollar value flat I have to pay $20K Every year? Or $1.6K every month? That is pretty insane if you ask me.

And why are people continue investing in US housing? So these tax, assuming being paid by its owner, are basally passed on to the lease? So a rise in property value will add an extra 2% effect on its rental pricing?

I would have thought property tax should lower the interest of investment in property, but that doesn't seems to be the case in US.
>Furthermore, that these inputs are information theoretically guaranteed to exploit the neural network (even if there are practical complexity theoretic workarounds).

I get the image of a technique that, when applied to humans, allows you to see through political speeches and reveals the eldritch horrors scurrying around us continually.
Tesla also struggles with this, and I think it's because of their direct model. If Rivian uses dealers they should have an easier time in theory.

It strikes me that Rivian is combining the advantages of electric vehicles with the advantages of auto industry know-how, instead of independent hubris.
"On the other hand, an HTA runs as a fully trusted application and therefore has more privileges than a normal HTML file; for example, an HTA can create, edit and remove files and registry entries."
> If incrementing a view counter, giving a one star review or inserting a log entry is important to you, you absolutely want that wrapped in a transaction.

You absolutely don't. You want it as CRDT operations, not transactions.
Depending on the size of the relations, something like adding a new FK might result in more than minutes of downtime due to an exclusive lock--although that's a heavily couched "might" given all the work the Postgres team has put towards online DDL.
These are issue trackers. I'm not reporting a bug in Google. I want support on "how to do X" or "I purchased this reserved instance by accident, can I get a refund".
I have a fundamental issue with the way in which the Gates foundation gets its work done. Sure, there may actually be impact achieved in some of its investments, but in most others, the team does not even know the name of the founders they have invested in. I've interacted with Associates from the Foundation based in London who know the broad strokes of investments they've made in India, for example, but the actual companies, they have no idea. Their process has been to spray and pray. No active involvement, no process optimisation, no impact metric monitoring etc.

Further, the manner in which the foundation functions in India is what makes me cringe when I hear their name. They have unrestricted access to members of parliament in India, they promote Indian government programs e.g. Ayushman Bharat (Health insurance for 500 mn Indians), Aadhaar (digital unique number for all Indians) and they ensure policy changes to suit their funding programs. Their close linkage with the Indian government to further their propoganda is what makes me cringe. Sure enough, do implement some programs its commonplace to liase with Governments, but where's the ethics in that? Where do you draw the line to limit promotions for government projects that fake numbers and are not really having any impact on the ground?

This Annual Letter is just another propaganda piece, as stated by others here.
It's death by a thousand cuts though. A bunch of localized effects that add up. That's not "terraforming." No one thing has impacted the entire planet except for fossil fuels. We dispersed a lot of lead globally in the mid 20th century, but that was also fossil fuel related. Plastic buildup in the ocean is also fossil fuel related. And of course the atmospheric changes.
Top Coins in the Green, Few See Minor Losses
That documentary, "Big Star: Nothing Can Hurt Me" is currently free on YouTube: https://www.youtube.com/watch?v=nuU23sDT6hY

Obligatory link to The Replacements song "Alex Chilton", which is how I and I'm sure many others of a certain generation first heard of him: https://www.youtube.com/watch?v=sTSJYZyouek

Fun to see a distinctly non-tech-related article make its way on to the front page of HN!
They're Indian, true. Well, the world is like that - thus Boyer's law:

"Mathematical formulas and theorems are usually not named after their original discoverers"

and Stigler's law of eponymy: "No scientific discovery is named after its original discoverer".

https://en.wikipedia.org/wiki/Stigler%27s_law_of_eponymy
These are all localized effects. A lot of localized effects can add up to global changes, but they're not the same thing. Terraforming implies global changes.
I've been saying this for years, because I started doing web apps when we pretty much were sending raw SQL over to a database. Even after ORMs got bigger, I still stress knowing SQL even if you don't use it often, because it helps you understand the ORM.

And oddly enough, now I'm a data engineer. Everything I do, even when I'm not doing pure SQL, is influenced by years of experience in SQL. Either the languages of my big tools are still based on SQL in some fashion, or it simply helps to have an understanding of the ecosystem to figure out what's going on at scale.

Everything else has come and gone and come again, but SQL has help up pretty nicely. The only other skills that come close for me are working in languages that branched out of C (because the syntax isn't so different over time) and years of on again off again procedural languages (ColdFusion, vanilla Javascript, etc. leads to it being way easier to pick up Python).
The Ethics of Automating Design
Which should be an argument for the reforming and redesigning of American labor unions, not a dismissal of the concept.
Ask HN: How to get better in advanced SQL
How to get better at indexing?
How to get better at joins?
How to get better in SQL optimization?

Must to know things about SQL and maybe relational databases?
“More adversarial” means “less dictatorial”.

Obviously some or most bosses are not evil. Some are, and they get away with it because they can.

Democracy is a beautiful thing. We should have it in our workplaces.
>Right now we have CSS Grid and it works in all browsers

Globally support seems to be at around 85%-87% [1], all browsers is misleading.

[1] https://caniuse.com/#feat=css-grid
While I agree with you, I met a friend of a friend in Denmark who works for PDC who makes the claim that, outside of them, there's only one other respectably-sized company on the planet that is actively keeping Prolog alive.

If I'm going to bet my career on one or the other, it'd be SQL.

Slight aside, I think there are good lessons to be learned from LINQ still.
Games these days have a lot of CRUD too. I spent the last 3 years in the games industry writing REST APIs and client code that consume them. Clans, messaging, friends, matchmaking, content update infrastructure, leaderboards, saving progress, in-app purchases, live-tuning... It's all CRUD
Companies should be able to freely lay off people independent of what a Union wishes. The other members of the union should just show solidarity and threaten to quit/protest if a company does that.
On the news you'll hear that the housing market has "recovered" and is now "healthy" when prices increase.

When food and gas prices go up we don't say that. We worry.

The narrative has been completely taken over by property owners.
> These are the least efficient chat app and least efficient music app ever

Which 99% of users never care about. The idea that large memory usage is a negative business driver is almost laughable at this point, yet for some reason it is a huge pet peeve among lots of technologists.
An alternative is this:

https://github.com/andlabs/libui

There are Go bindings here:

https://github.com/andlabs/ui
I loved this book as a kid, although once I got into the work force and began to appreciate the value of a work-life balance and the basically unbrigdeable gap in incentives between management and labor, I started to look at the ludicrous demands the company placed on its engineers with a more jaundiced eye.

My perception of the team leader hero, Tom West, was also permanently altered by an essay written by his daughter Jessamyn (a quasi famous technologist in her own right), who described him as basically a depressed alcoholic.