skysight-inc/HackerNews huggingface dataset:
> The issue with encountering CSV in the wild is that everybody who appreciates standards and interoperability ditched it a long time ago.

I worked on a team that used CSV somewhat extensively. For the data we generated, it was RFC complaint. It's pretty trivial to get RFC-compliant CSVs, too; most languages have a library — ours was in the standard library, too.

We also had a ("terrible", as we joked) idea to create a subset of CSV that would contain typing information in a required header row. (We never did it, and it is a bad idea.)

> If you are consuming CSV files in the wild, you can be sure that whoever is supplying them to you is using horrible tools to create them and will be unwilling or unable to address issues you find in them.

…but this is absolutely true. We also consumed CSVs from external sources and contractors, and this was an absolute drain on our productivity. I've also worked with engineers of this caliber, and changing CSV wouldn't change the terrible output. I've seen folks approach eMail, HTTP with a cavalier "oh, it's a trivial text format, I don't need a library!" attitude, and inevitably get it wrong. Pointing out the flaws in their implementation and that a library would fulfill their use-case just fine is just met with more hacks (not fixes) to try to further munge the output into shape. It is decidedly not software engineering. I've seen this even with JSON.

But yeah, even with RFC standard CSV, you shouldn't be parsing it with awk. It is the wrong tool.
What format of data file is best for working with Awk? I assume some kind of tab delimited file? With a reliable ingestion layer you can convert all your files CSV-ish files to something ergonomic for Awk scripting.

JSON data files seem to be a similar deal. Sometimes they are actually properly formed JSON arrays and sometimes they are individual line-delimited objects.

Data files are a mess, is there a command line tool that is well suited to taking in many inconsistent formats and outputting something ergonomic?
I work in a startup which is ~10 months old where we've decided to go all in on gRPC for all communications, both inter-service and client (Web SPA and a CLI) to service.

Although investment in tooling had been significant in the beginning it has truly paid off its dividends now as we can develop in Golang (micro services, CLI), Javascript (SPA) and Python (end to end testing framework), and have a single definition for all our API endpoints and messages in the form of Protobufs. These protobufs automatically generate all client and server code and give us out-of-the-box backward and forward compatibility, increased performance due to binary format over the wire and more..

Our Architect which put together most of this infrastructure has written an entire series of blog posts about how we use gRPC in practice, detailing our decisions and tooling:
https://stackpulse.com/blog/tech-blog/grpc-in-practice-intro...

https://stackpulse.com/blog/tech-blog/grpc-in-practice-direc...

https://stackpulse.com/blog/tech-blog/grpc-web-using-grpc-in...
I suspect that Waymo will do better compared to a human outside of Phoenix than inside it.

The hardest thing that Waymo will have to do is to interact with humans behaving oddly. Phoenix has those, just not as many as NYC/LA/SF. But one thing computers do exceedingly well is scale. Dealing with one strange human is very hard for a computer, but dealing with two or more of them is very similar.

Snow / ice / rain on the roads means changing underlying models, behaving more cautiously. Computers can switch modalities much quicker/easier than humans.

Fog and other visibility problems are sensor issues. Humans are stuck with the old Mark 1 eyeball, but self driving cars have a mix of sensors. These sensors may currently be worse than eyeballs in fog, but may not be in the future.

Even given those advantages, you still start in an easy location. Going from 0 to 1 is really hard, give yourself all the advantages you can. But going from 1 to N is a lot easier.
There is also just the question of what kinds of conditions are conducive to preserving fossil remains.
Now that you have .TEXT and .DATA sections, you're only a few sentences away from suggesting that the compression/diff algorithm generate and send WASM's binary encoding.
Remind's me of the SNES game "Yoshi's Island". That game used wobbly crayon for a lot of graphics, including goal UI: https://youtu.be/qZwjQu4lQm8?t=1341
Yeah, one way I've describe gRPC to colleagues (which may help or hurt depending on the perspective) is that is "SOAP, but without all the lunacy"
I stopped buying electronics from Amazon for this reason. They open all video card boxes and it is very likely you will not get the card you ordered. I was ripped off twice by them. Shame on me for falling for it twice.
Even if the converter was doing some buffering or interpolation (which ugh, who wants?), it couldn't reorder things to show out of order. At most, it would make things more simultaneous, or fade in.
Plus the benefit of deterring coyotes from the area
Forekast – The Calendar of the Internet
Crowdsourced events, to keep you on top of what's happening. Get top events and happenings in your calendar with Forekast+
Use Scala in your early stage startup
Actually cameras are everywhere all the time already, the question is who can access the footage

http://magarshak.com/blog/?p=169
Which is at least a very common thing across many fields, not a proprietary Amazon technology.
A bloated abomination?
I think it would be an unstable situation unless the hominid species were somehow incompatible enough to prevent cross-breeding; otherwise, what would happen is what evidently did happen, which is that all of the hominids cross-bred and produced a single remaining phenotype.
Prior Common Cold, Caused by Presumed Coronavirus Infection Reduces COVID19 Risk
Honestly the main feature of Haskell in this regard isn't STM-colored functions (as you note, that's a bad thing), but rather that it almost supports color-generic functions in the form of `Monad f => A -> f B -> f C`. Unfortunately, it doesn't correctly handle the identity monad `type Id a = a`, instead requiring `newtype Id a = Id a`, so it's impossible to write a function that matches both (eg) `A -> B` and `Monad f => A -> f B`.
iOS 14 Beta: 'A New iOS Update Is Now Available' Popping Up Repeatedly
So you are saying a dish should be named after the chef who cooked it?

A beijing chef cook in Sichuan, using the local cooking style and technique, are still considered a Beijing dish, that's what you implied here.

I am not saying it's wrong. But that's not how Chinese people think about the dish...
> Both ruling parties oppose anything that opens the system to additional parties.

Virtually all RC election schemes in the US, and also nonpartisan primaries (which are a close cousin) are championed by democrats. That's just not true.

Edit to expand: it's a partisan issue because structurally the democratic party is already a loose collection of interests. They've always structured their internal workings around this kind of dealmaking and coalition-building. Shifting to an environment where those groups (Blue Dogs, DSA, The Squad, the Congressional Black Caucus, etc...) become first class parties doesn't really change the way democrats have always governed.
It does help, but not much. It basically enforces that the most rejected candidate does not win. But it does nothing to the second most rejected one.

Of course, ranked and approval voting are much better choices.
I think many of these institutions are probably experiencing some internal tension about whether to publish this story, but that they dominant culture and voices are so panicked about the possibility of a Trump re-election that they are highly resistant to granting the story any credibility.

By the way, the emails found on the laptop have now been authenticated by a 3rd party security firm that has been relied upon before by "mainstream" publications like the Washington Post[1]. Not to mention that there is Tony Bobulinski, the CEO of Sinohawk that was founded in partnership with the Biden's, who has publicly stated that not only was Joe Biden aware of his son's foreign business activities, but that he believes Joe Biden was part of the bribery scheme.

[1] https://amp.dailycaller.com/2020/10/29/cybersecurity-expert-...
"This quote keeps on showing up out of context. Edsger and I got along quite well." - Alan Kay

https://news.ycombinator.com/item?id=11796926
that sounds like a problem with considering parties when voting, and trying to reduce the complexity of choice to a binary, rather than the merits of the candidates themselves.
Yeah if only Twitter had a "Stop Shadow Banning", a "Stop Censoring", and a "Stop Banning Individuals" button, that would be great. lol.
This is written so definitively, do you have a particular reason for making such a bold demand?
There is also Charlesproxy which supports Protobuf.

But from my experience you use the code generator and trust the deserializer and serializer since they are unit tested.
So you can just unit test your methods and don’t have to look at the actual binary blob payload.

You trust that gRPC is battle tested and you can just test your code.

You would probably wrap the generated methods/objects/structs in your own domain model and unit test the mapping between them.
Using the objects from gRPC throughout your code directly does work but sometimes is not what you want to work with.

So I rather would introduce another boundary to the transport. But that is personal preference (in case I want to get rid of gRPC and don’t want to touch my business logic)
It might also be precognition?
I must be missing something, how does splitting your ticket counter the spoiler effect? (Which impacts all US elections, not just the Presidential race)

As far as I understand it, a strong & viable 3rd party is nearly impossible for the simple & single reason of the spoiler effect.
Would you rather have an expert in Rust doing web programming in Rust, or a novice in JS doing web programming in JS?

The best language to use is the one you know how to use best. If you know all languages equally well that you're free to choose the ideal language for every project, then sure, that's the way to go.
There are tradeoffs to every system. We chose first past the post and our executive structure for historical reasons. It's largely working for us (in a broad historical sense) and we're not going to expend the effort to change it without good reason
What we call CI/CD is only CI
Ah right, I get that in Direct Messages now all the time. And IG does not even remove all the obviously spammy accounts.
Since you replied to me: I agree, STAR would be better. I also like approval voting for its simplicity. I believe both are better than RCV, but for whatever reason RCV seems to have the hype and I'm not sure whether it's better to try to run with that hype or redirect it towards STAR or approval voting.
Buy a dishwasher. Cook out.
I restored an old tube FM radio 20 years ago. The 'cat eye' tube for tuning was glorious to look at. You'd switch channels just for the pleasure of tuning it.

It did nicely heat up the room in winter times too.
As Jeff Kosseff, a US Naval Academy professor who actually wrote a book about Section 230, put it in an interview last year:

“There has been an increased amount of criticism of the platforms. But it’s not accurate. There’s a First Amendment distinction between publishers and distributors. But since Section 230’s been in place, that’s not really been an issue for the internet.”

https://www.theverge.com/2019/6/21/18700605/section-230-inte...
Shortcuts isn't really automation. Its just what it says - shortcuts. I tried getting shortcuts to do things for me and all it did was give me more notifications. Sucks.

For example, when I get to work, i wanted it to log the time, all it did was showed me a notification that I had to click (!) before it did the task I asked it to. Silly.

One feature I'm using more these days is the "share" popup. For example, one shortcut [1] i hacked up accepts an amazon url, extracts the product id and opens that product on camelcamelcamel. So now I can be in the amazon app, hit the share button, click this shortcut and see the product price history. pretty useful. Without this shortcut it was pretty annoying. CamelCamelCamel folks could use something like this to increase their usage :)

[1]: https://www.icloud.com/shortcuts/fc526325b9eb4ebf99bce8da65a...
Why Blacksmiths Are Better at Startups Than You – Stacking the Bricks
FPTP makes the mistake of assuming that the person with the most votes is the best.

Likewise, the biggest flaw of RCV (to me) is that it makes the opposite mistake: it assumes the person with the least votes in each round is the worst. This isn't necessarily the case.

It's still much better than our current system because it collects more data-points from voters about their preferences, and uses that data to make more comparisons between different batches of candidates.

But there are simpler systems out there with even greater voter satisfaction efficiency, because they don't make the same flawed assumptions about voter preferences. In approval voting, you either approve of a candidate or you don't, and you vote as such.

Election science wonks like to talk about theorems and satisfaction of obscure criteria, but I think they often undervalue the two things that matter most: voter satisfaction and simplicity. "Simplicity" meaning: an optimal strategy that's simple-to-explain, an easy to understand outcome, low cost of implementation, etc.

Most of us here are software folks, and we understand that designing a great system is the easy part; the hard parts are implementation and change management. Voting systems should be thought of the same way.
Blast from the past. I created a simple UI system for pygame a long time ago. It would be fun to hack on that again.
https://github.com/fictorial/pygameui
Amy Hoy with another epic post, one that I'd like my children to read when they grow up a bit (but not too much): "As the master blacksmith said, when the customer asks for “10 more of these” they’re going to be bloody upset when you come back with a newer, creative design and say “But this was more fun to make.” And then you don’t get paid... It’s this same attitude which leads you to abandon your project at the first sign of trouble. The same attitude which causes you to noodle endlessly on features. To delay marketing; to believe that if you build it, they will come. Or, hell, to ever build it or ship it at all. To seek feedback from your peers instead of your customers… to spend more time catering to venture capitalists than the people who’ll pay for your product. To lavish your energy on “innovating” instead of mastering the basics."
Thucydides and the plague of Athens – what it can teach us now(mar, 2020)
The makeup of SCOTUS is irrelevant in this case, because before they could hear the case Congress would need to pass a law contradicting these state measures, which could then be challenged up to SCOTUS. No matter what, the ball is in Congress's court here.
I am writing tools to analyze my self-tracking log:

https://twitter.com/marekgibney/status/1321545562592841729
Author of the article here.

The format itself is not strictly speaking coupled to JSON: https://github.com/sanity-io/mendoza/blob/master/docs/format.... If you can encode int8 and string more efficiently, then you can save some bytes with a custom binary encoding. However, you always need to be able to represent JSON as well. If a part of the JSON file isn't present in the old version, then you encode that part by the plain JSON.

> and moving the "symbol table" (string data) to the end? … you could also compress redundant symbols into single strings.

Sounds interesting, but in my experience these types of tricks are usually not paying off compared to just sending it through Gzip afterwards.
The Genie Is Out of the Bottle: Welcome to the Big Data Revolution (2014)
In many ways comparing REST and gRPC is apples-to-oranges. You can design a gRPC to work according to REST principles, and it is actually generally encourages to do so

And more to the point, the vast majority of "REST APIs" I've experienced in the wild are just RPC-style APIs that use JSON.
Wow. Pygame was one of my first forays into game development. I'm emotional now.
I have a totally boring "financial engineering"-related dream every time I need to replace a major appliance: I would gladly pay $X/mo for one appliance in perpetuity that I never have to think about it again. Give it a replaceable facade and no one would ever know when it's 10+ years old.

I don't need fancy apps, or screens, I don't want the internet on my fridge... Just give me enough space for my food and keep it the right temperature! Same with the dishwasher, just make it work well and don't build everything out of plastic and I bet it would last a lot longer...
Thats basically the only consideration.

Some future civilization is going to find an American frozen on Mt Everest and think that was our favorite habitat.
Just because science says Denisovans are a subspecies of humans doesn't mean human societies would see it like that.

Women have only been allowed to vote for about 100 years. It's not that long ago that you could go to an advanced country where people could be bought and sold.

We are good at defining the boundary socially, rather than scientifically. Who knows, perhaps we'll also decide that eating animals is wrong sometime. Certainly, there's some hope in that violence has lessened over recent decades.
European Commission Open source software strategy 2020-2023
I see what you did there, but man... that hurts.
I assume you're using that 85 deaths / 100000 annually which is for the worst case scenario of RCP8.5. With the more reasonable RCP4.5, it's only 14/100000, less than road deaths today. Road death rates have already plummeted by a factor of several over the past few decades. So we've already suffered far worse than the effects of 2100 climate change just from the direct danger of cars.

Since we'll probably continue to have improvements in safety, diseases, etc. between now and 2100, the world should be a safer place for humans by then. So it doesn't make sense for people to worry their kids will suffer a bad world due to climate change. They'll most likely enjoy a better world than us despite climate change.

Did you mention preshistoric occupation to suggest that continuous occupation is necessary for a city? That surely helps but if an area has to be vacated, people will obviously go somewhere else, probably another place that was already occupied. Cities renew themselves anyway within the climate change kind of time frame. Buildings usually aren't designed to last more than 50 or 100 years. People obviously don't last longer than that either. So cities of 2100 will likely contain mostly new buildings and people that don't exist today, while today's ones will be gone. They'll effectively be whole new cities. I don't see why that renewal can't coexist with a gradual move inland. Not starting from scratch, just putting new development slightly more on the landward side of the city than before.
I'm not gravely worried about the ads themselves. They definitely bother me, but I'm more worried by "organic" content. It's really the algorithmically curated feeds that I see being harmful. My dad has always been kind of wing-nutty, but it was localized. He was suspicious about things like Ruby Ridge and the Waco Siege when I was a kid. Now he is constantly repeating some garbage meme he encountered on FB. He is completely steeped in disinfo, and actively seeks out more of it by joining basically any FB group named something like "Real Trump Patriot Boat Lovers" and entices him with a meme about locking up the Clintons. If I watch him use it on his iPad, his feed is just torrent of crap, most of it endorsed by his friends and self-selected bubble. That's the harm, he was susceptible to disinfo to begin with, but now with the social proof that all his friends agree, they are escalating to more and more radical shit. At this point they're all saying how they won't stand for another inch of Corona rules and the governor is about to have an uprising on their hands. We don't even have any Corona restrictions in my state, but he's radicalized against them regardless.
SaaS Landing Page Examples: Get Inspired and Discover How to Boost Conversion
Part of the problem was that IFTTT started charging businesses a few years ago to add support. I think they used to charge per trigger, so lots of companies pulled everything but the bare minimum. Now IFTTT is trying to charge consumers instead but it’s likely too late. A cloud-based consumer automation platform is of dubious value in a world filled with smart home platforms and local options like iOS Shortcuts.
Working at a smaller company, I knew a few people in the hiring committee that had unreasonable standards. We used to tease them that they wouldn't pass their own standards when they were hired. Fortunately we didn't need unanimous approval of candidates.
I think GP was talking about the nation as a whole as the leader of the free world, not the current occupant of the White House.
I'm skeptical. These days it's increasingly possible to create models with enough free parameters and complicated math that you can sift through noise with the right filters and get what you were looking for. This is even more troublesome for unimodal phenomena. There has only been a singular multimodal observation that correlates with a GW observation; and that's troubling especially since the number of unimodal observations is increasing, and so the statistics of how often we would expect random signals to correlate (with the three prongs of the detector, and then with a multimodal observation) is getting murkier and harder for third parties to review.

The truly disciplined experiment is to do a double-blinded study: over a timespan record events in secret. Then augment the GW data with 3x fictional events (say, fix the times and magnitudes but randomize azimuth/altitude). Challenge EM observers to correlate with these events, break the seal, and see if multimodal observations pass a simple chi-squared test.
If I was coding my private program to run on a publicly owned & operated supercomputer, I expect I would say please & thank you.
IMHO this contains some absurd hyperbole:

> think TypeScript - but 10x better. That’s how Haskell feels like.

The only way I can see this being true is if you really hate TypeScript with a passion. I can't really imagine any contemporary language feeling 10x better than another.

> Thanks to it’s highly optimized runtime system it can also handle way more requests than a nodejs application.

I'm not here to defend node.js... but this links to a blog post from 2011 with a benchmark which uses a single node.js process on a 4-core server vs Haskell which will use all four cores. That's a cool feature on the Haskell side but it's not comparing like-for-like, since you'd normally spin up a cluster of node.js processes one-per-core in this scenario.

If you multiply the node.js result from this ancient benchmark x4 you find that it's faster than Yesod, the Haskell framework
This is basically the plot of the time machine. One of my favorite books!
Somewhat OT, but is the repeated use of "internalization" in the article instead of "internationalization" a common shortening of the term? I've seen i18n before, but it isn't really in my wheelhouse to know.
Solid document; thanks for sharing.

I'm curious which state's laws apply? That is, how is jurisdiction determined for a computer network event that might start from a laptop in one state, be routed via the Internet through another state—possibly even out of country—and hit an organization's server in a third state?
Cruzeiro x Paraná: confira as prováveis escalações
The simulated contacts are when Waymo investigates what happens after a driver disengages and concludes they would have had a collision, not the actual contacts measured from simulation.

I know, confusing right?