skysight-inc/HackerNews huggingface dataset:
I think you will enjoy Efron & Hastie's Computer Age Statistical Inference: Algorithms, Evidence and Data Science.

https://web.stanford.edu/~hastie/CASI/

MIT 6.008 Introduction to Inference also goes over many of the classic problems such as Cookie Jar, Monte Hall, Fair Dice, One-Armed Bandits, etc. with tons of labs.

I find this stuff easier to grok by just writing code and running a simulation. To that end, I'd setup an Anacondas environment and start experimenting with PyMC3. As your intuition suggests, there's no downside to mastery of probabilistic programming. Best of luck!

https://docs.pymc.io/
Am I allowed to plug my own site? The old web is still around - you just need to dig through more new web to find it. I run my site through a few Gulp tasks to minimize files and provide security-integrity checks for my CSS - but otherwise it is all hand written HTML. Every page begins with copy/pasting another page and changing out the content by hand.

I've noticed in the last few years the articles about the "early 90's/00's" web has increased. A desire for the older, more personal, mostly text and some cheesy few-framed animated .gif web. A web that felt more person to person instead of corporation to corporation or plastic Barbie doll to plastic Ken doll full with fake personas.

This is why I support Neocities [0] and host my site with them. You can find all sort of interesting sites if you browse [1] a while. My personal favorite is browsing all the layers of [2].

[0] https://neocities.org/

[1] https://neocities.org/browse

[2] [Warning: Auto-playing Music] https://mebious.neocities.org/Layer/Wierd.html
I suppose - and this applies generally, not just to programming - people (myself included) don't exactly like market's idea of "perfect". Because free-market perfect isn't just nice-sounding "solution that does the job for the lowest cost over time" - it's the borderline cheapest, ugliest, worst solution that's only barely fit for its purpose, and if it was any worse, it would be unsellable. It's aiming for the absolute lower bound - as any possible way to make it cheaper is taken.

The problems with market!perfection are many - mostly resolving around short-term optimization, externalities and lack of alignment between market values and human values. But we have brains that can be used to get better outcome than what the market incentivizes by default.
Post Office owes $3.5M for using wrong Statue of Liberty on a stamp
It can't. Even SVN at some point has some sort of data structure that can be modified by an admin.

Data is not permanent unless it's somehow written into the permanent fabric of space/time, and if you think about it long enough, deleting an svn or a git repo is just another way of changing history.
The myth of the link between rising wages and inflation is very common in the media, but there is hardly any connection in reality.

Wages will naturally adjust to the equilibrium supply and demand. If the needed increase in wages to increase production pushes prices up such that supply falls then production will be cut to adjust. That is what actual economic theory says.

In the real world their is a lot of lag, so some market participants will be increasing wages and producing too much, and then they lose money, and have to overcut on the other side, but in a massive diverse economy this random noise balances out.

The market will never over price labor, therefore inflation cannot come from increasing wages.

Inflation comes from printing money (or creating it digitally since we don't actually print any more). When the inflation from printing money results in rising wages, then that is a sign to the bankers that they should cut back so that they can keep the poor in line, and keep them from paying off their loans so that they can't get out of debt.

Real world economics.
Cloudflare analysis divides size difference by time difference. That function is commutative and cannot be used for meaningful comparisons. This leads to faulty numbers and faulty analysis.
I’m doing this, and I’ve been working on it full time since February. I don’t want to spam HN so I won’t copy / paste the link again, but I’ve posted it on this thread once, take a look if you’re interested.
Interestingly, something of a reverse effect is happening in the game development space. I think the driver of the above pattern is mainly economic; as a technology becomes more and more commercialized, it gets less personal and more streamlined. This is aided by the technology itself improving to allow it to be more efficient. With games, though, the barrier to entry was always (since the 90s, at least) so high that only corporations could participate. So in recent years, the technological strides that have been made have actually allowed the space to become less commercialized, and therefore more personal and diversified.
I have no clue what you are on about.
It looks like law enforcement was definitely one of their let's say top 3 target markets when they built Rekognition, though.

Do know what gives it away? The fact that Amazon is actively pursuing that market and isn't just "allowing anyone to use it freely and equally".

No, they're going to law enforcement and showing them Powerpoint presentations, demos, and everything.
Science Has Outgrown the Human Mind and Its Limited Capacities
Sorry sir, we can’t let you through customs until you Accept the U.S. Terms of Service and Privacy Policy.
In a few years.

An "SUV" is a luxury good anyway and many of them are absurdly priced (imagine what that'd get you in a real car!).
Developer Tea eh? I'll check that out.
"more jobs than people" can still be true, even if you don't find your preferred job.
Against the Gods by Peter L Bernstein, Chaos by James Gleick, and The (Mis)Behaviour of Markets by Benoit B Mandelbrot and Richard L Hudson.
Repealing prop 13 is never going to happen for a variety of reasons, so it would probably be better to focus on areas where progress can be made. Also SF does not equal the Bay Area. I almost never consider policies from the standpoint of SF alone as it is a relatively small yet intense part of the overall region. Many issues experienced by SF residents are very different from those experienced by the rest of the Bay Area. Granted, there is certainly overlap and some things we see in SF now will be coming to other cities in the future but you have to be careful not to fall into the 'SF as the center of the universe' trap (especially on HN).
Zstd compresses 5% less densely. Zstd compresses slower to a given density. Decoding zstd may use 128 mb of ram whereas Brotli may use up to 16 mb.
That's not recycling. That's decommissioning and reselling good hardware.
> It could just be that nobody cares about sysvinit anymore, so fewer bug reports happen.

Waving your hands and suggesting everything is going to have bugs isn't much of an argument. It's unlikely that sysvinit would suffer from any of these bugs as there's simply a much smaller vector of attack than systemd by design. You could knock me over with a feather if arbitrary network traffic could compromise your system via sysvinit. The other class of bugs are ones where sysvinit is the defined behavior and systemd is simply deviating in unexpected, unintuitive, and undocumented ways.
> but first make sure a top priority is program correctness

That's the thing, this doesn't happen in real world and it is questionable if the concept of correctness is useful at all. As it is based on unvalidated and incomplete assumptions about the world, never fully correct themselves. Sort of correctness of incorrectness.
Always look for third party benchmarking. High quality benchmarks can be found at lz turbo or from encode.ru
All of Statistics by Larry Wasserman is the book I recommend for anyone who knows calculus and linear algebra and wants to learn statistics.
I disagree with wealth taxation -- wealth can be tied up in illiquid assets (longtime family home, grandma's jewels, etc.) and even more importantly, a tax on wealth kind of makes it like you don't really own property, you are just leasing property rights from the government. Not a hallmark of a free society in my opinion (land taxes are questionable for the same reason), whereas a tax on economic activity made possible by a government that enforces a market structure / the rule of law seems far more amenable.

However, I will add that I could maybe get behind minor wealth adjustments for income taxation, if the incentives could be figured out. For example, a lower bracket person / new college grad with no wealth who had a really good year financially by consulting or something might pay a slightly lower amount than a longtime VP who has accumulated significant wealth, but had the same income for the year. This encourages people to spend, not save, though, and it still is indirectly taxing property rights. Perhaps a better way would be to adjust based on the moving average of previous incomes.
He's opposed to Amazon in no small part because Jeff Bezos owns the Washington Post, which publishes stuff like

https://www.washingtonpost.com/news/fact-checker/wp/2018/06/...

A lot of his and his daughter's clothes and other stuff is manufactured abroad - he doesn't really have a problem with that.

http://thehill.com/homenews/campaign/395557-chinese-factory-...
It is, and it's a claim that I didn't make. But even if it were true, I think people won't believe that it's true, because there will be instances where they won't understand the borrow checker's reasoning.
That’s a little dramatic, don’t you think?

With the exception of public figures, they aren’t sharing facial recognition datasets. This is a service that a moderately skilled team could implement with off the shelf and free software or an individual could do with a raspberry pi.

Law enforcement has been doing this for a long time in many areas. If there’s an ethical issue here, it’s with machine learning and camera surveillance in general, not Amazon.
Because history and biography are never fake or manipulative?
Despite the guideline-flouting/flame-attracting wording, I think there's a kernel of a point here: it's important to consider two seperate pay-gap issues (be it for gender, race, or any other class):

1) equal pay for equal work

2) equal represenatation among (higher paying) jobs

I routinely see these two issues conflated, and occasionally the purported resolution of #1 for gender being trotted as evidence of no more "gap".

Although I can see how that could be characterized as "cherry-picking" a statistic, it doesn't make the statistic any less valid, and it detracts from the real problem of conflation. If it's true, then additional effort at #1 would, indeed, be wasted. It would be better to criticize the notion of just one "gap" rather than any cherry-picking.

How does this relate to the topic at hand? The original commentor suggested a problem of conflation, between "unemployed" and "jobless".

Elsewhere in the thread, it's been discussed whether workforce participation is a more meaningful metric.

Even that risks conflating "employed" with "fully employed" (as opposed to "underemployed", such as part time or working for a lower wage). Real wage growth comes up repeatedly, presumably because of that confounding factor.
I added support for loading plugins to the pass manager because I could. It was never really useful. I had a vision for rustdoc_ng, which was that it would do all the dirty work of collecting information from the (complex) Rust AST into a (simpler) "doc tree" describing just details relevant for documentation, and backends would add their own plugin passes as needed to massage that AST before final output of the JSON doctree, while the original analyzed Rust AST was still around. I think I'm probably the only person that ever used this, in an experimental troff backend.

I was in a rush to get it out the door before I went off to start college, and I guess I never removed my testing path from the code. Oops!

It was fun getting the email this morning and reminiscing ;)
Fiske’s Reading Machine Was a Pre-Silicon Kindle
One reason might be that browser manufacturers are not keen to have a decompression that might allocate 128 mb per connection.
I've been physically threatened because of stuff I wrote online, have had a stalker for a couple of years and other pleasantness. Even so, for me that's worth the risk, I can see how for someone more vulnerable that sort of risk would be totally unacceptable.

You only need to look at the kind of stuff the griefers on various other websites get up to to see the extent of the menu of real-world consequences. Those things are not jokes.

So I totally see your 'real consequences' argument, and it goes way beyond just your employment, in some cases it is your life that is in the balance.

But there will always be idiots. Just like there are people using drugs and then driving vehicles I have to share the road with them. But that won't change my attitude towards driving, and neither will the existence of assholes diminish my activities online. But I totally sympathize with those people for whom lines have been crossed that cause them to censor themselves or even to tune out completely. And I'm sure I too have such lines (in fact, I can easily think of several) and if those were crossed I too would bow out.
The way I see it, telling a "harmless" or "justified" lie can destroy trust, which can have substantial or even devastating consequences. Often one faces several choices, all of which may hurt people, and moral rules are a heuristic method by which people avoid the harmful effects of cognitive biases due to self-interest or logical errors.

None of this should suggest I think it's obviously wrong to lie to a stranger about whether you're deaf in order to avoid a conversation - that might be permissible according to generally accepted social rules. My point is more that when you start talking about deciding for yourself when to obey moral rules, you are on shaky ground, no matter how wise or logical you are.
Why not? Because provably correct software is not necessarily correct software. One of the biggest classes of defects in programs is missing details in specifications, and provable correctness against the wrong specification doesn't help with that problem at all.

Provable correctness is one technique in software development, it's not the only technique nor even the most important technique nor even a required technique.
You forgot “(and beer)”. Who’s your team?

I had a look at Svelte in the early days but went with something more mature for the project at the time. I actually recently landed on Sapper while looking around tab Web Component projects and it looks good, though I haven’t had a chance to try it out yet.

edit: also, read a lot of comments about "why the military tagline". It's a play on the name Sapper. An old buddy of mine is one up in the CAF in Edmonton. They're combat engineers— hence the military tag.
> upgrading distributed databases live is always going to be quite non-trivial.

I understand that the implementation of live upgrades for a distributed database will be complex but this post is about the user experience. Given enough resources, is there a reason that it can't be a single "upgrade now" command? Or maybe slightly more real-world, a 3 step process like: "stage update" -> "test update" -> "start update".
Using search_path and views to hide columns for reporting with Postgres
Sounds funny, but this could actually happen. By entering the country you agree to give up your EU rights, or turn around and get back on the plane.
What? Tesla is pumping out electric cars in lots and are only expanding production with the Model 3.

The Bolt has been selling at between 1.5 and 1k per month while the production of the supply-limited model 3 is approaching 5k per week.

I guess I'm crazy and got pulled into the Musk hype.

> Tesla will not be able to deliver the cheap model 3 and GM has been doing it.

I'm guessing they will. Right now though, you have a point there, the model 3 is more expensive than the Bolt.
>just spin up your NN on any of the cloud platforms available

"just"...

Amazon marketed it to police explicitly, I'm pretty sure the open source team working on TensorFlow isn't going around suggesting you plop a model on Linode and use it to catch criminals. This isn't something that police departments have the ability or skill to discover and implement on their own, setting the menial bits up for them and suggesting a solution is half the battle with government stuff like this.
> The problems with market!perfection are many - mostly resolving around short-term optimization, externalities

Almost all bugs, security of otherwise, are just negative externalities. I think the public has been conditioned to accept that software not only comes with bugs, but many of them, and there's nothing that can be done about it. Companies/developers/publishers are not penalized much at all for buggy software, so much so that it's a common business tactic to deliver crappy software that doesn't even accomplish what it states it does, much less bug free and without security problems, with the understanding that it can be fixed up after delivery with little negative consequences.
Yes, absolutely. I'm a big TypeScript fan and this is high up my own priority list, not to mention one of the most common requests
It is great that he is volunteering to help, but him publicly presenting himself as a savior prior to actually accomplishing the solutions makes me just roll my eyes and think less of him for doing anything for the limelight. Sure if he does go out and solves the problem, then afterwards is the proper time to put out a press release and brag.

I'm still waiting for him to work out the kinks with his cars' autopilot and get his promised "hyperloop" that he loves talking about finally deployed.
Yes, the requisite degree these days is a "PharmD"
A special case of Goodhart's Law, as applied to public policy.
As an Indian-American US Citizen, is there anything I can do to contribute to reducing the green card wait times for Indian immigrants (e.g. prioritize Indian immigrants when choosing a spouse), or is it zero-sum due to per-country limits?
Making sweeping assertions without any proof (such as U.S. race relations have deteriorated) does sounds like pretty stupid behavior.
As hobby I'm building a relational language, and think the problem that the RDBMS folks have overlooked is how operate in partail relations (like slices or tables with less + more fields). You are set with the initial schema and that is. Is not easy to store arbitrary portions of relations, not is even easy to operate in-memory instead.

Plus, the fact the DB is far from the code miss a lot of oportunities.

In my mind, I think the solution is not to have a "database language + storage far away" but code all the app with a embebed db.

Is not as weird as it sound. This is how we operate with foxpro.
Are the employees willing to be retrained?

https://www.reuters.com/article/us-trump-effect-coal-retrain...
“Cheating Death in Damascus” Solution to the Fermi Paradox
People don't even think consistently, so correctness is an ever-moving target (aka a negotiation).
you're much too kind, thank you! Yes, I intend to publish a series of interactive blog posts over the next few weeks covering the material in the talk
I'd also like to plug this project: https://mavo.io/

Its goal is to bring back the idea of hacking together HTML pages by hand, but with the benefits of modern dynamic content. It's cool and inspiring.
Top 5 my own security audit fails
Ok, but in the meantime you’re still unemployed, stressed about health insurance and debts and feeding your family, and you get to explain to every potential employer why you were fired.
Ask HN: How wants to exchange skills?
I remember there was a thread on this sometime ago and it garnered many interests. Are you looking to offer your skill/expertise in return for guidance on some other skill? Please list your requirement here.

I am looking for help on CSS. I have read many books on it and many online courses but I could use an expert guidance when using it in real projects. I can offer you help on building web/mobile backends, REST APIs and implementation (Java/Python) and system scaling
> And then, five years after you've left the company and some system inevitably collapses with nobody having a clue as to what went wrong you'd finally realize the wisdom of all that.
But it's no longer your problem.

If that were a problem in reality, the markets would be punishing companies where that happens. It's not a real problem that that happens. Management pretends to be upset, but in reality it's not a huge deal. Entropy is normal in apps and everything else. To continue the analogy from my original comment, do companies really go into crisis mode when one of the many cars in their fleet inevitably "collapses"? No. They build or buy a new one and life goes on.

> nor does your real time medical device controller, ECU, database system or operating system.

Yep. Those are the rare cases I talked about. It's a tiny fraction of total programmers building databases and stuff like that.
I think a lower level, type safe, actor based framework is the idea behind the Pony language, which I've been meaning to check out.
The "so what" of it is that more jobs than people looking for jobs is a good thing, in the general sense.

As for mismatches, what is your solution?
For me, rewriting history is a feature of Git, and not a bug. I used to use Mercurial, which prioritized immutability of history, and I found that I was too frightened of some of the more advanced features with not-obvious side effects to bother messing around with them, because if I messed up, there was often no easy way for me to revert my repository back to the way it was. Immutability of the central repository is a reasonable thing to want, but let me blow up my own local clone if I want to.

What's more, I find that phk's tone and the blog's tone are at odds with each other. The blog seems to have the attitude of "Git sucks and this is why", while phk's e-mail is far more interesting, instead arguing that Git fits into another class of software entirely and saying "It's not for us, but that's okay, and oh by the way we should probably accommodate those who prefer git".
We chose max as default because Brotli actually compresses more at max setting. Gzip does not compress much more at max than it does at faster middle qualities, so they chose a default from middle qualities.
What's so important about progressing version numbers for commits?
I've long wanted to setup a system like this.

Cameras facing all entrances and exits of the state capitol would be fed into ALPR and facial recognition software. There are enough photos of elected officials to train facial recognition. It would be easy to identify who is coming and going, what cars they own, who they travel with, and their patterns.
Turn on "showdead". I'm not able to respond directly to that response to your comment, so I responded to your comment instead. The question is a bit moot anyway. 'firemancoder is hellbanned for some reason. It just seemed that this particular comment of his was especially true. b^)