skysight-inc/HackerNews huggingface dataset:
the wiki article is fine. however it too misses some context.

the internet has no flow control - any sender can issue as many packets as their egress link will bear. Since the subsequent links are over-provisioned, if the sum of the input rates exceeds the output rate, some packets may need to be dropped.

good or ill - the solution is to put a controller on the sender that examines the traffic statistics and tries to adapt its sending rate so as not to overflow the network capacity.

since everyone is doing this, we also kind of want to make sure that everyone sharing an output link adapts to something close to a fraction of that bandwidth divided by the total number of TCP flows. this is fairness.

without getting into the highly involved details you can already see that this is a really interesting control/game theory problem.

I find it particularly weird, astounding even, that this situation is really quite ideal for a tragedy of the commons. except there is no tragedy. everyone can cheat, but almost no one does. sure - you'd have to recompile your kernel, but anyone could ship 'network turbocharger 2.0' that forces all the other TCPs on the network to back off and allocate as much intermediate bandwidth as you like.

a very easy way to do this as Netscape discovered is to use multiple connections. the pieces are all the same size, but you can take as many as you like.

obviously that situation degenerates very quickly. but it hasn't. and it leaves the designers of wide area services that don't just use one TCP connection quite at a loss about how much bandwidth they should take.

as far as the survey goes, I can think of all sorts of reasons why the IETF would care. one reason is that uptake of new work is pretty hard - and has killed lots of great protocol work. I'm pretty surprised that BBR has such rapid uptake - the technical situation remains a little unclear.

for me the interesting part is the discussion of the measurement technique
The unicorn stampede is coming
At more than one of my jobs, this has been exactly the right way to horizontally scale relational workloads and has gone very well.
They probably wrote it because Coinbase stood up to BLM activists internally and the NYT is the media arm of BLM. But you get these accusations constantly against companies. "I felt ignored in meetings therefore the firm is sexist and racist". No, that happens to people all the time, including white men. A better explanation is maybe you weren't saying anything worth listening to in meetings, or you feel you were but your manager disagreed.

when most of your black employees leave because of what they feel is racism in the workplace that’s harder to ignore

They weren't ignoring it. Some of these people weren't even saying they felt that way to Coinbase - one of the people who claims she was bullied also claims nobody told her how to make an official complaint and that's why Coinbase have no record of her views. Complaining to HR has to be the easiest task in any modern corporation; if she couldn't figure out how to do even that then we probably found the explanation for why she felt unappreciated: maybe she just sucked. Or maybe she's made up this supposed racism after she left, as part of achieving other ends (like getting in the NYT).
Yeah that looks about right. Brake pad PM2.5 is 3x that of tires but both pale into insignificance next to exhaust PM2.5 at almost 10x that of brake pad and tire emissions added together.

The nice thing about EVs is those exhaust emissions are moved away from the tailpipe in populated areas to power generation facilities.

The efficiency of electric vehicles is almost 3x that of the gasoline cycle of drilling, transporting, distilling, transporting again, combusting then achieving almost 30% motion from the chemical energy of gas.

So because of this efficiency there’s just less emissions overall even though the emissions are away from population centres.

Then lastly, the emissions are consolidated in one place so capture and cleaning becomes viable.

EVs are not perfect but they are so much better than gasoline powered vehicles that if you can at all accomodate the switch, then it would be great to consider it.
The risk is, when will they disable those commands?
It is not necessary. Confidence issues are unrelated to actual success.

Confidence makes big difference in initial willingness to try something new and in ability to persist after failure. People with low confidence don't try harder things and give up after failures.

And in many areas, confidence brings success. Even in tech people judge you on confidence a lot, and other professions are even more subjective.
"In no world can you be working 5 hours a day and be giving a shit, and so the conclusion is that very little meaningful work gets done at Google. Maybe a bit of a hyperbole, but not far from the truth."

This is just silly. 5 hours of intensely focused, silent, eyes-glued-to-monitor-and-keyboard work beats the conventional 8 hours of work involving socializing/chatting with coworkers over the cubicle, making phone calls, checking in on people, walking around an office, taking breaks, etc., which itself seems to lead to approximately the same 5 hours of actual work... just with much less intense focus (intense focus which is mentally draining).

To quantify work output merely by time fails to appreciate the much more important factor involved in work: efficiency.

Working 5 hours, intensely, is draining. This author is silly for failing to realize that there's a reason Google engineers are allowed to work 11am-4pm: because they're competent, efficient, responsible, and probably don't waste much time (otherwise I don't see how they'd be employed there-- one of the most sought after & selective employers in the world)
My fire alarm goes off when I make toast. How can this happen?
Legalist (YC S16) Is Hiring a Chief of Staff
While I can agree, I don't think it really matters to end users.

I'm waiting on Unity to run natively on the M1. If it can magically beat my desktop PC ( working on an HDPR project now), I'm sold.
That was the thing with XP and refactoring and a handful of other techniques. It was a form of unionizing. Solidarity goes a long way toward changing norms. If I can’t just ask another developer until I get the answer I want, then it’s either fire everyone or accept that This is How We Do Things.
Wage share (labor share is the part of national income) have been decreasing in all OECD countries since 70s.

It's related to capital deepening and capital intensity. Capital as a factor of production is increasing and labour decreasing.

If you have both declining wage share and increasing inequality, it's good assumption to make that this is happening everywhere.
I've seen starbucks branches that are dirty. I don't think I have been a dirty independent coffeeshop.
I don't know about laptops specifically, but macOS's global market share is around 9%. M1 is exciting, but it's hardly going to dominate the market.
You can also build the kernel yourself. It's fun.
Analysing Glassdoor Reviews of the major tech firms
Millions of people don’t vote for exactly that reason.
Yappi a Python profiler aware of multiple threads, coroutines and greenlets
In what specific ways have they become heavy handed? And how, specifically, does that affect you day-to-day?
It’s the only entity with that power, in both directions.
Web & App Activity
Saves your activity on Google sites and apps, including associated info like location, to give you faster searches, better recommendations, and more personalized experiences in Maps, Search, and other Google services. https://support.google.com/websearch/answer/54068
I used to live near the flight path of crows retreating by dusk. For years, in warmer months, hundreds would gather daily at sunset at the local kiddie pool / nature park and have communal bath parties and squawk in the huge trees until the sun set, then fly off again.
Actually, the author seems to be a grad student in the field.

From downloading the PDF and skimming the raw bytes, I see:

<pdf:Producer>Microsoft® PowerPoint® 2016</pdf:Producer></rdf:Description>

That said, it's always impressive to see a non-professional spend this much attention to detail.
The share matters less than who specifically make up that share.
There’s also nothing in the constitution about murder, but it’s still illegal. Your rights end where they harm someone else. And killing someone is a valid reason to restrict your rights. Vaccines are a good example of this.
TCP congestion control is the algorithms that determine when to delay TCP packets and by how much, in the interest of getting maximum speed but not overloading routers and links. This is crucial to the survival of the Internet and to end-user experience, because without congestion control, everybody would send at their maximum rate all the time (subject only to the receiver's stated TCP receive window, which can be huge these days), and the Internet would collapse. Imagine sitting on a 2G connection in rural Africa, and the server at the other end blasts packets at 100 Gbit/sec on you. On the converse, imagine sitting at a 100 Gbit/sec connection, but the sender being overconservative and sending only at modem speeds...

Basically, this is a really hard problem, since you can measure bandwidth only indirectly (and with much delay), and the changes you do will affect the measurements. Solutions exist in the form of reacting to packet loss (ACKs don't come back, or selective ACKs come back to explicitly tell you something was missing), to ECN (routers along the path setting bits in your header to explicitly tell you it's getting tight on bandwidth) and to changes in delay (as measured by ACK timing and embedded TCP timestamps; higher delay typically means you're building up a queue somewhere, which is bad). They also differ in what rate they start at (initial window), how aggressive and how they increase the rate when things appear to go well (exponential, linear, binary search), and how they decrease the rate when they get negative signals (cut in half, other tactics). An important factor is “fairness”, usually to TCP Reno (a classic congestion algorithm from the 80s); if you and another sender send at the same time down the same path and they use some other congestion control algorithm, you should get about half of the bandwidth each. (An algorithm that's too aggressive could easily cause the other side to lose packets and just keep decreasing its bandwidth estimate, crowding it off the link entirely.)

A perfect congestion algorithm would immediately detect the correct amount of bandwidth (even in the presence of changing conditions and non-congestion-related packet loss such as a bad cable or Wi-Fi errors), send evenly at that rate, never send so much that packets are lost to congestion, never send so much that routers' queues build up and latency increases (bufferbloat) and be perfectly fair to all other algorithms.

As for census; it's interesting to know what exists out there, what people are doing in practice, and what algorithms we need to compete against and be fair to.
there is no guarantee other ARM manufacturers will even approach what Apple has done and this is evident in how other ARM implementations work versus the A series chips.

Apple has the ultimate advantage of writing the OS and the chip and that level of integration is obviously not being met by anyone else in the industry.

I am not dismissing the possibility of an ARM desktop that is better performing than a similarly priced CISC system but I do doubt the level of difference Apple was able to achieve
Ask your government and/or banking institutions about that.
The process for new grads and interns is different from industry hires and is decided by team.
> the refactor improves abstraction quality

The quality of abstractions is entirely subjective.

> coupling is diminished / cohesion is improved

This is also entirely subjective. The idea that eliminating coupling is inherently good is an unsound premise. There’s no proof that coupling is bad, and even if there were, there’s also the conversation to be had about which things should be coupled, which is surely a subjective conversation.

> design improvements resulting in edge cases being obviated

I guess this one is slightly closer to being an objective good. Though even still, I think this is linear thinking at its finest. You may be getting rid of some edge cases but introducing others. Every design is a trade off, and evaluating tradeoffs is a subjective act.
Yeah, which one of them has their CIA and FBI with many and many documented kills? Next thing you'll tell me corporations are basically comparable to the Communist party of China?
Editing should be allowed for an hour or so in order to fix spelling mistakes, reformat text for easier flow, or even as a recovery after pressing "post" by accident. But long-term deleting and editing will hurt the content. This, for example, is visible on reddit where older threads sometimes have these big piles of deleted comments. Instead maybe I would try something new:

1) Ability to post anonymous comments
2) Instead of deleting a comment a user can choose to make it anonymous so that it is no longer associated with his/her account
I think that's the main reason I try to limit my shopping on Amazon.
Shopping on Amazon means limited circular economy because all the large profit centers are concentrated on few large metropolis ( probably must of then in the US ) and by large shareholders. Lower amount of tax is collected from that purchase that in a local shop because of fiscal optimization.

Overall at the scale of the city it seems to me ( I don't have any numbers for that ) that consuming on Amazon is not a great deal long term.
From a quick look, Synology seems to be a proprietary [EDIT: not SaaS, just software]? I'll stick with Nextcloud, with which I am ethically aligned, thanks. [EDIT: point still applies. I'd prefer to use software that shares my values.]
Very interesting article that cuts to the core of many of the issues with pricing insurance products. While the phrase is hardly limited to the actuarial world, "all models are wrong, but some are useful" is definitely an extension of this.

The fluid nature of probability is the center of the insurance universe. Probability is always a moving target in the insurance world. Indeed, if it weren't, there wouldn't be much of a need for actuaries. Much of actuarial training revolves around the idea of credibility -- how credible is your sample set, what alterations should you make to old data to make it relevant to today, and what data should you add to it as a complement in order to relieve the model of the biases inherent in your sample size. This is inherently Bayesian in it's approach.

Where it truly gets interesting is that insurance companies are very cognizant of tail risk -- the 1-in-100, 1-in-250, 1-in-500 events that can cause insurer insolvency if not properly accounted for. You can survive a miscalculated loss trend within reasonable bounds, but if you haven't thought about the potential Cat 5 hurricane that hits Miami-Dade then you are going to have some very unhappy investors. When it comes to these types of events, you mostly need to be in the right ballpark. The order of magnitude matters more than the exact number -- albeit the exact number matters quite a bit for regulatory reasons. This type of calculation for property lines has largely been outsourced to the stochastic models developed by companies such as AIR and RMS. A sudden change in their models, which I think is likely after this record breaking hurricane season, can inflict capital pressure on the industry almost instantly.[1]

There are some actuarial papers from around 50 years ago that discuss information entropy as another way to approach the issue of constructing probability models, but they never really caught on. It seems that is likely due to the lack of widespread computing power. I'm hoping these ideas can gain some steam now that we can construct some of these distributions from Python and R.

[1] There is a fantastic article by Michael Lewis that describes this issue at great detail: https://www.nytimes.com/2007/08/26/magazine/26neworleans-t.h...
Apple’s share of the desktop and laptop market is minuscule. Competition already exists. Now, it may be that your use case is niche. But niche use cases don’t get mainstream support, and never have.
> everyone can cheat, but almost no one does

Try running a site with big files for downloads. Every week or so, you'll be visited by someone who runs 200+ simultaneous connections for the same file, keeps opening more, and ignores HTTP errors (like “too busy”).

There are also the “IW wars”, where CDNs compete by increasing their initial window more and more to gain an edge. This will be exponentially worse with QUIC, when tuning these knobs becomes more accessible to non-experts.
Hi Peter, thanks a lot for doing this. I know I'm a little late but posting my question in case you see it: I am an Indian citizen (currently residing in India) and my potential co-founder is on H1B in the US. We want to start a startup in the US (because that's where our market is). What are the best visa options for me and him?
Cloud 2030: Moving from transforming IT to transforming every business
SpaceX Is About to Launch Its Prototype Mars Rocket on Its Most Ambitious Flight
haha you got exactly what I was driving at. Wehn you're driving anyone passing you is a reckless maniac, and anyone slower than you is an idiot. When you're programming any convenience a language/standard library has more than your favorite is just Fisher Price childish handholding, and any missing feature is senseless busywork that should be built into the library.

And when it comes to OSes the word of choice is Bloated it would seem.
In what ways have they made the experince worse?

Why do you not trust their upgrades?

How are their hardware choices fragile? Do you mean build quality or do you think their ability to build their own chips will fail them and their chips for all the ipads and iphones haven't cut it?

How are you not locked into the hardware choices of any laptop maker? Are there realistic, upgradable laptops out there? or are you switching to a desktop system?
Plastic (the noun) isn't plastic (the adjective)

Pure 'plastic' polymer- be it nylon, polyethylene terephthalate, Acrylonitrile Butadiene, pvc- anything! Is generally a brittle, almost powdery material, that is of no use to anyone. I'd say they range in texture from something like .

What we think of as 'plastic' - what we experience and use as a product or a material, is a cocktail of polymer, 'plasticizers', chain extenders, cross linkers, and other chemicals.

Trying to come up with an analogy, I'd almost say polymers:flour::plastic::cake
Add in that no one can build an ecommerce website without strong web services its almost impossible for another ecommerce company to come in compete with them. Amazon is a monopoly.
Crispr- A Crack in the Creation book reading notes
Not that I know of. The lids have been so cheap that no one cared.
> We have played this argument out

I didn't get the memo.

> I'd love to get over beating this dead horse, here and all over the tech industry

Among the people I know closely enough, I see almost no one who has changed their minds ever since these discussions started circa 2015. And I have been in the tech industry for a long time. So keep beating that dead horse, or beat it in a different way.

> Not to mention that no one is getting "cancelled" here.

Some people are trying very hard. NYT article seems like a smear campaign as part of that overall effort.

> cancel culture doesn't exist as you describe even.

In my experience, it does. I personally know many other people for whom it does. Maybe your bubble is very thick? Maybe people are not honest and open with you because you are highly opinionated and based on this comment, not open to an open dialog?

> I'm simply tired of this.

If you keep communicating the same way as in this comment, you will keep getting tired. I don't think cancel culture, SJWs or suppression of uncomfortable viewpoints are going to stop anytime soon, nor the secret revulsion of these trends.
Most americans still carry cell phones with them so they can't object that much. Just stop carrying the tracking bracelet everywhere. Or at least take the battery out when not in use. It may sound infeasible but it really isn't.
This tech will surely be used in a lot of video meetings
Considering that Apple's closed ecosystem is like living on the Globex Corporation campus, and everybody else's is... well, like post-monorail North Haverbrook, can you fault Apple for wanting to maintain the control that keeps the UX quality so high?
Ask HN: Anyone else feeling more fatigue lately? Thoughts on fuzzy Covid states
So every since May I felt like I have been experiencing more fatigue lately.

I have taken the RT-PCR test last week and got back a negative result.

Still, I might have caught the virus at one point (and hopefully defeated it). What is baffling is that in the recent months I felt more tired in general and needed more sleep.

Anyone else feeling more fatigue lately?

Is it possible that 99% of the human population currently have the virus inside thier bodies (though most have it in a small quantity and only the considerably severe ones get detected in tests like RT-PCR)?

How fuzzy is state of covid-19 infection?

Anyone knows any good papers and studies to read up on that? And in general what are some good places (on-going research, virology textbooks/online courses, etc) to start learning about the fuzziness of viral infections?

Can it be that defecting the virus in the human body is like trying to solve a computational problem, and due to mutation everyone has a slightly different variance of the virus so our bodies are all trying to compute solutions to a particular set of the variances (where "solutions" correspond to antibody production, etc)? And when the virus exists in considerably small quantity it is fine (we probably don't feel anything but we may still infect one another with our own covid variances e.g. through saliva), and as the quantity of the virus accumulates, our immune system kicks in and try to compute the solutions (and that's when we feel fatigue though it's still too small of a quantity to be detected)?

And perhaps this is why masks work? (so we are really just trying to reduce the combinatoric richness of covid-19 variances inside each of us by reducing the transmission rate)

What are some existing theoretical ground on this? And where can I learn more?

Thanks!
Seems to me that the root problem could also be fixed by not using presumably blocking application threads talking to each of the other servers. Any async or poll mechanism wouldn't require N^2 threads across the pool.
Yep. Having each front end needing to scale with the overall size of the front end sounds is obviously going to hit some scaling limit. It's not clear to me from the summary why they are doing that. If it's for the shard-map or cache? Maybe if the front end is stateful that's a way to do stickiness? Seems we can only guess.
Awesome guide :). I've been meaning to learn the basics of LISP since trying out Emacs and this was finally an easy enough introduction to it that I've read a fair amount. Thanks for this!
I just recently flashed a Gotek with this firmware to resurrect an Amiga A500 with a broken floppy drive. It works great with the addition of an OLED screen and a 3D printed bracket to mount it in the Amiga's internal floppy slot.

I'm also eagerly awaiting the support for Heathkit *.H8D format images so that I can more easily use my H89 without needing unobtainable hard-sector floppy disks.
How do you know that one name is better than the other? I see renames all the time where I preferred the original version.
Even low end android phones take selfie video of way better quality than any built in laptop Web cam I've had experience with. Also unless you spend 200eu for the top end cams you won't get near that quality. At 200eu you can actually get a pretty decent mobile phone like oneplus nord which also has a decebt camera.