jkeisling/hacker-news-corpus-2007-2022 huggingface dataset:
I think you could actually implement this with nginx + <insert evented/actor server (tornado, rainbows, mochiweb, yaws etc.) here> + your application quite easily. Nginx buffers the client's request (you cannot turn this off) before passing it to the backend but you can turn proxy_buffering off which stops nginx from buffering the response to the client. In this middle tier you could instantly send the headers + loading JS and flush the buffer then determine the pagelets to render and either do it in process or further delegate to application servers with HTTP or your own protocol.

This does kind of beg the question, why use nginx at all? It provides you with a lot of protection against malformed requests and general fuckery. If you need it you can push the middle layer back into nginx as a module which would be screaming fast.

This reminds me of Heroku who do something like this with their 'routing mesh.' client -> nginx -> routing mesh (erlang) -> thin (ruby app server). The erlang process knows which ec2 instance has the ruby process to serve the request and initiates and is basically a smart proxy. You could quite easily query 6 backends simultaneously for each pagelet and pipe the JSON out to the client then throw in the footer as well.

I think this deserves some experimentation.

nginx + erlang + rails (serving JSON).
really!

iPad + home screen wallpaper that says, "Don't Panic" = HHGG
In Facebook's case, I think they are already serving completely different content to logged-in users and non-logged-in users/crawlers; most of the complexity of Facebook is invisible to crawlers anyway.
It's actually webserver-neutral, implemented entirely in PHP and Javascript. The basic idea is that each "pagelet" does its own data fetching and rendering and returns a thunk of HTML, js & css dependencies, onload hooks, etc, as a data structure (JSON or what have you). As each pagelet completes it is flushed down the single network connection to the client using HTTP chunked encoding.

The Javascript half of BigPipe catches those flushes, handles the dependencies, registers handlers, and slaps the HTML into place. This lays the groundwork for many things like incremental page updates, parallel execution, and so on.
function doTree(node, fn) {
fn(node.value);
for (var i = 0; i < node.children.length; ++i) {
doTree(node.children[i], fn);
}
}

var sum = 0;
doTree(numTree, function(value) { sum += value; });
I feel your concern, I've always struggled with phone conversations (none of the visual clues of face-to-face but without the buffer email gives). Anyway I would advise...

Just stay firm (as opposed to demand). If he asks for delay then maybe offer something you can cope with but isn't as vague as "next month". 7 days, 14 days - something like that. Offer a specific date it will be paid by. Don't be pushed back though; invent some reason why you need the money (i.e. rent payment etc.) if needed.

Then when you hang up send him a confirmation email with that date in it.

At the end of the day as a contractor his sob stories are not really your problem. On the other hand your financial difficulties are. A little "me first" attitude is appropriate in these situations (stops you being fobbed off).

EDIT: this is a good learning experience btw. It's not just for contractors but all sorts of companies will delay or "forget" to pay you. Where I work the woman who does all the admin spends a good 20% of her time chasing invoices (it has made me resolve to settle every bill I get as soon as I can from now on!)
What you're looking at actually is potential. It's like we have to flush all this nonsensical, vile shit out of our unconscious to detox it for big creativity. Or like you can't have the crest of a wave without a trough.

I see the stuff you described and I'm always so thankful that humanity finally has public, anonymous dumping grounds for the worst of our id. It's therapeutic and, I think, healthy.
There's almost such a thing right now. In the node Socket.IO package there is a 'computer' example where you and random internet strangers can control an XP machine: http://socket.io/demos/computer/
> It is the body shutting itself down, putting itself out of the way after it has done its job, finished reproduction.

Males' reproductive abilities continue into much later life. Wouldn't this theory then suggest that males would live longer? The opposite is in fact the case.
Ah fair enough. I'm more of lurker as I mainly read HN on my phone which doesn't have an interface for commenting.
> Then how why would they be the "top" 0.1%? If everyone is equal, there is no "top".

Start from:

If all were almost equal the top 0.1% would be doing more or less as well as everyone else.

Then take the limit for almost -> exactly
Thank you for sharing! If folks are interested in the code that powers the bot (it uses OpenCV to find the label, then draws frames and animates with ffmpeg) it's available here: https://github.com/thisisparker/78_sampler
Commu-terrorists? It sounds like they're members of an Abelian terrorist group
This reminds me of a philosophical question from Tom and Ray Magliozzi:

"Do two people who don't know what they're talking about know more or less than one persion who doesn't know what they're talking about?"
There is not yet, no. I'd imagine there will be one next year.
Yes, and more than a couple of people have observed downstream 16 channel bonding on Comcast. That would be 4 times as many as you cited "Most commonly 4 channel bond on the downstream and 2 on the up", in your post that I failed to reply to.
It's all relative. 80 decibels in the day isn't that loud. It's the sound of a vacuum cleaner. At night on the other hand 80db is loud. Considering that the F1 are 140DB the sound differences are massive.
"LOGS = []" this is bad ruby, shouldn't use global constants neither as a variable or as mutable.
Sure. I suppose that could be the reason. However, something like HA proxy[1] and (IIRC) CDNs like Akamai can be configured to inspect the headers and take various action.

[1] http://cbonte.github.io/haproxy-dconv/configuration-1.5.html...
Sadly yes, while ARM and SPARC bounds checking get used to tame C and its derived languages, Intel decides to retire MPX.
Paid ads for violent conspiracy theories are fine but god forbid you use an eggplant emoji.
It's a bit unreasonable to expect security and scalability, before it became big and valuable.
I have come around to worshiping the pioneers :-)
Edsger W. Dijkstra, Niklaus Wirth, Tony Hoare etc.

Though i have not read all their works (nor completely understood their ideas) just the way of exposition and breadth of their thoughts, the insistence on mathematical rigour and formalism etc. always makes me think that i don't yet understand what "programming" is all about. Just slinging code is NOT enough. The idea of programming to a specification using "correctness by design" methodologies (eg. Hoare triples and logic) seems to me to be fundamental to programming. And yet most of us only follow "trial and error" methodology limited by our own lack of knowledge and discipline.
Grocery carts are a thing.
Very cool. I love to see our API being used in creative ways.

Great write up, too. There are some nice techniques in here that would be useful for other developers (restricting viewable bounds, restricting zoom levels, custom map tiles, using custom overlays - MarkerWithLabel).
I've seen Carter take this from exhibityes (what art.sy was called before) to what it is today. He is an impressive founder and has an amazing team/investors.

Can't wait to see the product live and in action, and change the face of the art world as we know it today.
I'm sure they aren't writing another phone OS, but what devices exactly are they targeting? TVs, set-top boxes, MP3 players?

I loved the hardware of a Sony MP3 a bought a couple of years ago but it was ruined by absolutely atrocious syncing software. I hope this means they open up their interfaces a little more and let other people integrate with their products.
Evolution and natural selection are not facts. I understand why you use the word fact. It's because too many people are playing word games ("belief, opinion, theory!"), that you feel you need to counterattack by using such a solid word like fact.

In the vernacular, fact also has another meaning: true. Not conclusively true, not noisily true, but Simply True. Unrevisable. Unimprovable. Just Truth. And that's the game you've decided to be a part of. "It is a FACT that I am standing here right now." Some groups are well aware of this confounding of terms and they deceitfully abuse it.

But facts are data points. They are the things which you combine to formulate a theory. If all you have are facts, then all you have is a bundle of disconnected trivia. Theory is true power over facts, but in the vernacular, theory means opinion. Theory is weak. Theory is revisable. Theory is improvable. How do you know your theory won't change tomorrow? But Fact is Truth. It won't change tomorrow, or ever.

But in science, theory is power. Theory is sexiness. Theory is freedom from a huge bundle of disconnected, incoherent facts. "You have no theory, all you have are facts!", is a damning statement.

Historians have a lot of difficulty producing a decent theory of history. They have tons of facts, but where's the general theory of civil war? Everything in history is retrospective hyper-domain-specific explanation. So some people appreciate the difficulty of theory.

Maybe if people don't play these word games, then they also lose. But I don't currently believe that. I think the other side that plays word games is dishonest, and that those who join with me on this opinion should resist such immoral PR tactics. These are people who pervert the good instruments of societal transaction and improvement, because winning is everything to them. Whatever the damage to public relationship to science, whatever the cost to language, whatever -- let the kids of the future clean it up after we've won the "war".
> The person doing the 'healing' has met your personal standard for a 'healer' - in this case foreign experience.

I'm not imposing my standards for a healer on a sick person in his personal quest for a healer.

> Without licensing, I could, with no experience whatsoever, just cut you open and go to town.

Indeed, you could do the same thing absent a license in a regulated regime, and also you could get a license and kill me on purpose and say it was an accident or unfortunate outcome. What the requirement for a license does is create a class of people who are approved healers, and criminalize medicine outside of that state-sponsored context.

> You would die, and then what? Who's liable?

You'd be liable, just like you would if there were licenses and you either had one or did not. Or are you referring to the fact that physicians are shielded from liability if they meet industry accepted standards of care?

> You assume the 'healing' is successful. Does it become butchering if I fail to do so?

I don't assume that. I'm just referring to the telos of the act. You're allowed to give people free tattoos. You're not allowed to give them a tattoo if you claim it is medicine. It doesn't matter if its a drug or whatever. The intent to heal is what's criminalized here.

> So, to that end, while I may not agree with all aspects of licensing physicians (for instance, I'm with you on the foreign degree and experience limitations) I believe that on the whole it does more good than harm.

The problem arises when you enforce your values on other people who do not share those values because of your belief that "on the whole it does more good than harm."

> I will therefore be explicit and say, yes, I do "agree with the criminalization of healing people without permission [of competent authorities]," even if I do not today agree with all of their requirements, however I reject your framing.

Thanks for your reply and thanks for engaging my perspective directly :)
Don't you think that Telegram has the same monetization problems (it burns "a few hundred million dollars a year" while the owner left Russia with $300m in his bank account a few years ago) and they already announced their monetization plans https://techcrunch.com/2020/12/23/telegram-to-launch-an-ad-p...
Where would you move next?
How MacOS deals with it? Any slowdowns too?
Regardless of how they got in, all of these folks should be in jail awaiting charges for felony murder, along with a raft of other things.
That’s a beautiful quote.
Is 'financial' 'best' in the answer you're looking for? Or more broader aspects?
Is that Crystallizing Public Opinion? Will read next.

Lippmann says the answer is two parts:

1. For voters, improve their ability to make the right choice via education and representative (not direct) democracy.

2. For politicians, improve data so they can make better choices.

Interestingly, (2) sounds a lot like data.gov, a century before data.gov!
I’m confused. The Trump video they posted at the end was on Twitter. I believe it was taken down for election misinformation (it was not a landslide in trumps favor) and if you go to his page you can see his tweets calling for peace at the top. To imply that it was banned by big tech because they don’t want to show trump calling for peace in a lukewarm fashion is confusing.

https://mobile.twitter.com/potus
Was twitter shutting down BLM or Antifa accounts during their riots this summer?
Because the UK - like most of Europe - believes the free market is a poor mechanism to protect vulnerable people from rape and physical assault.

I'm not being flippant here: customers have routinely shown that for lower prices they'll suffer almost anything, to the point that safer alternatives become uncompetitive.

TfL isn't asking for much here: just that drivers are vetted properly and consistently. Every other firm in London is asked to do it, and complies. If Uber can put them all out of business by saving money on not doing that, the market will make the industry less safe for passengers.

We have voted in people to ensure that doesn't happen, because we want protection from the free market, simple as.
I thought about this too. The explanation I've reached is that when it comes to livestock, there is a certain amount of.. respect? going into the process. We are raising and exploiting cattle for thousands of years now, and every part of an animal is either directly consumed or used in other ways. Many cultures have elaborate rituals surrounding the slaughter, etc. This, I think, gives the impression of value to us.

But for these penguins, there is no respect (still not sure if this is the best word) to speak of. You just cut them into pieces and boil thousands of them in a steampot, then discard most of it. The oil you get is in small quantities and is not even of high quality. The animal is treated as a thing to be used up, without any value.
That's a brilliant insight. I have also seen it in the attitude of some CEOs of USSR vintage w.r.t to company culture.
I think it's at least partly related to the large range of possible "correct" values in these types of fields.
I second this. Don't be swayed by what you see and read in the media. Silicon Valley isn't a place for everyone and can be incredibly stressful. On the bright side, it's a very diverse place with tons of stuff to do, great weather, smart people and is easily one of the best places in the US (IMO anyway).
Damn that's cool :P
You're on the right track toward the end. It means they built their MVP in Python, and they've built more & more features on it in Python. Now they're looking for someone who will happily work on their existing codebase. They want it to be the best Python it can be. They want someone who knows the language inside & out; someone who goes to Python conventions and follows all the big Pythonistas on Twitter to get all the latest tips & tricks. And, they don't want daily requests to rewrite the whole thing in some developer's favorite language.

It wasn't that long ago people were clamoring for all the PHP in the world to be rewritten in Python. Ten years ago, I was part of one of thousands of efforts across the globe to rewrite a legacy codebase in hot new J2EE awesomeness. Around the turn of the century, it was a push to replace ancient COBOL with hip, modern C++. There's always a hot new language that makes the old hotness look ridiculous in comparison. This industry is like the fashion industry in more ways than we're willing to admit. But it's totally possible to run a successful business on a language with warts. Yes, even PHP.

If you ask them, they'll probably tell you they really do want someone discerning, someone passionate about programming languages. But right now they've prioritized their business needs over a rewrite for the sake of a rewrite.
When Google first appeared on the scene, I remember being disappointed in its lack of tweaks, compared to AltaVista. However, the quality of Google's results quickly won me over.
This isn't entirely true. If you pay Oracle millions of dollars a year, their support is actually fantastic, like really, really good!
I disagree about point A. GitHub as a whole is proprietary, but they have an exceptionally well designed API that can be used to export issues, pull requests, and wiki data. I setup a cron to backup this data weekly in case of a catastrophic github data loss event. There are multiple open source tools to get this meta data.

I'm pretty sure there is a tool to transfer a GitHub repo and all meta data to GitLab (which is open source).
Daily dumps are pulled from torrent sites. I grab each hash and title and store those. Then all the new torrents, I grab the hash, and scrape the demonii tracker to get seeder/leecher information.

Also at the same time, I am constantly scraping the demonii tracker for seeder/leecher information for older torrents based on age.

It currently takes 5 days to update all the torrents, but I will be implementing an auto-pruning system for torrents that are dead for so long, negative votes, etc etc
Have you checked Dr. Sarno's approach for RSI and related problems. If you have tried all those options and they didn't work you should definitely give a try.

You can check a story very similar to mine:
http://www.pgbovine.net/back-pain-guest-article.htm

Disclaimer: I am CS PhD student in a top tier US school. Suffered from RSI, tried everything. Was cured by Dr. Sarno's technique.
Totally unknown fact that resource_controller was initially extracted from a project James was working on with me (he was doing the coding) 7 odd years ago, we never fully discussed it as the project never saw the light of day (it was for a client) but I'm pretty sure the crazy client requirements drove the thinking behind it in some part.. I still have the half finished project somewhere, must dig it out..

Pretty shocked about his death, an inspirational guy.
Pretty sure this statement is incorrect
"Many people believe that evidence for a lack of free will was found when, in the 1980s, scientist Benjamin Libet conducted experiments that seemed to show that the brain “registers” the decision to make movements before a person consciously decides to move. In Libet’s experiments, participants were asked to perform a simple task such as pressing a button or flexing their wrist. Sitting in front of a timer, they were asked to note the moment at which they were consciously aware of the decision to move, while EEG electrodes attached to their head monitored their brain activity."
>Most cities in the country also have their own housing crises.

No they don't. The ones that do are the ones who's housing market is all jacked up by California money that wants off the sinking ship.
South Korea and North Korea use different romanization schemes. So for example, 대홍단 is properly romanized https://en.wikipedia.org/wiki/Taehongdan_County. ("Agriculture is also key, with the county leading the nation in potato production.") Google Translate (as expected) seems unaware that it should use North Korean rominzation scheme to romanize North Korean place names.
I found this comment from the article fascinating:

> I am a physician who did a computer science degree before medical school. I frequently use the Therac-25 incident as an example of why we need dual experts who are trained in both fields. I must add two small points to this fantastic summary.

> 1. The shadow of the Therac-25 is much longer than those who remember it. In my opinion, this incident set medical informatics back 20 years. Throughout the 80s and 90s there was just a feeling in medicine that computers were dangerous, even if the individual physicians didn't know why. This is why, when I was a resident in 2002-2006 we still were writing all of our orders and notes on paper. It wasn't until the US federal government slammed down the hammer in the mid 2000's and said no payment unless you adopt electronic health records, that computers made real inroads into clinical medicine.

> 2. The medical profession, and the government agencies that regulate it, are accustomed to risk and have systems to manage it. The problem is that classical medicine is tuned to "continuous risks." If the Risk of 100 mg of aspirin is "1 risk unit" and the risk of 200 mg of aspirin is "2 risk units" then the risk of 150 mg of aspirin is strongly likely to be between 1 and 2, and it definitely won't be 1,000,000. The mechanisms we use to regulate medicine, with dosing trials, and pharmacokinetic studies, and so forth are based on this assumption that both benefit and harm are continuous functions of prescribed dose, and the physician's job is to find the sweet spot between them.

> When you let a computer handle a treatment you are exposed to a completely different kind of risk. Computers are inherently binary machines that we sometimes make simulate continuous functions. Because computers are binary, there is a potential for corner cases that expose erratic, and as this case shows, potentially fatal behavior. This is not new to computer science, but it is very foreign to medicine. Because of this, medicine has a built in blind spot in evaluating computer technology.
Most software developers have mostly operated in largely unregulated domains, so there's a MISunderstanding of how manufacturer responsibility works in industries like automotive. Saying "I AM NOT RESPONSIBLE FOR ANYTHING" in the automotive software space is the product liability equivalent of Michael Scott screaming "I DECLARE BANKRUPTCY" in The Office.
As an Israeli I always wonder why people who live in the US or Europe think they have some special insight into Israel/Palestine by merit of being Jewish or Muslim.

Israel is vaccinating Palestinians who are Israeli citizens. It actually runs special promotion campaigns (including the PM visiting Nazareth) because some in Arab population are reluctant to take it.

It does not vaccinate Palestinians in the Palestinian controlled areas as it has no authority to do so. Furthermore, Abbas and the PA leadership make a point of not allowing their citizens access to Israeli healthcare (though they did make sure to get vaccinated themselves).

Some time ago my wife was involved in an effort to provide life saving medical care to a Palestinian child in an Israeli hospital. The hospital waved all costs and the treating surgeon was in daily touch with her. The PA refused to allow the child entrance into Israel to receive that care. This wasn't an isolated case, it's PA policy.
> pseudo open-source (the ML model is still a closed black box).

?

I am confused with this statement. Sure the ML model is a black box, but it's better than closed source completely with no model. It's more realistic to build the software yourself than training your own self driving ML system.

I would still class this as still 'open source'.
https://github.com/microsoft/PowerToys has reliable key remapping. Also has decent window tiling.