skysight-inc/HackerNews huggingface dataset:
Common CMS are fairly good at caching and can handle a high load, but quite often someone deems a badly programmed extension "mission critical". In that case one of your requests might trigger dozens of database calls. If multiple sites share a database backend, an accidental DOS might bring down a whole organization.

If the bot has a distinct IP (or distinct user agent), then a good setup can handle this situation automatically. If the crawler switches IPs to circumvent a rate limit or for other reasons, then it often causes trouble in the form of tickets and phone calls to the webmasters. Few care about some gigabytes of traffic, but they do care about overtime.

Some react by blocking whole IP ranges. I have seen sites that blocked every request from the network of Deutsche Telekom (Tier 1 / former state monopoly in Germany) for weeks. So you might affect many on your network.

So:

* Most of the time it does not matter if you scrape all information you need in minutes or overnight. For crawl jobs I try to avoid the time of day I assume high traffic to the site. So I would not crawl restaurant sites at lunch time, but 2 a.m. local time should be fine. If the response time goes up suddenly at this time, this can be due to a backup job. Simply wait a bit.

* The software you choose has an impact: If you use Selenium or headless Chrome, you load images and scripts. If you do not need those, analyzing the source (with for example beautiful soup) draws less of the server's resources and might be much faster.

* Keep track of your requests. A specific file might be linked from a dozen pages of the site you crawl. Download it just once. This can be tricky if a site uses A/B testing for headlines and changes the URL.

* If you provide contact information read your emails. This sounds silly, but at my previous work we had problems with a friendly crawler with known owners. It tried to crawl our sites once a quarter and was blocked each time, because they did not react to our friendly requests to change their crawling rate.

Side note: I happen to work on a python library for a polite crawler. It is about a week away from stable (one important bug fix and a database schema change for a new feature). In case it is helpful: https://github.com/RuedigerVoigt/exoskeleton
it's not. It's a stirling engine, no combustion here. (And no noicy pumps for cooling water as the nuclear subs have)
Awesome! Again, my comment is not directed at any particular person. It's directed at a particular motive. If you don't have that motive, my comment isn't talking about you and you can feel free to ignore it if it doesn't bring value into your life. :)
Dio (Program Language) 0.4.0 Release
Oh cool! That's good to know. Sadly too late to edit my original message, but have upvoted yours so people won't learn from my errors :)
While you can't officially do this according to the rules, I've gotten around this by trading "deposits". In other words, for your trade I might trade two sheep for one wood and one ore, and later trade one ore for three brick. That way there are two separate trades and you're not just giving me brick on a later turn to satisfy a previous trade.

The flip side of this, of course, is that there's nothing stopping you from welching on the deal later, aside from the normal game-theoretic reasons you may not want to screw someone over. So I'm incurring significant risk this way.
Apple is a monopolist for the iOS App Store. The eco-system is controlled by them using their rules and they compete with others in the same app space. The whole thing is rigged to the extent that an anti-competitive investigation should be done into the market place by the Justice dept.
Skype Meet Now: Free Video Conference
You're telling the guy with the power to ban you that you won't abide by the forum rules? Not a great strategy...
The point in brick/concrete walls is that they are much sturdier and harder to break - voluntarily or involuntarily - than plywood. It sounds like proponents of wooden structures keep forgetting that.

For thermal protection you can add the same insulation as for the wooden frame.

How those stone houses in New England fare during the year, are they that obsolete in terms of insulation?
https://www.gov.uk/service-manual/technology/making-source-c...

When you create new source code, you must make it open so that other developers (including those outside government) can:

- benefit from your work and build on it

- learn from your experiences

- find uses for your code which you hadn’t found
Are you not breaking their ToS though?
AirBnB will be worse off, because post COVID19, people will trust hotels more than random strangers' houses. You know the hotel will be cleaned. You can't say the same of an AirBnB.

And it's very likely that AirBnB restrictions will increase post-COVID19 to eliminate a lot of the apartment units that were (illegally) converted to AirBnB units, and that enforcement of existing AirBnB restrictions in cities like NY and LA will increase dramatically, both for safety reasons and to protect the hotel companies that actually employ workers, pay hotel taxes, and contribute to the local economy.
Ethical web scraping? Is that even a thing?
Well perhaps 'afraid' is not the right word to use here ('fear' sounds more neutral). Having a neighbor, and not a particularly friendly one, calls for counter-balancing actions on either side. Simple as that.
During the dot-com bust, rental prices went down a bit. During 2008, they stayed flat (as opposed to going up a few percent each year).

So I'm guessing it will either stay flat or go negative. It depends on how quickly things recover once the shelter in place is lifted and how many people actually leave the area.

The housing prices are driven by lack of supply, so even if demand softens a bit, it won't have that big of an effect, I think.
It sounds like it wasn't some sort of investment decision, but a setup that worked for this person.

Say you live in a major city and need a car, but it would sit there parked 80% of the time. You can't justify the cost.

But if you could rent it out that 80% of the time, you end up in a situation where you have a car to use, but it's either costing you nothing or making you a little bit of money.
I don't know. He was hamstrung by federal rules on tests, for instance. NY was not allowed to go it on their own.

https://www.washingtonpost.com/investigations/2020/04/03/cor...
I'm saying if it weren't for Apple's closed loop, you wouldn't have a fragmentation free channel to billions of prospective customers. This is clearly getting even stronger with SwiftUI's ability to target across their product space (TV, Watch, Phone, Tablet, Computer). I am talking merely from a technical one, leaving aside the obvious financial disparity between Apple and the "other guys" (which I don't even think you can group into "Android" at this point it's such a mess)
Nope, everything is ok
Airbnb is working on pulling out all the stops to try and prevent layoffs. They might not succeed, but if they were a smaller company they wouldn't even have anything to try.
No, that sounds like a private company trying to sound trendy.

A startup has a small number of employees to start with and a 2 - 3 year window to go big, fizzle out, or pivot into a small - medium sized business. You're not a "startup" forever, nor does eventually marketing yourself as one, actually make you one.
It appears to be a reply to this 2003 paper in the same journal:

> Parachute use to prevent death and major trauma related to gravitational challenge: systematic review of randomised controlled trials [1]

[1] https://www.ncbi.nlm.nih.gov/pmc/articles/PMC300808/
I think you missed a joke at the expense of the toothsome nightmare of après ski culture.
From a quick Google, Zoom does offer the compliance bits required (if their actual behavior breaks that, I think that shields the medical providers legally)
Zoom CEO: 'I Messed Up' on Video Platform's Security
Once again, this is a rather perfect example of why there is a great need in Math for a universal formal proof language that can be verified by computers.

If this existed, the burden of proof would be on Mochizuki to present his proof in a language that can actually be understood by others and by machines.
I only ever look for old links in my mailbox (I either save them or send them to someone). So I use the Linkdrop add-on : one click, and it sends a daily e-mail with the links. Everything ends up being centralized and searchable in my mailbox, I'm happy with it. https://www.linkdrop.co/home
How many bottles of water do you need to survive Quarantine?
Power struggle then becomes what are rights, and who owes them to whom? Who gets what rights and how are they enforced is pretty much the core of political struggle.
Checkboxland – render anything as HTML checkboxes
You can simplify the ssh-keygen command slightly. According to the man page -b is ignored for Ed25519 keys.
This is what I use:

https://www.bing.com/covid/local/unitedstates

As of now (4/4, 4pm EST) I can see 1376 fatalities in the last day, and a total of 8283.
Emacs Org-mode for desktop and beorg to share from ios is being the best setup so far.
Alternatively you can put the parachute on the aircraft:

* https://en.wikipedia.org/wiki/Cirrus_Airframe_Parachute_Syst...
I don't think so, because a whole lot of startups plan to get bought, not go public.
You started a flamewar here and then kept feeding it. We ban accounts that do that. Please read https://news.ycombinator.com/newsguidelines.html and don't do that again. Note how they include, among other thing:

"Eschew flamebait. Don't introduce flamewar topics unless you have something genuinely new to say."
I've never actually heard of this game until now, even though it was released during my "prime" teenage gaming years.

Reading the retrospective, though, I get the distinct impression that "gameplay" was left as an afterthought. The person being interviewed practically says as much at one point.

A lot of developers make the same cardinal mistake - assuming that some technical point of differentiation is enough to succeed.

The game, first and foremost, has to be enjoyable. It doesn't matter how realistic your physics engine is, how many sound blends your Foley system can create, or even how good your artwork is. There has to be some core, accessible gameplay mechanic that drives the whole game. It's not something you can just throw into the "we'll figure that out later" basket.
It definitely poses a challenge to the question of what a mathematical proof actually is. One of the things about mathematics is in a way its 'obviousness', there's a way in which once something is proven its intelligble to mathematicians in an immediate, direct sense.

A 600 page proof that requires essentially a new branch of idiosyncratic mathematics which as an end result is barely understandable even by peers in the field almost moves it from mathematics into the realm of empirical science, where people are often for years occupied with interpretation of data and discussions about how significant a finding is.

As mathematics moves on to tackle more and more complicated questions I think it's interesting to ask if there will be a push back against complicated solutions, focus on simplicity as integral to solving a mathematical problem, and so on.
This article about the paper is likely to be more informative than the paper itself. (https://blogs.bmj.com/bmj/2018/12/13/we-jumped-from-planes-w...)

The study is an absolutely ingenious way of simultaneously illustrating multiple different challenges that can frustrate randomized controlled clinical trials. Some highlights:

> We believe that randomisation is critical to evaluating the benefits and harms of the vast majority of modern therapies, most of which are unlikely to be nearly as effective at achieving their end goal as parachutes are at preventing injury among people jumping from aircraft.

> RCTs are vulnerable to pre-existing beliefs about standard of care, whether or not these beliefs are justified

> When strong beliefs about the standard of care exist in the community, often only low risk patients are enrolled in a trial, which can unsalvageably bias the results, akin to jumping from an aircraft without a parachute.

> even a well conducted RCT can provide misleading results
I resurface them when you read similar topics in the future, so that it is brought up when it is relevant to you again. This is a work in progress.
That the Turks probably won't genocide them over here
The 2018 Trump tax reform authorized selling 30% of the reserve in order to shrink the federal deficit. They only sold off 10% before halting, due to a glut depressing US energy industry.

https://www.eia.gov/dnav/pet/pet_sum_sndw_dcus_nus_w.htm

Line 7 under Stocks list the weekly SPR. Clicks its box, the graph button at top to get a history graph.
Ideally disable force pushes on master branches of a repo to prevent people who screw up to also also break upstream. You can still lose some work, but at least not the complete repo.
The shale was there in 1979 too. But in order to use it, you have to be able to get it out of the ground in a way that is economically viable.
How do you think Google provides search results?
FSF Events
Coronavirus: Zoom hackers target GAA web training with porn images
By turning point I mean the inflection point. You turn from “driving left” (convex) to “driving right” (concave).

By the way, the derivative of the logistic function is the logistic distribution, and that’s not the Gaussian bell shape, it has much fatter tails: Gaussian tails drop much faster, with exp(-x^2), while the logistic drops with exp(-|x|). (Makes sense, as the logistic curve grows exponentially at the beginning, and the derivative of the exponential is the exponential.)
Do you often have flying skyscrapers? Or pieces of concrete during tornadoes? Or even just rocks from mountains? The concrete technology is supposed to be able to achieve similar results. Does it take too much expensive concrete? What numerical comparisons are saying?
I'll be happy to answer any questions about the language.

This release has a syntax update. You no longer require to use backticks and you don't need a $ in front of a type. Static assert has been added as well as defer and errdefer. My favourite change is being able to destruct an object by calling a function so I can return it's internals without creating another object.
There are reasons to be skeptical of everyone!
The swedish Gotland-class submarines are know for their stealth. This is achieved by using stirling engines and other improvements. See wikipedia on them: https://en.wikipedia.org/wiki/Gotland-class_submarine

I think the reason that nuclear subs are hard to make quiet is that the reactor needs quite a lot of supporting machinery, which tends to make noise (pumps etc. for cooling), and these can't be quickly shut down. Hence diesel-electric subs can be a lot quieter (but of course can't win in endurance). But a silent sub can still do a lot , especially if it's targets really can't quiet themselves...
Actually, I think the last line of the intro makes their case pretty well: "No tactical nuclear weapon has ever been used in a combat situation."

Yes, the weapons exist, but suggesting that they could just be casually employed without massive global repercussions is absurd.
And sometimes a de facto scam (WeWork) or full-on scam (Theranos) because the investors caught FOMO fever and couldn't be bothered with due diligence.
Ahh, yeah, that actually helps quite a bit.
They made it a bit easier in ACNH. Best streak I got was six in a row during hard rain.
Please don't feed flamewars regardless of who started it or how wrong someone else is or you feel they are. We've had to ask you this before.

https://news.ycombinator.com/newsguidelines.html
-As kryptiskt has already pointed out, tactical nuking... isn't.

Besides, if things were getting hot, the Swedes (or anyone!) would be fools to keep their naval assets in port; doubly so when those assets are largely autonomous and easily hidden, like submarines.

The Norwegian navy also operates a few diesel-electric subs; in cold war days, the plan was to let the Soviet surface fleet enter the fjords, then give them hell - the point being that just about any Norwegian population center or strategic asset is - drumroll - by a fjord.

Hence an invading navy would have to venture into the fjords to support the land forces - the fjords packing subs, coastal artillery, torpedo batteries and lots of observation posts to make the stay interesting.

Noone thought the Norwegian armed forces could repel a determined aggressor - the idea was to keep the foe busy (bleeding profusely in the process) until NATO allies could arrive.

The other Nordic countries probably had similar strategies.
Well, which is why it may be useful to get some of the NANOG (or international equivalent) folks involved in the IETF (and vice versa?): having end-user buy-in is important for any technology or service.
Is instead of using multiple keys, writing an AutoGUI script better? Of course I know both are against their ToS.
Most of the infected aren't going out of their way and infecting people. A small number of the infected are acting with, at least, reckless disregard for the possibility of infecting others.
Corrections in real estate market, be it rent or selling, tend to reflect economy in slower pace and depend greatly on location/overall attractivity. Owners get very quickly used to higher rent/property valuations, but are very reluctant to go down with prices.

It might be good for those high renters to simply move elsewhere in couple of months when/if there will be many free places on the market. This is experience from elsewhere, from +-2008, so it might not work out exactly like this of course, but generally I would expect so.
Bill Gates is funding factories for 7 coronavirus vaccines, wasting billions
Mailper: Disposable Mailboxes
Flamebait and personal attacks will get you banned here. No more of this please.

https://news.ycombinator.com/newsguidelines.html
I use Firefox's Email Tabs [0] add-on to send full articles, sometimes multiple at a time, to my gmail address. That makes them searchable and archived should they ever go down.

[0]: https://addons.mozilla.org/en-US/firefox/addon/email-tabs/
I think developers should be more principled and stop supporting the platform.
I wonder why none are talking about an automated GUI script instead of multiple keys? (I know both are against Google’s ToS)
Point of context: This does not relate to vulnerabilities discovered more recently.
Thanks for the correction. Then put Russia in the middle category or the last (with the USA), depending on how extensive public services are…
Ramping up PPE and ventilators at the first hint of an infectious disease would have saved tons of lives.

The second thing was closing borders. We wouldn’t need a massive lockdown inside the country if only negatively tested people were coming in.

Airlines would have taken a big hit, yes, but you’d still save the economy. It would be way cheaper to pay the airlines for all their potential lost fare than 20% of the population unemployed.

The president still not wearing mask in public says it all. He won’t take this seriously until he himself gets infected and gets seriously ill. The negligence is atrocious.
I think the point is that Apple could still run their own App Store, which meets all of your requirements, without excluding all alternatives, which others might find valuable even if you choose not to use them yourself.
Maybe, but I don't think I did, mainly because "expatriate" isn't spelled with a hyphen.
Are these the ones France claimed they'd bought but the U.S. got there first?
Please stop posting ideological battle comments to HN. We ban accounts that do this, regardless of their ideology, because it destroys what this site exists for.

https://news.ycombinator.com/newsguidelines.html
Though it would probably be better to tell beginners to run git stash save first. Then they wouldn't lose changes they made to the files before running a hard reset.
There’s never been an extended global shutdown of travel like now though.
I was thinking more businesses will question their long term commercial rentals and seek more flexible alternatives with a lighter overall footprint - benefitting the likes of WeWork.
The animated show isn't useful. This article is useful because it actually reveals information about the author.

Also even if you're not interested in the author, it has useful information about cryptography, cryptanalysis, and optimization.
While a lot of git commands can compete for the title of the most useful, I believe the combination of git reflog and git reset is what can transform the git user from someone who lives in fear of their tool to someone who loves it.

Know reflog and you stop being afraid of losing your work if you mess up, know reflog and reset and you stop being afraid of not being able to fix things if you mess up.
In the early 2000s, rents really didn’t go down. In rent controlled buildings you should expect they will still ask for the max increase. That’s what happened back then and people were moving away in droves.
6 months ago, you could have made the same argument about medical PPE - it costs billions of dollars and "we can always make a tremendous amount more".

Take the case of the SPR drawn downs after hurricane Katrina. Most of the disruption there was that the ports needed to get the oil on shore were damaged. More drilling wouldn't have fixed that in the short or long term - we just needed to repair the ports. The SPR was able to cover that and minimize the economic shocks of a fairly short term problem.
Many Europeans are lazy. They don't want to have to repair damages. They prefer to build so that damage doesn't accumulate for decades. Don't see the point in easy repairing.
Our board and investors have made it clear they think it's highly unlikely any meaningful funding will be able to progress until early 2022 at this point.

Recently-funded or reasonably conservative startups should be able to do okay with that, but ones without a lot of runway are going to be in a really difficult position.
If anyone on iOS Safari gets a blank white page following these links: you may have to turn off your content blocker(s) (in my case Firefox Focus)
*Knowingly

> The Microsoft billionaire Bill Gates told “The Daily Show” on Thursday that his foundation was funding the construction of factories for seven coronavirus vaccine candidates. Gates said the foundation would end up picking only one or two of the seven, meaning billions of dollars spent on manufacturing would be abandoned. He said that in a situation where the world faces the loss of trillions of dollars to the economy, wasting a few billion to help is worth it.
The reasons are particularly relevant in this case.

https://blogs.sciencemag.org/pipeline/archives/2020/03/29/mo...

https://science.sciencemag.org/content/335/6072/1033