skysight-inc/HackerNews huggingface dataset:
There are dozens of HFT players, all endlessly leap-frogging each other. Despite the fact that HFT is actually a relatively tiny market (the crumbs claimed by the HFT market account for at most a couple of billion a year), and is grossly overstated in significance.

In the broader market there are tens of thousands of major players, and millions of smaller participants. There is no network effect, and the market is so enormous that it doesn't concentrate.
There’s a very effective way out, don’t your data on the public web.
nice, then someone would just port rust and go and whatever to all the obsd arches, and not just to the main 2-3 platforms.
Breaths not being held.
Is that how really circuit court rulings get applied?

I always understood each ruling on the rungs up the ladder to the supreme court applied across the land until a final ruling was determined.
Doesn't gmail though still get to see your emails even with the forward?
Yes, I consider storing something in a way that is a demonstrably secure as feasibly possible "safe", regardless of the timespans. Especially when compared to the alternative, which is fossil fuels spewing their waste straight into the air.

And a better analogy would be that what anti-nuclear folk are arguing is like saying we shouldn't go to space at all because there's radiation there.
9% interest! Are you saying that is good or bad? If Buffet is getting interest, at least he is getting money off the table sooner than later. It's less risky than taking an equity stake. The loan is for a lot more than the sale. The loan is probably cheaper money than Lee can get elseware while the sale price for Buffet is probably a better sale price than if he just tried to fire sale the assets. Buffett is an infamous "one last puff" investor. While newspapers are heading down a continual decline, there is still some money to be made for a while.
Read a bit about the Cofnas guy WHO wrote that and judge for yourself if he seems like a guy you want summing the scientific literature regarding veganism.
As soon as they fixed text control, they broke URL handling. Long press on a link? Congrats, now you've got a weird floating popup Safari window with no Close button! Enjoy trying to use the finicky "drag between two invisible targets to open the app switcher" gesture to find and close the unwanted window.
I'm pretty good at keeping up with the SOTA in subjects like crypto, AI. But it's because I make an effort. And they interest me immensely. And it's easy with the wealth of information online.

Where I find it harder to keep up is that esoteric knowledge of "the culture". What is current in music and movies and art. Even interacting with young people a lot. The velocity of relevance seems to have altered significantly.

Another interesting take is returning to childhood passions. I used to be into sailing and thought if I have some free time I'll take it up as a hobby again. Maybe book a class in Annapolis MD. Or charter a small yacht for a day trip in Florida during spring break.

But the world of sailing has just metastasized into a massive industrialized complex! Lexus has a concept luxury yacht. You can control the helm 100% using a Garmin Smart Marine Watch. There exist software platforms for archival wind data.

Don't get me wrong, it's awesome. But there is an activation energy. And I am sure there are still single person Hobie Cats available. But it does make you feel as if you need to be all-in or else exist in a perpetual state of n00b-ishness ;)
Yeah, I have nothing at all against scraping per se, it's more about the huge bot traffic the commercial scrapers generate, which would ALSO be fine, but 1. it can be hard to tell scrapers from malicious DDOS bots sometimes and 2.) the person being scraped literally pays for that scraping traffic.
If you are insurance company you should want it.

If you are customer you shouldn't want it.

Every party can have different interest and should fight for their own interest.
Predict? Facebook buys earnings data directly from payroll companies.
> I think the answer is that there are two sources of feeling like a noob: being stupid, and doing something novel.

I very much doubt that being stupid correlates with feeling like a noob. In fact, my own experience of 'stupid' people suggests the very opposite.
Nuclear is more expensive than building a combination of wind turbine parks and natural gas plant. That is a fact.

People theorize that nuclear could be more expensive than a grid that relies on over capacity wind turbine parks in combination with thermal or hydro batteries, but no country has gone that route yet. We have countries that are almost 100% nuclear and we have a bunch that are a mix between wind/solar which falls backs to fossil fuels when needed.

The cost of running a energy grid is the total cost, not individual megawatts being produced in isolation.

Ban fossil fuels and the real costs comparison between clean energy becomes apparent.
If this is the only bathing you do, I would think all the fatty and oily residue particularly on the face, neck and chest would be harder to wash off. That's kind of the point of a hot shower, IMO. Still, I do experience the aftereffects of a cold shower and I think it's useful to do from time to time. But every day? Ew!
> Without energy storage, renewables will fail

but none of the below are renewables

* Massive adoption of nuclear fission alone
* Development & massive adoption of nuclear fusion alone
* Shift from coal&oil to natural gas, cleaner fossil fuels + scaling carbon capture/sequestration
http://waxeye.org/manual.html#_using_waxeye_from_python

> Waxeye’s Python runtime has been tested with Python version 2.5.1 and is intended to work with 2.x.x versions of Python.

Hmm, so this is quite old then...!
Cloudburst: Stateful Functions-as-a-Service
Exactly this.

The point of most on/off page SEO things like meta tags and link building is to help Google understand what needs your website can satisfy.

If your content solves problems effectively, and Google understands how to connect you to the people who have those problems, that's when things work.
I realize this is an unpopular opinion around here... but can anyone explain how they have actually been harmed by this? Like for real not in abstract notions of "creepiness" or whatever. I, for one with Facebook actually figured how to do something useful with that data and not be that raw sewage stream that basically led to stop logging in.
nuclear power is not scalable though https://ieeexplore.ieee.org/stamp/stamp.jsp?arnumber=6021978
The Most Modern Rabbit Breeding Software
Or, y'know, I'll stick to beans, lentils, and veggies.
I once scraped job sites to get a mile high sense of the tech industries in cities I was considering moving to.

EDIT: and to add, I've always dreamed of a website that gathered job, rent, entertainment, etc data on cities you're interested in to help figure out where are good places to move to. A site like that would have to be pretty much entirely built from scraping.
The github page does not yet reflect the very latest release, still have to upload the video (due to lack of time :) ). But the latest version has an additional freeplay mode without music (just the sound effects), that way you can play your own music hit the drum to the beat of the music to tell the game the BPM and then you can play to your own background music.
I think it might just be an algorithmic thing. He has one of the top karmas in HN.
The Chromecast is a Chromecast, and the controller works on my PC with steam just fine. (Although it appears wireless doesn't work)
Paper: https://arxiv.org/abs/2001.04592
I love your npm package dependency tree graph, I've actually posted links to it very recently on both HN and Reddit. Awesome tool!

https://npm.anvaka.com/#/
If you shower every day and use a soap, you will be clean no matter the water temperature. Hygiene is a matter of good habits and ethic.
It's an actual carve-out. Database work is explicitly NOT protected - Feist v Rural was actually about a telephone book deemed unprotectable!
Nobody believes in the 100% efficient market. It's not even possible.

But if someone's got a bead on a 99.99% efficient market, they can make a lot of money, whereas if you say "Ah ha! The market is not perfectly efficient! Here, I can make money doing this!", you probably won't make much.

(Then there are those who think the market is like maybe 10% efficient, in which case my response is, if it's so inefficient, go make money. That would imply all sorts of arbitrage opportunity. Why slave away in whatever job you may have now when there's such an inefficient market just waiting for someone smart & clever to pluck it? The answer is that where ever the market may be on the range of 0-100% efficient, to the extent that such a measurement is even particularly definable, while it may not be exactly 100.00000%, it's much closer to that than the 0% side.)

(Remember, efficient doesn't mean good or moral, which I think is the most common mistake I see on HN. It means something much more like "there are no easy arbitrage possibilities". It hasn't got anything to do with "goodness" or "morality" any more than analyzing gravity or electromagnetism in terms of its goodness or morality makes any sense.)
I'm working (at Chequeado.com) on automated fact checking using Machine Learning and NLP. Our first product works in Spanish (it's already been used in Chequeado's newsroom) and we're working towards a Portuguese version for fellow brazilian fact-checkers.

I'm also working as a contractor on automated valuation systems for real estate properties, mainly for the argentinian market. The company have already sold the service to a big international bank to periodically update their mortgages.

And now I'm pondering about starting a research+prototype AI consultancy.
I was waiting for someone to bring up Wim Hof. I think he's amazing and pioneering but I think there may also be a genetic component to his work since NW European DNA already gives him a headstart IMO plus probably has neanderthal DNA which was probably well-attenuated with extreme cold.
I don't think that's necessary. Most people living in urban areas have x-ray practice in a close vicinity.
Even for those who don't, a home kit wouldn't justify the cost. You want to make a standard high quality x-ray set 2 times a year. Professionally done. Most of people on the planet can make a trip to a city 2 times a year.
It does, and the result is that phone books and maps get fictional entries inserted in order to prove copying -- because it is perfectly legal to do your own work to amass the same data set.

https://en.wikipedia.org/wiki/Fictitious_entry
I'm making RoomWithAView [1] in Godot. Not quite a productivity app, more an apartment builder/computer interface. Although on a bit of a hiatus (and a bit buggy) for the time being.

I'm pulling in desktop screens to VR which can be moved and placed as wanted. Working on pulling in individual applications and doing application launching. Aside from that it exposes a good bit of file system access in game. So a decent amount of stuff a productivity app may want to do.

I'm not a Unity guy but I briefly tried VR in Unity and the support seemed quite fractured. SteamVR has multiple versions across stores/github and I wasn't sure which to use, ditto for various tool kits. Godot I just downloaded a sample project and striped it down then worked off that.

The hardest part is doing anything non-gamey. Occasionally I'll make a help post and people will just reply "why would anyone want to do that?" but the C# support means you can use just about any libraries out there, so pretty much anything is possible with enough fiddling. I dropped the idea but even had OpenCV working with the Index's webcams at one point.

[1] https://ark1ve.itch.io/roomwithaview
How Sustainable Is a Solar Powered Website?
The concern about farmland contamination is not because people are farming around Pripyat and getting cancer. On the contrary, it's because people are not farming around Pripyat. Deaths per terajoule doesn't factor in the loss of the farmland.

I think you're probably right that, even with frequent meltdowns, nuclear power would be less bad than coal. But I also think that we don't have a large enough number of disasters to extrapolate reliably. A hundred Chernobyls might produce much more than a hundred times the deaths from one Chernobyl — or much less.
How do you get search to work? For me, Windows Search Indexer just uses 100% CPU forever.
Crystal structure of halide perovskite blue LED is temperature-dependent
Additionally, some public areas prohibit photography of architecture because of copyright.

https://www.diyphotography.net/10-famous-landmarks-youre-all...
Isn't that a different paradigm, though? A posting bot set loose on a forum/platform will (normally) visibly degrade service in a much more visible and impactful way than a scraping bot. And in either case, writing (and running!) a bot that posts on HN is not illegal behaviour in itself.
the smart people live in a plastic oil tank buried under four feet of peat
> A routine (hot-to-) cold shower resulted in a statistical reduction of self-reported sickness absence but not illness days in adults without severe comorbidity.

In other words, it does nothing. Maybe it gives you some kind of refreshing feeling afterwards but that’s it.

I’ll pass on this upcoming health fad.
Another problem with web scraping is a B2B website offering services for B2C companies to better reach consumers. It can be a tricky thing to do without basically giving your clients list to all your competitors.
I had exactly one item, and it's a store I never shop at, so assuming they are actually showing all the information they "have" on me, I also feel encouraged that my opsec is sufficient.

I guess the only thing better would be 50 stores I never shop at. I might experiment in the future with finding ways to deliberately poison companies' data wells with incorrect information...
One year inside Trump's monumental Facebook campaign
It is very easy to point at a poor person and make up a random reason why they are poor. (It's not like anyone will spend resources on validating your claim.)

It is very difficult to look at a random average person and predict whether they will become poor within the next 2 decades.
I'm glad scraping isn't criminal. Applying the CFAA here is ridiculous. But saying LinkedIn can't put technical measures in place to prevent scraping seems like a huge stretch to me. Why should they have to pay server costs for persistent scraping, particularly from a company that is actively trying to harm them?
Perhaps lithium battery manufacture is improving rapidly because we're investing more on it.

And your video has one huge logical fallacy "assuming energy comes only from Green and renewable sources" If that's the case then hydrogen is the most environmentally friendly choice even with the loss of energy, which is also improving.
Didn't you hear about that? Or is there too much other stuff happening that it distracts from important issues like protecting children from windmill cancer?

https://www.washingtonpost.com/lifestyle/style/the-story-of-...

https://qz.com/1291269/the-scottish-wind-farm-donald-trump-t...

https://www.youtube.com/watch?v=Q0s5Zqmb09g
I dunno.

I'm on Hackernews to see interesting articles and read interesting conversation. If a bot can post interesting articles and make interesting conversation, I'm not sure I care that it's a bot. And if a human can't do those things, I'm not sure I care whether or not they're 'real'.

https://xkcd.com/810/

That focus on "we don't care if you self-promote, we don't care why you're here, we just want you to be a good citizen" is part of why I like HN.

It's not completely black and white, but in general I believe that users online have the Right to Delegate[0]. That right should only be legally taken away if there's a really, unbelievably compelling social justification for doing so. I am pretty skeptical that banning web scraping has that kind of justification.

[0]: https://anewdigitalmanifesto.com/#right-to-delegate
Iran an NK both have elections. As for Russia, it casually ignores evidence of election fraud (as in literally throwing in stacks of ballots by local officials caught on camera). Also the official vote results in some especially democratic regions show over 99% support for the putin party, would you claim this result to be possible in real elections?
> The life of hunter-gatherers was complex, but it didn't change as much as life does now. They didn't suddenly have to figure out what to do about cryptocurrency.

This line gave me a good laugh.
Headline makes the monetization sound like a done deal but it only seems like it's a possibility that they're considering.
True but it's more scrubby. Soap usually has an emulsifying agent that breaks up fat molecules but there's still a physical component to it. If you want your cold showers you can keep your cold showers!
Former Windows chief reveals Microsoft’s reaction to the iPad
This one isn’t because of any inherent problem with Xorg but because Chrome doesn’t have the feature to select a specific client and instead is just capturing the root window always. Nothing is really preventing Chrome or any other app from doing this.

A workaround would be to launch a second Xorg instance and point Chrome and the app you want to share at that server.
>You’re giving the government too much credit. Medicare has a 20% coinsurance. Who knows if you have a chronic illness if that 20% is $20 or $200k.

Exactly, my mother needs several new artificial teeth. She's going to have to pay just shy of 900$ to get them with medicare retired via disability.

Then there was her thyroid cancer, her gall bladder removal, the 2 ambulance rides to the ER-only facility then to a proper hospital 2 weeks ago when she had pain so bad she couldn't even make it 2 rooms over to wake me up and I woke up to medics pounding on the door, her wire mesh installation, the second surgery from her wire mesh causing problems after they removed the gall bladder, multiple oral/dental surgeries and caps (one of which broke off at the post last at the beginning of the month), the umpteen trips in the past few months for liver issues she's having (apparently quite a bit of scarring potentially as a complication of her diabetes and the drug they gave her when her bones were rapidly deteriorating).

All of that adding up that she has to pay 20% of.

I was excited I overpaid on taxes and was going to be able to pay down a card, now I get to hand the money over to her for her teeth and it still won't be enough to get them so I'll have to try and squeeze that out of my income with a wedding in May that we're already doing basically for free. While also trying to figure out how we're going to start paying down whatever the ER/surgery/hospitalization bills end up being from earlier this month.

My mother is far more fortunate than most though, my father died just before I turned 13 and she never remarried so she gets his survivor's pension (state police) which IIRC is like 60% of his salary at the time. Without that and me she'd properly be screwed. I feel truly sorry for people less fortunate than her, she's got it rough and miserable but still orders of magnitude better than some that rely on medicare and disability.

Medicare is great! /s.
>C programmer who typically avoids dynamic allocation

Me too. But the problem is, maybe they'll give you a few. Probably not more than 10 or 20? Say 20 to be safe. So I'd keep an empty box ready.
I think perhaps the layout, cover letter, and maybe any flourishing notes are copyrightable, but the actual details of work experience and education are not.
Kinda surprised how many interactions I've had tracked from my visits to Home Depot, I've only recently started stopping by there in the past year or so. What data could they have possibly even used? Sell me more cardboard moving boxes? Plant supplies?
>This is a post saying how learning new things is good.

At the same time, this is a post saying "I wonder why evolution discouraged a lack of confidence!"

Like, duh. I'm all for Paul, but pretty much any stoned teenager would be able to come up with this.
This is probably about Warren Buffer specifically, who has donated a majority of his wealth to things like the Bill and Melinda gates foundation.

You're 100% right of course that most billionaires makes the world a worse place, but I'd argue he's one of the exceptions.
If that were true, you’d expect that as a group they would have better risk adjusted returns. I personally have not witnessed any insider trading in the industry and suspect it quite rare nowadays. It was more common in the past, though.
If you suddenly had a massive amount of resources you’d use it to... achieve nothing? And you think that’s the enlightened option?
Makes me wonder, how many users on HN are actually very convincing bots?
If morality is derived from a belief in God, then a nihilist could argue any form of morality is essentially artificial.
i’m doing it. forward all gmail to proton, reply from proton mail only. unsubscribe or more all junk over. eventually you’ll be fully switched over. takes time.

definitely use a custom domain so you never have to do this again.
5-4 overturn?
I think we know. Knowing your kids are most likely to suffer Dengue Fever 2-3 times before they finish high school, just like you have suffered, means you have a vastly different outlook than those in non-affected regions. These are painful, debilitating diseases that affect every family in certain regions.
> 3. The more wealth he generates, the better off the world is.

wat?

Is this some "Make the World a better place™" Silicon Valley techo-religious bullshit?

Wealth can be good or bad and good and bad at the same time, it's not automatic.
I think the common argument against try is that it was a macro in a language without macros. That’s pretty confusing behavior and you can’t expect anyone to understand that without reading the specification.
They probably just have a Like button on their website, which passes on data even if you don't click it. Use a request blocker like uBlock Origin.
Facts aren't copyrightable under US law. You could copy all of the phone numbers out of the phone book and put them in your own phone book without risking any sort of copyright infringement.
One of my clients is involved in property tax collection and reporting. Property Tax records are public info, and their website allows looking up the records for any property without a login. However, the data behind this website it the _source_ of the public records, and not the public records themselves (which would be local government databases).

For years now we've been in an arms race with someone using a botnet to scrape all of the account information for a particular county. My client doesn't care so much about the data; it's the server load that's a problem. Normal activity for this site is a few dozen account searches per minute, but when the botnet gets through our blockade it sends hundreds of search requests per second, overwhelmimg the site. The operator of the botnet has NEVER tried to contact my client to ask for an efficient api to access the data, which they'd probably provide for a minimal fee.

Data hosting isn't free, even if the data is.
ICE Uses Open Source to Violate Human Rights
Did I miss the benchmarks somewhere?
From a technical aspect I agree that it's definitely solved! I'm building my service on top of PKI for this reason.

The problem lies with the issuing and trust. Many countries do not issue e-IDs and it's not easy for a business to support all the ones that do. Take for example my country, Sweden. Basically every single citizen has an e-ID and it's used for everything. Yet I can't use it if I want to sign up for a non-Swedish service such as Revolut, N26, Transferwise etc.
Which is to say, he expects the newspaper business to not return 9% - otherwise he would keep it.