skysight-inc/HackerNews huggingface dataset:
Note - you may need to disable your adblocker for this site to function
The software community has built a lot of extraordinary tools that have been through a lot of battle testing. Pretending those lessons aren’t worth something and thinking you can do it all yourself is a mistake a lot of the time.
Ideas to Save the Planet with Controversial Geoengineering
> Votgle and Flamanville projects that you like to cherry-pick.

Yes, I have cherry picked 100% of the current era new nuclear construction projects in France and the US. How selective of me! /s

I suppose I should also have included all the projects that were abandoned before ground was even broken?

> Also, I'm not sure why you think weapons programs have anything to do with nuclear power generation's supply chain. The supply chain issues pertain to the construction of pressure vessels, pumps, and pipes that need to withstand the more difficult environment inside a nuclear reactor.

It includes such things as instrumentation, enrichment, fuel fabrication, and (most importantly) manpower and expertise.

> Trillions of dollars wasted is "no big deal"?

Investments are made on expected payoff. The expectation that renewables will do well is high. The off chance that they do not, oh well! Nuclear could be a backup in that case. There is no need to pump trillions into nuclear now to restore your putative golden age.

(I'd actually put carbon capture over nuclear as the backup plan. Nuclear would be the backup to the backup.)
> Are individual investors or non-HFT participants being "fleeced" in every transaction by those who are able to take advantage of timing?

And a follow up question:

Wouldn't the results of this be unpredictable because the price could either be lower or higher than when the individual non-HFTer pulled the trigger to execute the trade?
I don't think dynamic you describe is something that would affect undecided voters much.

And honestly, what Portland or democrats actually so has so little impact on what trump says, that they might as well do what they want.
- 25% Wealthfront (~medium aggressive fund)

- 30% Industrial/Commercial Real Estate

- 5% Crypto

- 40% Cash

I'd like to reduce the cash. Will probably buy gold with about half the cash to align with a more all weather portfolio [0].

0. https://ofdollarsanddata.com/ray-dalio-all-weather-portfolio...
Perhaps you could clamp a microphone to a metal rod stuck into the Earth to test that hypothesis.

Same for clamping onto the structure of your house for the vibration/fan one?
Nice. This is Rust for people programming machines of Arduino size.
You may be missing the point of the comparison, which is this: to compare the performance of the de facto standard CSV parsers of each system when used the way that a typical user would use them, i.e. to parse a CSV file into a data frame.

Regarding your specific points:

1. Yes, it's possible to rig up some way of parsing in parallel in Python, like splitting the CSV file into multiple files and then parsing them in separate processes and then joining that. But no matter how you do it, you have to jump through extra hoops to do it. And that is not something most users do.

2. I don't entirely follow this point. Perhaps using PyArrow's parser would be faster than what is timed here, but is that what the typical Python data science user would do? Most Python users use Pandas and the CSV parsing that it provides. If that changes, then it would be good to do a new benchmark.

3. Yes, floating-point decoding is hard, but Julia's is fully accurate, so if it's also faster than Python's how is it an unfair comparison? If Julia was cheating by doing imprecise float parsing, sure, that would be a valid complaint, but it's not.

These "conflations" sound suspiciously like excuses. If float parsing is slow, make it faster. If concrete object decoding is slow, stop doing that. If threading would be faster, bite the bullet and use threading. If the language doesn't provide good support for these things, then maybe the language is at fault.
it's the first language that doesn't have me use Python for quick shell scripting or small prototypes

How do you define quick? Python has a large standard library and so you don't have to hunt for functionality on crates.io and then download/compile -- I have written scripts faster than that.
When there is stuff that limits the path of price info there are wars and hunger and people die.
Creating a Public Symbol Server
The U.S. Is Trying to Be the 'Gatekeeper' of Space, Researchers Warn
1. Scalar level

Various benchmarks (including those in the paper) show NiLang is much better than Zygote to differentiate scalar functions. And Zygote is much faster than TF and PyTorch.

2. Tensor level

Zygote, TF and PyTorch are much better than NiLang, because NiLang's matrix multiplication is not fully optimized, it is much slower than BLAS. (One can wrap BLAS into NiLang, but that does not measure NiLang's programming language level AD performance anymore)
Exactly my point. It generated some work for a few companies, in the short term, but not ongoing value, work, equity for those companies or the economy as a whole.

But what about overall, total value to society, the economy, over the long term, not just to the few companies who won a bid.
I’m quite sure he meant that he was sniffing traffic through wireshark or such. And using that he found it was making lots of connections to different endpoints.
Pipes and Paper: Ancient Abstractions (ReMarkable Tablet Screen Share Hack)
this is an excellent point

Google pushes Chrome EVERYWHERE

Now that Chrome is the leading browser they are turning off targeting for everyone else, so that only Google has access to target users

The solution is to STOP the monopoly of Search

So that a new thing like Google Chrome can't happen i.e. Search can't be used to take over another space
A San Francisco 'Co-Living' Startup Suddenly Shut Down, Leaving Tenants in Limbo
> The end product of this is "fairness" - which is extremely valuable, because without a reliable ledger, bitcoins would have no value, and without the ultimate judge of time at the stock market, there would be no stock market, because nobody would trade at a market where a specific participant could just backdate his orders.

But again, those benefits are self-referential: Fairness rules for Bitcoin serve Bitcoin and fairness rules for stock exchanges serve stock exchanges. Would the wider world be very much worse off if we had no Bitcoin or stock exchanges?

> without the ultimate judge of time at the stock market, there would be no stock market

I'm also not sure about that. Yes, in principle, time is a good arbiter - however the descision to follow that rule down to microsecond precision seems like a deliberate choice to allow HFT. The article mentions front running as an attack on the trading system that would occur with inaccurate timekeeping. However, seems to me this could be circumvented: e.g., if an exchange wanted to ensure fairness but also prevent HFT (and the associated technology arms race), they could bucket orders by e.g. second resolution and then execute the orders in a bucket in random ordering. This will give predictable ordering at second resolution but would make front-running or racing impossible as the sub-second ordering would be unpredictable.
Is it possible to stuff more purple prose into a single article? For a laugh, try reading out loud in a Keira Knightley accent. Puke.
Caching was a major dissapointment for me. DllPlugin is a nightmare to setup and other caching plugins I tried don't really speed things up. What eventually worked for me is HardSourceWebpackPlugin [1] - two lines added and went from 2min to 15s (with a tradeoff of a slightly longer initial build).

[1] - https://github.com/mzgoddard/hard-source-webpack-plugin
> there need to be severe penalty for such abuses - not just financial, serious jail time.

punishment for who? those making the poorly thought out policy or the restaurant / pub owners who suddenly see themselves as the nominated enforcers of these data collection activities? rule #1 should be not to collect data you don't have a safe way to process. GDPR or not this shouldn't even be collected.
I think a case could be made that Nat Geo certainly took a hit to their reputation:

"The manipulation damaged the magazine’s credibility. Tom Kennedy, who became National Geographic’s Director of Photography after the incident, stated: “We no longer use that technology to manipulate elements in a photo simply to achieve a more compelling graphic effect. We regarded that afterwards as a mistake, and we wouldn’t repeat that mistake today.”

[https://www.alteredimagesbdc.org/national-geographic/]

In any case, I was certain it had happened but this isn't exactly compelling evidence that it's a widespread problem. A much more recent example would help your case. Also, (as you mentioned) this is a case of an outlet fooling people with their own fakes, not an outlet getting fooled by a fake which is more what I was referring to.
I disagree with the pleasure of asm macro.

Nothing beats PC / Amiga inline Assembly code blocks / compiler intrisics.
Local police and sheriffs will partner with Feds in so-called task forces to get around these limitations.

That is what local police in Washington State do to get around the state's long standing restrictions on wire-tapping.
this is brilliant -> On the other hand, Chrome is nothing without promotion on google properties and being installed by default on Android. Chrome would need to pay Google an extraordinary amount to continue to be the default browser on Android. Maybe even the same amount as what Google would pay Chrome to be the default search engine provider.

Chicken? Egg?
The modern economic concept of value is also largely subjective, so I don't think you need to caveat your thoughts with that.

As someone who used to write HFT code, I've vascillated between "it adds liquidity" and "it's a video game played between HFT firms". Neither is entirely satisfactory.

When I meet up with my old engineering friends, almost nobody is an engineer in the sense you might have thought when applying during the last year of high school.

Incentives are messed up. I remember getting offered £12K for a half year internship as an actual engineer. I took a marketing internship instead for a few grand more. My friend took an internship at Goldmans and was on £39K. When we got back, everyone applied to work in finance and consulting.

According to the market, making powerpoints is more valuable than making bridges, aircraft, medical equipment, etc.

We do somewhat envy the lady who took up an actual engineering job at a startup space launch company run by an eccentric South African guy.
Pythons CSV reader is actually decently fast. It is just that speed wasnt a priority.

I dislike the whole "faster than C" comparisons. Almost nothing is. If you want speed you chose C. If you want something that is plenty fast with a much better speed-to-effort ratio, Julia is a strong contender.
Yeah, Spotify has even contributed offical IFTTT triggers:

https://ifttt.com/spotify

I think this functionality belongs in the core experience.
Quic kind of has 3 windows:

Per stream and per connection flow control windows, which kind of indicate how much data the peer may send on a given connection before it gets a window update. Those windows also indicate how much the server is willing to store in its receive buffers, since the updates are likely sent when those buffers are drained.

A congestion window, which indicates how many low-level packets and data in them can be in-flight without being acknowledged. Those also account for retransmissions, and packets which do not necessarily contain stream data.
Show HN: AskHadith – A Hadith search engine based on Mongo text search
> You can assign numeric values to enum variants in Rust too

Is this (C-style enums) new?

I swear I looked for it a year or two back, found questions about it, with the answers "use constants".
Good reason not to visit pubs and restaurants which require reservations beforehand. This is not were my contact details are being collected fore. I think they private watchdog should look into this.
🇳🇴🇳🇴🇳🇴🇳🇴 Woooo!!! 🇳🇴🇳🇴🇳🇴🇳🇴

Go Norway! We are the best!

🇳🇴🇳🇴🇳🇴🇳🇴 Woooo!!! 🇳🇴🇳🇴🇳🇴🇳🇴
Thanks for the link to the paper, also check the latest version here: https://github.com/GiggleLiu/nilangpaper/blob/master/invc.pd...
I would like to see something like that as well. Something I read yesterday said there have been no peer reviewed studies showing surface transmission.
Right. If we build nuclear plants to fulfill peak energy demand (which coincides with a lack of energy production from solar) then there's not reason not to just run the nuclear plants 24/7 and skip building solar altogether. This is why nuclear power and intermittent sources end up being a dichotomy in practice.

Solar does provide a good way to mitigate carbon emissions in the meantime, even if it's role in a fully decarbonized economy is dubious. It's fast to build and makes a good complement for gas plants. Turn off the gas when the solar cells are collecting, and you can save a good deal of emissions.

Solar also has niche use cases that make sense even with nuclear power. Rooftop solar is a good way to offset air conditioning energy use. In this case, the solar energy collected by the panels are intrinsically connected to the power demand of the air conditioning unit. Plus the energy production and energy demand are co-located.
The reasons mentioned in regulation are twofold- that it allows better reconstruction of activity across markets when monitoring for market abuse, and that it allows for a meaningful consolidated tape
hey everyone, this is Richard, one of the co-founders of Wellcome. Thanks very much for the really great feedback, we will look at all of this carefully. Cheers!
As an aside, I think that's a poor analogy. Electric cars have been around since the late 1800s, only a decade or two after the first internal combustion engine, and for a while set land speed records. The last 30 years of electric cars did not start from scratch.

Electric motors reached a technological plateau. As https://en.wikipedia.org/wiki/Electric_car points out, it required MOSFET power converters and lithium-ion batteries. Before then, it could appear that it reached a technological limit.
Why not split search and AdWords while they’re at it? There are too many perverse incentives created by the combination of Google’s ad monopoly with their search monopoly.
A typical user will rarely ever use the built in CSV library in Python, and would choose among the many third party options for much greater performance, ease of use, parity with rectangular data structure tools like pandas, and so forth.

Comparing anything against the built-in CSV reader in Python is pretty much an exercise in nothing.

In 20 years of programming Python professionally, I have used the built in CSV parser about 5 total times, and all were use cases where 10-20x improvement of CSV parser performance did not matter whatsoever to the application.
That's not what front-running is.
This particular incident happened in 2009, when HFT was still relatively new and very profitable. These days, it's much more competitive and I doubt you could justify such an investment.
There were still market makers that provided liquidity. Algorithms can just do it faster than people.
I feel like we need to extend the laws we have that govern credit reporting agencies to these other businesses that aggregate personal data. Which hopefully will put them right out of business.
The 30 day figure is likely derived from the legal limit under GDPR for a Subject Access Request (one calendar month).

Why commit to a tighter SLA than you legally have to?
No, I don't want to restrict ownership of howitzers. Though personally, I'd prefer an M61 vulcan. So no, I wouldn't say I'd restrict based on body count.
When packaging apps for Sandstorm, eradicating these sorts of external dependencies is one of my top irritations. Not only do projects themselves rely on them, but components they drag in also bring in their own CDN dependencies. FontAwesome is the top offender today, call out to a third party server just to avoid hosting your own toolbar icons.

Recently, Sandstorm added the ability to block apps from loading external client-side scripts, and I hope more app platforms and hosting platforms adopt similar so that doing it goes out of style.
a Glock is militarization? A glock is not militarization. By semi auto I understood they meant a military style semi automatic rifle because of the context of the conversation. Police may carry these in their trunk, but I've never seen them carrying one around.
But there are plenty of other outlets for covert US propaganda that would be a valid comparison.
Thanks so much for sharing! The map couldn't be what it is today without the help of the great open source community:https://github.com/tmrowco/electricitymap-contrib

We're also super proud that the data is being used by Google to ensure that they use their data centers more when the electricity is greener and to help them in goal to make their electricity usage 24/7 carbon free in 2030 (https://www.gstatic.com/gumdrop/sustainability/247-carbon-fr...)

Martin from Tomorrow (behind electricityMap)
> actually used

Legacy systems are actually used.

If you don't have legacy systems then ride the wave of enthusiasm that comes with using the latest newest tech.
Well then you should ask yourself: is building this nuclear reactor cheaper than buying some batteries or converting excess energy to LNG to store it for later? If it is, then a nuclear power plant is economical, if it isn't, you should do the alternatives instead.
`xsetroot mod 2 2` and I rarely thought about them.
I've spent much of my career on similarly, perhaps a little more, restricted networks and found the opposite.

Dependencies are painful to pull in and only pulled in when a dev needs a specific version. The internal repos end up being a missing version nightmare where people cobble together whatever works with what's available. Where feature and security upgrades go ignored, left to rot like the brains of the devs who struggle to keep up with what's available in the real world.

Many of those networks I've worked on are becoming more permeable at the edges because the cost of the air gap outweighs any benefits.
Not OP, but The Harvard Classics is a good enough place to start. One of the things that made the series so good was the 15-minute a day reading guide.

This site has .pdf copies of the books for free. You can sign up and pay for more content if you'd like, but the gist of it is free anyway. Here is page for the daily reading guide: https://www.myharvardclassics.com/categories/20120612_1

I'll caution that the book collection was published in 1909, so you'll be missing out on the last 111 years of history. Still, it's as good a place to start as any for a look at classical literature.
I'm aware of these examples, but they are not holistic, and some are not related to my premise.

My "unproductive" remark was meant to include long term and perhaps indirect consequences, and was only provided as a charity to the opposite argument.

As for the police injustices, I already don't take a strong stance on exactly how pronounced the role of race is, aside from the obvious corollary aspect (i.e. not necessarily causative), but that's why I don't argue in defense of one race. I don't think these examples refute my premise, or the practical significance of it.
This is also very easy to achieve in Python by using Cython to selectively optimize code. That way for the 99% of code where such optimizations are meaningless and their requirement for static typing is a liability, you can ignore them, and only focus on the 1% of use cases where it matters.
Agree, but to add, there are many transcendental functions (e.g. I needed to use the Mittag-Leffler function many times in my work) which are near-impossible to implement in Numpy in a way that gives anywhere near usable performance. It's not a common enough function to be pre-implemented in Scipy special functions.

In my case, I wrote the algorithm in Numpy/python myself which was almost unusably slow. I then outsourced it to a precompiled fortran program. Finally I just switched to Julia. There was already a library, MittagLeffler.jl which did everything I needed and was written in pure Julia. In the end everything was much faster than the Python/Fortran frankenstein code I had.

Edit: For more info on Julia and difficult (computationally) mathematical functions see:

https://youtu.be/mSgXWpvQEHE?t=1262
Don’t the ads fund the search engine? If search was its own company, where would its funding come from?
If kids breaking windows is a societal problem, an economic system that has to frequently produce windows would result in stronger windows, making them less attractive for kids to break. A top down solution imposed by police, laws, and imprisonment also makes society poorer, arguably more so.
I mean, it's contact tracing or a shutdown..
Ok, how exactly do HFT traders lead to less food waste?
I think far, far fewer Americans support its illegal wars than you claim .. they're just silenced by the minority who stand to profit from it and who currently control the war megaphone.
Learning Rust through open source and live code reviews
You're right however this isn't possible with our current understanding of time: https://en.wikipedia.org/wiki/Spacetime
Overlooking the irony of trying to have an open discourse about the censorship of discussion about America's crimes against humanity by making reference to holocaust denial .. You're moving the goal posts and clearly adding further to very obvious agitprop.

But, I'll take your bait: Where in the wayback machine for these censored sites does it discuss holocaust denial?

So far, upon review, I haven't found a single mention of the holocaust in any of the banned sites.

Lots of factual details about multiple extraordinarily repugnant crimes against humanity committed in the name of the American people, however.

Do you deny those crimes? If so, why?
If you know that a crate exists then you can simply `cargo add foo` and have it download in the background while you get on with writing your script. If you don't know that it exists then you'll have to find it the first time, but you have that problem with python standard library modules too.

Writing scripts with Rust likely will be slower than Python, but I don't really buy that having functionality in crates is part of that.
Tehran Radio != Sovereign Iranian Government policy.

The Ahatollah also had this, very specifically, to say about the slogan:

"It goes without saying that the slogan does not mean death to the American nation; this slogan means death to the US’s policies, death to arrogance,” he said."
Why don't you give the war-monger routine a rest:

“It goes without saying that the slogan does not mean death to the American nation; this slogan means death to the US’s policies, death to arrogance,” [the Ayatollah] said.
Of course there will always be a better and safer design. But what about replacing the 50 year old designs currently deployed now with recent ones?
Large scale, automated and auditable camera surveillance coupled with AI, linked directly to a crime + mugshot database.

Do it right, and no liberty or privacy is lost for honest individuals. While petty thieves will lose liberty, of course.
Snapshots can be freed through reverse computing in NiLang. Reverse computing has subtle relationship with checkpointing, see author's blog: https://nextjournal.com/giggle/reverse-checkpointing .
The fact that the standard CSV reader is not good enough to actually use except in toy applications is itself an issue, frankly.
so you have to include it in the cost, and...
This is arbitrage, not front running. Front running requires not-public information.