skysight-inc/HackerNews huggingface dataset:
Funny this comes up again so soon after I needed it! I recently did a proof-of-concept related to bioinformatics (gene assembly, etc...), and one quirk of that space is that they work with enormous text files. Think tens of gigabytes being a "normal" size. Just compressing and copying these around is a pain.

One trick I discovered is that tools like pigz can be used to both accelerate the compression step and also copy to cloud storage in parallel! E.g.:

pigz input.fastq -c | azcopy copy --from-to PipeBlob "https://myaccountname.blob.core.windows.net/inputs/input.fastq.gz?..."

There is a similar pipeline available for s3cmd as well with the same benefit of overlapping the compression and the copy.

However, if your tools support zstd, then it's more efficient to use that instead. Try the "zstd -T0" option or the "pzstd" tool for even higher throughputs but with same minor caveats.

PS: In case anyone here is working on the above tools, I have a small request! What would be awesome is to automatically tune the compression ratio to match the available output bandwidth. With the '-c' output option, this is easy: just keep increasing the compression level by one notch whenever the output buffer is full, and reduce it by one level whenever the output buffer is empty. This will automatically tune the system to get the maximum total throughput given the available CPU performance and network bandwidth.
Locally-hosted alternative to cloud machine translation
> Microsoft char­ac­ter­izes the out­put of Copi­lot as a series of code "sug­ges­tions". Microsoft "does not claim any rights" in these sug­ges­tions. But nei­ther does Microsoft make any guar­an­tees about the cor­rect­ness, secu­rity, or exten­u­at­ing intel­lec­tual-prop­erty entan­gle­ments of the code so pro­duced. Once you accept a Copi­lot sug­ges­tion, all that becomes your prob­lem:

> "You are respon­si­ble for ensur­ing the secu­rity and qual­ity of your code. We rec­om­mend you take the same pre­cau­tions when using code gen­er­ated by GitHub Copi­lot that you would when using any code you didn’t write your­self. These pre­cau­tions include rig­or­ous test­ing, intel­lec­tual prop­erty scan­ning, and track­ing for secu­rity vul­ner­a­bil­i­ties."

I can't help but recall:

"Linux is a cancer that attaches itself in an intellectual property sense to everything it touches."

- Steve Ballmer, while CEO of Microsoft
> You can either be stubborn about tech, or adopt a grown-mindset and learn about new things.
> Their generated developed this technology - it can't be beyond them to learn it?

My point is that, actually, no: nobody alive predates the popularisation of the telephone (the oldest person listed as being alive at the moment was born in 1904 – by which point there were ~3 m telephone subscribers in the US [1] https://www.technofunc.com/index.php/domain-knowledge/teleco...).

I think the point about being resistant to learning new skills is one thing, extreme poverty and the historically incredibly rapid widespread adoption of the smartphone is another. A smartphone from ten years ago is as good as useless for banking nowadays. If you're an 80 year old pensioner on a fixed income, it may well both be a significant proportion of your income, have taken a long time to learn to use and not exactly be understanding of your (statistically quite likely to be present) visual or fine manual dexterity difficulties, and I can very much imagine that you feel locked out of society for no good reason.
> You can read the menu as long as you'd like before you get on the line to order. The waiter can always come back. I mean really...

No I can't, because lots of restaurants don't bother to put all possible options and their descriptions or even just a list of non-alcoholic beverages there. Wine cart is always there, but specifying a kind of tea seems like a big no-no. What kind of tea is that? Oh, some random bags which you can check in the kitchen in a few minutes? Do you have apple juice then? How large is it? Can you make it without ice? Maybe you have some other rarer drinks that I like? Can you remove pickles from the burger, even though there were none on the picture, but I've heard from the neighboring table that there are some?

An average kiosk answers all these questions because it _has to_ have buttons for these options. An average menu does not, it relies on me remembering all the possibilities and interacting with a waiter or a cashier.

And I'm not even talking fast-food restaurants where the menu is up at the top, only listing a tenth of the options with pictures, and the rest being written in a small font I'm unable to see without binoculars.
I bet I can get banned from Parler with my first 'parl'?
http://webcache.googleusercontent.com/search?q=cache%3Ahttps... is somehow still working for me, but it may be region-specific
I am appalled at the code I wrote when I was 8 years into the proffesion.

I would also be wary of any code I wrote after 16 years (though some I do... the very pure no dependency stuff!)

In 2 years that'll be 3x8 years and I hope to pass the audition.
I think GP is joking about getting just 6m40s of sunshine per year in England/Sweden.
Code pushed to GitHub is quite often not pushed by actual copyright holders and there no way to distinguish between it even if there was clause like this in GitHub user agreement.
Well a toddler isn’t making money off the information they are absorbing for one. If these are open to the public models that is one thing. But no, these are proprietary models whose sole purpose is to make money for large corporations.
wouldn't it be better to learn about where you are and how to find the north by looking at the sun?

then again, this thing could greatly teach how to do this, as long as you stopped wearing it eventually
Russia is 19% of your Uranium imports. Larger for natural gas.

You can easily source that 19% from Canada, Kazakhstan, Australia, and the US instead of Russia.
Why are we concerned with people saying horrible things per se, and not with the fact that the horrible things are amplified on a Twitter platform? In the conversation above, the smaller forums idea lets people go where they want. If you wander into an offensive place and you get offended, that becomes on-you, and then we do away with the complaint about Twitter promoting the bad and people getting offended inadvertently.

The idea of chasing after evil ideas is flawed from the outset.

It's not new, either, which is why this very long hacker news thread bothers me. I usually like to wade on on these topics more extensively, but here the entirety of the population is applauding free speech being a shitty idea, without any historical conversation.

Oh and it's incredibly US centric. Freedom of speech is a principle that was discussed in the Enlightenment and beyond, and fought for (first against religious authorities in ancient times, then against religious authorities in the 20th century). It happens to exist in the 1st amendment as a government limitation, but as a principle and a moral it is well beyond that.
This feels very "I made a transphobic comment and got removed"
Huh. The link somehow changed after I submitted it. I wonder if you read the wrong article?

Here's the original link: https://cedarlawpllc.com/2022/10/12/uw-paid-out-six-figures-...
As someone who has managed a team of SREs that kind of behavior would land someone on a PIP if done repeatedly. Sounds like you had a run of bad luck in teams.
ToS isn't some all-powerful thing, first of all. A lot of it is unenforceable nonsense. And I'm not sure how it really works with OSS.

For instance, what if I self-host an OSS project but someone puts a mirror on GitHub? Or just uses GH as a remote for their fork? Does that random person accepting the ToS now mean GH has carte blanche to do whatever they want with that IP?
Because complexity sells.
alternatively: https://archive.ph/MtiIa
It's tragically beautiful how the copyleft crowd is putting so much effort into drastically expanding the scope of copyright.

"I used the copyright to destroy the copyright."

That sort of plot never works in practice.
https://news.ycombinator.com/item?id=33238679
With the rapid pace of development in machine learning, the quality of seq2seq translation models are fast approaching what's available on cloud platforms. Convenience, cost and privacy are all good reasons to consider. In the case of low-resource languages, cloud translation may not exist.

Couple models to highlight (available on the Hugging Face Hub):

facebook/mbart-large-50: Supports translating between 50 different languages. https://huggingface.co/facebook/mbart-large-50

facebook/m2m100_418M: Supports translating between 100 different languages. https://huggingface.co/facebook/m2m100_418M

facebook/nllb-200-distilled-600M: Translations between 200 languages, including low-resource languages. https://huggingface.co/facebook/nllb-200-distilled-600M
Everything else aside, the design on this site is among the best I've ever seen. Amazing typography, great to read on a phone.
The issue with copilot is that it is not respecting clause 1.
> because for Gödel's theorem to actually work on theories of arithmetic the encodings of formulas have to be numbers

ASCII codes are numbers.

> but that's not as directly amenable to a rigorous mathematical proof

Why not?

> you technically have to prove that that encoding scheme doesn't lead to ambiguities,

ASCII is unambiguous. In fact, the only difference between ASCII and Godel numbers is that ASCII encodes strings as powers of 256 whereas Godel numbers encode strings as powers of prime numbers.

> i.e. every string has (at most) a unique parsing

Huh? That makes no sense. Did you mean that every number has a unique mapping to a string? Because ASCII certainly meets that requirement.

> The more technically relevant part about Gödel's proofs that doesn't just readily follow from the halting problem is the fact that incompleteness of first-order theories has only very weak conditions - Robinson arithmetic is already sufficient.

Why does that matter? This seems to me like an interesting bit of trivia about Robinson arithmetic, but I don't see why this matters to the main point. Any system less powerful than PA is trivially incomplete.
1) Can you point to negative implications of nuclear waste? Anyone that got hurt or harmed in Germany for example?

2) If it's too expensive it will not happen, no need for the government to step in.

3) Have a look at the link, some renewables like Biomass emit a lot of C02, all energy sources are trade offs
> nobody alive predates the popularisation of the telephone

I didn't claim that. I said it was the state-of-the-art until recently, and it was.

But I know what you mean.

(Except newer smart phones tend to have better support for accessibility as people realise it's more important.)
1) It is dangerous yes. That is the nature of the energy being so concentrated. But this concentration is a blessing because you don't need to mind nearly as much material, and it is far far easier to keep an eye on the waste. Where does the waste from coal/gas go? Into the air. It costs way more to try to contain the harms of those substances because they are the opposite of energy dense.

Nuclear waste is such a tiny tiny amount that we just keep it on site. It's solid. It's not going to leak out of its containers. It just sits in concrete casks on site. Even better, it still has 98% of the energy in it so you don't really want to get rid of it. It can be used in breeder reactors to extract more energy. I quote this too much, but all the nuclear waste the US has ever generated would sit in a single football field, 10 yards high.

2) Nuclear is capital intensive AND the only energy generation that is forced to pre fund its own decommissioning and cleanup. The increased operating costs of nuclear plants is largely due to intentional mismanagement b/c of politics. For example, in France they force nuclear plants to stop outputting power when renewables are generating. They prioritize renewables because that's what politics dictates. They also mandated a cap on power allowed to be generated by nuclear plants, forcing the closure of perfectly good and already paid for plants, so they could buy more renewables. These privatized energy markets don't want stable cheap energy because there's no money in it.

In addition, the US has largely forgotten how to build big things. But it can be done. The UAE just finished 4 1250MW reactors in 10 years. It will generate a quarter of their electricity, (basically) carbon free for 60+ years. Cost was 6B per reactor. Over 60 years, it's a steal. Renewables are only "cheap" in LCOE because the storage costs and capacity factor costs are often not included. Even if you build a megawatt of solar/wind, you really only get 20 to 40% of that peak capacity on average. In Virginia, we are building a wind farm for 10B that is 2640MW. And it is intermittent, off shore is usually 40%. You could get a 1250 MW stable nuke for that much. And it would last twice as long.

3) The main issue with solar/wind though, is that we literally don't have enough material to build enough of it. Not to mention the battery storage. It's not a matter of we can't mine fast enough, we literally don't know of the mineral reserves needed. Here's a presentation going over a report that find this: https://youtu.be/MBVmnKuBocc?t=2403
Computer says No
There are quite a few projects that didn't originate on Github. Some are mirrors of projects hosted elsewhere, some accept patches through other means, some include code that predates github. If get your linux kernel patch accepted by emailing it to the responsible maintainer, it will end up on https://github.com/torvalds/linux. But you never agreed to the Github ToS, all you did was agree to publish it under the GPLv2. Linus agreed to the Github ToS, but he can't give away rights he doesn't have, so he can't be giving Github any rights to your patches that go beyond the GPL.
I'm less certain on the payment part, but having a very accurate bathymetric survey of the entire path is important for inter-continental submarine fiber optic cable laying. The cable ship needs to know precisely what speed to maintain at every point in the path and how rapidly to pay out the cable for it to not lay taut across underwater valleys, and to conform to the shape of the bottom.
Usually the beliefs being excluded are things like "white people are superior to all others", "there is no reason for the English language to have different words for sex and gender", or "it's acceptable to use terms for immutable characteristics as insults", etc.

And let's be honest - those ideas are excluded in the name of inclusivity. If you interpret "inclusivity" as meaning "accepts everything", you end up at a paradox quite quickly. It's the paradox of tolerance, yet again. And its cause is the same thing: misunderstanding the goals based on a naive reading of the name.

Inclusivity isn't about including absolutely everything. It's about maximizing the variety present. And doing that does have the cost of rejecting people who drive others away.
I think the test for whether an AI is infringing or not should be:

Can this AI regurgitate the vast majority of the creative aspects of an original/novel piece of software with minimal prompting, to the point where the output code looks mostly and directly cloned to a reasonable person trained in the art?
We detached this subthread from https://news.ycombinator.com/item?id=33235298.
I asked, what are examples of beliefs that are excluded by CoCs?

Most CoCs I've seen simply state a variation of "don't be an asshole", "don't act like some people aren't actually humans", etc - which seems reasonable to me: being an asshole drives away contributors, treating some people as subhuman has a similar effect.

I have yet to see a CoC that limits beliefs (e.g. "no christians", "no muslims", "no atheists"), nor politics (e.g. "no democrats", "no republicans", etc), nor any other group really - I have certainly never seen any CoC that excluded sexuality or biology, and I would love an example because I think that kind of discrimination is important to acknowledge and avoid.

I'm sure that you could find some smaller projects that do shit like the above, but by and large CoCs are generally boring "respect other people in the community" drivel.
Not really clone. It's a fork from the last commit under a free license, after which Drone changed theirs.
Show HN: Using the new batch replication feature on MinIO
> Tell me how ML is different than the mind of a toddler ravenous for new information.

If a person published a work that clearly plagiarized or violated a patent, that person would be open to legal action.

I’m all for systemic change, but uses like this may end up having a chilling effect on human-created work.
It's not an oversimplification; it's the cruel reality of Canada outside of the major urban centres, where relatively tiny companies can flourish before either listing themselves on a foreign exchange, being purchased, or failing. In every major sector of the Canadian economy you'll find one or two dominant corporations, and most of them are helmed by, or advised by, hereditary rulership; sometimes you'll find a cartel operating with the support of the provincial government.

IE, basically nothing is done in the Maritimes without the approval of the Irvings:
https://en.wikipedia.org/wiki/Irving_Group_of_Companies

Sometimes it seems like there's competition and diversity in the market, but in practice there's not. Like in BC, where Forestry appears to have many players, but they mostly isolate themselves from one another and form a monopoly in their regions and they negotiate together with the Province to set the terms of their business; and the very small forestry corporations often take their product to market through channels provided by the larger players.

Where I live, the local Forestry company has been barricading public access roads and using rentacops to drive people off Crown Land; and it's tolerated and allowed, because forestry companies are given great leeway to act above the law.
Doesn't Copilot reproduce the exact expression given the right prompt, though?
Battery power mod allowed Tesla Model S to go 1,600 miles without charging
That's from 2019. I wonder if they're reactivated robots due to covid.
I would be wary about replacing a mirror and turning your head with such a system so its main advantage that you don't need to take your eyes off the oncoming road is moot.

As a supplemental system the advantages would include redundancy, lack of a blind spot, and better situational awareness even when you're not planning to change lanes.
Would an ROV even register C'thulhu if it saw it?
The blog post is littered with React code (plus Apollo). Which part of the problem was specific to the workers - and how can this lesson be generalized to any FE framework, or no framework at all?
I haven't seen this for quite a few years but I use one of the major carriers. I assume it may still happen with more budget options in the US.
This is funny to me in a way. When I look at my very first few non-trivial Haskell projects, I still like the code. Are there ways to improve it? Things I've learned? Sure. But the code is still perfectly good and fine. Maybe things are just different outside the Turing Tarpit.
This woman is truly living the Gandhi quote, be the change that you want to see in the world. It is a bit remarkable that her efforts were recognized by the Queen.
The current github terms of service don't seem to mention this use when they describe the license granted github.

https://docs.github.com/en/site-policy/github-terms/github-t...

4. License Grant to Us

We need the legal right to do things like host Your Content, publish it, and share it. You grant us and our legal successors the right to store, archive, parse, and display Your Content, and make incidental copies, as necessary to provide the Service, including improving the Service over time. This license includes the right to do things like copy it to our database and make backups; show it to you and other users; parse it into a search index or otherwise analyze it on our servers; share it with other users; and perform it, in case Your Content is something like music or video.

This license does not grant GitHub the right to sell Your Content. It also does not grant GitHub the right to otherwise distribute or use Your Content outside of our provision of the Service, except that as part of the right to archive Your Content, GitHub may permit our partners to store and archive Your Content in public repositories in connection with the GitHub Arctic Code Vault and GitHub Archive Program.
It's so sad how unions were demonized in recent history. Even on HN I see a lot of commenters making that tired old "lazy union worker" argument come out of the woodwork with any unionization thread.

Like, why the hell would you not want to collectively bargain? You really think you have more leverage with your employer as an individual? What negotiation book taught you that strategy, the one called "what not to do"? Its always ironic seeing threads about how software engineers are fed up with stupid corporate stuff, like the interview song and dance or whatever else, then fail to see that by unionizing, software engineers could dramatically change how the entire industry works, and by continuing to just jump ship in hopes of finding better pastures they perpetuate this broken system that just finds another worker to exploit.
Which clearly indicates that the fines need to me much higher, + probably specific accountability for individuals who made the calls, rather than just the corporation itself.
It makes the headlines for Solana though because everyone expects their transactions to confirm within 500ms not one hour.
Maybe not real "demonstrations", but users of popular websites tend to riot when ui changes.

On wikipedia, the relationship between editors and devs can often be quite tense.
The forests near mine and just about everywhere else on the entire planet have elevated levels of BEING ON GODDAMNED FIRE thanks to coal-burners.

No there's not history. There's not emotions. There's god-damned stupidity and a refusal to evaluate risk at the top level of government, that has condemned hundred of millions.

I've lived near irradiated areas too. There was zero justification for this.
Bugs and unexpected behaviour catch us all.

I’m not saying they’re intentionally lying, but that one possible explanation is it looking through non public repositories
Yeah there way fewer mosquitoes in Van than at the arctic circle.

It’s like the cold preserves them like a deep freeze.

And you can’t get much more standing water than in Vancouver.
Soil scientists and some conservationists will tell you that 95% of what's a centimeter underground is unknown as well.
It may be that some of us didn’t know there was an extension that did this in vscode! ;) I definitely wasn’t aware of it until your comment.

Are you using LaTeX-Workshop?
ECS/Fargate for long lived things. Lambdas for short lived things.
Can you elaborate on what makes it so? Changing font sizes, boldness, lines etc...
> Steve Ballmer

They have some really good blow in Redmond.

If anybody could win an award for being coked up and sweaty on stage...

https://www.youtube.com/watch?v=Vhh_GeBPOhs
Details.

"Cash-less" society means loss of anonymity.

The matter is not with options, but with lack of options.