skysight-inc/HackerNews huggingface dataset:
The application backing use case is best suited for when you have parts of your database that get updated periodically and need human review. So you have a production database that you serve to your customers. Then you have a branch / fork of that (dev) that your development team adds batches of products to. Once a week you do a data release: submit a PR from dev -> prod, have somebody review all the new copy, and merge it once you're happy. If there's a big mistake, just back it out again. We have several paying customers building products around this workflow.

As for lots of people collaborating on data together, we have started a data bounties program where we pay volunteers to assemble large datasets. Two have completed so far, and a third is in progress. For the first one, we paid $25k to assemble precinct-level voting data for the 2016 and 2020 presidential elections. For the second, we paid $10k to get procedure prices for US hospitals. You can read about them here:

https://www.dolthub.com/blog/2021-02-15-election-bounty-revi...

https://www.dolthub.com/blog/2021-03-03-hpt-bounty-review/

What's cool is that novices can make a really good income from data entry as a side gig, and it's two orders of magnitude cheaper than hiring a firm to build data sets for you.

You're right that the site is kind of vague about what dolt is "for." It's a really general, very multi-purpose tool that we think will get used a lot of places. Here's a blog we wrote a while back about some of the use cases we envision.

https://www.dolthub.com/blog/2020-03-30-dolt-use-cases/
I find Weinstein very irritating. This whole GU thing is just another example. It is the typical mix of “I have discovered the extremely important X, the establishment is oppressing me.” So far X has included a theory of everything, a conspiracy by academia to keep wages low, a nobel prize worthy discovery by his brother on mouse models and a nobel prize worthy economic theory he helped his wife develop. He had some good stuff on his podcast sure but it just isn’t worth the effort when it is interspersed with these self-aggrandising narratives. I also question his motives when he quit recording his podcast for no reason despite talking about how lucrative it was (?) and going on and on about the importance of the community he was building, and the ‘distributed idea suppression complex’ which his podcast was supposed to combat.
With RPN you can just type facts in as you think of them, and figure out how to combine them later. With conventional entry, you have to have the entire equation in mind from the beginning, or backtrack to add brackets.

RPN has no use for brackets, because there is never any ambiguity.
"don't assume you know better" than what? Why is it assumed that I'm wrong by default? Anybody who has an opinion about this can test it themselves.
A related concept that might resonate with some is "How many more times will you pick up your kids?".

Life perspective Fermi questions.
If anyone from the dolt team is reading this, I'd like to make an enquiry:

At bugout.dev, we have an ongoing crawl of public GitHub. We just created a dataset of code snippets crawled from popular GitHub repositories, listed by language, license, github repo, and commit hash and are looking to release it publicly and keep it up-to-date with our GitHub crawl.

The dataset for a single crawl comes in at about 60GB. We uploaded the data to Kaggle because we thought it would be a good place for people to work with the data. Unfortunately, the Kaggle notebook experience is not tailored to such large datasets. Our dataset is in a SQLite database. It takes a long time for the dataset to load into Kaggle notebooks, and I don't think they are provisioned with SSDs as queries take a long time. Our best workaround to this is to partition into 3 datasets on Kaggle - train, eval, and development, but it will be a pain to manage this for every update, especially as we enrich the dataset with results of static analysis, etc.

I'd like to explore hosting the public dataset on Dolthub. If this sounds interesting to you please, reach out to me - email is in my HN profile.
Weinstein doesn't 'believe' in peer review ...
That depends on the person using it, there isn't a fix list provided by the devs of vscode. For me it's some of the following:

It can be a remote workstation you'd otherwise have to RDP into it. Sometimes RDP is annoying due to network conditions. Via vscode this works great, even at the worse case scenarios of connection drops. Mind you, it's not just source code editing, but debugging, local server management during iterative development. Experience is just like if it was local. Can have multiple projects (directories) opened at the time via a single vscode instance, or multiple instances of vscode running different projects (or modules of the same project) all connected to the same ssh target.

It can be a local container filled with tons of prerequisites/deps, like application server runtimes, support files, all that stuff that i don't necessary want (or need) to pollute my host just because of that one thing right now i will be working on. I just destroy that container when i don't need it, or do anything with it without fear of consequences on the main host. Another case would be a container that perfectly mimics final production environment with all its config.
This is awesome. Thanks for starting it. I added a site via PR.
It does work. What doesn't is the aos library which is responsible for the animations. You can take it out if you'd rather it work for this edge case.
I've watched two of her videos and think she is a talented explainer. But I think she needs to have more people read her scripts before getting in front of the camera, because both of them contained glaring errors. Since she bristles and gets rather defensive when her errors are pointed out, I am not optimistic that these videos are going to get much better. In short, I don't see how being “a layperson familiar with these people” informs you who us correct and who isn’t in any particular instance.
Airline (from the article): "The possible issue was related to an engine oil pressure or volume indicator and not the result of anything related to the MCAS system linked to two fatal 737 MAX crashes in 2018 and 2019 that prompted the plane’s 20-month grounding, it said."

Boeing doesn't make the engines.
Linus Torvalds: A note on the 5.12-rc1 tag
I think people are missing the bigger picture... This doesn't have to be 100% correct or it's worthless. Sometimes there's gold in a failed effort. Maybe some part of Weinstein's approach moves the field forward even if the proposal is not complete. The physics community has been obsessed with string theory for a generation. Maybe this is a way to restart other areas that might lead to something.
It's easier if you imagine identical fans for the compressor and turbine but gearing so the turbine can spin faster. Of course the gasses will take the easy way out the turbine. At some speed, air stops going out the compressor and comes in instead. Burning fuel keeps the gas expanding so there's still a lot more volume to go through the turbine. Then adjust blade angles and turbine diameters to get rid of the gearing.
ffmpeg is the most intimidating piece of software ever crafted, and it’s not even close
Huh. I just read the spec. Not quite three 'dimension', but looks like exactly what I was asking for: a (reasonably) automatic and transparent record of previous values, as well as timestamps for when they changed.

I'll call this a "you learn something every day" and a "hey thanks @tthun (and @predakanga)"
This is the dataset on Kaggle - https://www.kaggle.com/simiotic/github-code-snippets
A while ago, yes. https://meta.wikimedia.org/wiki/Sep11wiki
Jane Austen’s Wince-Inducing Descriptions of 19th-Century Dentistry
"At the time Austen penned the letter, dentistry was still painfully unstandardized. Treatments varied widely, and troublesome teeth were often yanked out by people from all sorts of professions. 'In London and large towns, surgeons were available to pull out teeth, but elsewhere, apothecaries, quack tooth-drawers, and even blacksmiths might oblige,' write historians Roy Adkins and Lesley Adkins in Jane Austen’s England: Daily Life in the Georgian and Regency Periods."
I guess this is a design decision. Some services might be ok with the "if you lose your password you may lose everything without recourse" approach. I think it would be a tough sell for a lot of customers. Is iMessage really handled this way? I can believe that Signal is, considering how often they remind me to remember my PIN.
My point is: How do we know what the sit author is saying is accurate?
If he was just a random researcher (and was actually putting it down in a falsifiable form), fine, but he’s a public figure. Half a million followers, many of which now think they have THE unified theory and are going to waste the time of actual physicists.

And Don’t forget Brandolini’s Law: https://en.wikipedia.org/wiki/Brandolini%27s_law
I'd love to be proven wrong, but I don't believe this is correct.

The IDE shell is the same, but in (for example) Rider there are features that are in Rider but not in IDEA.

Likewise RubyMine. I suspect WebStorm and PhpStorm, too.
I am glad the merit of ideas are proportional to the likeability of the author.
ffmpeg is a command designed to keep me grounded. I rely on a recipe to convert FTA TS mpeg streams to an mp4 compression I can tolerate, for my digital pvr stash of free-to-air movies.

Handbrake worked too, sometimes easier for things like 4:3 deletterbox or ad removal or b&w restoration on colourised screening.

I still use mpeg_streamclip for some things. I used to use an Italian PhD students Java tool to fix TS flags without explicitly reencoding. ffmpeg can probably do all the things I am doing, if I look harder.

I have no idea what most of the options mean beyond bullshitting, and I rely on the wisdom of others "try adding this option"

It's digital alchemy. Do not offend Yagoth, incanting for Morgoth. The candles are optional but the goat skull is not: i tried removing the -a: option but something broke.
https://news.ycombinator.com/item?id=26351702
That doesn't let you merge in someone else's changes easily. Aka two team members make changes to the (local copy of) database and now you want to merge it.

I mean sure you can have another database tracking their changes and a merging algorithm but that's what dolt is doing for you
I think you are right. I think he used the line filter features to drill down to specific parts of a book he was working on.

It sounds very cool, but I wouldn't want to be bound to a mainly abandoned text editor if I were one of the most celebrated non-fiction writers. Although maybe it is his secret sauce?
IDEs like IDEA and Visual Studio give me perfect tool for a perfect learning experience: As a hobbyist I'm extremely picky about what I want to learn. For exmaple, when I'm learning C++ and game programming, I'm not interested at all at the inner workings of Git or Makefile or whatever that is not relevant at the moment.

I need something that I can sit down, install some libraries on, config a bit within, and then it works to some extent that I can start coding and with one click it can compile and run. I also need intellisense out of box for a better coding experience. Debugging experience should also be pleasant without installing anything. Of course it's a bonus point if there is a plugin system and I can potentially write my own.

I tried Vim and realized that:

- It will take many months to reach the same comfort of an IDE out of box.
- I'm reaching 40 and don't have many months to live, so wasting any for anything not in my target list should be a sin.
- I probably won't code professionally for my life so it's OK not to learn a lot of things (e.g. I only Git with myself)
- If somehow coding becomes my profession I should be able to use the same IDE for work as well.
- My coding skill is too low to make any advertised productivity increase of the Vim/Emacs people looks insignificant comparing to the time I nheed to debug some trivial errors.

Thus I dropped any learning towards Vim/Emacs/VSCode. However if I want to pick up one of them it's going to be Emacs because I really like its note taking facilities.
First - most of these places are running pretty advanced virus / malware scanners. So when you go to download a file from drive etc, a scan is done (at least for files that are not enormous).

This is actually a big issue sometimes for folks who use google drive, because malware will infect their files, they will then be synced to google, then blocked from downloading them ever again!

That leads to support requests list this:

https://support.google.com/a/thread/60528209?hl=en

Even if you pay the ransomeware fee, google WILL NOT let you access your own files again. So years worth of files - GONE.

They do use different origins for these services. Google DOES actively ban users (everything, youtube, drive and email) from their service even users using google services (vs a third party upload service). Ie, if you are going to run a phishing scam, host the image on this service, not google, or your drive account + a lot of other stuff is at risk. I've even seen google follow links to other accounts your google account is an admin on, so can have business impacts and more.

I don't know where the idea comes from that google is very hands off on this stuff, they run a major spam fighting op that blocks lots of even potentially legit email, they do tons of scans through chrome, they do advanced stuff for opt-in domains on their paid platforms (even more intrusive but let's them pick stuff up behind password locked pages etc).

This last one can really confuse site owners, when NON PUBLIC content results in site bans.
imagemagick is close for me, but I do use ffmpeg and magick often, but as others have said feel as though I have to relearn each as soon as I have do something nonbasic.
> It's way more important that CLIP learned to read (crudely)

It learned to detect the features that make up the word "iPod", and match them against other features. I don't see that as being any different than detecting the features that make an apple, or a car or a face. It's just detecting the minimum number of features to distinguish the images in a training set.

I'm generally disappointed with how breathlessly this forum gets excited about NN software. It doesn't 'get' images as a whole and compare them. There's no symbolics going on underneath, it's just picking up 'something' in an image and matching it with 'something else'. It's clearly nothing like how we see, let alone how we think or imagine. It's impressive and a useful innovation for sure, but it's not even on the ladder to our capabilities yet and I'm not convinced that it ever will be.
Pétrolette
After seeing some posts here on HN about FFMPEG I tried looking into green-screen joining two Twitch streams together.

Sometimes a streamer wants to overlay his stream with a tournament channel, but because of copyright they can't. It'd be nice to have an easy way to set that up, if twitch won't do it on their end the user can do it themselves
Is this your website? http://www.dotnom.com/ I like it, very fast and clean!

Would you consider setting up TLS?
Are you saying you buy Weinsteins claims?
Not a big fan of those "combined" swiss-army-knife clients. MobaXterm is another one. Using separate clients is better, so you can keep everything updated.
What are the consequences for Jack Dorsey if he does sell it again?

At least an artist copying their own painting has to produce a new object.
People want three things:

1. publishers want to be able to put content on the Web without undergoing background checks

2. everyone wants to be able to discover content with as little friction as possible

3. consumers don’t want to drown in unwanted crap

The incomprehensible Algorithm is the result of trying to square that circle. Give up any of those requirements, and the arms race would end:

Give up #1, and it’ll be possible to do all of the rules enforcement reactively, with no algorithms and no inhumane call centers, because when someone is banned, they’ll stay banned. The ban will be tied to a legal name and anyone caught ban-dodging can be sued.

Give up #2, and it won’t matter how much spam you make available on the web because nobody will fall victim to it. The web becomes less like a publishing platform and more P2P, because you basically only find content on there through your in-person social contacts.

Give up #3, and you don’t need Safe Browsing any more. Good luck selling that to everyone, though.

In order to sue them, you need to come up with something that they should’ve done but didn’t. Having a human review every web page that’s ever published is obviously dumb, so they’re going to have to go with the algorithmic approach.
Luckily, this blog post was written by Timothy Nguyen rather than Sabine Hossenfelder, so her level of personal fact-checking is largely immaterial. For a more technical version, here is Nguyen’s paper, https://timothynguyen.files.wordpress.com/2021/02/geometric_...

I must say, it is a little weird to get the public involved in an intellectual debate about theoretical physics which is so far hosted on a podcast and a blog, rather than in peer-reviewed journal articles.

Laypeople should probably wait a couple years for this idea to be hashed out more formally.
This seems like some race bait to me. As you may have guessed, the article says that overconfidence leads managers to see leadership potential and allow reports to "fail up", and of course this is a problem primarily caused by evil white men. Because as we all know, every white man is overconfident, and nobody from any other race or sex is nearly as bad.

Would not recommend reading this.
We'll be in touch :)
As opposed to, you know, providing proof for your claims?
I have a $HOME/bin folder full of bash scripts invoking imagemagick or ffmpeg one liners.
Barely. A passenger airplane can fit a certain number of people. Their suitcases are unlikely to fill the cargo hold, so the airlines sell the extra cargo space
Sure, rabbits are happy enough with mowed grass, but if you asked them, they'd probably rather you didn't cut the tender tips off all the time. :) And the species of birds that hunt worms in the ground are a very small subset of what you could find in a city. (I would venture you're mostly seeing robins.)
Not to their other ides, just for Intellij.
> Single-quotes are great for indicating "there is no interpolation here" and for strings that embed double-quotes.

I used to think that too. But it doesn’t really help that much, because interpolation is fairly obvious with syntax highlighting. I changed my mind and I prefer consistency, and have every string the same. Also, if you need to add or remove interpolation then you don’t have to change the type of quotes.
Ask HN: Research Heavy Startups in Germany?
I am living in Germany and have noticed a weird kind of startup niche that I have not witnessed elsewhere.

Usually found in some notable student city, this startup has 3 to 4 technical co-founders, all with Ph.ds and none with industry experience. Their product/service is some highly technical idea still in research phase. Their only output is publications. Some have a small number of employees, usually developers writing helper code. Often hiring Ph.ds.

I am wondering if any German residents could tell me more about these enterprises. First of all what is the main goal of such setups? Is there a real belief that these enterprises will make money, or is it just a hedge, in case they could be profitable?
Do these kind of enterprises get funding? And if they get funding is it from industry or some government grant? Have you worked for such an enterprise as a founder or employee? Do you recommend it?
Tossing my JS implementation onto the pile as well, I guess. Missing the flood fill command; picked the wrong graphics library for this and it was too late by the time I'd realized it. ;) Easy enough to change over to something else, but it's time to move on.

https://codepen.io/Fortyseven/pen/rNWZpJb
Old-style AI [1] could learn how to exploit the rules of the game too.

[1] https://en.wikipedia.org/wiki/Eurisko
Why don’t they just post something on arxiv as everyone else seems to.
I am saying GP's "I find Weinstein very irritating" is a non sequitur.
"...most of us have endured years of mindless criticism of our decision, usually from WordPerfect users..."

Wow. it's like stepping through a time portal.
Elon Musk Insane Car Collection
Weinstein has been far less forthcoming than Mochizuki, but he has already gotten far better treatment. Mochizuki is an actual career mathematician, and not merely someone with a PhD.

But the refusal to be transparent in communication has made the mathematics community severely unwilling to continue to expend efforts into saving / communicating with Mochizuki's work.
A little further south, the Mogollon people [1] are also getting more attention. Lots of the groups in that area moved north and south based on periods of cold or droughts, came into conflicts, and so on (at least this is the current theory behind things like the Gila Cliff dwellings and Mesa Verde and similar cliff dwelling sites, AIUI).

[1] https://en.m.wikipedia.org/wiki/Mogollon_culture
It seems like a certain percentage of people are susceptible to Weinstein type claims. Like people with anti vaccine stuff or natural remedies.
Replace "China" with "CCP" - and yes, however it's obvious as to why that is - the control systems, the censorship systems, the confirmed genocide [by definition, cultural genocide] of Uighurs, and things like not allowing the UN to go into China to investigate claims directly are a few examples; it's not to say different administrations in the US have been part of bad/unacceptable behaviour as well, however the CCP is a different - "permanent" leadership/hierarchy that isn't voted in by the general population, so it's not comparable.
I see the BBC is conducting honest reviews on its own staff and its place in society.
It’s funny, this is the kind of thing that’s meant to end bike shedding, but to me this is the ultimate bike shed.

I like linters, and having a good default config out of the box is a good idea. But the idea that you need an entire language community to agree to only ever do anything one specific way is just kind of silly IMO.

What projects like these say to me is that there are too many teams with poor leadership who spend far too much time bickering over things like which linter rules to use, and thus feel that invoking a higher power (the “standard,” in this case), is the only thing that will save them.

Now that this problem is “solved,” what new crisis caused by a lack of leadership will present itself?
Whuffo I want to read no Tale of Two Cities? Whuffo?
Photo a) Cave inhabitant is an interesting surprise and really bizarre, an antique branch of arachnida. Maybe a new relict species (would be the third in Europe).

Totally harmless to humans and a real creature. Harry Potter's fans may remember it from the third film.
Say, network configuration.
This was discussed earlier: https://news.ycombinator.com/item?id=26365579

Here is the documentation on ERC-721 (NFTs): https://ethereum.org/en/developers/docs/standards/tokens/erc...
> While the Deltic engine was successful in marine and rail use and very powerful for its size and weight, it was a highly strung unit, requiring careful maintenance. This led to a policy of unit replacement rather than repair in situ. Deltic engines were easily removed after breakdown, generally being sent back to the manufacturer for repair, although after initial contracts expired both the Royal Navy and British Railways set up their own workshops for overhauls.

I guess nobody wanted to maintain them.