skysight-inc/HackerNews huggingface dataset:
I'd love to hear tptacek's view on the pros and cons of "authenticated connections," where the client uses asymmetric crypto to establish an authenticated-as-the-principal bytestream, and then issues a bunch of unsigned requests over that bytestream.

In practice, I'm talking about (1) "SSH public-key authentication to GitHub" (or to an EC2 or GCE instance), or (2) using FIDO2/WebAuthn (or TLS client certs...) to authenticate an HTTP connection or browsing session.

One major pro is that this is a lot more widely implemented and standardized than "authenticated requests" -- there are lots of reasonable implementations of SSH pubkey authentication or FIDO2/WebAuthn, compared with trying to sign an individual HTTP request. And that maturity brings robustness and security, e.g., I like that I can have my SSH private key (or my FIDO2 private key) on a tamper-resistant hardware device and not worry about some rogue software stealing my private key, whereas trying to find a hardware device to hold my AWS credentials and do the AWSv4 signature is a different story. Any bearer-token-based scheme seems... a lot scarier in that sense.

I'm less clear on the practical cons (assuming "authenticated requests" is not available). With SSH keys or TLS client certs, I could imagine it's annoying because only the terminus of the secure connection can verify that the client is who it claims to be, and maybe it's annoying to have your SSH/TLS termination component directly talk to a user database to authenticate individual clients and then attest that it did so to the rest of the backend. But... somehow GitHub/GitLab/Bitbucket all manage to do this at scale, and with WebAuthn/FIDO2, any component can be the one to make the challenge. (I suppose only recently can you make a "user presence not required" challenge, so maybe that's why nobody uses this in the non-presence setting...?)
"False flag" is pretty close to loaded language these days.

"Spurious error" would probably be a better term.

Thanks, BTW, amazing tool.
If you have some brick and a couple of pizza stones, try making a pizza oven. No mortar, but puzzle it together.

Here's a profile:

+--------------+
+--------------------+ +---------------+ |
| Top Pizza Stone |<--+ | | |
+--------------------+ | +-----------------------------------------+ | |
+----+-----------------------------------------+-----+---------+-----+ |
+--------------------+ .-----------------------------------. | | |
| PIZZA! |<---------( ) | | |
+--------------------+ `-----------------------------------' +---------------+ | <--These are
+-----------------------------------------+ | | | all brick
+--------------------+ +----+-----------------------------------------+ | | |
| Bottom Pizza Stone |<--+ +-----------------------------------------+ +---------------+ |
+--------------------+ | | | | Note the gap
| | | |at the back of
| X X +-----+---------+-----+ | the bottom
| X / \ X / \X | | | pizza stone
| / \/ \ \ / \\ | | |
+--->| / | | | |\ +---------------+ |
+--------------------+ | | | \ / \ / | | | |
| Fire Box |---+ | \ /\ / / \ / / | | |
+--------------------+ | +----\ /--V-\ /---V\ /--+ +---------------+ |
| +-----V------V------V---+ | | |
| | | |
+-----------------------------------------+---------------+ +--------------+

View from the front:

+---------------+ Upper stone +---------------+
| +-----------------------------------------+ |
| +-----------------------------------------+ |
+---------------+ .-----------------------------------. +---------------+
| | ( PIZZA! ) | |
| | `-----------------------------------' | |
+---------------+-----------------------------------------+---------------+
+---------------+-----------------------------------------+---------------+
| Bricks! | Lower stone | Bricks! |
| | | |
+---------------+ X X +---------------+
| | X / \ X / \X | |
| | / \/ \ \ / \\ | |
+---------------+ / | FIRE! |\ +---------------+
| | | \ / \ / | | |
| | \ /\ / / \ / / | |
+---------------+ +----\ /--V-\ /---V\ /--+ +---------------+
| | +-----V------V------V---+ | |
| | | |
+---------------+-----------------------------------------+---------------+

Tips:

Try to use as few bricks as possible - say 30, but extra points for as few as you require to build

Square pizza stones are easier to build with - but round can work too

Takes about 25 minutes to get to temperature of 800f but careful, it can get to much more and your pizza with simply burn

Fire brick takes much longer to heat to temp

Wood peel to place pizza and metal peel for taking out

Rebuild often and without reason
I suppose, but it sounds a little like: don't bother testing, just use good code.
Idk. I wasn't the one making the choice. I am just the one trying to make the best with what I have inherited.
I never trust articles without a byline.

Who wrote this? Who funds them? How can I know that they aren’t introducing bias to their assessment in their own self interests?
This has been my go to pizza recipe for years. Super stoked to see it on the front page of HN.

My favorite step is “jailbreaking” your home oven with a pair of bolt cutters to use the cleaning cycle to get pizza oven temps.

> I've cook good pizzas at temps under 725F, but never a great one. The cabinet of most ovens is obviously designed for serious heat because the cleaning cycle will top out at over 975 which is the max reading on my Raytec digital infrared thermometer. The outside of the cabinet doesn't even get up to 85F when the oven is at 800 inside. So I clipped off the lock using garden shears so I could run it on the cleaning cycle. I pushed a piece of aluminum foil into the door latch (the door light switch) so that electronics don't think I've broken some rule by opening the door when it thinks it's locked.
I also was unclear on what the scorecard was. From elsewhere in this thread it's something to do with "Consumer Reports", which I've never heard of. Wikipedia helped with the rest.

"Consumer Reports graphs formerly used a modified form of Harvey balls for qualitative comparison. The round ideograms were arranged from best to worst. On the left of the diagram, the red circle indicated the highest rating, the half red and white circle was the second highest rating, the white circle was neutral, the half black circle was the second-lowest rating, and the entirely black circle was the lowest rating possible"
A simple & lazy bread machine dough (they have dough settings) will produce a damn good pie, given quality toppings. Best if you can rest it at room temp for a few hours after the machine's cycle finishes, but also OK if you can't. I've done fancier doughs, and it is better, but I mostly just do that these days. With that, you can either get some pizza-specific tools (peel, stone—you need the peel) or you can just make pan pizzas in a cast iron pan, no extra stuff needed—and that method's lower-mess. The down side is it's harder to do multiple pizzas quickly in a row, unless you have multiple cast iron pans, since you can't construct a second one while the first is using the pan, and when it comes out the pan is no fun to work on for a while, as it'll be quite hot.

Getting started making decent pizza at home is as simple and easy as a bread machine and a cast iron pan (or two).

(pro tip: get small cans of tomato sauce or crushed tomato [yes, use canned] and mix salt, way more black pepper than seems right, and some oregano [fresh is great if you have it, but dried is fine], directly in the can. Boom, nearly zero mess [one spoon, perhaps] sauce, on the cheap, and it's good. You don't need to pre-cook it, just put it directly on as is. You won't be able to beat this cheap, lazy method by too much unless you've got garden-grown sauce tomatoes)

[EDIT] other pro tip: you can build a pizza on your peel while another's in the oven provided you have a large cutting board. The pizza coming off the stone will be stiff enough that you can just shove it onto the cutting board. A peel provides little benefit for taking a pizza off a stone in a normal home oven, though it is very nice for putting it on. Further pro tip: avoid pretty, finished wood peels. Smooth-finished wood makes the dough stick way worse.
The patents too. An IP lawyers dream...
I'm not "we" but I have some experience in this area.

Computers are fast, basically. ACID transactions can be slow (if they write to "the" disk before returning success), but just processing data is alarmingly speedy.

If you break down things into small operations and you aggregate by day, you can always have big numbers. The monitoring system that I wrote for Google Fiber ran on one machine and processed 40 billion log lines per day, with only a few seconds of latency from upload start -> dashboard/alert status updated. (We even wrote to Spanner once-per-upload to store state between uploads, and this didn't even register as an increase in load to them. Multiple hundred thousand globally-consistent transactional writes per minute without breaking a sweat. Good database!)

apenwarr wrote a pretty detailed look into the system here: https://apenwarr.ca/log/20190216 And like him, I miss having it every day.
This is a huge potential win for software supply chain security. If it becomes widely deployed, and the standard for major Linux distros, I think it will really put pressure on all software ecosystems (from app stores to language-specific package managers) to close this trust gap.

Right now, with the prevalence of automatic updates, I think users and the software industry as a whole just accept that if you trust a developer once, you trust them to have effective control over your device (or at least the data accessible to their app) forever. That's not a sign of a healthy ecosystem, and it provides an attack surface that is only going to be targeted more and more by governments.
What can we do with a captured asteroid?
That would be a fun product actually.. kickstarter idea?

B&W TV w/ built-in roku-like/streaming capabilities.

I wonder how expensive it would be to manufacture a B&W TV these days
Thank god, I'm not him.

I couldn't stand my haircut in the mirror.
Latest Ryzen's CPU perf and max 128GB ECC UDIMM should be enough for most users, but it still lacks homelabby features and flexibilities. I need more than 16x PCIe lanes that supports ACS and IPMI, so I go for EPYC build. It's great except idle power consumption. I with they improve it to Xeon level, but maybe chiplet architecture (8CCD and massive CCD) isn't good about it.

For hypervisor, I recommend Proxmox VE.
I find it astounding that people here can not even grasp the concept of why Discord is popular. I am perfectly capable of hosting my own server and doing everything manually. But it is clear as day why discord wiped out the competition while most of the comments here seem dazed by the fact and are left wondering why people don't just use IRC.

It's no wonder so many projects and FOSS tools fail to gain large userbases when it seems that most developers seem to be living on another planet entirely.
Can you give examples from your experience?
The result of that is what is played up and down the charts, learned from what sells 'records', and embedded into almost anything new to be more and more refined to the taste of the majority/masses. Also the stuff playing in supermarkets to make you buy more.
Sorry to hear that, hoping things improve for you.
> but rack-mounted hardware is insanely loud

A 1U chassis stuffed with high power dissipation components will be insanely loud like a jet engine. But it's easy to avoid that. The key for quiet is to use 4U chassis for anything that requires significant cooling so it has large fans.

On my home rack I have three 1U computers, two are Atom-based (fanless with SSD, so zero noise) and one is a Celeron-based with slow fans (about as loud as my MacBook). The larger machine is a 4U with larger fans, so same sound level as any tower case (a 4U is literally a tower case sideways, with rack mounting tabs).
There are cameras inside of the cars in AVs that face towards the passenger area - it's trivial to have someone check for crud in the back of the car before rides and send it back to the depot for cleaning. And automating that via ML would be easy considering the simple environment.
Hiring software development interns for startup
$25/hr. Interview is data structures and algo questions. Email chen.john233@gmail.com with resume. Thanks.
i never bought in to this, since the team was working hard, and had to support the odd production issues as well.

However, the team did inflate the points for some stories, and then moved some stories across sprints from time to time.

i hated the slavedriver attitude, and it was one of the reasons I left.
Google’s internal memegen website does not confirm that. I’ve never seen anything so critical of Google.
Pokémon GO had that problem. Lots of "flyers" hacked their GPS for fun and profit.
great idea and traction!
do patients know how to take their own heart tracing?
It sounds like you've been very lucky in a few respects, and that certainly wouldn't lead you question whether or not it's a good career choice. Supposing those things that you've done are true, would you feel the same way if you were part of the downsizing, or you never found yourself in the position to affect sales in such a way, or you weren't compensated for it, or you never got to know who the work actually impacted directly?
Boy that's nice. I read a whole lot less Twitter.

Net gain for me.
I've always hated any karma-based forum. I just don't participate in it. I've gone as far as to block karma displays on Reddit and HN through element hiding and running custom userscripts. It allows me to type without trying to please random nobodies.
Especially if the company is expecting the same output/productivity as the 5 day a week people!
I won’t say I’m always working but I have flexible hours and am far more interested in taking weeks off than fixed days.
Does PTO count towards those hours? Just give employees enough PTO to take Fridays off.
All of these maintenance issues exist with regular taxi fleets driving equivalent miles, though. The main difference is the taxi driver salary vs the cost of the self-driving tech plus some support and extra interior cameras and this should be in favor of self-driving cars. From the customer's point of view, self-driving cars might be slower but safer.
BTW, the biggest plastic problem in the ocean is not microplastics or straws, it is used fishing nets.... But either way, that isn't the biggest threat to our oceans, that would be industrial fishing. Eat less fish and watch Seaspiracy, the movie.
Hey. I am in a similar boat and would be happy if you can give some pointers on 'interviewing and negotiating properly' either here or on mail.

Is there anyway to reach you? Thanks.
(Just in case some Scylla employees see this YC News post)

Sigh...

I know this sounds like a nitpick, and I know it sounds like a broken record, and I know you probably work in a different team and there's "nothing" you can do about it...

But.

I went to your website, interested in your product. I'm your target market! This site needs to impress me, and people like me.

What's the first thing that I see? The website oh-so-slowly animates, sliding down to show some TechCrunch ad.

I don't care about TechCrunch. I care about high-performance databases.

But okay, I move to close it, but "No!" says your website, helpfully overlapping it with another animated slider asking me to accept your cookie policy so that I can be tracked by your marketing group.

Fine. I close both popups, and try to read the content of your site despite the animations every paragraph or so trying to distract me from the content. As soon as I scroll too far past the animations, a stupid chat bot pops up to overlay the bottom of the content as well.

I figure I'll just go to the meat of it, some whitepaper or technical documentation. Despite their miriad flaws, PDFs are thankfully not commonly animated.

The download link for your benchmarks asks for my contact details. It's not a link. It's a sign-up form for spam. I'm not an idiot. I don't want spam. I want to read about your database.

Your marketing team actively stops your target market from looking at your products. Perhaps that's an issue you should look into, because right now there are potential customers that simply never get to find out just how amazing your technology is, because their first experience of your products makes used car salesmen look upstanding and trustworthy.
The latency is a complex topic.

In order to be able to run so much stuff on MongoDB, we almost never run single queries to the database. If I fetch or insert trade data, I probably run a query for 10 thousand trades at the same time.

So what happens is, as data comes from multiple directions it is being batched (for example 1-10 thousand at a time), split into groups that can be processed together in a roughly similar process, and then travels the pipeline as a single batch which is super important as it allows amortizing some of the costs.

Also the processing pipeline has many, many steps in it. A lot of them have buffers inbetween so that steps don't get starved for data.

All this causes latency. I try to keep it subsecond but it is a tradeoff between throughput and latency.

It could have been implemented better, but the implementation would be complex and inflexible. I think having clear, readable, flexible implementation is worth a little bit of tradeoff in latency.

As to storage being source of most woes, I fully agree. In our case it is trying to deal with bloat of data caused by business wanting to add this or that. All this data causes database caches to be less effective, requires more network throughput, more CPU for parsing/serializing, needs to be replicated, etc. So half the effort is constantly trying to figure out why they want to add this or that and is it really necessary or can be avoided somehow.
> antitrust law is pretty much incoherent and illogical

Most things antitrust are incoherent and illogical. The unofficial plan seems to be literally to find market leaders who are offering substantially better products than the competition and then attack them for unspecified and likely immeasurable gains. Whether or not we've seen benefits from past antitrust actions, I don't believe measurements and observations of the actual outcomes are part of the debate. There is just an assumption that because they happened and big companies are bad ergo the outcome must have been good.

The article alludes to Google's 92% search engine market share as some sort of concealed monopoly. As a problem, this doesn't make sense! There is absolutely nothing stopping anyone switching to another search engine except the other search engines aren't generally very good. Google is better at providing search results than they are. Or presumably it is, I don't know since I stopped using Google Search a long while ago. This is a monopoly only in the sense that everyone agrees Google is a better option.

The problem with Google is that it is likely integrated with the US intelligence services. No antitrust suit is ever going to attack that; because it is the part that the government supports.
Isn't this the same for literally every service you use since they need a license to use it just to display it in app?
Show HN: Semi-Supervised Learning Using Noisy Student for Image Captioning
To solve the root issue, it would be better to move to open system like zeronet and peertube
Disclaimer: I know very little beyond what I've superficially experienced. Not being a spiritual person, I had a hard time thinking common Christian systems made much sense. It seemed too much concentration was given to the hierarchy or building. I then met the Quakers. What I experienced there was much different. I'm not familiar enough with their customs so I'd rather not give bad information. I will suggest visiting a Friends Meeting if you have the opportunity.
I suspect HN tends towards less likely to be enticed by shinny things and marketing hype cycles. My phone is pushing 4 years at this point. I always buy with the expectation that I will get 3-5 years out of any phone/laptop.

Really want to see data on this one.
You could create a black hole wifi SSID or vlan to frustrate their efforts if this was discovered to be the case.
Can you block samsung.com at the DNS level and be alright or do the issues go deeper than that? Honest question as I don't have a Samsung tv...
There's a quote that I'm too lazy to look up that essentially says software development is the management of complexity.

That, more than any other description, has always resonated with me. Any beginner can create a bird's nest of code that is too complex for even the most experienced developers to fully understand.

I've been at this for 40+ years now, and if I'm struggling to write something, it's usually not because I don't know how to implement it. It's because I'm trying to pick an implementation that will be simple to understand, verify, and use.
How? That's like $8 a day. Can a 3080 even do that?
Recent semi-supervised learning (SSL) methods are predominantly focused on multi-class classification tasks. Classification tasks allow for easy mixing of class labels during augmentation which does not trivially extend to structured outputs such as word sequences that appear in tasks like image captioning. Noisy Student Training is a recent SSL paradigm proposed for image classification that is an extension of self-training and teacher-student learning. In this work, we provide an in-depth analysis of the noisy student SSL framework for the task of image captioning and derive state-of-the-art results. The original algorithm relies on computationally expensive data augmentation steps that involve perturbing the raw images and computing features for each perturbed image. We show that, even in the absence of raw image augmentation, the use of simple model and feature perturbations to the input images for the student model are beneficial to SSL training. We also show how a paraphrase generator could be effectively used for label augmentation to improve the quality of pseudo labels and significantly improve performance. Our final results in the limited labeled data setting (1% of the MS-COCO labeled data) outperform previous state-of-the-art approaches by 2.5 on BLEU4 and 11.5 on CIDEr scores.
I'd imagine that the images are not part of the main database and that they are in some kind of s3 like file storage system.
The language the article uses, is a bit inflammatory. It may well be correct, but the tone gives me pause.

Sounds like the author has an axe to grind.
Track-inspection drone rides the rails, and flies away from trains
I certainly do.

Not based on losing the revenue generated directly by U.S. Customs and Border Protection contracts or any other government agency, but based on having icy/arms length relations with governments.

It's very important to them that governments dont see them as a problem and start looking at all the different ways to dismantle them and poke in to their business. Maintaining multifaceted relationships with them, having lots of different connections with lots of different departments, goes a long way to helping prevent that.
I’m a little sad to see this on the front page, because even though it’s just a matter of time before Twitter nixes this workaround for their recent user hostile change, it might have otherwise lasted a bit longer.
No it's completely useless. But a company pays me a decent salary for my skillset, which allows me to live and enjoy the fruits of society and earth. Not bad for now, but need to get the Ikigai flowing.
Battery not removeable was a stopper since year one. (Why would anyone not want to wait for a charge?)

A "nice" user feature would be a preference to self-throttle a step or two. Else it's like they think they own the phones you bought years ago... or don't trust their own developers to do it right.
> I think we can safely ignore entry-level roles here

You mean, as long as we're personally beyond entry-level? My own career and compensation isn't my only concern.