skysight-inc/HackerNews huggingface dataset:
“I also love email, which I’ve always thought of as the digital equivalent of a postcard.”

Postcards would be the equivalent of email if they didn’t require a stamp. And then your mailbox would be full of 5,000 postcards every day from people you don’t know. You can change the mailbox (client) all you want, but it will still be full of junk.
You have multiple comments discussing economics, politics of technology, and politics generally. Just look.. they are there.

You are insinuating that this story about politics and economics should not be treated in good faith because the poster is tainted in some way via linking to their comment history. Your post on the other poster's comments seems in bad faith imo. Plus, I find "negative vibe man" comments are not ideal.
> I doubt that someone doing what you described over a few months or year could make a search engine that anyone wanted to use.

Dunno, not only are people sending me money to develop my search engine, not enough to live off but still, I also get emails and tweets from people who say they love it almost on a weekly basis.

I think attempting to be as comprehensive (or more) than Google is a trap. The better move is to fly under them. Be cheaper and better at something. Recipes is a great example of something Google is just miserable at, that is easy to do much better. There's plenty of such niches.
I don't think it's clear that every problem can be solved by spending more money on it. In this case, if the root cause of the problem is outside the school, then the school may not be able to do much about it even given infinite funding.
Except if that happened, they just wouldn't use it.
None of the SpaceX ideas where actually that new, rockets lanfed already decades earlier. That ULA got complacent is a differwnt story, ULA is far from being the only competitor of SpaceX outside of US government launches.

Not tgat SpaceX isn't imoressive, it is. They did move woth less beauraucracy, not with more risk. Kind of like the Covid vaccines, less red tapes speeds things up. Otherwise, SpaceX seems to be rather conservative ubder Shotwell's leadership as far as safety is concerned.

Dpace flight is, funny enough, less regulated that commercial aviation and tue aero part of aerospace.
My wish list:

* HTTP/2 (3?) (on the roadmap)
* a refresh of the dyno line-up - at least pass on some of the cost savings of removing/supporting free tier by reducing dyno pricing or preferably bumping specs
* auto-scale for all dyno tiers
* rebuild security team with reputable lead
* edge / multi region active-active DX
* edge ssl termination
* iterate on chat ops (underrated feature)
* more metrics
* more alerting (e.g. crashed apps)
* better user/access team management (default app roles)
* enhanced secrets management in env (2 layers of env view/roles - config vs secrets)
* DDOS protection
* Treat CI env vars as secrets!
Yeah, all of those workers who don't want to give unpaid labor are really awful! /s
The humanities are weird, people write and defend their PhD and then they can keep their PhD thesis confidential for years!?

The theory seems to be that the thesis doesn't count as a publication so you must keep it secret while they turn it into papers/book??
In Philosophical Investigations Wittgenstein famously said that "if a lion could speak, we could not understand him".
Dokku on your own server
So if the counter doesn't speak, there is no counting?
I agree! It's great when companies take the time to do this. Though it's tough when it's been a few months/years and the code hasn't been maintained. You'll see some repos in the library that are up to 8 years old.

One of the ideas my team brainstormed is to create and maintain a library like this that engineering teams can rely on.
I'm not saying they haven't earned this kind of treatment necessarily, but it is a little exhausting how much negativity and assumption of bad faith there is here in the commentary on more or less everything Google does. This even is just an explainer of a concept that's implemented by all the vendors, and as far as I know isn't something Google has railroaded.
What's your approach towards hobbyist programmers under 18, people living in a country that doesn't commonly use the Visa/Mastercard duopoly, or otherwise unable to get a credit card for any reason?

I started learning to code as a teenager, with cash being my only way of spending money, so all services that either had a price or required CC verification were completely unavailable for me. Not being able to afford them wasn't the problem, not being able to pay was.

I really enjoyed Heroku for that reason, it was the only service that allowed me to put apps up on the internet that I could actually get access to. It's really sad that something like that is going away.
Generalization in quantum machine learning from few training data
>> There isn't even any kind of consensus on where the root of the problem is.

> We know what the root problem is, housing supply.

How do we know that is the root problem?

If we knew the root problem is housing supply, and we haven't been able to address housing supply, then clearly housing supply isn't the root problem and it's something like entrenched interests (NIMBY's) or alignment problems regarding people not wanting to be taxed. Clearly there is some more "5 why's" work to be done.

I think it's hubris to think you have the answer for a problem that's been around for 3 decades+ worth of administrations.

> We know how to make cities far better and reduce total cost of living in them.

This also needs citation. I don't think we do. It's not "build better public transportation" or "build more housing", it's build more under the American legal system, under American culture and American politics.

These problems require systemic thinking. Why is the website down? Because we don't have enough web servers (not enough housing?)? No, because the databases are overloaded slowing down requests, because we haven't increased the number of database shards, because the database team is understaffed, because our hiring pipeline has problems, because recruiting is understaffed... etc.
It's worth noting that AWS's free tier has absolutely no safety net and you can easily end up with an unexpected bill, sometimes a very large one. The single best thing AWS could do to encourage people to learn about its services by trying them out would be to have a safe-by-default billing configuration. A user should have to flip a switch in their account to allow any usage over a given dollar amount, with services being halted in the event they would breach this limit without having flipped that switch.
This also works.
And then a controller or operator heals it.
For whatever reason, this seems like a popular thing to implement. There are several on pypi already so it would useful to know why you wrote a new one.

Something that seems missing is a pluggable backend for when you need to coordinate rate-limiting across machines. This library allows for a variety of backends:

https://pyrate-limiter.readthedocs.io/en/latest/
From the paper you link:

"This article summarizes the practical and theoretical implications of 85 years of research in personnel selection. On the basis of meta-analytic findings, this article presents the validity of 19 selection procedures for predicting job performance and training performance and the validity of paired combinations of general mental ability (GMA) and the 18 other selection procedures. Overall, the 3 combinations with the highest multivariate validity and utility for job performance were GMA plus a work sample test (mean validity of .63), GMA plus an integrity test (mean validity of .65), and GMA plus a structured interview (mean validity of .63)"

1. The research is dated (1998). Long before many of the current best practices in SW Eng were established.

2. Says it is based on 85 years of research. Obviously not IT-related then.

3. Even if we get past that it gives 3 almost equally good methods of hiring where the highest one is GMA and integrity test - not work sample test.

4. Even if we get past all that work sample means work sample. It does not have to be produced under pressure in a weekend as unpaid work which as any professional knows is very hard to bring yourself to do right (being a professional means getting paid for my services as I live from selling them). It can very well be some past work on github etc.

So, unless there is a better/more focused on IT/up to date research proving that take home tests (which btw can be offshored/gamed very easily) lead to better hires I remain highly skeptical of all that and big fan of whiteboard/pair programming.
"... UFOs by non-humans ..."
Self host it?

https://github.com/prerender/prerender
It's always struck me as pretty much useless; unless the service is uniquely identifying each downstream and somehow backing them off individually (which is not usually the case, you're usually backing off a consuming identity like an account or an address) then Retry-After is more or less meaning-free for an individual client.

In a practical sense, a 429 is just a 503. Back off and try again if you have time, otherwise fail. It's the passive-aggressive "I'm not providing service to your well-formed request, but it's you and not me" response code.
In the database world it is generally recognized that doing data duplication to 'flatten' a particular view is a special case of normalization (adapting data to a model) which is encouraged to be done dynamically (eg. as an SQL view) and not in stored data (as this would create redundant information, which negatively affects the database in terms of ongoing management, authority and clarity). Generating reports in whatever format users prefer is generally a very cheap and fast operation.

Also, duplicating the data does not make it more correct or more authoritative. Do not confuse presentation with data. A rose by any other name would smell as sweet.

Edit: I can't reply to your response so will reply here. I suggest reading some basic database design books. Good luck.
Vercel’s free Hobby tier is solid:

https://vercel.com/pricing/
Right. Constitutional protections are the bare minimum for government to follow. There exist configurations of current society with all constitutional protections in place that still leave a lot to be desired. Unfortunately, modern political discourse is obsessed with government and less obsessed with polities, which is really sad, because government is actually a small part of society.
No ports are required to be opened at the edge (i.e., source and destination). The OpenZiti edge makes outbound connections using the strong identity into the fabric mesh network. Therefore its only the fabric dataplane which needs inbound ports but it does not listen to any connections other than those of edge components which are authenticated and authorised.

Vs standard MQTT there are several advantages incl. (not limited):
- mTLS connections rather than just TLS
- least privilege and microsegmentation
- outbound only (authenticate and authorise before connect) meaning we can close or deny inbound connections at source and destination
- private DNS with unique naming (e.g., instead of xxx.xxx.xx.xx to antoher IP, you could say MQTT client to MQTT server
- smart routing on the overlay to reduce latency, increase availability and in general increase visibilty without owning the underlay network
Are people still writing hagiographies about Facebook?
The GPU shortage is over. The GPU surplus has arrived
They have pushed that contract to the limit thankfully. You can load up Firefox with ad blockers and then compare and contrast with their browser. They do as well as allowed, and have extra value adds. More well intentioned than brave imo.
It might convert users, but that might not matter aid we see these companies continually fall / vanish.
Sorry, I should clarify. The overlay network definitely has a listening port/s. The network will be somewhere (usually best on the open internet) listening that is quite correct, that port is listening.

The "no open ports" bit comes from the MQTT client and the MQTT server. Those have no open, listening ports because they will establish connections to the edge-routers. They'll have outbound connections, but no open ports.

The security is better than TLS for a few reasons, mostly it's due to the whole "no open ports" on the server or the client. That's a pretty big difference. Also the connections will be mutual TLS, not only TLS to the server. There's other zero trust things that the overall OpenZiti overlay covers too. So there's a bunch of good reasons and I didn't want to blather on ...
Just an FYI, but you're still legally liable for charges on your virtual credit card, regardless of whether or not the charges go through.
> I don't know why no one disagreeing with you will engage.

It's a common problem on HN; very used to it at this point.

I do agree that immigration plays a part as well, but immigration is also driven by pre-existing differences. The US must have done something that made so many migrants want to study here over other countries, and I think this is because American universities have been good for a very long time.

EDIT: Sorry you're being downvoted too. What a strange world.
Push your web application to their git endpoint and Heroku runs it for you. As long as you follow the best practices for your language it will just work. Python, Node.js, Ruby, Java, et.c.
Two clicks in UI (or CLI commands, or configuration lines) and it will also run a database for your app. Same if you need a message broker. Searchable logs. Blob storage. Horizonal scaling? Drag a slider, single command.
Heroku provides zero bullshit deployment.
I mean, if i wanted to read reddit i would reddit.
Oh, it looks like the release command would fit the `build` step I mention.

As far as the after-deployment tasks go, we automate those just like migrations - they're (occasionally very slow) one-offs that we don't want to hold up a restart for. Really, an analogue to the release command that can run after restart is all that I'm talking about here.
It looks like default branch was force-pushed to the last commit on the branch of the PR? If you have permission to push … that's not "unauthorized"?

That a PR gets "merged" if the base branch becomes equal with the PR's last commit is … a bit weird, but it makes perfect sense in cases like where one might want to FF the base to keep things clean. The force-push muddles it a bit. Surprising to new users, maybe, but "unauthorized" seems like a stretch unless I'm missing something.

There are cases where I think Github's controls could be much clearer. E.g., in some cases, you can "require" reviews, yet still change the branch after the approval. So once you have approval … it's like carte blanche to merge whatever. It is sometimes useful — if the repo is not security critical, and you trust your reviewee, it lets me say "these three changes please, then LGTM", approve it, and just trust they'll do the right thing. But if you need tight controls, then not so much. There's also Github Actions & required checks … if a "required check" is skipped, Github treats that as if the check passed! (That, to me, is a bug. To Github's support reps … that's just how it works.)
I think the biggest problem that needs to be solved here is the tendency of people here not to accept that Hacker News' purview is "anything that satisfies intellectual curiosity" - not exclusively technology and startup oriented content. People can't just ignore the presence of content they're not personally interested in, rather they'll flag and downvote otherwise perfectly legitimate content or else start tangential threads about whether or not it belongs on the site.

To that end, I think personal filters would be more useful than either tags or subreddits (even though HN already has ersatz subreddits in /ask, /show and /jobs.) The hide option is already a step in that direction, but it requires being reactive, whereas filters would be proactive. Give users a field in which they can list words or domains to either include or exclude (similar to the format of USENET killfiles) and have the feed sort based on that.

Then everyone gets what they want, and hopefully fewer people pollute the threads with complaints about Hacker News "turning into Reddit" because other people find things interesting and intellectually gratifying that they don't.
I always wanted a relative z-index.

Example:

<year dropdown> over <date picker> over <modal form> over <desktop style app>

A complex “desktop style” UI, that shows a modal form over it, and the modal form contains a custom date input component. Click the date input and a custom date entry pop up component is drawn above the modal form to pick the date. On the custom date entry pop up is a year picker, which you click and a custom year dropdown is shown. This was an actual example from my past (I’m not saying it couldn’t have been done better, but this was before there were many better ways to do it). Using absolute z-index required complex coordination between components.

The top-layer at least solves the problem of covering the viewport and providing a backdrop (difficult to do reliably, especially 10 years ago). Although I can think of other issues one still needs to solve: disabling inputs and events behind “modal” pop up, disabling iPad background scrolling, must be accessibility, can need multiple layers of popups e.g. loading spinner, problem of tab key handling, et cetera.
Yes! That's actually one of the primary motivations behind why we made this "comment-based." The caveat of course is that we presently only support Python at the moment, but you can expect to see C++ and Java support rolled out in the next few weeks. This particularly excites me since these languages are heavily lacking these sorts of tools IMO.
Hey, fellow ADHD brother/sister. If you haven’t tried to talk to a medical professional regarding your condition, I would highly recommend to do that.

Medication helped me and many others tremedously. So much regret that I accepted that I am different and I do need some support only in my mid 30s.
>The US chronically underfunds pre-college education.

As streptomycin said, you are wrong.

New York City spends more per student than anywhere else in the US (<https://www.silive.com/news/2019/06/how-much-does-new-york-c...>). Baltimore, an incredibly poor and run-down city, spends the third most. #4-6 and #8 are all wealthy suburbs of Washington DC, but their schools are all far better than those of Baltimore or NYC on average, despite Baltimore spending slightly more per student and NYC spending 60-70% more.

Money can only do so much against dysfunctional families immersed in dysfunctional ethno-societal groups.
Seems like the reduction of everything into market-based economies has some limits! Maybe we should break from the frankly radical notion that all problems can be solved and all relations understood in this way.
> and was amazed that JPEG XL has more detail than AVIF at 0.05-0.1 bpp (~120KB 1080p)

bpp = bits per pixel, not bytes. At 1080p, "0.05-0.1 bpp" is 13-26 KB. Much smaller than what you were testing. Might want to recheck your sizes, if you are actually looking at 0.5 bpp it would not surprise me at all that you found JPEG XL superior.

At very small sizes like 0.1 bpp the results are debatable, but I think AVIF is a pretty clear winner if you aren't too bothered by blurring. Samples at 0.15 bpp:

https://afontenot.github.io/image-formats-comparison/#air-fo...

https://afontenot.github.io/image-formats-comparison/#citroe...

https://afontenot.github.io/image-formats-comparison/#festa-...
Power use tends to scale non-linearly past a point - disabling turbo modes would likely significantly reduce the peak power use, and ~18% performance differenceis pretty big buffer to lose.

The 6850u also beats it rather comprehensively according to those same results, and that's only 18-25w.

Really, you'd need everything power normalized, and even the rest of the hardware and software used normalized to compare "just" the CPU, which is pretty much impossible due to Apple and their vertical integration - which is often a strength in tests like this.
> why are more and more resources being allocated to keep it going

What does that even mean? Where? Across the entire industry? In specific companies? Empirically how much “more resources”?

Conversely you could ask: if k8s is so terrible and building your own version is so simple, why is the market not doing that?

Everywhere I’ve seen that uses k8s does indeed have full time Devops/platform people, but the ratio to the developers they support is far, far lower than homegrown platforms, as is the time to implement new requirements.

Usually these homegrown solutions get to a specific point in time where there isn’t the internal knowledge to maintain them, and the effort required grows too large. At which point they stagnate. Building on a stagnant, homegrown platform that you don’t know how to improve is not great.
Our community recently pulled together a guide for comparing different free hosting providers.

https://blog.battlesnake.com/deploying-web-servers-for-free-...

It's really a shame, given how much we've relied on Heroku free tiers to lower barriers fr all.
Not a single one of the things he has as a shared pointer needed to be a pointer at all.
Really, do you have an estimate of what it would cost?
I've been having good luck with CloudFlare as a minimal web stack.
ASK HN: Why are we not doing large scale desalination?
There are an ever-increasing stream of places, even just inm the US that is in severe shortage of water.

That is a local problem.

The Earth has an extreme abundance of water.
71% of the surface is covered with it and
it is quite deep in places.

All added up about Thirteen Quintillion Five Hundred Ninety Quadrillionth liters of it.

There is no conceivable way we are running out of water anytime soon.

Water we have.
People who desperately need it we have.
The problem is that they are not the same
location.

That is a solved problem for a lot of things
people need.

Why are we not doing global scale desalination?

The pipelines could be constructed in a massiv parallel concurrent way. As long as you could keep the supplylines of construction material work.

Is the only thing holding it back the amount of enenrgy it would take to power it?
This podcast covers most of the important points:

https://www.acquired.fm/episodes/tsmc
Never worked on IBM i, but Wang VS had a very unique system. It also expected the terminals connected to it to have a small CPU.

Too bad it never made it to the wild. In its last days it was ported to an IBM AIX System (RS6000?), but the company went bankrupt before that port made it out.
If the pandemic taught me anything it was sitting alone in a room did not inspire me to 'look inward', 'find myself' and 'create'. I suspect this is a very individual thing that works for some people but not for others and turning it into a naval-guru-like prescription isn't that helpful.

DO your own thing...if sitting helps, sit. If moving helps, move.
"hide" is an option on every submitted article. Very handy when certain topics come up that I don't care about, especially when a day starts developing a "theme" that I'm uninterested in. Of course, on those days it's also a good chance to break free from HN for a bit too.
> You're probably more or less on your own in terms of figuring it out [...]

Sure, but as I'm not a good hardware tinkerer, ... but maybe I should visit some local self-repair community group and learn.

Symbolics produced a nubus(?) coprocessor with their Ivory chip in their final days, which used a box to interface the keyboard to Apple's ADB, but I never got hold of either the coprocesor nor the box.
Has this analyst ever been correct?