skysight-inc/HackerNews huggingface dataset:
Attention is limited. We cannot see everything on the Internet. We do not have enough time for that.

There is a lot of valuable and interesting data on the Internet, but it is not visible. Certainly high quality, low profile blog that ended its development in 2015 will not be ranked high in Google.

Media platform, search engines monetize content. YouTube channels need to churn new content every week or so to stay relevant and to stay watchable.

Our society produces content, not quality, not products.

SEO can be gamed, it is impossible to create objective index of valuable content. Bad actors will hack the game, spam results, destroy quality to gain profit.

Google search engine most often connects users with media sites, with news sites, with the middle men. The more often not connect users with product directly. Write "search engine" in search query, you may not only find search a "search engines" but articles about "Best search engines in 2024", or "best SEO tricks to boost your page".

Google does not have any incentive to fix this. Search engines are dead tech. It will be replaced by chatbots in a few years. People will not search for content, content will be generated at wish.

Some time ago I have created my own domain repository with domain names: https://github.com/rumca-js/Internet-Places-Database

I wanted to find "wargames" related pages. It is quite impossible to find anything interesting concerning warhammer on the normie internet (not Facebook).

The second thing is I cannot find anything "amiga" related.

This solved this my initial problem. I have also found out that many interesting pages are gone. I think that Google directing our attention toward "content" broke good quality pages.

Right now I am using less and less google, because I use more and more my bookmark manager.

https://github.com/rumca-js/Django-link-archive

My solutions may not be as complex as common crawl, but they are enough for me. For now. I am still working on my program. It has been fun and interesting experience for me, and I learned a lot. About open graph protocol, about schema, about web scraping, etc. etc. Maybe this will inspire people to be more self sufficient, and more self-hostable.

In times of walled gardens we need more standard, and more open data to keep what remains of the old wild west of the Internet.
Depends on the courtroom.
Could even practice by watching The Cable Guy

I don't say this to make a false equivalence, mainly in jest - I recognize TV is fairly mild and internet is a firehose by comparison.

Yet, we keep ignoring parents... and really, personal responsibility and simply the environment/impact that has. He raised himself like many of us do today.

This movie was a bit of a warning, then - decades ago. Except now we have phones, schools are even closer to day care/prison, and so on.
When I was a kid in the 90s, it was all about how video games and TV would ruin the new generation. Now, it’s smartphones and YouTube. Somehow I think the next generation will be fine.
NTP, BGP, MTU and a lot of other acronyms should be also in the list of not trivial to trace root cause for things that goes from big outages to mysterious malfunctions, specially if there are many parties or servers involved. And the security protocols that are above those and more (DNSSEC, SSL, etc).
You didn't present it as a thought experiment, and it's also not something to treat flippantly. If it happens, it will be because we achieve AGI and nothing less. I know it's in vogue to think that's 5 years away right now, but we're not remotely close and it's also in no way inevitable.

If it does come to that, whether or not there is code will be the least of our worries.
You make it sound like people are trading ethical standing for money. Not everyone agrees that supporting Israel is unethical.
> you can look at the code and double check

Can you honestly say that when a few months ago someone was trying to put a security hole in OpenSSH by making changes that looked harmless to an archiving tool (the xz backdoor)?

Your response is such textbook propaganda, instantly riffing into whataboutism with US surveillance, that I actually had to wonder if you had a real profile.

I then did see that you have actual posts, but imagine if I'd have to investigate the profile of absolutely every commenter I read. Isn't that practically impossible to do? And isn't auditing the source code of absolutely every project you use a few times harder than that?
What makes this a "search engine" any more than GPT already is?
Actually this is not ridiculous.
Freezing and thawing organoids is not new, it’s fairly routine. The frozen piece of brain from an epilepsy patient doesn’t retain ”normal function”. There is no evidence in the paper that it integrates into neuronal circuits (this was not even tested), or supports anything like normal neuronal firing. The cells are alive, yes, and likely highly abnormally perturbed.
Everything I see about OpenAI makes me more and more convinced that the people running it are the last people anyone should want to be stewards of AI technology.
I spent hours and hours on a train through Malaysian palm oil plantations. I’m happy to do a bit of stirring.
For years we stored Adams natural peanut butter at room temperature with no ill effects. A large jar usually lasts less than a month. Then one day I noticed it says refrigerate after opening on the label. I wonder if that is the reason why, or if it's really prone to spoilage.
People like to say this about everything they personally dislike — big cars, added sugar, McMansions, sports betting, sitting, whatever.

But outside of us uppity coastal elites, America doesn’t even look that badly on cigarettes. People still smoke them — over 10% of adults! You can buy them in nearly every gas station. If we hated them that much they’d be banned.
oh wow, didn't know that. That's actually pretty bad. Why on earth was it designed in such a way that didn't require both tests to pass if both of them are configured.
Well, here in Australia schools seem to successfully ban phones during school hours.

Perhaps "Kids who don't want to learn" is not a constructive way to look at the issue. Maybe "Kids who are engaged with something other than what is going on in the classroom" would be more useful. That goes for covert books, magazines, hunger, lack of sleep, drug addiction, unstable home life, personal drama, or any other distracting factor. Teachers and schools have existing strategies for these ranging from internal and external referrals, social support and psychologists, learning disability specialists, temporary removal from the class, etc. Some students will fail, but you should never brand kids as write-offs or uninterested, that's akin to giving up on them which becomes a self-fulfilling prophecy.

As for separating higher motivation and engagement students from the general student body, gifted and talented programs continue to exist for this purpose. https://en.wikipedia.org/wiki/Gifted_education

I attended such a program in Sydney Australia at ages 11 and 12 then a similarly academically tested high school. In the former and most of the latter case I found it to be quite positive experience, but lack any point of direct comparison. There were still troubled kids, drugs, etc. Mostly it was still slow and not very challenging. However, there were virtually no distracting elements in an average classroom whereas my understanding is that in many countries, high school teachers may often be unable to maintain a genuinely focused and academically engaged classroom. To me, this sounds like a state-mandated waste of time for all involved.

These days, where switched on kids can grok arbitrary subjects through the internet within seconds, what's the point of rote schooling? Perhaps we need to reduce the classroom hours expected of children and increase other activities, this would partially recognise the declining utility of rote knowledge in the workplace. This touches on the greater social problem, which is that post industrial revolution schooling largely performs a child minding function. What do we do with the kids if they're not locked in school? State and other schooling often also seeks to ingrain what IMHO are various negative, outmoded and incorrect ideas (much of religion, false assertions of the representative nature of a local "democratic" system, nationalism, etc.) in the student body. Home schooling is a good antidote but comes with its own challenges.
You seem unfamiliar with the great American tradition of inventing things to solve problems for the fun of it.

Please view these commercials for reference:

1. https://youtu.be/FqWgTM4di4s, remixed version: https://youtu.be/-gLOALCvlMI

2. https://youtu.be/4rBAmrZX5XQ
Yeah. We learned that lesson when I uninstalled YouTube because half the features didn’t work and then it rejected any attempt to install the app again.
There are domains that software being static is a guarantee of law obedience. In other words even continuous deployment is undesired in such cases
Swiss' Entire Boeing 777 Fleet Now Has Shark Skin Technology
It's not about me and my configuration. The problem with Markdown is that there are so many "extensions" or variants or whatever you want to call them.
But the usage of Wiki-style links instead of Markdown or HTML links is something really, well, "interesting". While it may be easier to type than markdown links, they are certainly worse to read as "plain text".
Tangentially related, but I'm currently winding down my SSRI prescription after some psilocybin therapy over 2 months ago that has made me feel normal and sometimes actually happy for the first time in over a decade. It's criminal the amount of time wasted and lives lost to the "war on drugs".
Game dev here. Hardly any serious game developer uses lerp like that. I prefer a quadratic friction when I write custom friction, ie: a constant force away from velocity, and simply ensure it doesn't go past the zero point. More controllable. Box2Ds friction uses something like v = v * 1/(1+damping*delta_time), which is a good method as well.

Keep in mind it's best practice to run your game logic at a constant update rate and render an interpolated state between the current and previous game logic frame, meaning that if your game logic is frame rate dependent, you can still run it smoothly on any monitor.
You are literally repeating false smears about Elon Mask. No emerald mine has ever been owned by anyone in Elon's family, and Elon certainly didn't inherit any of it. I find it very ironic that you are doing this while accusing someone of being a manipulative crook.
It’s completely different.
Schools can use passive Faraday walls/floors/ceilings. Metal fly screen works quite well. Common aluminum extruded windows, work fine. The brick needs to be shielded, and aluminium foil inserted as an inner layer is very good. In effect a metal 'balloon' has to be erected so all RF is blocked. I have seen very good shielded enclosures with transparent Faraday windows(not screens) that would use the same clear shielding layer. Quite good stuff, I have used a few of them. Screen is cheap and OK for cellular, but if you want 500+ Ghz blocked, screen is not good enough.
Read about it here (no connection to me at all)https://jretest.com/
It is easy and cheap to build a faraday plane in the construction phase, with a layer of screen/foil made where needed, at a fairly low cost.
I see many cases of exam cheating that could be Faradayed out of existence by a wooden frame screen room set up for the exam at whatever size needed. No jamming or emission interruption that would break FCC laws.
In fact the cheaters are breaking more laws and I can suggest a few RFI 'sniffers' like this from JREtest would find emitters. https://jretest.com/product/jre-sta-1/ At $550 a school could buy one for each invigilator to use to detect cheats as each one will last 10 years or so so the cost per exam approaches zero.
A little chat with the owner of JREtest might find he can sense a market and he can work with a school to find the optimal build for that task, because there is a global market for a few hundred thousand RFI Turko-Sniffers every year...
Cigarettes are much easier to regulate than phones are because you need continual consent from regulated businesses to continue the habit. So regulation isn't really possible, and parents will never be perfect, so society needs to provide an alternative to whatever problem is being solved by giving these kids phones. Framing this as a moral failing just seems like a way to avoid suggesting any kind of improvement on a societal level.
If at this point, it isn't very clear for OpenAI employees that they're working for the dark side and that altman is one of the worst manipulative psychopath the world has ever seen, I doubt anything will get them to realize what is happening to them.
You mean he works for Airbus? :-)
These are just London traffic cameras. There are a lot more TfL traffic cams than just those listed on this website. They're available through the (really nice) TfL API if you want to play around with them.

Here's another random website that has them all on a convenient map if you want to click around London's busiest/ugliest intersections: https://www.tfljamcams.net/
If you want more of these cameras, an actually interactive version is available here: https://www.tfljamcams.net/
Bad As someone who is a paid up OpenAI user I absolutely agree that there should be a role to put the brakes on because some value profit over risks.

Two years ago, you wouldn't have believed it if someone had promised results like we have now.
AGI can appear suddenly, or even decades later.
But if nobody pays attention to it, we will definitely notice it too late if it happens.
Mutable and immutable objects are both common. In Java, ArrayList is mutable, but String is not. If you concatenate strings, it makes a new string. It never changes the existing one. This maps pretty well to peoples' intuitions when using strings. If you have a reference to a string, its' contents can never change. You can assign a new string to your variable, but that's different. In JS, the contents of a Date object can change. This is widely regarded to be a mistake, and I agree with that.
Makes me feel better for not going out
I must say that this "billion dollar mistake" about nulls really baffles me. What's the mistake?

We invent new languages almost daily and none of them have ever resolved the problem. I mean, when you start with a pointer, it's uninitialized. Setting it to null is much better than having it point somewhere, where there might be incorrectly interpreted data.

So, null. We have Java, suffering the same problem, Golang suffering the same problem and Rust, where you have the same problem if you call unwrap, without checking that all code paths ensure you have the value populated.

Seems to me this is an inherent problem of using an uninitialized value... so, what is the mistake?
We do this too. And we buy huge bulk peanut bags from Azure Standard and store them in food bricks. My kids eat A LOT of peanut butter.
Why don't we see these attacks though? I know they're worryingly practical and the West certainly has enough enemies (especially from extremist groups who don't have the same peace keeping concerns as a nation state), and yet we don't see groups just sabotaging critical infrastructure and businesses left and right. Is it really just difficulty/a lack of skill?
> I go out in the world and see not just adults sitting around a table staring at screens and not interacting, but parents and children.

Remember newspapers and comic books and magazines and those junkie magazines by the cash register that talked about celebrity scandals? What about parents who would come home from work and just watch TV all night?

That kinda stuff is nothing new really lol.
When my kids were about 5 I gave them a hella old Android with Cyanogenmod. It wasn't powerful enough to do anything dangerous and they learned a lot about how to use software just from screwing around with it. It had a camera, microphone, and speaker which already is a pretty good start for having a good time. They discovered infinite repetition by making the phone shout "BUTT BUTT BUTT" in the middle of the night.
The merits of this service aside, the cynical takes on HN can be exhausting.

“How is pooping in a toilet measurably different from using a bucket - the same way people did 100 years ago?“
Yes, it was more along the lines of The Last Question, wasn't even thinking about LLM.
What was the lower tech stuff on Oct 7?
You can see all of the TfL traffic cameras here: https://tfl.gov.uk/traffic/status/

Use the hamburger menu to enable "jam cams", and click on the icons to view the clips. They're 10-second clips that refresh every five minutes if memory serves. The actual videos are uploaded to predictable locations on S3 if anyone's so inclined to scrape them.
I have an old rock tumbler hanging out in my garage. Now I have a practical near-daily use for it. Hindsight is 20/20.
Is it time to start designing schools so that the buildings are basically faraday cages that block all cell signals? And definitely no Wi-Fi.

Yea I know parents might cry “I need to be in contact with my child at ALL times”. But no you don’t and in the public education system you shouldn’t even have a choice, if you need something call the school someone will pick up on a landline and deliver your message. And if there’s a school shooting oh well if your kid dies they die so hug them tightly every morning like it’s the last.

Otherwise I just don’t see any way out of this problem.
Abstractions are a thing. We use devices all the time that we don't understand entirely the workings of.
I dunno, man. I get the frustration, but part of me also feels like this guy is banging his against against a cultural change and just giving up. Rock music. Cable TV. Video games. The Internet. iPhones. Every generation has that thing their parents generation think is ruining them.

I have a hard time believing he can’t simply ban their active use in class. If he can’t for some bureaucratic reason, then maybe he needs to figure out how to get educational value out of the situation. Have them do TikTok videos explaining biology topics. Who knows. Times are changing. Gotta change with them…
We built our metadata layer on FoundationDB
Considering all the code I write is GPL licensed and I always write a comment on top of SO inspired code blocks with their respective URLs, I don't think I'm doing something wrong.

Update: SA 4.0 accepts GPLv3 as compatible, and I use GPLv3 exclusively. I'm on clear.

LLMs neither know provenance nor licenses about the things they generate, you're right. I think that part of the problem is ignored not just because it's hard, but it's convenient to ignore, too.
I suspect people just don't stop to think hey - perhaps not everyone is/can be/wants to be on Instagram.
Which is one of those cases where I briefly want to reject linguistic descriptivism because to me the "G" in "AGI" is precisely "general".

But then I laugh at myself, because words shift and you have to roll with the changes.

But do be aware that this shift of meanings is not universally acknowledged let alone accepted — there's at least half a dozen different meanings to the term "AGI", except one of them requires "consciousness" and there's loads of different meanings of that too.
Show HN: Abusing a GitHub repo as a private certificate authority
I tend to create a private certificate authority for every side project, in order to create TLS certs for local development. I find it useful to have local development closely resemble production when at all possible, and "real" certificates are an important element.

Anyway I got tired of having these CA private keys on my local machine, especially as I started thinking about setting up a private CA for my company (https://riza.io). So I started thinking about what the simplest way to host a private CA might be.

You really only need two things: 1) secret storage, to hold the CA's private key, and 2) a computer with access to the secret that can run openssl.

It turns out that a GitHub repository has secret storage, and GitHub Actions provides a computer with access to that secret storage which can run openssl.

So I made a GitHub repo with a stupid-simple workflow and a couple of convenience shell scripts to use as a private CA. I've already used it as a template repo to host private CA's for my projects, and thought it might be useful to others.
> I mean all USA debt delinquencies are currently between the same levels as Q1 and Q2 of 2008...

Where did you find this? None of the data in https://fred.stlouisfed.org/categories/32440 confirms this other than the small bank credit card delinquencies.
AI slop.

The article it pointlessly regurgitates is readable though:

https://developer.cisco.com/articles/from-frustration-to-inn...
Rutherford says he was careful not to blame his students for their phone dependency.

I remember a teacher in high school throwing a textbook at a student that wasn't paying attention. He paid attention after that. I suppose times and approaches to teaching have changed.
Good questions.

Firstly, this is specifically designed for business users (founders, ceo's) that are already using Google Workspace for email. Using SpamAssassin (afaik) is not possible in that environment.

On the "AI" topic, it's not used because AI is a cool thing. It's used because of the wide permutations these cold emails come in. Lead gen people, SDR folks, and tools like Apollo makes it trivial for outbound sales peeps to send bulk personalised mails. The emails that Unspam focus on are the ones that already make it through Google's "black box" spam filter (and boy, does Google filter out a lot of spam already! like 99% of all mail that hit my inbox).

I can't compare against SpamAssassin, but from using Unspam for the last 8 months, I received 11,951 emails of which 663 we're caught as spam (after Google's spam filter let them through).

Anyhow, the primary goal of this is to make it super easy for busy people like founders and CEOs (who are often non-technical) to simply enable the filter on their inbox and continue with work. :)
This has not been my experience, to be honest -- I wrote a pretty complex scraper for extracting portions of a page and structuring their contents into JSON, using ChatGPT-4, about a year ago and it worked pretty well. (But not "well" in the sense that a non-programmer would've been able to do this, if that's your bar.)

I even got it usefully updated when the format changed!