MurphyA/hacker-news huggingface dataset:
by arisudesu | 2025-04-17 11:21:59+00:00
Having short-lived certificates is good, replacing them too often is not. This is implemented trivially for single-host deployments which just run certbot or ACME each subdomains. But for sophisticated setups where a certificate for a domain (or multiple domains or a wildcard) must be shared across fleet of hosts, it is a burden.

There are no ready-made tools available to automate such deployments. Especially if a certificate must be the same for each of the hosts, fingerprint included. Having a single, authoritative certificate for a domain and its wildcard subdomains deployed everywhere is much simpler to monitor. It does not expose internal subdomains in certificate transparency logs.

Unfortunately, organizations (persons) involved in decisions, do not provide such tools in advance.
by yk | 2025-04-17 11:22:43+00:00
Last time bio signatures where found (I believe on Venus), there was a flurry of papers on arXiv a week later, which all explained the signature by abiotic processes. Of course, if you have more than one explanation, then you really don't have one explanation. So I fully expect the same thing to happen here, and perhaps sometime in a decade or so follow up observations will have ruled out all but one explanation, until then exciting but ultimately it's not over before the fat lady sings.
by mon_ | 2025-04-17 11:23:18+00:00
Why the focus on scorekeeping? I feel like an AI model is overkill here, when you have text-based sources readily available such as news apps, Twitter feeds, and apps such as Livescore which would be easier and cheaper to scrape. They probably cover more matches that aren't televised too.

I'd be curious to see what useful insights could be gleamed from the match commentary. You have the main commentator giving play-by-play objective reporting and then a 'colour' commentator giving some subjective analysis during breaks in play. I bet there's a lot of interesting ways this could be used.
by pjmlp | 2025-04-17 11:24:28+00:00
As someone that bought into WinRT, saw it as .NET 1.0 done right, and went through all the technology reboots between Windows 8 and WinUI 3.0/WinAppSDK, I can only double down on that remark.

It was gone so bad that most Windows developers, me included, advise focusing on Win32/Windows Forms/WPF, at BUILD 2024 WPF got back into the spotlight as official Windows GUI framework (WinUI 3.0 keeps being years away from feature parity with UWP, let alone WPF), even Office and XBox teams rather reach out to React Native than bothering to make XAML C++ in WinUI 3.0 work.

Check the agenda for BUILD 2025, hardly anything related WinUI 3.0 / WinAppSDK.

And if you want to have some fun, come around into the Github discussion issues from all the related repos.
by pmarreck | 2025-04-17 11:24:57+00:00
I've been on a longish search for a bash replacement (or at least "extra substitute") in the realm of "more complex commandline scripting" (functions, utility scripts, etc.). Naturally, every option is a set of different compromises.

I think I've finally settled on Lua- It's small, coherent, surprisingly fast (especially with LuaJIT) and has the "virtually no startup cost" I was looking for (which ruled out, for example, Elixir for a lot of things).

And, I've finally figured out how to bang my nix-darwin flake.nix config in a way that gets it AND a bunch of popular libraries installed together and all seeing each other.

Wondering what others have found to address this. Or if they just stuck with Bash, since it's just not going away anytime soon.
by albert_e | 2025-04-17 11:25:34+00:00
Tangentially related

I once picked up my memory foam mattress and stood it up against one of the walls ... for cleaning the bed or whatever.

As I walked past the mattress I instantly noticed that the mattress is such a good absorber of audio waves that I could immediately notice a dip in ambient sound in the ear facing the mattress.

The room was already "silent" and this newly discovered lower limit of silence was pretty surprising to me physiologically.
by mr_mitm | 2025-04-17 11:25:43+00:00
That's mainly because our population roughly grew exponentially lately. That won't continue.

Energy production is not something self-amplifying like a population of rabbits, so there is no fundamental reason why energy production per capita should grow indefinitely.

But sure, how you would turn sunshine into antimatter at astronomical rates might be an interesting problem to think about. But my original point that basically dismissing this as an engineering issue is a bit dishonest still stands.
by Ian_Kerins | 2025-04-17 11:25:59+00:00
We just dropped the State of Web Scraping 2025 report. TL;DR: scraping is scaling—fast.

- Market boom: Web scraping is growing 15% YoY and projected to hit $13B by 2033. Web data is now a real asset class. The gold rush is on.

- AI + scraping: LLMs are getting surprisingly good at generating spiders, debugging selectors, and auto-healing. Still brittle, but improving fast. 2025 might be the year of the “self-healing” scraper.

- Bot wars intensify: Anti-bot tech is getting aggressive, Cloudflare, decoy pages, forced JS rendering, login walls. Scraping popular sites is now high-effort and high-cost.

- Proxy market shake-up: Residential/mobile proxy prices have dropped 25–50% in the last year, thanks to scrappy newcomers. But domain-level pricing is rising, creating more complexity and less transparency.

- Legal landscape: Lines are getting clearer: public data is generally safe; behind logins is risky. AI crawlers are under increasing scrutiny, and enforcement is likely to tighten.

- Scraping stack evolution: New tools are focusing on stealth, AI assistance, and integration into real data pipelines. The modern scraping stack looks more like infrastructure than hacked-together scripts.

Big picture: 2025 is shaping up to be a turning point. Smarter scrapers, tougher competition, higher stakes.
by dakiol | 2025-04-17 11:26:11+00:00
AI won’t become “normal technology” until the open source versions are more powerful than the closed ones. Just like Linux is the “best” kernel out there, and that doesn’t prevent other kernels to be proprietary (but that doesn’t matter because they are not better than Linux).

Imagine for a moment what would happen if suddenly one company “buys” the Linux kernel, and suddenly you need to pay per the number of processes you run in your machine. Awful.
API and Self-Hosting Options for HelpWire
by Kate_f25 | 2025-04-17 11:26:55+00:00
Hi everyone! I’m exploring remote support tools and came across HelpWire. Does it offer an API for integrating custom workflows or automation? Also, is there a self-hosted option for organizations that prefer to keep their data in-house? I couldn’t find much info about that on their website. If anyone has experience with these features or has looked into them, I’d really appreciate your insights. Thanks!
by carlosjobim | 2025-04-17 11:28:12+00:00
The advantages of this:

- Every website has the same accessible layout

- Blocks advertisements

- Blocks popups and auto playing videos

- Blocks cookie banners

- Blocks newsletter signup modals

- Blocks sticky headers and all distractions

- Auto dark/light mode on all websites

- Choose your preferred colour theme, font, font size and margins and it applies to all websites

- Images are presented neatly

- Inline videos are presented neatly

- Space bar to scroll down, shift+space bar to scroll up

- J/K to scroll between HTML elements (usually next paragraph)

- Can be disabled on a per-domain basis for when it's not suitable

The downsides:

- There are no downsides
by alchemist1e9 | 2025-04-17 11:28:57+00:00
I’m personally not convinced advanced civilizations would necessarily exhibit such technosignatures at all. I even go as far and ask are you sure if an advanced civilization was living and mining in Saturn’s rings we would even notice? If one considers the scales of things and realizes how big the Saturn system is relative to Earth then I doubt they can be so confident we would even notice our neighbors in the solar system yet.
by orlp | 2025-04-17 11:29:21+00:00
It is pull in the sense that an operator can call `recv().await` (the equivalent of `input.next()` in the article) at any point, which can then block the execution of the operator until more data is available.

It is push in the sense that an operator can call `send(x).await` (the equivalent of `out(x)` in the article) at any point, which can then block the execution of the operator until the data is consumed.

So it is a hybrid of both pull and push. You can, at any point, block on either pulling data or pushing data.
by pmarreck | 2025-04-17 11:29:29+00:00
A lot of dev tooling still expects x86_64. Example off the top of my head, Cosmopolitan will not build ARM binaries and will not compile on ARM. (But it WILL build x86_64 universal binaries that will run on Apple Silicon and macOS via Rosetta.)

There is also the issue of wanting to have your dev environment be as close to your prod environment as possible, and the vast majority of cloud-based hosting is still x86_64.
by mettamage | 2025-04-17 11:29:58+00:00
I've noticed some of these factors myself as well. I'd love to build more AI applications like this. Currently I'm a data analyst and they don't fully appreciate that I can build stuff like this as it is not a technology oriented company.

I'd love to work on stuff like this full-time. If anyone is interested in a chat, my email is on my profile (US/EU).
by Braxton1980 | 2025-04-17 11:30:20+00:00
I hope people realize that protesting or being angry at Trump/Republicans is pointless.

The power is bestowed upon them by Republican voters and they are to blame. Voting for one issue, lack of education, or desire to tune out politics isn't a reasonable excuse.

Edit

I have no issue with downvotes but offer up arguments why voters aren't responsible.
by MattPalmer1086 | 2025-04-17 11:31:43+00:00
Looks better! A couple of other minor comments, since I'm looking at it:

1. You don't need to assign the last char of the pattern inside the search loop every time around the loop. It will never change (line 1143). Just do it once before the search loop starts.

2. tc_last is the text aligned with the end of the pattern window (line 1142). You don't need to get it again when getting the shift (lines 1201, 1208). bad char is the last char which you already have.
by sirwhinesalot | 2025-04-17 11:31:56+00:00
The Atari line was much better at scrolling, had a much much better master palette, supported display lists (nicer than setting up interrupts in the C64) and the POKEY had some advantages over the SID, not just the extra channel but also in doing beefy sound effects.

I don't think any of this is denied by C64 fans.

The C64 on the other hand could push nearly 6x the sprite data per line, had Color RAM for more interesting tile work, the SID was more capable for music, and it had much much better support for high resolution graphics.

For their time they were very comparable but when (ab)used just right the C64 can do a neat NES impression. The Atari can't do that, but it can do some bonkers 3D using the super low resolution modes.
by joe_91 | 2025-04-17 11:32:19+00:00
Instead of focusing solely on the "market boom" and technological advancements, we should be having a serious conversation about the societal implications and the long-term sustainability of this scraping free-for-all.

The "higher stakes" mentioned aren't just about cost and effort; they're about the potential erosion of online privacy, the destabilization of websites reliant on ad revenue, and the ethical responsibility of data practitioners.

It would be interesting to explore ways of profit sharing to cover loss of ad revenue, better caching to reduce the cost on websites themselves, and simple ways to opt in or opt out of personal information being used online!
by autonomousErwin | 2025-04-17 11:32:32+00:00
How do you know it's incompatible with the actual universe instead of our current understanding of the universe?

Take us for example, we're communicating instantly (for practical purposes) using thinking machines - how would that not seem like magic to someone thousands of years ago?

My point is, we don't know what the tribe have behind the bush. It's the equivalent of the Mayans wondering what's over that hill and then finding the Spanish with gunpowder, horses, and steel armour.
by beeforpork | 2025-04-17 11:32:43+00:00
Oh -- this has a name? And it is not commonly known to be better than modulo? Forgotten? I feel old.

The reason multiply+use of high bits is better than modulo is not the golden ratio. In fact, any number using a lot of bits is good (well, not all are the same, like 0 is extremely bad, and 1 and all powers of two are quite bad, because they just shift. But OTOH, the golden ratio is not outstandingly good either -- many values are good.). This is because in the result of a multiplication, higher bits depend on all lower-bits of the operands, because the carry propagates from low bits to higher bits through the resulting value. In contrast, modulo essentially cuts off the upper bits, and so the upper bits are lost for the distribution entropy. This means that if you take the high bits of a multiplication result to distribute into a small set of integers, then you get a better distribution than using only the lower bits, because more bits of the input value are significant for the output result.

I thought this was common knowledge. The man page on rand() used to tell you that you should always multiply into the target range instead of modulo into the target range. It is surprising to see that all big hash libraries seem to miss this.
by sixQuarks | 2025-04-17 11:33:48+00:00
There is no way civilizations make it past a certain point. It’s so completely obvious, just look at our world. In 2025 we are enabling a genocide while the masses don’t seem to care or even know about it.

You think the people that are having these types of atrocities committed against them would think twice about ending civilization as revenge if given the power? What do you think is going to happen with AI?

If we can’t stop a genocide, why would you think we can stop civilization ending?
by anonzzzies | 2025-04-17 11:33:51+00:00
I think seeing the world in current times but hoping for more advancements is the best way. I see what there is now as a tool that is useful, I hope and sometimes even assume it will improve, but that does not help me now so what is the point in thinking about that? I am a programmer, not a philosopher.

And of course there is no viable path at this moment to make AIs actually smart so he, we use it and know the issues.
by nradov | 2025-04-17 11:34:34+00:00
A lot of people blame failure to lose fat on a "slow metabolism" but this is usually incorrect. Have you had an actual resting metabolic rate (RMR) test to quantity your baseline total daily energy expenditure?

Fat adaptation is a real thing. Endurance athletes focused on longer events will target some of their training around that energy system. This is more complex than can really be explained in an online comment but basically you want to do long training sessions below your lactate threshold in a glycogen depleted state.
by e40 | 2025-04-17 11:34:42+00:00
I have their 10G service. I love the company and the people. I remember when I first called them to sign up. At the end of the call with the sales guy I told him that 30 minute conversation was one of the most interesting and fun conversations I had ever had with someone I had just met. It was surreal.

The installer was super nice and great at their job.

Their service is so good I have not had an excuse to talk with anyone else.

Many of my neighbors have switched from Comcast, who I was with for more than 10 years, and hated every second of it. Only AT&T is worse than Comcast, but they are both bottom dwellers.
by Ukv | 2025-04-17 11:35:05+00:00
True, but practically I don't think you'd ever need to - should be able to narrow things down with insights/heuristics (and even with the simple algorithm alone, most programs would loop or halt far sooner).

Often seems to be presented as if humans can make some deductions or introspections that machines/AI would be incapable of seeing, or that the machine would have to rely on brute force for, but I don't think there's actually any result to that effect.
by mnky9800n | 2025-04-17 11:35:22+00:00
Stop offering online classes and expect students to show up in person. Online education sucks, everyone knows this. Everyone knows that they are making some kind of compromise when teaching or taking an online course. And if people are too poor to drive themselves to college or have to work too much or whatever else, then the state should provide opportunities for them so that they can continue their education. Stop accepting less than this.
by belter | 2025-04-17 11:35:26+00:00
> which is only known to be produced by living organisms.

Comets with DMS: https://arxiv.org/abs/2410.08724

And the interstellar medium.

"On the abiotic origin of dimethyl sulfide: discovery of DMS in the Interstellar Medium" - https://arxiv.org/abs/2501.08892

"...Although the chemistry of DMS beyond Earth is yet to be fully disclosed, this discovery provides conclusive observational evidence on its efficient abiotic production in the interstellar medium, casting doubts about using DMS as a reliable biomarker in exoplanet science..."
by kevincox | 2025-04-17 11:38:00+00:00
To me I don't really care about the certificate lifetime, what I care about is the time between being allowed to renew and time until expiry.

Right now Let's Encrypt recommends renewing your 90d certificates every 60 days, which means that there is a 30 day window between recommended to renew and expiry. This feels relatively comfortable to me. A long vacation may be longer than 30 days but it is rare and there is probably other maintenance that you should be doing in this time (although likely routine like security updates rather than exceptional like figuring out why your certificate isn't renewing).

So if 47 days ends up meaning renew every 17 days and still have that 30 day buffer I would be quite happy. But what I fear is that they will recommend (and set rate limits based on) renewing every 30 days with a 17 day buffer which is getting a little short for comfort IMHO. While big organizations will have a 24h oncall and medium organizations will have many business hours to figure it out is sucks for individuals who what to go away for a few weeks without worrying about debugging their certificate renewal until they get home.
by janpmz | 2025-04-17 11:38:14+00:00
I'm not an expert on this topic, so take it with a grain of salt. The reason a low carb diet works for many people (not necessarily extreme keto) is that it reduces the volatility of blood sugar levels, and this results in fewer cravings and being less tired over the day. So taking in fewer calories becomes easier. And then I learned about gluconeogenesis. The body can create glucose on its own and perfectly regulates glucose levels in the brain, etc., once it switches to that mode.

In the end, these tips help to get into a different lifestyle and then reinforce the habits to stay there because it feels better.
by theodric | 2025-04-17 11:38:36+00:00
> swedes, turnips, cabbage, beetroots, leeks, rhubarb, types of squash, etc.

Perhaps this is a U.S. issue. Every single one of these is available at my local Lidl supermarket (~a marginally upscale Aldi for those outside Europe) for much of the year, not to mention other more starkly seasonal things that filter in like peaches, salsify, runner beans, cherimoya (a tropical fruit), and so on. Across Europe I've had no trouble getting all the offal I'd want: head cheese/zult, haggis, black pudding, balkenbrij, hearts, various horrors suspended in aspic-- in supermarkets. Not specialist shops, not the butcher. I'm in rural Ireland now, but the selection was better yet when I lived in Switzerland and NL and also shopped at Lidl.
by haswell | 2025-04-17 11:38:38+00:00
I grew up in a very conservative and controlling environment. My ability to study remotely is one of the things that helped lift me out of that environment. I am far from alone in this experience.

I’d have much preferred an in-person education. But I don’t think we should look at the situation as “A is better than B so let’s get rid of B”. B still serves an important purpose and eliminating it will leave people behind.
by keepamovin | 2025-04-17 11:39:35+00:00
We can improve this. antirez has made a highly compelling poc but it could be refined for authorship attribution judging by the number of misses in the comments here, and how this compares to greater accuracy of the original post to which antirez refers. I’m no expert, but some ideas:

- remove super high frequency non specific words from the comparison bags, because they don’t distinguish much, have less semantic value and may skew the data

- remove stop words (NLP definition of stop words)

- perform stemming/tokenization/depluralization etc (again, NLP standard)

- implement commutativity and transitivity in the similarity function

- consider words as hyperlinks to the sets of people who use them often enough, and do something Pageranky to refine similarity

- consider word bigrams, etc

- weight variations and misspellings higher as distinguishing signals

What are your ideas ?
by foxglacier | 2025-04-17 11:40:19+00:00
Did you notice that you aren't wrong because you're not really saying anything at all? "in its current form" - so maybe with slightly different distribution of land use but basically fine and not necessarily as different as today is from 50 years ago? "mass extinction" already been happening for ages for many species. "uncomfortable floods/etc?" Already been happening for all of history. "very quickly" is how quicky? "more extreme" is how much more extreme?
by thinker5555 | 2025-04-17 11:40:26+00:00
Maybe I'm just really out of my depth on this, but it feels like there's not a lot of information about _why_ these particular steps and tools are used. Why are 4 different Linux images needed? Why are there all of these steps to create a one-time use "init.iso"? Is it just so the cloud-init script can run? I see the call to mkisofs is referencing "cidata", but it's the only place in the whole page that "cidata" shows up. Does that mean mkisofs is cloud-init aware? And why use emulation instead of virtualization?

I guess part of why I'm asking is because I've set up virtual machines in UTM on Apple Silicon before, and I never had to go through all of this just to get Linux installed and configured. The post makes me wonder if there's something I'm maybe missing, but it doesn't give any explanation for me to be able to figure out if that's the case. Maybe the post is meant more just as a checklist for the person that wrote it, for their own reference? But the way the post reads doesn't quite sound that way.

Hmm... that's all coming out sounding more critical than I mean to. I just want more info and I am curious about the approach.
by austin-cheney | 2025-04-17 11:40:30+00:00
There are no tricks, no gimmicks, no games. You are most focused when your motivation is aligned to the goal.

This is still somewhat true even for people with ADHD. The difference with ADHD is that low dopamine uptake results in shifts towards induced excitement stimuli that can be distracting unless the goal itself is so exciting as to result in ongoing obsessive behaviors.

If you really emotionally want something to be done you will apply the work to get it done full stop by motivation alone. When this alignment is present the thing that most gets in your way is poor decision making from fatigue. This is how mammalian brains are chemically wired.

So, if you want better focus don’t change your actions. Instead know exactly what to do and why you want it with extreme clarity.